Hi,
I have +-300 csv data files, containing +- 1 million lines each. Currently, when I do data analysis, my first step is: I select the data from all csv files seperately by loading a csv file in excel, set up filters, copy the lines which are filtered to a sheet and continue with the next csv file etc. This selection of data takes me hours.
If it is possible, I would like to get a tool, in which I can:
- set up filter rules: for example,column x = y, column x contains y, column x + c > column y etc
- select a directory (with csv files) and it automatically processes all files
- gives me a csv file containing the filtered lines from all csv files.
Are the csv files of the same structure? Can u provide a list of all types of filters you use? This can be all done although it is not a straightforward task. Regards.
Good day!
I would like to submit my application as Data Collector. I shall be pleased to consider me as a qualified applicant.I believe my qualifications would make me an outstanding asset to your organization. I would appreciate the opportunity to meet with you. I look forward to hearing from you and answering any other questions you may have.