Hi,
I have a company who receives occasional large csv files 90M records from their clients. Â When I uploaded the CSV using the FTP extractor (file was on an FTP server), it took 1.5 hours to upload.Â
What would you recommend to shorten the 1.5 hour process? Â Use a different method to store the file? Use preprocessors? Â etc..?
Please note that this process needs to be automated and I can instruct the company to adopt a new process to accepting large CSV files from their client. Â