Hi, I have 100 files each of ~3 GB. I need to distcp them to S3 but copying fails because of large size of files. The files are not gzipped so they are splittable. Is there a way or property to tell Distcp to first split the input files into let's say 200 MB or N lines each before copying to destination.
-- -Himanshu Vijay