Hello all, I'm running Sqoop 1.4.2. I'm running into a weird issue when I execute the following command:
sqoop job --exec IncrementalLoad -- -target-dir /PROD/SQOOP/$(date +%Y%m%d%H%M%S) The table I'm loading has 31 million rows. When job completes, the target-dir still remains to be something like this: _sqoop/21225255558v_tblNameSqoop and not the designated directory. It works as expected on smaller datasets but for some reason on this much data, it doesn't. Also, I just added two nodes to the 4-node clusters, why does Sqoop by default chooses to use 4 input paths and not 6? Thank you. Artem Ervits [email protected]<mailto:[email protected]> New York Presbyterian Hospital -------------------- This electronic message is intended to be for the use only of the named recipient, and may contain information that is confidential or privileged. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution or use of the contents of this message is strictly prohibited. If you have received this message in error or are not the named recipient, please notify us immediately by contacting the sender at the electronic mail address noted above, and delete and destroy all copies of this message. Thank you. -------------------- This electronic message is intended to be for the use only of the named recipient, and may contain information that is confidential or privileged. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution or use of the contents of this message is strictly prohibited. If you have received this message in error or are not the named recipient, please notify us immediately by contacting the sender at the electronic mail address noted above, and delete and destroy all copies of this message. Thank you.
