Hi,
I am running a Distcp programmatically from Hadoop cluster to another -
using Hadoop 2.7 and distcp v2. I would like to set a custom block size and
replication factor for my files. How can I achieve that ?
Thanks !
Varun
I looked at
hadoop-tools/hadoop-distcp/src/main/java/org/apache/hadoop/tools/DistCpOptionSwitch.java
but didn't find such switch.
FYI
On Wed, Aug 19, 2015 at 12:20 PM, Varun Sharma varun13...@gmail.com wrote:
Hi,
I am running a Distcp programmatically from Hadoop cluster to another -
using
Not sure if this feature is available. A workaround would be to update
replication factor and block size at the HDFS level and reverting the
changes after the distcp is complete. This is good for a one time copy. :-)
On Wed, Aug 19, 2015 at 12:52 PM, Ted Yu yuzhih...@gmail.com wrote:
I looked
