[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949570#comment-15949570 ] Yongjun Zhang commented on HADOOP-11794: Thanks a lot [~chris.douglas]! will commit soon. >

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949383#comment-15949383 ] Chris Douglas commented on HADOOP-11794: I skimmed the patch, looks reasonable. +1 Thanks for

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949257#comment-15949257 ] Yongjun Zhang commented on HADOOP-11794: Thank you so much and great to hear [~omkarksa]! Hi

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948924#comment-15948924 ] Omkar Aradhya K S commented on HADOOP-11794: [~yzhangal] I have tested the patch with ADLS

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15946531#comment-15946531 ] Yongjun Zhang commented on HADOOP-11794: No problem to test it out after you are back from

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15946262#comment-15946262 ] Yongjun Zhang commented on HADOOP-11794: No problem and thanks for confirming [~chris.douglas].

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15946180#comment-15946180 ] Chris Douglas commented on HADOOP-11794: bq. Maybe you were looking at the -rdiff section which

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15945750#comment-15945750 ] Yongjun Zhang commented on HADOOP-11794: Hi [~omkarksa], I'd really appreciate if you could try

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944512#comment-15944512 ] Yongjun Zhang commented on HADOOP-11794: Thanks [~chris.douglas], the doc was already addressed

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15944231#comment-15944231 ] Chris Douglas commented on HADOOP-11794: +1 overall, though the DistCp docs currently claim:

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15940043#comment-15940043 ] Omkar Aradhya K S commented on HADOOP-11794: {quote} This is usually handled in the same

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939337#comment-15939337 ] Yongjun Zhang commented on HADOOP-11794: The failed tests succeeded in local run. They look

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939192#comment-15939192 ] Hadoop QA commented on HADOOP-11794: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15938826#comment-15938826 ] Chris Douglas commented on HADOOP-11794: bq. Once the new patch with all above changes is

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15938768#comment-15938768 ] Yongjun Zhang commented on HADOOP-11794: Uploaded rev10 to address remaining stuff. About the

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15938672#comment-15938672 ] Yongjun Zhang commented on HADOOP-11794: Thanks much all! [~omkarksa], All the changes except

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15938217#comment-15938217 ] Steve Loughran commented on HADOOP-11794: - I like the direction here. I undertstand while a

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937986#comment-15937986 ] Hadoop QA commented on HADOOP-11794: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937918#comment-15937918 ] Omkar Aradhya K S commented on HADOOP-11794: [~yzhangal] Thanks for reconsidering the

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937830#comment-15937830 ] Yongjun Zhang commented on HADOOP-11794: Thanks [~chris.douglas]. Uploaded rev9 as outlined.

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937609#comment-15937609 ] Chris Douglas commented on HADOOP-11794: bq. the current patch would split a file and copy them

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937523#comment-15937523 ] Yongjun Zhang commented on HADOOP-11794: HI [~chris.douglas], Sorry did not see your last post

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937370#comment-15937370 ] Yongjun Zhang commented on HADOOP-11794: Had a discussion with [~atm] (thanks ATM), we now

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937359#comment-15937359 ] Chris Douglas commented on HADOOP-11794: [~omkarksa], can you post your patch? I see your

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937230#comment-15937230 ] Yongjun Zhang commented on HADOOP-11794: Hi [~steve_l], [~chris.douglas], Thanks for the

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937095#comment-15937095 ] Chris Douglas commented on HADOOP-11794: I agree with [~ste...@apache.org]. If the FileSystem

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937066#comment-15937066 ] Steve Loughran commented on HADOOP-11794: - the thing is: if we remove the checks for FS type, we

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15937018#comment-15937018 ] Yongjun Zhang commented on HADOOP-11794: Hi [~omkarksa], [~steve_l] [~jzhuge], Thanks for the

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15936932#comment-15936932 ] Steve Loughran commented on HADOOP-11794: - I'm less worried about GFBL: everything at least

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15936826#comment-15936826 ] Omkar Aradhya K S commented on HADOOP-11794: Thanks [~steve_l], [~jzhuge], Yes, this could

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15936791#comment-15936791 ] John Zhuge commented on HADOOP-11794: - [~steve_l] concat is implemented by ADLS backend as a

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15936385#comment-15936385 ] Steve Loughran commented on HADOOP-11794: - One of the problems we have here is there's no API

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15936105#comment-15936105 ] Steve Loughran commented on HADOOP-11794: - bq. Is there any reason not to use FileSystem.concat

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935814#comment-15935814 ] Omkar Aradhya K S commented on HADOOP-11794: Thanks for the clarification [~yzhangal]. About

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935803#comment-15935803 ] Yongjun Zhang commented on HADOOP-11794: Thanks [~omkarksa]. I chose the other method because

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935743#comment-15935743 ] Omkar Aradhya K S commented on HADOOP-11794: {quote} The main reason of checking

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15935473#comment-15935473 ] Yongjun Zhang commented on HADOOP-11794: Thanks much for reviewing and trying

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934045#comment-15934045 ] Omkar Aradhya K S commented on HADOOP-11794: I was trying to evaluate your patch with ADLS:

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929782#comment-15929782 ] Steve Loughran commented on HADOOP-11794: - # this is an opportunity to switch distcp over to

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900237#comment-15900237 ] Yongjun Zhang commented on HADOOP-11794: Thanks for being interested [~zshao], Wonder if you

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15899989#comment-15899989 ] Zheng Shao commented on HADOOP-11794: - [~yzhangal] Can you provide a github link to make review

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882140#comment-15882140 ] Hadoop QA commented on HADOOP-11794: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881955#comment-15881955 ] Yongjun Zhang commented on HADOOP-11794: Looks like something changed in the build side, same

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881770#comment-15881770 ] Hadoop QA commented on HADOOP-11794: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15866331#comment-15866331 ] Yongjun Zhang commented on HADOOP-11794: Thanks for the positive feedback [~Lu Tao]! Hi

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15863120#comment-15863120 ] Lu Tao commented on HADOOP-11794: - very useful improvement！！ > distcp can copy blocks in parallel >

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15857843#comment-15857843 ] Hadoop QA commented on HADOOP-11794: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15857449#comment-15857449 ] Yongjun Zhang commented on HADOOP-11794: Rev 007: 1. Better -update handling, only copy files

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852392#comment-15852392 ] Hadoop QA commented on HADOOP-11794: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15849225#comment-15849225 ] Hadoop QA commented on HADOOP-11794: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15849125#comment-15849125 ] Hadoop QA commented on HADOOP-11794: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15848237#comment-15848237 ] Hadoop QA commented on HADOOP-11794: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15848116#comment-15848116 ] Yongjun Zhang commented on HADOOP-11794: Hi [~mithun], Thanks you so much for the review and

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15838988#comment-15838988 ] Aaron T. Myers commented on HADOOP-11794: - Latest patch looks pretty good to me. Just a few

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836381#comment-15836381 ] Yongjun Zhang commented on HADOOP-11794: HI [~mithun], Thanks much for the earlier discussion.

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15832929#comment-15832929 ] Hadoop QA commented on HADOOP-11794: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15830894#comment-15830894 ] Hadoop QA commented on HADOOP-11794: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124319#comment-15124319 ] Mahak Mukhi commented on HADOOP-11794: -- No worries, just wanted to check in. :) > distcp can copy

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124268#comment-15124268 ] Mahak Mukhi commented on HADOOP-11794: -- [~yzhangal] Hey, I was wondering, if you're still om this

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124274#comment-15124274 ] Yongjun Zhang commented on HADOOP-11794: Yes [~mmukhi_2]. Sorry for the delay incurred due to a

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067007#comment-15067007 ] Mithun Radhakrishnan commented on HADOOP-11794: --- [~yzhangal], bq. Appreciate your

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067064#comment-15067064 ] Yongjun Zhang commented on HADOOP-11794: Thanks [~mithun]! Not sure about

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067190#comment-15067190 ] Yongjun Zhang commented on HADOOP-11794: HI [~mithun], For your question 2, it's because we now

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067232#comment-15067232 ] Yongjun Zhang commented on HADOOP-11794: Thanks much [~mithun], I will resume working on this

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067227#comment-15067227 ] Mithun Radhakrishnan commented on HADOOP-11794: --- Ah, I finally see. That makes complete

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067142#comment-15067142 ] Mithun Radhakrishnan commented on HADOOP-11794: --- bq. My argument is that fetching all

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15055099#comment-15055099 ] Yongjun Zhang commented on HADOOP-11794: HI [~mithun], Some more thinking to share. When I

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048017#comment-15048017 ] Yongjun Zhang commented on HADOOP-11794: Thanks [~mithun] and [~dhruba]! There will be some

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048044#comment-15048044 ] Yongjun Zhang commented on HADOOP-11794: BTW guys, I was thinking (some ideas are inspired by

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048097#comment-15048097 ] Yongjun Zhang commented on HADOOP-11794: We probably don't need ChunkUniformSizeInputFormat, and

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044684#comment-15044684 ] dhruba borthakur commented on HADOOP-11794: --- Thanks for offering to pick this up Yongjun

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044105#comment-15044105 ] Mithun Radhakrishnan commented on HADOOP-11794: --- [~yzhangal]: Thank you, sir. Please do.

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044096#comment-15044096 ] Yongjun Zhang commented on HADOOP-11794: Hi [~mithun], thanks for your earlier work here. Wonder

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044111#comment-15044111 ] Yongjun Zhang commented on HADOOP-11794: Thanks [~mithun]. There is a patch currently attached

[jira] [Commented] (HADOOP-11794) distcp can copy blocks in parallel

[ https://issues.apache.org/jira/browse/HADOOP-11794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044373#comment-15044373 ] Mithun Radhakrishnan commented on HADOOP-11794: --- Sorry, no. That's likely [~dhruba]'s