[jira] [Updated] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Attachment: HDFS-12190.003.patch rev3 to take care of a missed place in last rev. > Enable 'hdfs

[jira] [Updated] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Attachment: (was: HDFS-12190.003.patch) > Enable 'hdfs dfs -stat' to display access time >

[jira] [Issue Comment Deleted] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Comment: was deleted (was: 003 to fix a place missed earlier. ) > Enable 'hdfs dfs -stat' to

[jira] [Updated] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Attachment: HDFS-12190.003.patch 003 to fix a place missed earlier. > Enable 'hdfs dfs -stat'

[jira] [Updated] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Attachment: (was: HDFS-12190.002.patch) > Enable 'hdfs dfs -stat' to display access time >

[jira] [Updated] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Attachment: HDFS-12190.002.patch > Enable 'hdfs dfs -stat' to display access time >

[jira] [Commented] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102531#comment-16102531 ] Yongjun Zhang commented on HDFS-12190: -- Thanks a lot [~jojochuang], very good point! Just uploaded

[jira] [Updated] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Attachment: HDFS-12190.002.patch > Enable 'hdfs dfs -stat' to display access time >

[jira] [Commented] (HDFS-12202) Provide new set of FileSystem API to bypass external attribute provider

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102188#comment-16102188 ] Yongjun Zhang commented on HDFS-12202: -- Hi [~arun.sur...@gmail.com], [~daryn], [~jingzhao] and other

[jira] [Assigned] (HDFS-12202) Provide new set of FileSystem API to bypass external attribute provider

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reassigned HDFS-12202: Assignee: Yongjun Zhang > Provide new set of FileSystem API to bypass external attribute

[jira] [Created] (HDFS-12202) Provide new set of FileSystem API to bypass external attribute provider

2017-07-26 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-12202: Summary: Provide new set of FileSystem API to bypass external attribute provider Key: HDFS-12202 URL: https://issues.apache.org/jira/browse/HDFS-12202 Project:

[jira] [Comment Edited] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done

2017-07-25 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101040#comment-16101040 ] Yongjun Zhang edited comment on HDFS-12191 at 7/26/17 5:22 AM: --- Thanks

[jira] [Commented] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done

2017-07-25 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101040#comment-16101040 ] Yongjun Zhang commented on HDFS-12191: -- Thanks [~manojg]. - We don't want to break backward

[jira] [Commented] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done

2017-07-25 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100601#comment-16100601 ] Yongjun Zhang commented on HDFS-12191: -- Thanks much [~manojg] for the comment. Please notice that

[jira] [Commented] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-25 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100393#comment-16100393 ] Yongjun Zhang commented on HDFS-12190: -- Thanks [~vagarychen], I tried it and it's still applicable at

[jira] [Updated] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done

2017-07-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12191: - Attachment: HDFS-12191.001.patch > Provide option to not capture the accessTime change of a file

[jira] [Commented] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done

2017-07-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16097827#comment-16097827 ] Yongjun Zhang commented on HDFS-12191: -- Submitted patch 001. > Provide option to not capture the

[jira] [Updated] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done

2017-07-23 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12191: - Status: Patch Available (was: Open) > Provide option to not capture the accessTime change of a

[jira] [Created] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done

2017-07-23 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-12191: Summary: Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done Key: HDFS-12191 URL:

[jira] [Updated] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Attachment: HDFS-12190.001.patch > Enable 'hdfs dfs -stat' to display access time >

[jira] [Updated] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Status: Patch Available (was: Open) > Enable 'hdfs dfs -stat' to display access time >

[jira] [Assigned] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reassigned HDFS-12190: Assignee: Yongjun Zhang > Enable 'hdfs dfs -stat' to display access time >

[jira] [Created] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-21 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-12190: Summary: Enable 'hdfs dfs -stat' to display access time Key: HDFS-12190 URL: https://issues.apache.org/jira/browse/HDFS-12190 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-11799) Introduce a config to allow setting up write pipeline with fewer nodes than replication factor

2017-07-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094015#comment-16094015 ] Yongjun Zhang commented on HDFS-11799: -- HI [~brahmareddy], Thanks for the updated patch and really

[jira] [Updated] (HDFS-12139) HTTPFS liststatus returns incorrect pathSuffix for path of file

2017-07-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12139: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1

[jira] [Commented] (HDFS-12139) HTTPFS liststatus returns incorrect pathSuffix for path of file

2017-07-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093621#comment-16093621 ] Yongjun Zhang commented on HDFS-12139: -- Thanks a lot [~xiaochen], committed to trunk and branch-2. I

[jira] [Updated] (HDFS-12162) Update listStatus document to describe the behavior when the argument is a file

2017-07-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12162: - Description: The listStatus method can take in either directory path or file path as input,

[jira] [Created] (HDFS-12162) Update listStatus document to describe the behavior when the argument is a file

2017-07-19 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-12162: Summary: Update listStatus document to describe the behavior when the argument is a file Key: HDFS-12162 URL: https://issues.apache.org/jira/browse/HDFS-12162

[jira] [Commented] (HDFS-12139) HTTPFS liststatus returns incorrect pathSuffix for path of file

2017-07-18 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092298#comment-16092298 ] Yongjun Zhang commented on HDFS-12139: -- All good catches, thanks much [~xiaochen]! I just uploaded

[jira] [Updated] (HDFS-12139) HTTPFS liststatus returns incorrect pathSuffix for path of file

2017-07-18 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12139: - Attachment: HDFS-12139.002.patch > HTTPFS liststatus returns incorrect pathSuffix for path of

[jira] [Commented] (HDFS-12139) HTTPFS liststatus returns incorrect pathSuffix for path of file

2017-07-18 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16092058#comment-16092058 ] Yongjun Zhang commented on HDFS-12139: -- Thanks [~shahrs87] [~xiaochen] [~jojochuang]. {quote} This

[jira] [Updated] (HDFS-12139) liststatus returns incorrect pathSuffix for path of file

2017-07-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12139: - Description: Per the following logs, we can see that liststatus returns the same pathSuffix

[jira] [Updated] (HDFS-12139) liststatus returns incorrect pathSuffix for path of file

2017-07-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12139: - Status: Patch Available (was: Open) > liststatus returns incorrect pathSuffix for path of file >

[jira] [Updated] (HDFS-12139) liststatus returns incorrect pathSuffix for path of file

2017-07-17 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12139: - Attachment: HDFS-12139.001.patch > liststatus returns incorrect pathSuffix for path of file >

[jira] [Updated] (HDFS-12139) liststatus returns incorrect pathSuffix for path of file

2017-07-13 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12139: - Component/s: httpfs > liststatus returns incorrect pathSuffix for path of file >

[jira] [Created] (HDFS-12139) liststatus returns incorrect pathSuffix for path of file

2017-07-13 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-12139: Summary: liststatus returns incorrect pathSuffix for path of file Key: HDFS-12139 URL: https://issues.apache.org/jira/browse/HDFS-12139 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2017-06-30 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16070989#comment-16070989 ] Yongjun Zhang commented on HDFS-9820: - Hi [~venkatnrangan], Thanks for the feedback. Would you please

[jira] [Commented] (HDFS-11799) Introduce a config to allow setting up write pipeline with fewer nodes than replication factor

2017-06-24 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16061828#comment-16061828 ] Yongjun Zhang commented on HDFS-11799: -- Hi [~brahmareddy], Thanks for working on this and sorry for

[jira] [Commented] (HDFS-12014) Improve spacing on distinct versions message

2017-06-22 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060116#comment-16060116 ] Yongjun Zhang commented on HDFS-12014: -- Hi [~alanj_impala_5a78], Thanks for working on this. I added

[jira] [Assigned] (HDFS-12014) Improve spacing on distinct versions message

2017-06-22 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reassigned HDFS-12014: Assignee: Alan Jackoway > Improve spacing on distinct versions message >

[jira] [Moved] (HDFS-12014) Improve spacing on distinct versions message

2017-06-22 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang moved HADOOP-14575 to HDFS-12014: --- Key: HDFS-12014 (was: HADOOP-14575) Project: Hadoop HDFS

[jira] [Commented] (HDFS-11974) Fsimage transfer failed due to socket timeout, but logs doesn't show that

2017-06-18 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053440#comment-16053440 ] Yongjun Zhang commented on HDFS-11974: -- A further thought. The exception reported was thrown here

[jira] [Commented] (HDFS-11949) Add testcase for ensuring that FsShell cann't move file to the target directory that file exists

2017-06-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16052617#comment-16052617 ] Yongjun Zhang commented on HDFS-11949: -- Sorry for not being clear [~legend]. I meant the "-1" and

[jira] [Commented] (HDFS-11976) Examine code base for cases that exception is thrown from finally block and fix it

2017-06-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16051449#comment-16051449 ] Yongjun Zhang commented on HDFS-11976: -- That's great [~pavgustinov]! very nice tool and thank you so

[jira] [Updated] (HDFS-11976) Examine code base for cases that exception is thrown from finally block and fix it

2017-06-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11976: - Description: If exception X is thrown in try block, and exception Y is thrown is finally block,

[jira] [Created] (HDFS-11976) Examine code base for cases that exception is thrown from finally block and fix it

2017-06-14 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-11976: Summary: Examine code base for cases that exception is thrown from finally block and fix it Key: HDFS-11976 URL: https://issues.apache.org/jira/browse/HDFS-11976

[jira] [Assigned] (HDFS-11949) Add testcase for ensuring that FsShell cann't move file to the target directory that file exists

2017-06-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reassigned HDFS-11949: Assignee: legend Hi [~legend], I added you to the contributer and am assigning this jira

[jira] [Commented] (HDFS-11949) Add testcase for ensuring that FsShell cann't move file to the target directory that file exists

2017-06-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049796#comment-16049796 ] Yongjun Zhang commented on HDFS-11949: -- Thanks for reporting and working on this issue [~legend]. The

[jira] [Created] (HDFS-11974) Fsimage transfer failed due to socket timeout, but logs doesn't show that

2017-06-14 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-11974: Summary: Fsimage transfer failed due to socket timeout, but logs doesn't show that Key: HDFS-11974 URL: https://issues.apache.org/jira/browse/HDFS-11974 Project:

[jira] [Comment Edited] (HDFS-11198) NN UI should link DN web address using hostnames

2017-06-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049490#comment-16049490 ] Yongjun Zhang edited comment on HDFS-11198 at 6/14/17 6:27 PM: --- HI

[jira] [Commented] (HDFS-11198) NN UI should link DN web address using hostnames

2017-06-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16049490#comment-16049490 ] Yongjun Zhang commented on HDFS-11198: -- HI [~xiaochen], Per offline discussion, it seems HDFS-11198

[jira] [Commented] (HDFS-11797) BlockManager#createLocatedBlocks() can throw ArrayIndexOutofBoundsException when corrupt replicas are inconsistent

2017-06-12 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16047116#comment-16047116 ] Yongjun Zhang commented on HDFS-11797: -- Thanks you all for looking into this issue. Hi [~kshukla],

[jira] [Updated] (HDFS-11914) Add more diagnosis info for fsimage transfer failure.

2017-06-06 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11914: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha4

[jira] [Created] (HDFS-11938) Logs for KMS delegation token lifecycle

2017-06-06 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-11938: Summary: Logs for KMS delegation token lifecycle Key: HDFS-11938 URL: https://issues.apache.org/jira/browse/HDFS-11938 Project: Hadoop HDFS Issue Type:

[jira] [Assigned] (HDFS-11938) Logs for KMS delegation token lifecycle

2017-06-06 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reassigned HDFS-11938: Assignee: Xiao Chen Thanks Xiao for offering to work on this. > Logs for KMS delegation

[jira] [Commented] (HDFS-11914) Add more diagnosis info for fsimage transfer failure.

2017-06-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16037945#comment-16037945 ] Yongjun Zhang commented on HDFS-11914: -- Thanks for the review [~jojochuang], I committed to trunk and

[jira] [Updated] (HDFS-11914) Add more diagnosis info for fsimage transfer failure.

2017-06-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11914: - Attachment: HDFS-11914.branch-2.001.patch > Add more diagnosis info for fsimage transfer failure.

[jira] [Updated] (HDFS-11914) Add more diagnosis info for fsimage transfer failure.

2017-06-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11914: - Attachment: HDFS-11914.004.patch Thanks [~jojochuang]. Good to know. Rev4 address your comments,

[jira] [Updated] (HDFS-11914) Add more diagnosis info for fsimage transfer failure.

2017-06-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11914: - Attachment: HDFS-11914.003.patch > Add more diagnosis info for fsimage transfer failure. >

[jira] [Commented] (HDFS-11914) Add more diagnosis info for fsimage transfer failure.

2017-06-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035128#comment-16035128 ] Yongjun Zhang commented on HDFS-11914: -- Thanks [~jojochuang], good comments. I'm uploading a patch

[jira] [Updated] (HDFS-11914) Add more diagnosis info for fsimage transfer failure.

2017-06-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11914: - Issue Type: Improvement (was: Bug) > Add more diagnosis info for fsimage transfer failure. >

[jira] [Updated] (HDFS-11914) Add more diagnosis info for fsimage transfer failure.

2017-06-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11914: - Labels: supportability (was: ) > Add more diagnosis info for fsimage transfer failure. >

[jira] [Commented] (HDFS-11914) Add more diagnosis info for fsimage transfer failure.

2017-06-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034880#comment-16034880 ] Yongjun Zhang commented on HDFS-11914: -- Uploaded rev 002 to include some more info. The failed tests

[jira] [Updated] (HDFS-11914) Add more diagnosis info for fsimage transfer failure.

2017-06-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11914: - Attachment: HDFS-11914.002.patch > Add more diagnosis info for fsimage transfer failure. >

[jira] [Updated] (HDFS-11914) Add more diagnosis info for fsimage transfer failure.

2017-06-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11914: - Attachment: HDFS-11914.001.patch Upload patch rev 001. > Add more diagnosis info for fsimage

[jira] [Updated] (HDFS-11914) Add more diagnosis info for fsimage transfer failure.

2017-06-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11914: - Status: Patch Available (was: Open) > Add more diagnosis info for fsimage transfer failure. >

[jira] [Created] (HDFS-11914) Add more diagnosis info for fsimage transfer failure.

2017-06-02 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-11914: Summary: Add more diagnosis info for fsimage transfer failure. Key: HDFS-11914 URL: https://issues.apache.org/jira/browse/HDFS-11914 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-05-31 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16032316#comment-16032316 ] Yongjun Zhang commented on HDFS-11741: -- Thanks [~xiaochen]. I'm +1 on both the trunk and branch-2

[jira] [Commented] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-05-31 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16031619#comment-16031619 ] Yongjun Zhang commented on HDFS-11741: -- Thanks [~xiaochen], +1 pending jenkins. > Long running

[jira] [Commented] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-05-31 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16030741#comment-16030741 ] Yongjun Zhang commented on HDFS-11741: -- Thanks [~xiaochen] for the updated patch. Suggest to make

[jira] [Commented] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-05-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16013246#comment-16013246 ] Yongjun Zhang commented on HDFS-11741: -- Hi [~jojochuang], Thanks for your work here. It seems the

[jira] [Updated] (HDFS-11799) Introduce a config to allow setting up write pipeline with fewer nodes than replication factor

2017-05-10 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11799: - Summary: Introduce a config to allow setting up write pipeline with fewer nodes than replication

[jira] [Created] (HDFS-11799) Introduce a config to allow setting up write pipeline with single node

2017-05-10 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-11799: Summary: Introduce a config to allow setting up write pipeline with single node Key: HDFS-11799 URL: https://issues.apache.org/jira/browse/HDFS-11799 Project: Hadoop

[jira] [Commented] (HDFS-11659) TestDataNodeHotSwapVolumes.testRemoveVolumeBeingWritten fail due to no DataNode available for pipeline recovery.

2017-05-03 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15996163#comment-15996163 ] Yongjun Zhang commented on HDFS-11659: -- Hi [~eddyxu], Thanks for working on this issue. I did a

[jira] [Commented] (HDFS-11661) GetContentSummary uses excessive amounts of memory

2017-05-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15994067#comment-15994067 ] Yongjun Zhang commented on HDFS-11661: -- HI [~jojochuang], Thanks for working on this, it seems a

[jira] [Commented] (HDFS-11721) When Standby NameNode is paused using kill -SIGSTOP clients hang rather than moving to the active.

2017-05-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993714#comment-15993714 ] Yongjun Zhang commented on HDFS-11721: -- Hi [~thomaskwscott], The client will not time out when the

[jira] [Commented] (HDFS-11721) When Standby NameNode is paused using kill -SIGSTOP clients hang rather than moving to the active.

2017-05-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993266#comment-15993266 ] Yongjun Zhang commented on HDFS-11721: -- Hi Guys, Yes, it should be HADOOP-12672, As far as I know,

[jira] [Created] (HDFS-11706) Enable fallback to regular distcp when distcp failed with snapshot diff

2017-04-26 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-11706: Summary: Enable fallback to regular distcp when distcp failed with snapshot diff Key: HDFS-11706 URL: https://issues.apache.org/jira/browse/HDFS-11706 Project:

[jira] [Comment Edited] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-04-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15979738#comment-15979738 ] Yongjun Zhang edited comment on HDFS-11402 at 4/22/17 4:05 AM: --- Committed to

[jira] [Commented] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-04-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15979739#comment-15979739 ] Yongjun Zhang commented on HDFS-11402: -- We might consider backport to branch-2. The jira is marked

[jira] [Commented] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-04-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15979738#comment-15979738 ] Yongjun Zhang commented on HDFS-11402: -- Committed to trunk. Thanks [~manojg] for the very good

[jira] [Updated] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-04-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11402: - Resolution: Fixed Hadoop Flags: Incompatible change,Reviewed (was: Incompatible change)

[jira] [Commented] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-04-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15979731#comment-15979731 ] Yongjun Zhang commented on HDFS-11402: -- Thanks [~andrew.wang] for the review, I did another round of

[jira] [Updated] (HDFS-11689) New exception thrown by DFSClient#isHDFSEncryptionEnabled broke hacky hive code

2017-04-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11689: - Resolution: Fixed Fix Version/s: 2.8.1 3.0.0-alpha3 Status:

[jira] [Commented] (HDFS-11689) New exception thrown by DFSClient#isHDFSEncryptionEnabled broke hacky hive code

2017-04-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15979415#comment-15979415 ] Yongjun Zhang commented on HDFS-11689: -- Thanks a lot [~shahrs87], [~daryn], [~aw] and [~andrew.wang]!

[jira] [Comment Edited] (HDFS-11689) New exception thrown by DFSClient#isHDFSEncryptionEnabled broke hacky hive code

2017-04-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15979415#comment-15979415 ] Yongjun Zhang edited comment on HDFS-11689 at 4/21/17 9:27 PM: --- Thanks a lot

[jira] [Updated] (HDFS-11689) New exception thrown by DFSClient%isHDFSEncryptionEnabled broke hacky hive code

2017-04-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11689: - Summary: New exception thrown by DFSClient%isHDFSEncryptionEnabled broke hacky hive code (was:

[jira] [Commented] (HDFS-11689) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15979123#comment-15979123 ] Yongjun Zhang commented on HDFS-11689: -- Andrew explained that @InterfaceAudience.Private is not java

[jira] [Updated] (HDFS-11689) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11689: - Attachment: HDFS-11689.001.patch > New exception thrown by (private) DFSClient API

[jira] [Commented] (HDFS-11689) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15979094#comment-15979094 ] Yongjun Zhang commented on HDFS-11689: -- Thanks [~andrew.wang]. I wish the private annotation {code}

[jira] [Commented] (HDFS-11689) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15979082#comment-15979082 ] Yongjun Zhang commented on HDFS-11689: -- Thanks [~steve_l] and [~daryn]. I moved the jira to hdfs

[jira] [Moved] (HDFS-11689) New exception thrown by (private) DFSClient API isHDFSEncryptionEnabled broke hacky hive code

2017-04-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang moved HADOOP-14333 to HDFS-11689: --- Affects Version/s: (was: 3.0.0-alpha3)

[jira] [Created] (HDFS-11656) RetryInvocationHandler may report ANN as SNN in messages.

2017-04-14 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-11656: Summary: RetryInvocationHandler may report ANN as SNN in messages. Key: HDFS-11656 URL: https://issues.apache.org/jira/browse/HDFS-11656 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11656) RetryInvocationHandler may report ANN as SNN in messages.

2017-04-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11656: - Description: When multiple threads use the same DFSClient to make RPC calls, they may report

[jira] [Commented] (HDFS-11588) Output Avro format in the offline editlog viewer

2017-03-29 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947287#comment-15947287 ] Yongjun Zhang commented on HDFS-11588: -- Hi [~wheat9], Thanks for proposing this new feature and

[jira] [Commented] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-03-28 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15946165#comment-15946165 ] Yongjun Zhang commented on HDFS-11402: -- Hi [~manojg], Thanks a lot for your work here and very sorry

[jira] [Comment Edited] (HDFS-9868) Add ability for DistCp to run between 2 clusters

2017-02-28 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888341#comment-15888341 ] Yongjun Zhang edited comment on HDFS-9868 at 2/28/17 4:19 PM: -- Here is my

[jira] [Commented] (HDFS-9868) Add ability for DistCp to run between 2 clusters

2017-02-28 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888341#comment-15888341 ] Yongjun Zhang commented on HDFS-9868: - Here is my proposed approach to handle confMap with

[jira] [Commented] (HDFS-9868) Add ability for DistCp to run between 2 clusters

2017-02-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887273#comment-15887273 ] Yongjun Zhang commented on HDFS-9868: - Thanks [~xiaochen]. I just committed HADOOP-14127. Found a

[jira] [Comment Edited] (HDFS-9868) Add ability for DistCp to run between 2 clusters

2017-02-27 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886076#comment-15886076 ] Yongjun Zhang edited comment on HDFS-9868 at 2/27/17 4:35 PM: -- Thanks

<    1   2   3   4   5   6   7   8   9   10   >