[jira] [Commented] (HDFS-11364) Verify Audit log entries for successful ACL commands

2017-01-24 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15837010#comment-15837010 ] Xiao Chen commented on HDFS-11364: -- Sorry missed the ping earlier. Good to have more tests to cover this.

[jira] [Updated] (HDFS-11363) Need more diagnosis info when seeing Slow waitForAckedSeqno

2017-01-24 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11363: - Attachment: HDFS-11363.01.patch Attaching patch 1 for the logs. Added filename, block, and datanode list

[jira] [Updated] (HDFS-11363) Need more diagnosis info when seeing Slow waitForAckedSeqno

2017-01-24 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11363: - Target Version/s: 2.9.0 Status: Patch Available (was: Open) > Need more diagnosis info

[jira] [Updated] (HDFS-11363) Need more diagnosis info when seeing Slow waitForAckedSeqno

2017-01-24 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11363: - Labels: supportability (was: ) > Need more diagnosis info when seeing Slow waitForAckedSeqno >

[jira] [Updated] (HDFS-11363) Need more diagnosis info when seeing Slow waitForAckedSeqno

2017-01-24 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11363: - Component/s: (was: logging) > Need more diagnosis info when seeing Slow waitForAckedSeqno >

[jira] [Updated] (HDFS-11363) Need more diagnosis info when seeing Slow waitForAckedSeqno

2017-01-24 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11363: - Component/s: logging > Need more diagnosis info when seeing Slow waitForAckedSeqno >

[jira] [Commented] (HDFS-11418) HttpFS should support old SSL clients

2017-02-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15877789#comment-15877789 ] Xiao Chen commented on HDFS-11418: -- Seems fine overall. I think this is a +1 pending the KMS equivalent

[jira] [Updated] (HDFS-9868) Add ability for DistCp to run between 2 clusters

2017-02-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9868: Attachment: HDFS-9868.07.patch Reviving this jira, attaching patch 7, which is after a new review of patch

[jira] [Updated] (HDFS-9868) Add ability for DistCp to run between 2 clusters

2017-02-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9868: Summary: Add ability for DistCp to run between 2 clusters (was: Add ability to read remote cluster

[jira] [Updated] (HDFS-11410) Use the cached instance when edit logging SetAclOp, SetXAttrOp and RemoveXAttrOp

2017-02-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11410: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3 2.9.0

[jira] [Commented] (HDFS-11379) DFSInputStream may infinite loop requesting block locations

2017-02-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15870830#comment-15870830 ] Xiao Chen commented on HDFS-11379: -- Ping, does the 2.7 backport look good? (Also not sure if backports

[jira] [Updated] (HDFS-11379) DFSInputStream may infinite loop requesting block locations

2017-02-17 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11379: - Resolution: Fixed Fix Version/s: 2.7.4 Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-11379) DFSInputStream may infinite loop requesting block locations

2017-02-17 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15872744#comment-15872744 ] Xiao Chen commented on HDFS-11379: -- It seems from other jiras a backport doesn't need a +1, so with

[jira] [Updated] (HDFS-9868) Add ability for DistCp to run between 2 clusters

2017-02-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9868: Attachment: (was: HDFS-9868.07.patch) > Add ability for DistCp to run between 2 clusters >

[jira] [Updated] (HDFS-9868) Add ability for DistCp to run between 2 clusters

2017-02-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9868: Attachment: HDFS-9868.07.patch > Add ability for DistCp to run between 2 clusters >

[jira] [Commented] (HDFS-8915) TestFSNamesystem.testFSLockGetWaiterCount fails intermittently in jenkins

2017-02-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879143#comment-15879143 ] Xiao Chen commented on HDFS-8915: - Thanks for the fix. Linking HDFS-8883 here to make it more explicit. >

[jira] [Updated] (HDFS-9868) Add ability for DistCp to run between 2 clusters

2017-02-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9868: Attachment: HDFS-9868.08.patch Thanks [~yzhangal] for the comment, I think it's a good idea. Patch 8

[jira] [Commented] (HDFS-11421) Make WebHDFS' ACLs RegEx configurable

2017-02-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881622#comment-15881622 ] Xiao Chen commented on HDFS-11421: -- Thanks for reporting and fixing this [~qwertymaniac]! Looks pretty

[jira] [Commented] (HDFS-9868) Add ability for DistCp to run between 2 clusters

2017-02-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881863#comment-15881863 ] Xiao Chen commented on HDFS-9868: - Precommit seems to be yetus related? The reason for failing is a

[jira] [Comment Edited] (HDFS-9868) Add ability for DistCp to run between 2 clusters

2017-02-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881562#comment-15881562 ] Xiao Chen edited comment on HDFS-9868 at 2/24/17 3:28 AM: -- Thanks [~yzhangal] for

[jira] [Commented] (HDFS-9868) Add ability for DistCp to run between 2 clusters

2017-02-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882158#comment-15882158 ] Xiao Chen commented on HDFS-9868: - Thanks for the review and comment [~yzhangal]. bq. separate the

[jira] [Commented] (HDFS-11421) Make WebHDFS' ACLs RegEx configurable

2017-02-24 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15883845#comment-15883845 ] Xiao Chen commented on HDFS-11421: -- Test failures look unrelated and passed locally. I just committed

[jira] [Updated] (HDFS-11421) Make WebHDFS' ACLs RegEx configurable

2017-02-24 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11421: - Fix Version/s: 3.0.0-alpha3 > Make WebHDFS' ACLs RegEx configurable >

[jira] [Commented] (HDFS-11421) Make WebHDFS' ACLs RegEx configurable

2017-02-24 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15883160#comment-15883160 ] Xiao Chen commented on HDFS-11421: -- Thanks Harsh for the new rev! +1 pending jenkins. Do you know how to

[jira] [Updated] (HDFS-9868) Add ability for DistCp to run between 2 clusters

2017-02-24 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9868: Attachment: HDFS-9868.09.patch Patch 9 to address most of the comments. Kept #5 unchanged because I can't

[jira] [Created] (HDFS-11410) Use the cache when edit logging XAttrOps

2017-02-13 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-11410: Summary: Use the cache when edit logging XAttrOps Key: HDFS-11410 URL: https://issues.apache.org/jira/browse/HDFS-11410 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-10899) Add functionality to re-encrypt EDEKs.

2017-02-13 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10899: - Attachment: (was: HDFS-10899.08.patch) > Add functionality to re-encrypt EDEKs. >

[jira] [Updated] (HDFS-10899) Add functionality to re-encrypt EDEKs.

2017-02-13 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10899: - Attachment: HDFS-10899.08.patch > Add functionality to re-encrypt EDEKs. >

[jira] [Updated] (HDFS-10899) Add functionality to re-encrypt EDEKs.

2017-02-13 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10899: - Attachment: HDFS-10899.08.patch Thanks much for the soak and all these good comments Andrew. Sorry this

[jira] [Updated] (HDFS-11410) Use the cache when edit logging XAttrOps

2017-02-13 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11410: - Attachment: HDFS-11410.01.patch Simple patch 1 attached. Trivial changes. Pinged one of the initial

[jira] [Commented] (HDFS-6301) NameNode: persist XAttrs in fsimage and record XAttrs modifications to edit log.

2017-02-10 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15862115#comment-15862115 ] Xiao Chen commented on HDFS-6301: - Hi, sorry for pinging on this 3yo jira... [~andrew.wang] recently had a

[jira] [Reopened] (HDFS-11379) DFSInputStream may infinite loop requesting block locations

2017-02-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reopened HDFS-11379: -- Sorry for reopening this. Attaching a branch-2.7 patch. 2.6 seems will be EOL'ed soon so maybe we can skip

[jira] [Updated] (HDFS-11379) DFSInputStream may infinite loop requesting block locations

2017-02-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11379: - Attachment: HDFS-11379.branch-2.7.patch 2.7 patch has some trivial conflicts: {{fetchBlockAt}} signature,

[jira] [Updated] (HDFS-11379) DFSInputStream may infinite loop requesting block locations

2017-02-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11379: - Status: Patch Available (was: Reopened) > DFSInputStream may infinite loop requesting block locations >

[jira] [Commented] (HDFS-11390) Add process name to httpfs process

2017-02-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15866228#comment-15866228 ] Xiao Chen commented on HDFS-11390: -- +1 committing this > Add process name to httpfs process >

[jira] [Updated] (HDFS-11390) Add process name to httpfs process

2017-02-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11390: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.1 2.9.0

[jira] [Commented] (HDFS-11379) DFSInputStream may infinite loop requesting block locations

2017-02-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15866658#comment-15866658 ] Xiao Chen commented on HDFS-11379: -- All the red and yellow are not introduced by the patch, and the

[jira] [Updated] (HDFS-11410) Use the cached instance when edit logging SetAclOp, SetXAttrOp and RemoveXAttrOp

2017-02-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11410: - Summary: Use the cached instance when edit logging SetAclOp, SetXAttrOp and RemoveXAttrOp (was: Use the

[jira] [Updated] (HDFS-11410) Use the cached instance when edit logging XAttrOps

2017-02-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11410: - Summary: Use the cached instance when edit logging XAttrOps (was: Use the cache when edit logging

[jira] [Updated] (HDFS-10899) Add functionality to re-encrypt EDEKs.

2017-02-15 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10899: - Attachment: HDFS-10899.09.patch patch 9: - added a throttler. Note this won't be very accurate as we do

[jira] [Updated] (HDFS-10899) Add functionality to re-encrypt EDEKs.

2017-02-15 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10899: - Attachment: HDFS-10899.09.patch > Add functionality to re-encrypt EDEKs. >

[jira] [Updated] (HDFS-10899) Add functionality to re-encrypt EDEKs.

2017-02-15 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10899: - Attachment: HDFS-10899.09.patch > Add functionality to re-encrypt EDEKs. >

[jira] [Updated] (HDFS-10899) Add functionality to re-encrypt EDEKs.

2017-02-15 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10899: - Attachment: (was: HDFS-10899.09.patch) > Add functionality to re-encrypt EDEKs. >

[jira] [Commented] (HDFS-6301) NameNode: persist XAttrs in fsimage and record XAttrs modifications to edit log.

2017-02-15 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868107#comment-15868107 ] Xiao Chen commented on HDFS-6301: - FYI - created HDFS-11410 for the above and Andrew +1'ed, plan to commit

[jira] [Updated] (HDFS-10899) Add functionality to re-encrypt EDEKs.

2017-02-15 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10899: - Attachment: (was: HDFS-10899.09.patch) > Add functionality to re-encrypt EDEKs. >

[jira] [Updated] (HDFS-9868) Add ability for DistCp to run between 2 clusters

2017-02-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9868: Issue Type: Improvement (was: New Feature) Updating jira type to improvement since this is just adding a

[jira] [Updated] (HDFS-6532) Intermittent test failure org.apache.hadoop.hdfs.TestCrcCorruption.testCorruptionDuringWrt

2016-08-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-6532: Attachment: TEST-org.apache.hadoop.hdfs.TestCrcCorruption.xml I further looked at the issue but not root

[jira] [Commented] (HDFS-10549) Memory leak if exception happens when closing files being written

2016-08-15 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15421982#comment-15421982 ] Xiao Chen commented on HDFS-10549: -- Thanks Yiqun for revving! Patch 5 looks good to me. +1 pending

[jira] [Updated] (HDFS-8986) Add option to -du to calculate directory space usage excluding snapshots

2016-08-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-8986: Attachment: HDFS-8986.05.patch Thanks Wei-Chiu, patch 5 attached to rename the params. > Add option to -du

[jira] [Updated] (HDFS-10549) Correctly revoke file lease when closing files

2016-08-17 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10549: - Summary: Correctly revoke file lease when closing files (was: Memory leak if exception happens when

[jira] [Updated] (HDFS-10549) Correctly revoke file leases when closing files

2016-08-17 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10549: - Summary: Correctly revoke file leases when closing files (was: Correctly revoke file lease when closing

[jira] [Commented] (HDFS-10549) Correctly revoke file leases when closing files

2016-08-17 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15425501#comment-15425501 ] Xiao Chen commented on HDFS-10549: -- Test failure look unrelated an passed locally. +1, committing this

[jira] [Commented] (HDFS-10756) Expose getTrashRoot to HTTPFS and WebHDFS

2016-08-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15423882#comment-15423882 ] Xiao Chen commented on HDFS-10756: -- Ah, I see. Thanks Wei-Chiu for closing the gaps. > Expose

[jira] [Commented] (HDFS-10756) Expose getTrashRoot to HTTPFS and WebHDFS

2016-08-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15423880#comment-15423880 ] Xiao Chen commented on HDFS-10756: -- Thanks [~yuanbo] for looking into this. bq. Actually I find that EZ

[jira] [Commented] (HDFS-10756) Expose getTrashRoot to HTTPFS and WebHDFS

2016-08-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15423906#comment-15423906 ] Xiao Chen commented on HDFS-10756: -- Delete without trash already works. IMO ideally we can add trash to

[jira] [Updated] (HDFS-10549) Correctly revoke file leases when closing files

2016-08-17 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10549: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 2.8.0

[jira] [Updated] (HDFS-9868) Add ability for DistCp to run between 2 clusters

2017-02-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9868: Attachment: HDFS-9868.10.patch Thanks [~yzhangal] for the review. Tested on a real cluster (without kerberos

[jira] [Commented] (HDFS-9868) Add ability for DistCp to run between 2 clusters

2017-02-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886478#comment-15886478 ] Xiao Chen commented on HDFS-9868: - {quote} bq. separate the /log4j.properties change to a new jira This is

[jira] [Commented] (HDFS-9745) TestSecureNNWithQJM#testSecureMode sometimes fails with timeouts

2016-08-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433048#comment-15433048 ] Xiao Chen commented on HDFS-9745: - Woot. Thanks [~jlowe]! > TestSecureNNWithQJM#testSecureMode sometimes

[jira] [Commented] (HDFS-10833) Fix JSON errors in WebHDFS.md examples

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459277#comment-15459277 ] Xiao Chen commented on HDFS-10833: -- +1. Thanks for taking care of this, Andrew. > Fix JSON errors in

[jira] [Commented] (HDFS-10832) HttpFS does not use the ephemeral ACL bit introduced in HDFS-6326

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459593#comment-15459593 ] Xiao Chen commented on HDFS-10832: -- Good find Andrew! Patch looks great too. Some comments: -

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459700#comment-15459700 ] Xiao Chen commented on HDFS-9781: - [~jojochuang] ping'ed me offline saying this looks fine to me too. I'll

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459773#comment-15459773 ] Xiao Chen commented on HDFS-9781: - I have committed this to trunk. There are some minor conflicts

[jira] [Updated] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9781: Fix Version/s: 3.0.0-alpha2 > FsDatasetImpl#getBlockReports can occasionally throw NullPointerException >

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459931#comment-15459931 ] Xiao Chen commented on HDFS-9781: - Branch-2 patch looks good too, committing shortly. >

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459653#comment-15459653 ] Xiao Chen commented on HDFS-9781: - Patch 3 LGTM, +1. Will wait to see if any comments from others. >

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459708#comment-15459708 ] Xiao Chen commented on HDFS-10830: -- Thanks for working on this [~arpitagarwal] and [~manojg]. Just

[jira] [Updated] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9781: Attachment: HDFS-9781.branch-2.001.patch Hm, when I locally ran the test it actually timed out. Attaching a

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459992#comment-15459992 ] Xiao Chen commented on HDFS-9781: - Discussed this offline with Manoj. This jira fixes the NPE, and also

[jira] [Comment Edited] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459700#comment-15459700 ] Xiao Chen edited comment on HDFS-9781 at 9/2/16 10:33 PM: -- [~jojochuang] ping'ed

[jira] [Commented] (HDFS-10835) Typo in httpfs.sh hadoop_usage

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15460412#comment-15460412 ] Xiao Chen commented on HDFS-10835: -- {{hadoop_add_subcommand "top n" "Stop $name, waiting up to n seconds

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15460302#comment-15460302 ] Xiao Chen commented on HDFS-9781: - Findbugs warning is due to HDFS-10745, I left a comment on that jira. >

[jira] [Commented] (HDFS-10745) Directly resolve paths into INodesInPath

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15460300#comment-15460300 ] Xiao Chen commented on HDFS-10745: -- Thanks for working on this, Daryn and Kihwal. It seems this change

[jira] [Commented] (HDFS-10835) Typo in httpfs.sh hadoop_usage

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15460388#comment-15460388 ] Xiao Chen commented on HDFS-10835: -- Thanks [~jzhuge] for working on this, and [~aw] for commenting. To

[jira] [Commented] (HDFS-10784) Implement WebHdfsFileSystem#listStatusIterator

2016-09-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15466388#comment-15466388 ] Xiao Chen commented on HDFS-10784: -- Yep, that's being tracked by the linked HDFS-10823. > Implement

[jira] [Commented] (HDFS-10841) Remove duplicate or unused variable in appendFile()

2016-09-06 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468041#comment-15468041 ] Xiao Chen commented on HDFS-10841: -- Thanks Kihwal for taking care of this! The original problem only

[jira] [Commented] (HDFS-10841) Remove duplicate or unused variable in appendFile()

2016-09-06 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468192#comment-15468192 ] Xiao Chen commented on HDFS-10841: -- +1 on the patch, committing soon. > Remove duplicate or unused

[jira] [Updated] (HDFS-10835) Fix typos in httpfs.sh

2016-09-06 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10835: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 Status:

[jira] [Updated] (HDFS-10835) Fix typos in httpfs.sh

2016-09-06 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10835: - Summary: Fix typos in httpfs.sh (was: Typo in httpfs.sh hadoop_usage) > Fix typos in httpfs.sh >

[jira] [Commented] (HDFS-10835) Fix typos in httpfs.sh

2016-09-06 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15468179#comment-15468179 ] Xiao Chen commented on HDFS-10835: -- +1 on patch 5, committing this. > Fix typos in httpfs.sh >

[jira] [Updated] (HDFS-10841) Remove duplicate or unused variable in appendFile()

2016-09-06 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10841: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 2.8.0

[jira] [Comment Edited] (HDFS-10820) Reuse closeResponder to reset the response variable in DataStreamer#run

2016-09-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456864#comment-15456864 ] Xiao Chen edited comment on HDFS-10820 at 9/1/16 10:51 PM: --- I have committed

[jira] [Updated] (HDFS-10820) Reuse closeResponder to reset the response variable in DataStreamer#run

2016-09-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10820: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 Status:

[jira] [Commented] (HDFS-6532) Intermittent test failure org.apache.hadoop.hdfs.TestCrcCorruption.testCorruptionDuringWrt

2016-08-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449965#comment-15449965 ] Xiao Chen commented on HDFS-6532: - Thanks Yiqun for working on this. It does look like we can reuse the

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457568#comment-15457568 ] Xiao Chen commented on HDFS-9781: - Sorry for my epic slow response on this one And thanks all for

[jira] [Commented] (HDFS-10823) Implement HttpFSFileSystem#listStatusIterator

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457676#comment-15457676 ] Xiao Chen commented on HDFS-10823: -- Thanks Andrew for the nice investigation and thoughts here. I've only

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-01 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15457611#comment-15457611 ] Xiao Chen commented on HDFS-10830: -- Thanks Manoj and Arpit. IIRC the reason of not {{Thread.sleep}} here

[jira] [Commented] (HDFS-4210) Helpful exception when DNS entry for JournalNode cannot be resolved

2016-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447014#comment-15447014 ] Xiao Chen commented on HDFS-4210: - Thanks John for the patches. 2 comments, other than these LGTM: {code}

[jira] [Updated] (HDFS-4210) Throw helpful exception when DNS entry for JournalNode cannot be resolved

2016-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-4210: Summary: Throw helpful exception when DNS entry for JournalNode cannot be resolved (was: Helpful exception

[jira] [Updated] (HDFS-4210) Throw helpful exception when DNS entry for JournalNode cannot be resolved

2016-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-4210: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 2.8.0

[jira] [Updated] (HDFS-4210) Throw helpful exception when DNS entry for JournalNode cannot be resolved

2016-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-4210: Labels: BB2015-05-TBR supportability (was: BB2015-05-TBR) > Throw helpful exception when DNS entry for

[jira] [Commented] (HDFS-4210) Throw helpful exception when DNS entry for JournalNode cannot be resolved

2016-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447572#comment-15447572 ] Xiao Chen commented on HDFS-4210: - +1 on patch 4, committing soon. > Throw helpful exception when DNS

[jira] [Commented] (HDFS-10784) Implement WebHdfsFileSystem#listStatusIterator

2016-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15448015#comment-15448015 ] Xiao Chen commented on HDFS-10784: -- Thanks for the new patch, Andrew. Looks pretty good to me. I have a

[jira] [Comment Edited] (HDFS-10820) Reuse closeResponder to reset the response variable in DataStreamer#run

2016-08-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15451307#comment-15451307 ] Xiao Chen edited comment on HDFS-10820 at 8/31/16 6:23 AM: --- +1, will commit

[jira] [Updated] (HDFS-10820) Reuse closeResponder to reset the response variable in DataStreamer#run

2016-08-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10820: - Summary: Reuse closeResponder to reset the response variable in DataStreamer#run (was:

[jira] [Commented] (HDFS-10820) Reuse closeResponder to reset the response variable in DataStreamer#run

2016-08-31 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15451307#comment-15451307 ] Xiao Chen commented on HDFS-10820: -- +1, will commit after 24 hours. > Reuse closeResponder to reset the

[jira] [Commented] (HDFS-10784) Implement WebHdfsFileSystem#listStatusIterator

2016-08-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450440#comment-15450440 ] Xiao Chen commented on HDFS-10784: -- Thanks for the new patch, Andrew. Checkstyle is not related, +1

[jira] [Commented] (HDFS-10820) DataStreamer#Responder close fails lead the error recovery

2016-08-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15451131#comment-15451131 ] Xiao Chen commented on HDFS-10820: -- This is a trivial refactor, so no test needed. Error from checkstyle

[jira] [Commented] (HDFS-6532) Intermittent test failure org.apache.hadoop.hdfs.TestCrcCorruption.testCorruptionDuringWrt

2016-08-30 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15451120#comment-15451120 ] Xiao Chen commented on HDFS-6532: - Yep, sadly I'm not able to locally reproduce this at all, either with

[jira] [Updated] (HDFS-10489) Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones

2016-09-14 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10489: - Attachment: HDFS-10489.02.patch > Deprecate dfs.encryption.key.provider.uri for HDFS encryption zones >

<    3   4   5   6   7   8   9   10   11   12   >