[jira] [Commented] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-02-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359238#comment-16359238 ] Xiao Chen commented on HDFS-13040: -- Side note: I never really understand the {{JDK perfor

[jira] [Comment Edited] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-02-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359236#comment-16359236 ] Xiao Chen edited comment on HDFS-13040 at 2/10/18 4:09 AM: --- Hi [

[jira] [Commented] (HDFS-13112) Token expiration edits may cause log corruption or deadlock

2018-02-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16359271#comment-16359271 ] Xiao Chen commented on HDFS-13112: -- Thanks for the fix Daryn and Kihwal. I have not revie

[jira] [Updated] (HDFS-13135) Lease not deleted when deleting INodeReference

2018-02-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13135: - Status: Patch Available (was: Open) > Lease not deleted when deleting INodeReference > --

[jira] [Updated] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-02-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13040: - Attachment: HDFS-13040.half.test.patch > Kerberized inotify client fails despite kinit properly >

[jira] [Commented] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-02-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16361857#comment-16361857 ] Xiao Chen commented on HDFS-13040: -- Worked on the test based on [~pifta]'s original. I

[jira] [Commented] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

2018-02-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16361903#comment-16361903 ] Xiao Chen commented on HDFS-11187: -- Thanks [~gabor.bota] for revving and [~jojochuang] fo

[jira] [Commented] (HDFS-13135) Lease not deleted when deleting INodeReference

2018-02-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16361913#comment-16361913 ] Xiao Chen commented on HDFS-13135: -- Thanks for reporting this and providing a patch Sean!

[jira] [Comment Edited] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-02-13 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16361857#comment-16361857 ] Xiao Chen edited comment on HDFS-13040 at 2/13/18 11:06 PM: Wo

[jira] [Updated] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-02-13 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13040: - Attachment: HDFS-13040.03.patch > Kerberized inotify client fails despite kinit properly > ---

[jira] [Commented] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-02-13 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16363516#comment-16363516 ] Xiao Chen commented on HDFS-13040: -- Patch 3 ready for review. Cleaned up Istvan's test ca

[jira] [Commented] (HDFS-13112) Token expiration edits may cause log corruption or deadlock

2018-02-15 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16366261#comment-16366261 ] Xiao Chen commented on HDFS-13112: -- Thanks for the comments Daryn. Given this really is j

[jira] [Commented] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

2018-02-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16367606#comment-16367606 ] Xiao Chen commented on HDFS-11187: -- Thanks for revving [~gabor.bota]. Looks like pre-comm

[jira] [Updated] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-02-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13040: - Attachment: HDFS-13040.04.patch > Kerberized inotify client fails despite kinit properly > ---

[jira] [Comment Edited] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-02-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16367694#comment-16367694 ] Xiao Chen edited comment on HDFS-13040 at 2/16/18 6:25 PM: --- Than

[jira] [Commented] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-02-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16367694#comment-16367694 ] Xiao Chen commented on HDFS-13040: -- Thanks Daryn for the comments. It's helpful and ... r

[jira] [Commented] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-02-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16367695#comment-16367695 ] Xiao Chen commented on HDFS-13040: -- ... for some reason Jira doesn't let me reference to

[jira] [Comment Edited] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-02-16 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16367694#comment-16367694 ] Xiao Chen edited comment on HDFS-13040 at 2/16/18 6:26 PM: --- Than

[jira] [Created] (HDFS-13164) File not closed if append fail with DSQuotaExceededException

2018-02-16 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-13164: Summary: File not closed if append fail with DSQuotaExceededException Key: HDFS-13164 URL: https://issues.apache.org/jira/browse/HDFS-13164 Project: Hadoop HDFS Iss

[jira] [Updated] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

2018-02-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11187: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.4 2.9.1

[jira] [Updated] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-02-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13040: - Attachment: HDFS-13040.05.patch > Kerberized inotify client fails despite kinit properly > ---

[jira] [Commented] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-02-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16370999#comment-16370999 ] Xiao Chen commented on HDFS-13040: -- Thanks for the review Daryn. Patch 5 attached to add

[jira] [Commented] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

2018-02-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16371050#comment-16371050 ] Xiao Chen commented on HDFS-11187: -- Failed tests look unrelated. checkstyle and whitespac

[jira] [Updated] (HDFS-11187) Optimize disk access for last partial chunk checksum of Finalized replica

2018-02-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11187: - Resolution: Fixed Fix Version/s: 2.7.6 Status: Resolved (was: Patch Available) Pushed t

[jira] [Commented] (HDFS-13164) File not closed if append fail with DSQuotaExceededException

2018-02-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16372114#comment-16372114 ] Xiao Chen commented on HDFS-13164: -- The 0-sized file should be fine, as long as we make s

[jira] [Comment Edited] (HDFS-13164) File not closed if append fail with DSQuotaExceededException

2018-02-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16372114#comment-16372114 ] Xiao Chen edited comment on HDFS-13164 at 2/21/18 10:22 PM: Th

[jira] [Created] (HDFS-13177) Investigate and fix DFSStripedOutputStream handling of DSQuotaExceededException

2018-02-21 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-13177: Summary: Investigate and fix DFSStripedOutputStream handling of DSQuotaExceededException Key: HDFS-13177 URL: https://issues.apache.org/jira/browse/HDFS-13177 Project: Hadoop

[jira] [Updated] (HDFS-13164) File not closed if append fail with DSQuotaExceededException

2018-02-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13164: - Target Version/s: 2.8.4, 2.7.6, 3.0.2 (was: 2.8.4, 3.0.2) > File not closed if append fail with DSQuotaEx

[jira] [Updated] (HDFS-13164) File not closed if append fail with DSQuotaExceededException

2018-02-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13164: - Attachment: HDFS-13164.01.patch > File not closed if append fail with DSQuotaExceededException > -

[jira] [Updated] (HDFS-13164) File not closed if append fail with DSQuotaExceededException

2018-02-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13164: - Status: Patch Available (was: Open) > File not closed if append fail with DSQuotaExceededException >

[jira] [Commented] (HDFS-13164) File not closed if append fail with DSQuotaExceededException

2018-02-21 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16372246#comment-16372246 ] Xiao Chen commented on HDFS-13164: -- Attached a patch that fixes this, with some unit test

[jira] [Commented] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-02-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16373627#comment-16373627 ] Xiao Chen commented on HDFS-13040: -- Verified patch 5 works in Istvan's cluster too. [~dar

[jira] [Updated] (HDFS-13164) File not closed if append fail with DSQuotaExceededException

2018-02-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13164: - Attachment: HDFS-13164.02.patch > File not closed if append fail with DSQuotaExceededException > -

[jira] [Commented] (HDFS-13164) File not closed if append fail with DSQuotaExceededException

2018-02-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16373944#comment-16373944 ] Xiao Chen commented on HDFS-13164: -- Thanks [~yzhangal] for the review. [^HDFS-13164.02.p

[jira] [Updated] (HDFS-13164) File not closed if append fail with DSQuotaExceededException

2018-02-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13164: - Attachment: (was: HDFS-13164.02.patch) > File not closed if append fail with DSQuotaExceededException

[jira] [Updated] (HDFS-13164) File not closed if append fail with DSQuotaExceededException

2018-02-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13164: - Attachment: HDFS-13164.02.patch > File not closed if append fail with DSQuotaExceededException > -

[jira] [Updated] (HDFS-13164) File not closed if append fail with DSQuotaExceededException

2018-02-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13164: - Target Version/s: 2.8.4, 3.0.2 (was: 2.8.4, 2.7.6, 3.0.2) > File not closed if append fail with DSQuotaEx

[jira] [Updated] (HDFS-13164) File not closed if append fail with DSQuotaExceededException

2018-02-22 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13164: - Affects Version/s: (was: 2.6.5) 2.8.0 > File not closed if append fail with DSQ

[jira] [Commented] (HDFS-13164) File not closed if append fail with DSQuotaExceededException

2018-02-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374929#comment-16374929 ] Xiao Chen commented on HDFS-13164: -- Failed tests does not look related. Ran them all twic

[jira] [Updated] (HDFS-13164) File not closed if streamer fail with DSQuotaExceededException

2018-02-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13164: - Summary: File not closed if streamer fail with DSQuotaExceededException (was: File not closed if append f

[jira] [Updated] (HDFS-13164) File not closed if streamer fail with DSQuotaExceededException

2018-02-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13164: - Fix Version/s: 2.8.4 3.0.1 2.9.1 2.10.0

[jira] [Updated] (HDFS-13164) File not closed if streamer fail with DSQuotaExceededException

2018-02-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13164: - Affects Version/s: (was: 2.8.0) > File not closed if streamer fail with DSQuotaExceededException > ---

[jira] [Updated] (HDFS-13164) File not closed if streamer fail with DSQuotaExceededException

2018-02-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13164: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committe

[jira] [Updated] (HDFS-13170) Port webhdfs unmaskedpermission parameter to HTTPFS

2018-02-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13170: - Affects Version/s: (was: 3.2.0) 3.0.0-alpha2 > Port webhdfs unmaskedpermission

[jira] [Commented] (HDFS-13170) Port webhdfs unmaskedpermission parameter to HTTPFS

2018-02-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16375384#comment-16375384 ] Xiao Chen commented on HDFS-13170: -- Hi [~sodonnell], thanks for reporting the issue and p

[jira] [Commented] (HDFS-13164) File not closed if streamer fail with DSQuotaExceededException

2018-02-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16377588#comment-16377588 ] Xiao Chen commented on HDFS-13164: -- Thanks for the revert and sorry for the breakage. IIR

[jira] [Commented] (HDFS-13087) Fix: Snapshots On encryption zones get incorrect EZ settings when encryption zone changes

2018-02-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16378120#comment-16378120 ] Xiao Chen commented on HDFS-13087: -- Thanks for the ping, sorry I was in various things an

[jira] [Updated] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-03-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13040: - Attachment: HDFS-13040.06.patch > Kerberized inotify client fails despite kinit properly > ---

[jira] [Commented] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-03-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16383934#comment-16383934 ] Xiao Chen commented on HDFS-13040: -- Thanks for checking [~jojochuang]. I rerun this and i

[jira] [Updated] (HDFS-13164) File not closed if streamer fail with DSQuotaExceededException

2018-03-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13164: - Attachment: HDFS-13164.branch-2.8.01.patch > File not closed if streamer fail with DSQuotaExceededExceptio

[jira] [Commented] (HDFS-13164) File not closed if streamer fail with DSQuotaExceededException

2018-03-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16384075#comment-16384075 ] Xiao Chen commented on HDFS-13164: -- Fixed the import, will commit once jenkins comes back

[jira] [Reopened] (HDFS-13164) File not closed if streamer fail with DSQuotaExceededException

2018-03-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reopened HDFS-13164: -- > File not closed if streamer fail with DSQuotaExceededException > -

[jira] [Updated] (HDFS-13164) File not closed if streamer fail with DSQuotaExceededException

2018-03-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13164: - Status: Patch Available (was: Reopened) > File not closed if streamer fail with DSQuotaExceededException

[jira] [Updated] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-03-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13040: - Attachment: HDFS-13040.07.patch > Kerberized inotify client fails despite kinit properly > ---

[jira] [Commented] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-03-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16384185#comment-16384185 ] Xiao Chen commented on HDFS-13040: -- Thanks for the review Wei-Chiu. Patch 7 addressed 1-

[jira] [Comment Edited] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-03-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16384185#comment-16384185 ] Xiao Chen edited comment on HDFS-13040 at 3/2/18 9:36 PM: -- Thanks

[jira] [Commented] (HDFS-13164) File not closed if streamer fail with DSQuotaExceededException

2018-03-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16384192#comment-16384192 ] Xiao Chen commented on HDFS-13164: -- Created HADOOP-15283. > File not closed if streamer

[jira] [Commented] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-03-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16384375#comment-16384375 ] Xiao Chen commented on HDFS-13040: -- Failed tests look unrelated (mostly oom), committing

[jira] [Updated] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-03-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13040: - Attachment: HDFS-13040.branch-2.01.patch > Kerberized inotify client fails despite kinit properly > --

[jira] [Commented] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-03-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16384380#comment-16384380 ] Xiao Chen commented on HDFS-13040: -- Committed to trunk, branch-3.1 and branch-3.0. Branch

[jira] [Updated] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-03-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13040: - Fix Version/s: 3.0.2 3.1.0 > Kerberized inotify client fails despite kinit properly > -

[jira] [Updated] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-03-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13040: - Attachment: (was: HDFS-13040.branch-2.01.patch) > Kerberized inotify client fails despite kinit proper

[jira] [Updated] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-03-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13040: - Attachment: HDFS-13040.branch-2.01.patch > Kerberized inotify client fails despite kinit properly > --

[jira] [Commented] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-03-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16384391#comment-16384391 ] Xiao Chen commented on HDFS-13040: -- Besides the backport conflict and the java 7/8 confli

[jira] [Commented] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-03-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16386425#comment-16386425 ] Xiao Chen commented on HDFS-13040: -- I have triggered a few pre-commits but none can compl

[jira] [Updated] (HDFS-13040) Kerberized inotify client fails despite kinit properly

2018-03-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13040: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.10.0 Status: Resolved (wa

[jira] [Commented] (HDFS-13164) File not closed if streamer fail with DSQuotaExceededException

2018-03-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16386739#comment-16386739 ] Xiao Chen commented on HDFS-13164: -- Test failures look unrelated to patch. Had an cdh tes

[jira] [Commented] (HDFS-13164) File not closed if streamer fail with DSQuotaExceededException

2018-03-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16386742#comment-16386742 ] Xiao Chen commented on HDFS-13164: -- Committed to branch-2.8. Thanks all. > File not clos

[jira] [Updated] (HDFS-13164) File not closed if streamer fail with DSQuotaExceededException

2018-03-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13164: - Resolution: Fixed Fix Version/s: 2.8.4 Status: Resolved (was: Patch Available) > File n

[jira] [Commented] (HDFS-13170) Port webhdfs unmaskedpermission parameter to HTTPFS

2018-03-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16386887#comment-16386887 ] Xiao Chen commented on HDFS-13170: -- bq. checkstyle ... Sorry I missed the fact that this

[jira] [Commented] (HDFS-13170) Port webhdfs unmaskedpermission parameter to HTTPFS

2018-03-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387299#comment-16387299 ] Xiao Chen commented on HDFS-13170: -- Hi [~sodonnell], Thanks for the new patch. I'm doing

[jira] [Commented] (HDFS-13170) Port webhdfs unmaskedpermission parameter to HTTPFS

2018-03-06 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16388197#comment-16388197 ] Xiao Chen commented on HDFS-13170: -- Thanks Stephen for revving! the new javadoc thing is

[jira] [Updated] (HDFS-13170) Port webhdfs unmaskedpermission parameter to HTTPFS

2018-03-06 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-13170: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.2 3.1.0

[jira] [Commented] (HDFS-12614) FSPermissionChecker#getINodeAttrs() throws NPE when INodeAttributesProvider configured

2018-03-08 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16391850#comment-16391850 ] Xiao Chen commented on HDFS-12614: -- +1 based on diff. Thanks Kihwal! > FSPermissionCheck

[jira] [Commented] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-08 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392142#comment-16392142 ] Xiao Chen commented on HDFS-13239: -- Thanks [~hanishakoneru] for reporting the issue and [

[jira] [Commented] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-08 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392355#comment-16392355 ] Xiao Chen commented on HDFS-13239: -- If you look into the code, null is handled at: {code:

[jira] [Commented] (HDFS-13239) Fix non-empty dir warning message when setting default EC policy

2018-03-08 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392472#comment-16392472 ] Xiao Chen commented on HDFS-13239: -- As the property name suggests, that is an NN configur

[jira] [Commented] (HDFS-13087) Fix: Snapshots On encryption zones get incorrect EZ settings when encryption zone changes

2018-03-08 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16392481#comment-16392481 ] Xiao Chen commented on HDFS-13087: -- Thanks for creating the jira and fixing it, [~GeLiXin

[jira] [Assigned] (HDFS-13177) Investigate and fix DFSStripedOutputStream handling of DSQuotaExceededException

2019-06-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reassigned HDFS-13177: Assignee: (was: Xiao Chen) > Investigate and fix DFSStripedOutputStream handling of > DSQuota

[jira] [Updated] (HDFS-12300) Audit-log delegation token related operations

2017-08-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12300: - Attachment: HDFS-12300.01.patch Finally find some cycles to get this rolling. Patch 1 attached, example a

[jira] [Updated] (HDFS-12300) Audit-log delegation token related operations

2017-08-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12300: - Status: Patch Available (was: Open) > Audit-log delegation token related operations > ---

[jira] [Created] (HDFS-12363) Possible NPE in BlockManager$StorageInfoDefragmenter#scanAndCompactStorages

2017-08-27 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-12363: Summary: Possible NPE in BlockManager$StorageInfoDefragmenter#scanAndCompactStorages Key: HDFS-12363 URL: https://issues.apache.org/jira/browse/HDFS-12363 Project: Hadoop HDF

[jira] [Commented] (HDFS-12363) Possible NPE in BlockManager$StorageInfoDefragmenter#scanAndCompactStorages

2017-08-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16143387#comment-16143387 ] Xiao Chen commented on HDFS-12363: -- {{datanodeManager}} is a final member var that's init

[jira] [Updated] (HDFS-12363) Possible NPE in BlockManager$StorageInfoDefragmenter#scanAndCompactStorages

2017-08-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12363: - Status: Patch Available (was: Open) > Possible NPE in BlockManager$StorageInfoDefragmenter#scanAndCompact

[jira] [Updated] (HDFS-12363) Possible NPE in BlockManager$StorageInfoDefragmenter#scanAndCompactStorages

2017-08-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12363: - Attachment: HDFS-12363.01.patch Attaching a simple patch to fix this. Unit test looks to be very hard. Hop

[jira] [Created] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file

2017-08-28 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-12369: Summary: Edit log corruption due to hard lease recovery of not-closed file Key: HDFS-12369 URL: https://issues.apache.org/jira/browse/HDFS-12369 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file

2017-08-28 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12369: - Description: HDFS-6257 and HDFS-7707 worked hard to prevent corruption from combinations of client operat

[jira] [Commented] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file

2017-08-28 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16144529#comment-16144529 ] Xiao Chen commented on HDFS-12369: -- Attaching a unit test that sorta reproduces this - it

[jira] [Comment Edited] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file

2017-08-28 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16144529#comment-16144529 ] Xiao Chen edited comment on HDFS-12369 at 8/28/17 11:21 PM: At

[jira] [Updated] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file

2017-08-28 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12369: - Attachment: HDFS-12369.test.patch > Edit log corruption due to hard lease recovery of not-closed file > --

[jira] [Updated] (HDFS-12363) Possible NPE in BlockManager$StorageInfoDefragmenter#scanAndCompactStorages

2017-08-28 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12363: - Attachment: HDFS-12363.02.patch Thanks for the review [~liuml07] and [~jojochuang]. Initially changed the

[jira] [Updated] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file

2017-08-28 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12369: - Status: Patch Available (was: Open) > Edit log corruption due to hard lease recovery of not-closed file >

[jira] [Updated] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file

2017-08-28 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12369: - Attachment: HDFS-12369.01.patch After further looking I think the different exception is due to block stat

[jira] [Commented] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16145658#comment-16145658 ] Xiao Chen commented on HDFS-12291: -- Thanks for the ping Surendra, will take a look by Thu

[jira] [Updated] (HDFS-12117) HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST Interface

2017-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12117: - Issue Type: Improvement (was: New Feature) > HttpFS does not seem to support SNAPSHOT related methods for

[jira] [Commented] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146067#comment-16146067 ] Xiao Chen commented on HDFS-12336: -- Patch 4 LGTM, thanks [~wchevreuil]. Failed tests loo

[jira] [Updated] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file

2017-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12369: - Attachment: HDFS-12369.02.patch Chatted offline with [~yzhangal] and [~manojg]. We cannot remove the inode

[jira] [Commented] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file

2017-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146552#comment-16146552 ] Xiao Chen commented on HDFS-12369: -- Following the above, we also brainstormed about other

[jira] [Commented] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16146582#comment-16146582 ] Xiao Chen commented on HDFS-12336: -- Compared failed tests side-by-side, the only intersec

[jira] [Updated] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

2017-08-29 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12336: - Component/s: encryption > Listing encryption zones still fails when deleted EZ is not a direct child of >

<    3   4   5   6   7   8   9   10   11   12   >