[jira] [Updated] (HDFS-12248) SNN will not upload fsimage on IOE and Interrupted exceptions

[ https://issues.apache.org/jira/browse/HDFS-12248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-12248: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1

[jira] [Commented] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142630#comment-16142630 ] Anu Engineer commented on HDFS-12282: - cc: [~nandakumar131] Once delete capability is in, we should

[jira] [Commented] (HDFS-12333) Ozone: Extend Datanode web interface with SCM information

[ https://issues.apache.org/jira/browse/HDFS-12333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142629#comment-16142629 ] Anu Engineer commented on HDFS-12333: - +1, on this change. I will wait for [~msingh] to take a look.

[jira] [Commented] (HDFS-11834) Ozone: Fix TestArchive#testArchive

[ https://issues.apache.org/jira/browse/HDFS-11834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142625#comment-16142625 ] Anu Engineer commented on HDFS-11834: - The code changes look correct, but I was just wondering why we

[jira] [Assigned] (HDFS-11834) Ozone: Fix TestArchive#testArchive

[ https://issues.apache.org/jira/browse/HDFS-11834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-11834: --- Assignee: Xiaoyu Yao (was: Anu Engineer) > Ozone: Fix TestArchive#testArchive >

[jira] [Commented] (HDFS-12282) Ozone: DeleteKey-4: Block delete via HB between SCM and DN

[ https://issues.apache.org/jira/browse/HDFS-12282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142623#comment-16142623 ] Anu Engineer commented on HDFS-12282: - [~cheersyang] Thank you for taking care of all the comments. I

[jira] [Comment Edited] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142620#comment-16142620 ] Xiao Chen edited comment on HDFS-12336 at 8/26/17 5:12 AM: --- Thanks for the new

[jira] [Comment Edited] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142620#comment-16142620 ] Xiao Chen edited comment on HDFS-12336 at 8/26/17 5:12 AM: --- Thanks for the new

[jira] [Commented] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142620#comment-16142620 ] Xiao Chen commented on HDFS-12336: -- Thanks for the new patch Wellington, looks pretty good to me. I think

[jira] [Updated] (HDFS-12359) Re-encryption should operate with minimum KMS ACL requirements.

[ https://issues.apache.org/jira/browse/HDFS-12359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12359: - Attachment: HDFS-12359.01.patch Attach a patch for the fix: - can (and should) simply drain the client

[jira] [Updated] (HDFS-12359) Re-encryption should operate with minimum KMS ACL requirements.

[ https://issues.apache.org/jira/browse/HDFS-12359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12359: - Status: Patch Available (was: Open) > Re-encryption should operate with minimum KMS ACL requirements. >

[jira] [Commented] (HDFS-12358) Catch IOException when transferring edit log to Journal current dir through JN sync

[ https://issues.apache.org/jira/browse/HDFS-12358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142614#comment-16142614 ] Hadoop QA commented on HDFS-12358: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done

[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142610#comment-16142610 ] Yongjun Zhang commented on HDFS-12191: -- Thanks much for the review [~manojg]. Uploaded rev004 to

[jira] [Updated] (HDFS-12191) Provide option to not capture the accessTime change of a file to snapshot if no other modification has been done

[ https://issues.apache.org/jira/browse/HDFS-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12191: - Attachment: HDFS-12191.004.patch > Provide option to not capture the accessTime change of a file

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142582#comment-16142582 ] Hadoop QA commented on HDFS-7878: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12358) Catch IOException when transferring edit log to Journal current dir through JN sync

[ https://issues.apache.org/jira/browse/HDFS-12358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142568#comment-16142568 ] Hadoop QA commented on HDFS-12358: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12358) Catch IOException when transferring edit log to Journal current dir through JN sync

[ https://issues.apache.org/jira/browse/HDFS-12358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142563#comment-16142563 ] Arpit Agarwal commented on HDFS-12358: -- Triggered another Jenkins run. The failures are likely

[jira] [Commented] (HDFS-12356) Unit test for JN sync during Rolling Upgrade

[ https://issues.apache.org/jira/browse/HDFS-12356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142553#comment-16142553 ] Hadoop QA commented on HDFS-12356: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142532#comment-16142532 ] Hadoop QA commented on HDFS-11912: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12299) Race Between update pipeline and DN Re-Registration

[ https://issues.apache.org/jira/browse/HDFS-12299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142523#comment-16142523 ] Brahma Reddy Battula commented on HDFS-12299: - [~kihwal] thanks for review and commit. > Race

[jira] [Commented] (HDFS-12319) DirectoryScanner will throw IllegalStateException when Multiple BP's are present

[ https://issues.apache.org/jira/browse/HDFS-12319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142521#comment-16142521 ] Brahma Reddy Battula commented on HDFS-12319: - [~arpitagarwal] thanks for review and commit.

[jira] [Commented] (HDFS-11986) Dfsadmin should report erasure coding related information separately

[ https://issues.apache.org/jira/browse/HDFS-11986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142519#comment-16142519 ] Hudson commented on HDFS-11986: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12248 (See

[jira] [Commented] (HDFS-12358) Catch IOException when transferring edit log to Journal current dir through JN sync

[ https://issues.apache.org/jira/browse/HDFS-12358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142513#comment-16142513 ] Hadoop QA commented on HDFS-12358: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142509#comment-16142509 ] Manoj Govindassamy commented on HDFS-11912: --- LGTM. +1 pending jenkins. Thanks [~ghuangups]. >

[jira] [Commented] (HDFS-11986) Dfsadmin should report erasure coding related information separately

[ https://issues.apache.org/jira/browse/HDFS-11986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142503#comment-16142503 ] Hadoop QA commented on HDFS-11986: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11986) Dfsadmin should report erasure coding related information separately

[ https://issues.apache.org/jira/browse/HDFS-11986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11986: -- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was:

[jira] [Commented] (HDFS-11986) Dfsadmin should report erasure coding related information separately

[ https://issues.apache.org/jira/browse/HDFS-11986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142488#comment-16142488 ] Manoj Govindassamy commented on HDFS-11986: --- Thanks for the review [~eddyxu]. Committed to

[jira] [Commented] (HDFS-12356) Unit test for JN sync during Rolling Upgrade

[ https://issues.apache.org/jira/browse/HDFS-12356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142486#comment-16142486 ] Hadoop QA commented on HDFS-12356: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11986) Dfsadmin should report erasure coding related information separately

[ https://issues.apache.org/jira/browse/HDFS-11986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142484#comment-16142484 ] Manoj Govindassamy commented on HDFS-11986: --- Test failures are not related to the patch. Except

[jira] [Created] (HDFS-12359) Re-encryption should operate with minimum KMS ACL requirements.

Xiao Chen created HDFS-12359: Summary: Re-encryption should operate with minimum KMS ACL requirements. Key: HDFS-12359 URL: https://issues.apache.org/jira/browse/HDFS-12359 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12215) DataNode#transferBlock does not create its daemon in the xceiver thread group

[ https://issues.apache.org/jira/browse/HDFS-12215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142456#comment-16142456 ] Hudson commented on HDFS-12215: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12247 (See

[jira] [Commented] (HDFS-12358) Catch IOException when transferring edit log to Journal current dir through JN sync

[ https://issues.apache.org/jira/browse/HDFS-12358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142447#comment-16142447 ] Arpit Agarwal commented on HDFS-12358: -- +1 for the v3 patch, pending Jenkins. > Catch IOException

[jira] [Updated] (HDFS-7878) API - expose an unique file identifier

[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-7878: Attachment: HDFS-7878.08.patch > API - expose an unique file identifier >

[jira] [Updated] (HDFS-12332) Logging improvement suggestion for SampleStat function MinMax.add

[ https://issues.apache.org/jira/browse/HDFS-12332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12332: --- Target Version/s: 3.0.0-beta1 (was: 3.0.0-alpha4) > Logging improvement suggestion for SampleStat

[jira] [Updated] (HDFS-12358) Catch IOException when transferring edit log to Journal current dir through JN sync

[ https://issues.apache.org/jira/browse/HDFS-12358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-12358: -- Attachment: HDFS-12358.003.patch Thanks for the catch Arpit. Fixed it in patch v03. > Catch

[jira] [Commented] (HDFS-12358) Catch IOException when transferring edit log to Journal current dir through JN sync

[ https://issues.apache.org/jira/browse/HDFS-12358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142436#comment-16142436 ] Arpit Agarwal commented on HDFS-12358: -- One more comment, sorry I missed it last time. The delete

[jira] [Commented] (HDFS-7337) Configurable and pluggable Erasure Codec and schema

[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142418#comment-16142418 ] Andrew Wang commented on HDFS-7337: --- Hey folks, are we on track for completing this by beta1 in ~three

[jira] [Commented] (HDFS-12356) Unit test for JN sync during Rolling Upgrade

[ https://issues.apache.org/jira/browse/HDFS-12356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142416#comment-16142416 ] Arpit Agarwal commented on HDFS-12356: -- +1 for the v2 patch, pending Jenkins. > Unit test for JN

[jira] [Updated] (HDFS-12358) Catch IOException when transferring edit log to Journal current dir through JN sync

[ https://issues.apache.org/jira/browse/HDFS-12358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-12358: -- Attachment: HDFS-12358.002.patch Thanks for the review [~arpitagarwal]. Addressed your

[jira] [Updated] (HDFS-12356) Unit test for JN sync during Rolling Upgrade

[ https://issues.apache.org/jira/browse/HDFS-12356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-12356: -- Attachment: HDFS-12356.002.patch Thanks for the review [~arpitagarwal]. Posted patch v02 with

[jira] [Commented] (HDFS-11986) Dfsadmin should report erasure coding related information separately

[ https://issues.apache.org/jira/browse/HDFS-11986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142404#comment-16142404 ] Hadoop QA commented on HDFS-11986: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142397#comment-16142397 ] George Huang commented on HDFS-11912: - Thanks Manoj for the review. Change was made and patch

[jira] [Updated] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Huang updated HDFS-11912: Attachment: HDFS-11912.007.patch > Add a snapshot unit test with randomized file IO operations >

[jira] [Updated] (HDFS-12215) DataNode#transferBlock does not create its daemon in the xceiver thread group

[ https://issues.apache.org/jira/browse/HDFS-12215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12215: - Fix Version/s: 2.9.0 > DataNode#transferBlock does not create its daemon in the xceiver thread

[jira] [Updated] (HDFS-12215) DataNode#transferBlock does not create its daemon in the xceiver thread group

[ https://issues.apache.org/jira/browse/HDFS-12215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12215: - Resolution: Fixed Fix Version/s: 3.0.0-beta1 Target Version/s: 2.9.0, 3.0.0-beta1

[jira] [Updated] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Huang updated HDFS-11912: Attachment: (was: HDFS-11912.007.patch) > Add a snapshot unit test with randomized file IO

[jira] [Updated] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Huang updated HDFS-11912: Attachment: HDFS-11912.007.patch > Add a snapshot unit test with randomized file IO operations >

[jira] [Updated] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Huang updated HDFS-11912: Attachment: (was: HDFS-11912.007.patch) > Add a snapshot unit test with randomized file IO

[jira] [Updated] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] George Huang updated HDFS-11912: Attachment: HDFS-11912.007.patch > Add a snapshot unit test with randomized file IO operations >

[jira] [Commented] (HDFS-12358) Catch IOException when transferring edit log to Journal current dir through JN sync

[ https://issues.apache.org/jira/browse/HDFS-12358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142373#comment-16142373 ] Arpit Agarwal commented on HDFS-12358: -- Thanks for this improvement [~hanishakoneru]. Minor comments:

[jira] [Updated] (HDFS-12358) Catch IOException when transferring edit log to Journal current dir through JN sync

[ https://issues.apache.org/jira/browse/HDFS-12358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-12358: -- Status: Patch Available (was: Open) > Catch IOException when transferring edit log to Journal

[jira] [Updated] (HDFS-12358) Catch IOException when transferring edit log to Journal current dir through JN sync

[ https://issues.apache.org/jira/browse/HDFS-12358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-12358: -- Attachment: HDFS-12358.001.patch > Catch IOException when transferring edit log to Journal

[jira] [Commented] (HDFS-12356) Unit test for JN sync during Rolling Upgrade

[ https://issues.apache.org/jira/browse/HDFS-12356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142363#comment-16142363 ] Arpit Agarwal commented on HDFS-12356: -- +1 pending Jenkins. Thanks [~hanishakoneru]. > Unit test

[jira] [Commented] (HDFS-12215) DataNode#transferBlock does not create its daemon in the xceiver thread group

[ https://issues.apache.org/jira/browse/HDFS-12215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142356#comment-16142356 ] Hadoop QA commented on HDFS-12215: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12358) Catch IOException when transferring edit log to Journal current dir through JN sync

[ https://issues.apache.org/jira/browse/HDFS-12358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-12358: -- Description: During JN sync, a missing edit log is first downloaded from a remote JN to a tmp

[jira] [Created] (HDFS-12358) Catch IOException when transferring edit log to Journal current dir through JN sync

Hanisha Koneru created HDFS-12358: - Summary: Catch IOException when transferring edit log to Journal current dir through JN sync Key: HDFS-12358 URL: https://issues.apache.org/jira/browse/HDFS-12358

[jira] [Updated] (HDFS-12356) Unit test for JN sync during Rolling Upgrade

[ https://issues.apache.org/jira/browse/HDFS-12356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-12356: -- Attachment: HDFS-12356.001.patch > Unit test for JN sync during Rolling Upgrade >

[jira] [Updated] (HDFS-12356) Unit test for JN sync during Rolling Upgrade

[ https://issues.apache.org/jira/browse/HDFS-12356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-12356: -- Status: Patch Available (was: Open) > Unit test for JN sync during Rolling Upgrade >

[jira] [Updated] (HDFS-12350) Support meta tags in configs

[ https://issues.apache.org/jira/browse/HDFS-12350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12350: -- Description: We should add meta tag extension to the hadoop/hdfs config so that we can retrieve

[jira] [Commented] (HDFS-12303) Change default EC cell size to 1MB for better performance

[ https://issues.apache.org/jira/browse/HDFS-12303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142284#comment-16142284 ] Hudson commented on HDFS-12303: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12246 (See

[jira] [Commented] (HDFS-11834) Ozone: Fix TestArchive#testArchive

[ https://issues.apache.org/jira/browse/HDFS-11834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142262#comment-16142262 ] Hadoop QA commented on HDFS-11834: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Resolved] (HDFS-10825) Snapshot read can reveal future bytes if snapshotted while writing

[ https://issues.apache.org/jira/browse/HDFS-10825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy resolved HDFS-10825. --- Resolution: Duplicate Fix Version/s: 3.0.0-beta1 2.9.0

[jira] [Commented] (HDFS-11986) Dfsadmin should report erasure coding related information separately

[ https://issues.apache.org/jira/browse/HDFS-11986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142259#comment-16142259 ] Lei (Eddy) Xu commented on HDFS-11986: -- LGTM. +1 pending Jenkins. Thanks Manoj. > Dfsadmin should

[jira] [Work started] (HDFS-10825) Snapshot read can reveal future bytes if snapshotted while writing

[ https://issues.apache.org/jira/browse/HDFS-10825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10825 started by Manoj Govindassamy. - > Snapshot read can reveal future bytes if snapshotted while writing >

[jira] [Commented] (HDFS-12349) Improve log message when it could not alloc enough blocks for EC

[ https://issues.apache.org/jira/browse/HDFS-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142243#comment-16142243 ] Lei (Eddy) Xu commented on HDFS-12349: -- Many of the failures are due to error message change.

[jira] [Commented] (HDFS-11885) createEncryptionZone should not block on initializing EDEK cache

[ https://issues.apache.org/jira/browse/HDFS-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142232#comment-16142232 ] Rushabh S Shah commented on HDFS-11885: --- bq. Rushabh, we'd still appreciate your patch if you have

[jira] [Updated] (HDFS-11885) createEncryptionZone should not block on initializing EDEK cache

[ https://issues.apache.org/jira/browse/HDFS-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11885: --- Priority: Major (was: Critical) I'm dropping this one in priority. Rushabh, we'd still appreciate

[jira] [Updated] (HDFS-11986) Dfsadmin should report erasure coding related information separately

[ https://issues.apache.org/jira/browse/HDFS-11986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11986: -- Attachment: HDFS-11986.02.patch Attaching patch version 02 with latest trunk rebase.

[jira] [Updated] (HDFS-12303) Change default EC cell size to 1MB for better performance

[ https://issues.apache.org/jira/browse/HDFS-12303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12303: --- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-12303) Change default EC cell size to 1MB for better performance

[ https://issues.apache.org/jira/browse/HDFS-12303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142212#comment-16142212 ] Andrew Wang commented on HDFS-12303: +1 LGTM, will check this in. > Change default EC cell size to

[jira] [Commented] (HDFS-12349) Improve log message when it could not alloc enough blocks for EC

[ https://issues.apache.org/jira/browse/HDFS-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142208#comment-16142208 ] Hadoop QA commented on HDFS-12349: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11834) Ozone: Fix TestArchive#testArchive

[ https://issues.apache.org/jira/browse/HDFS-11834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11834: -- Status: Patch Available (was: Open) > Ozone: Fix TestArchive#testArchive >

[jira] [Updated] (HDFS-11834) Ozone: Fix TestArchive#testArchive

[ https://issues.apache.org/jira/browse/HDFS-11834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11834: -- Attachment: HDFS-11834-HDFS-7240.001.patch Attach a patch that fix the test under Linux. > Ozone: Fix

[jira] [Commented] (HDFS-12215) DataNode#transferBlock does not create its daemon in the xceiver thread group

[ https://issues.apache.org/jira/browse/HDFS-12215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142197#comment-16142197 ] Andrew Wang commented on HDFS-12215: +1 LGTM pending Jenkins, thanks Eddy! > DataNode#transferBlock

[jira] [Updated] (HDFS-11220) SnapshotDiffReport should detect open files in HDFS Snapshots

[ https://issues.apache.org/jira/browse/HDFS-11220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11220: -- Fix Version/s: 2.9.0 > SnapshotDiffReport should detect open files in HDFS Snapshots >

[jira] [Updated] (HDFS-11720) LeaseManager#getINodeWithLeases() should support skipping leases of deleted files with snapshot feature

[ https://issues.apache.org/jira/browse/HDFS-11720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11720: -- Fix Version/s: 2.9.0 > LeaseManager#getINodeWithLeases() should support skipping leases

[jira] [Updated] (HDFS-11218) Add option to skip open files during HDFS Snapshots

[ https://issues.apache.org/jira/browse/HDFS-11218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11218: -- Fix Version/s: 2.9.0 > Add option to skip open files during HDFS Snapshots >

[jira] [Updated] (HDFS-11218) Add option to skip open files during HDFS Snapshots

[ https://issues.apache.org/jira/browse/HDFS-11218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11218: -- Fix Version/s: 3.0.0-beta1 > Add option to skip open files during HDFS Snapshots >

[jira] [Resolved] (HDFS-11220) SnapshotDiffReport should detect open files in HDFS Snapshots

[ https://issues.apache.org/jira/browse/HDFS-11220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy resolved HDFS-11220. --- Resolution: Workaround Fix Version/s: 3.0.0-beta1 The core issue described in

[jira] [Resolved] (HDFS-11218) Add option to skip open files during HDFS Snapshots

[ https://issues.apache.org/jira/browse/HDFS-11218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy resolved HDFS-11218. --- Resolution: Workaround The core issue described in the jira is not a problem any

[jira] [Commented] (HDFS-12215) DataNode#transferBlock does not create its daemon in the xceiver thread group

[ https://issues.apache.org/jira/browse/HDFS-12215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142176#comment-16142176 ] Hanisha Koneru commented on HDFS-12215: --- Thanks for the fix, [~eddyxu]. The patch LGTM. +1

[jira] [Resolved] (HDFS-11720) LeaseManager#getINodeWithLeases() should support skipping leases of deleted files with snapshot feature

[ https://issues.apache.org/jira/browse/HDFS-11720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy resolved HDFS-11720. --- Resolution: Duplicate Fix Version/s: 3.0.0-beta1 HDFS-12217 solved the issue

[jira] [Updated] (HDFS-12215) DataNode#transferBlock does not create its daemon in the xceiver thread group

[ https://issues.apache.org/jira/browse/HDFS-12215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12215: - Status: Patch Available (was: Open) > DataNode#transferBlock does not create its daemon in the

[jira] [Work started] (HDFS-11720) LeaseManager#getINodeWithLeases() should support skipping leases of deleted files with snapshot feature

[ https://issues.apache.org/jira/browse/HDFS-11720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-11720 started by Manoj Govindassamy. - > LeaseManager#getINodeWithLeases() should support skipping leases of

[jira] [Updated] (HDFS-12215) DataNode#transferBlock does not create its daemon in the xceiver thread group

[ https://issues.apache.org/jira/browse/HDFS-12215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12215: - Attachment: HDFS-12215.00.patch The patch simply puts {{DataTransfer}} to {{Daemon}} as the same

[jira] [Assigned] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reassigned HDFS-12357: Assignee: Yongjun Zhang > Let NameNode to bypass external attribute provider for special

[jira] [Created] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

Yongjun Zhang created HDFS-12357: Summary: Let NameNode to bypass external attribute provider for special user Key: HDFS-12357 URL: https://issues.apache.org/jira/browse/HDFS-12357 Project: Hadoop

[jira] [Commented] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142132#comment-16142132 ] Hadoop QA commented on HDFS-12321: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10391) Always enable NameNode service RPC port

[ https://issues.apache.org/jira/browse/HDFS-10391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142129#comment-16142129 ] Hadoop QA commented on HDFS-10391: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12299) Race Between update pipeline and DN Re-Registration

[ https://issues.apache.org/jira/browse/HDFS-12299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142120#comment-16142120 ] Hudson commented on HDFS-12299: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12243 (See

[jira] [Commented] (HDFS-12136) BlockSender performance regression due to volume scanner edge case

[ https://issues.apache.org/jira/browse/HDFS-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142118#comment-16142118 ] Kihwal Lee commented on HDFS-12136: --- I think the performance impact is less severe after HDFS-12157, so

[jira] [Commented] (HDFS-12084) Scheduled Count will not decrement when file is deleted before all IBR's received

[ https://issues.apache.org/jira/browse/HDFS-12084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142110#comment-16142110 ] Kihwal Lee commented on HDFS-12084: --- I don't know if it is related, but I see reserve RBW space gets

[jira] [Updated] (HDFS-12299) Race Between update pipeline and DN Re-Registration

[ https://issues.apache.org/jira/browse/HDFS-12299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-12299: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.2 3.0.0-beta1

[jira] [Commented] (HDFS-11968) ViewFS: StoragePolicies commands fail with HDFS federation

[ https://issues.apache.org/jira/browse/HDFS-11968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142102#comment-16142102 ] Arpit Agarwal commented on HDFS-11968: -- Thanks for reporting this issue [~msingh]. A few comments: #

[jira] [Created] (HDFS-12356) Unit test for JN sync during Rolling Upgrade

Hanisha Koneru created HDFS-12356: - Summary: Unit test for JN sync during Rolling Upgrade Key: HDFS-12356 URL: https://issues.apache.org/jira/browse/HDFS-12356 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-12299) Race Between update pipeline and DN Re-Registration

[ https://issues.apache.org/jira/browse/HDFS-12299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142051#comment-16142051 ] Kihwal Lee commented on HDFS-12299: --- +1 LGTM > Race Between update pipeline and DN Re-Registration >

[jira] [Commented] (HDFS-12352) [branch-2] Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

[ https://issues.apache.org/jira/browse/HDFS-12352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16142013#comment-16142013 ] Arpit Agarwal commented on HDFS-12352: -- [~linyiqun] can you please commit this patch if you are +1?

[jira] [Updated] (HDFS-12321) Ozone : debug cli: add support to load user-provided SQL query

[ https://issues.apache.org/jira/browse/HDFS-12321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12321: -- Attachment: HDFS-12321-HDFS-7240.010.patch Fix checkstyle and findbugs in v010 patch > Ozone : debug

[jira] [Commented] (HDFS-7764) DirectoryScanner shouldn't abort the scan if one directory had an error

[ https://issues.apache.org/jira/browse/HDFS-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141983#comment-16141983 ] Arpit Agarwal commented on HDFS-7764: - Cherry-picked to branch-2.8. > DirectoryScanner shouldn't abort

[jira] [Commented] (HDFS-12336) Listing encryption zones still fails when deleted EZ is not a direct child of snapshottable directory

[ https://issues.apache.org/jira/browse/HDFS-12336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141981#comment-16141981 ] Hadoop QA commented on HDFS-12336: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >