[jira] [Commented] (HDFS-11923) Stress test of DFSNetworkTopology

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035752#comment-16035752 ] Hadoop QA commented on HDFS-11923: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11880) Ozone: KSM: Remove protobuf formats such as StorageTypeProto and OzoneAclInfo from KSM wrappers

2017-06-02 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035705#comment-16035705 ] Nandakumar commented on HDFS-11880: --- The following classes are moved from

[jira] [Updated] (HDFS-11880) Ozone: KSM: Remove protobuf formats such as StorageTypeProto and OzoneAclInfo from KSM wrappers

2017-06-02 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-11880: -- Attachment: HDFS-11880-HDFS-7240.000.patch > Ozone: KSM: Remove protobuf formats such as

[jira] [Updated] (HDFS-11771) Ozone: KSM: Add checkVolumeAccess

2017-06-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11771: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target

[jira] [Commented] (HDFS-11920) Ozone : add key partition

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035675#comment-16035675 ] Hadoop QA commented on HDFS-11920: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-06-02 Thread George Huang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035663#comment-16035663 ] George Huang commented on HDFS-11912: - 10. /** Delete an existing test directory */ private void

[jira] [Commented] (HDFS-11742) Improve balancer usability after HDFS-8818

2017-06-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035658#comment-16035658 ] Vinod Kumar Vavilapalli commented on HDFS-11742: bq. If 2.8.1 is put up for vote with

[jira] [Commented] (HDFS-11743) Revert HDFS-7933 from branch-2.7 (fsck reporting decommissioning replicas)

2017-06-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035648#comment-16035648 ] Vinod Kumar Vavilapalli commented on HDFS-11743: [~zhz], I'm pushing for a 2.7.4, can you

[jira] [Commented] (HDFS-11771) Ozone: KSM: Add checkVolumeAccess

2017-06-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035639#comment-16035639 ] Anu Engineer commented on HDFS-11771: - +1, I will commit this shortly. > Ozone: KSM: Add

[jira] [Commented] (HDFS-11708) Positional read will fail if replicas moved to different DNs after stream is opened

2017-06-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035632#comment-16035632 ] Konstantin Shvachko commented on HDFS-11708: Latest patch HDFS-11708-07.patch is not applying

[jira] [Commented] (HDFS-11921) Ozone: KSM: Unable to put keys with zero length

2017-06-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035630#comment-16035630 ] Anu Engineer commented on HDFS-11921: - The fix for HDFS-11796 could have fixed this issue. We added a

[jira] [Updated] (HDFS-11923) Stress test of DFSNetworkTopology

2017-06-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11923: -- Attachment: HDFS-11923.002.patch fix checkstyle in v002 patch. > Stress test of DFSNetworkTopology >

[jira] [Updated] (HDFS-11796) Ozone: MiniOzoneCluster should set "ozone.handler.type" key correctly

2017-06-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11796: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target

[jira] [Commented] (HDFS-11898) DFSClient#isHedgedReadsEnabled() should be per client flag

2017-06-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035615#comment-16035615 ] Konstantin Shvachko commented on HDFS-11898: I don't think new variable {{hedgedReadEnabled}}

[jira] [Commented] (HDFS-11923) Stress test of DFSNetworkTopology

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035607#comment-16035607 ] Hadoop QA commented on HDFS-11923: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11796) Ozone: MiniOzoneCluster should set "ozone.handler.type" key correctly

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035604#comment-16035604 ] Hadoop QA commented on HDFS-11796: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11777) Ozone: KSM: add deleteBucket

2017-06-02 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-11777: -- Attachment: HDFS-11777-HDFS-7240.000.patch > Ozone: KSM: add deleteBucket >

[jira] [Commented] (HDFS-11777) Ozone: KSM: add deleteBucket

2017-06-02 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035602#comment-16035602 ] Nandakumar commented on HDFS-11777: --- Initial version of patch uploaded, please review. Thanks. >

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-06-02 Thread George Huang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035598#comment-16035598 ] George Huang commented on HDFS-11912: - 9. There is only one entry in snapshottableDirectories list,

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-06-02 Thread George Huang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035593#comment-16035593 ] George Huang commented on HDFS-11912: - 8. // Get list of snapshottable directories

[jira] [Commented] (HDFS-7933) fsck should also report decommissioning replicas.

2017-06-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035587#comment-16035587 ] Konstantin Shvachko commented on HDFS-7933: --- May be we should only fix the reporting, that is

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-06-02 Thread George Huang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035580#comment-16035580 ] George Huang commented on HDFS-11912: - 7. private String GetNewPathString(String originalString,

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-06-02 Thread George Huang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035572#comment-16035572 ] George Huang commented on HDFS-11912: - 6. // Create files in a directory with random depth,

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-06-02 Thread George Huang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035547#comment-16035547 ] George Huang commented on HDFS-11912: - 4. // Set Random RANDOM = new Random(); long seed =

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-06-02 Thread George Huang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035540#comment-16035540 ] George Huang commented on HDFS-11912: - 5. int fileLen = new Random().nextInt(MAX_NUM_FILE_LENGTH);

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-06-02 Thread George Huang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035535#comment-16035535 ] George Huang commented on HDFS-11912: - 2. private static MiniDFSCluster cluster; => Fixed private

[jira] [Commented] (HDFS-11737) Backport HDFS-7964 to branch-2.7: add support for async edit logging

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035515#comment-16035515 ] Hadoop QA commented on HDFS-11737: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11796) Ozone: MiniOzoneCluster should set "ozone.handler.type" key correctly

2017-06-02 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035480#comment-16035480 ] Xiaoyu Yao commented on HDFS-11796: --- LGTM. +1 for patch v2. > Ozone: MiniOzoneCluster should set

[jira] [Updated] (HDFS-11920) Ozone : add key partition

2017-06-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11920: -- Attachment: HDFS-11920-HDFS-7240.002.patch Post v002 patch to fix findbug warning and asf license. >

[jira] [Updated] (HDFS-11923) Stress test of DFSNetworkTopology

2017-06-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11923: -- Status: Patch Available (was: Open) > Stress test of DFSNetworkTopology >

[jira] [Updated] (HDFS-11923) Stress test of DFSNetworkTopology

2017-06-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11923: -- Attachment: HDFS-11923.001.patch > Stress test of DFSNetworkTopology >

[jira] [Created] (HDFS-11923) Stress test of DFSNetworkTopology

2017-06-02 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11923: - Summary: Stress test of DFSNetworkTopology Key: HDFS-11923 URL: https://issues.apache.org/jira/browse/HDFS-11923 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-11796) Ozone: MiniOzoneCluster should set "ozone.handler.type" key correctly

2017-06-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035405#comment-16035405 ] Chen Liang commented on HDFS-11796: --- Thanks [~anu] for the updates! +1 on v002 patch. > Ozone:

[jira] [Commented] (HDFS-11472) Fix inconsistent replica size after a data pipeline failure

2017-06-02 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035397#comment-16035397 ] Erik Krogen commented on HDFS-11472: [~jojochuang] no problem! So I was actually wondering if,

[jira] [Commented] (HDFS-11472) Fix inconsistent replica size after a data pipeline failure

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035375#comment-16035375 ] Hadoop QA commented on HDFS-11472: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11920) Ozone : add key partition

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035371#comment-16035371 ] Hadoop QA commented on HDFS-11920: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11914) Add more diagnosis info for fsimage transfer failure.

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035364#comment-16035364 ] Hadoop QA commented on HDFS-11914: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-11796) Ozone: MiniOzoneCluster should set "ozone.handler.type" key correctly

2017-06-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035359#comment-16035359 ] Anu Engineer edited comment on HDFS-11796 at 6/2/17 8:25 PM: - with this new

[jira] [Commented] (HDFS-11796) Ozone: MiniOzoneCluster should set "ozone.handler.type" key correctly

2017-06-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035359#comment-16035359 ] Anu Engineer commented on HDFS-11796: - with this new patch all test pass while running this command.

[jira] [Updated] (HDFS-11796) Ozone: MiniOzoneCluster should set "ozone.handler.type" key correctly

2017-06-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11796: Attachment: HDFS-11796-HDFS-7240.002.patch This patch extends the changes that is done by [~msingh]

[jira] [Commented] (HDFS-11914) Add more diagnosis info for fsimage transfer failure.

2017-06-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035349#comment-16035349 ] Wei-Chiu Chuang commented on HDFS-11914: bq. About why using String.valueOf(), it's because I saw

[jira] [Assigned] (HDFS-11921) Ozone: KSM: Unable to put keys with zero length

2017-06-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-11921: --- Assignee: Anu Engineer > Ozone: KSM: Unable to put keys with zero length >

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-06-02 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035272#comment-16035272 ] Manoj Govindassamy commented on HDFS-11912: --- continuation of my review comments... 8.

[jira] [Created] (HDFS-11922) Ozone: KSM: Garbage collect deleted blocks

2017-06-02 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11922: --- Summary: Ozone: KSM: Garbage collect deleted blocks Key: HDFS-11922 URL: https://issues.apache.org/jira/browse/HDFS-11922 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-11472) Fix inconsistent replica size after a data pipeline failure

2017-06-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11472: --- Attachment: HDFS-11472.003.patch Rev 003. I am really sorry about that. I thought I had

[jira] [Created] (HDFS-11921) Ozone: KSM: Unable to put keys with zero length

2017-06-02 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11921: --- Summary: Ozone: KSM: Unable to put keys with zero length Key: HDFS-11921 URL: https://issues.apache.org/jira/browse/HDFS-11921 Project: Hadoop HDFS Issue

[jira] [Comment Edited] (HDFS-11920) Ozone : add key partition

2017-06-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035204#comment-16035204 ] Chen Liang edited comment on HDFS-11920 at 6/2/17 6:34 PM: --- Post initial v001

[jira] [Comment Edited] (HDFS-11920) Ozone : add key partition

2017-06-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035204#comment-16035204 ] Chen Liang edited comment on HDFS-11920 at 6/2/17 6:33 PM: --- Post initial v001

[jira] [Updated] (HDFS-11920) Ozone : add key partition

2017-06-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11920: -- Attachment: HDFS-11920-HDFS-7240.001.patch Post initial v001 patch > Ozone : add key partition >

[jira] [Updated] (HDFS-11920) Ozone : add key partition

2017-06-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11920: -- Status: Patch Available (was: Open) > Ozone : add key partition > - > >

[jira] [Created] (HDFS-11920) Ozone : add key partition

2017-06-02 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11920: - Summary: Ozone : add key partition Key: HDFS-11920 URL: https://issues.apache.org/jira/browse/HDFS-11920 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-11737) Backport HDFS-7964 to branch-2.7: add support for async edit logging

2017-06-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-11737: - Attachment: HDFS-11737-branch-2.7.00.patch > Backport HDFS-7964 to branch-2.7: add support for async edit

[jira] [Commented] (HDFS-11898) DFSClient#isHedgedReadsEnabled() should be per client flag

2017-06-02 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035200#comment-16035200 ] John Zhuge commented on HDFS-11898: --- +1 LGTM Ok to continue the static pool discussion in HDFS-11900.

[jira] [Updated] (HDFS-11737) Backport HDFS-7964 to branch-2.7: add support for async edit logging

2017-06-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-11737: - Status: Patch Available (was: Open) > Backport HDFS-7964 to branch-2.7: add support for async edit

[jira] [Created] (HDFS-11919) Ozone: SCM: TestNodeManager takes too long to execute

2017-06-02 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11919: --- Summary: Ozone: SCM: TestNodeManager takes too long to execute Key: HDFS-11919 URL: https://issues.apache.org/jira/browse/HDFS-11919 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11779) Ozone: KSM: add listBuckets

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035176#comment-16035176 ] Hadoop QA commented on HDFS-11779: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11914) Add more diagnosis info for fsimage transfer failure.

2017-06-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11914: - Attachment: HDFS-11914.003.patch > Add more diagnosis info for fsimage transfer failure. >

[jira] [Commented] (HDFS-11914) Add more diagnosis info for fsimage transfer failure.

2017-06-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035128#comment-16035128 ] Yongjun Zhang commented on HDFS-11914: -- Thanks [~jojochuang], good comments. I'm uploading a patch

[jira] [Comment Edited] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035112#comment-16035112 ] Chen Liang edited comment on HDFS-11907 at 6/2/17 5:51 PM: --- Thanks

[jira] [Comment Edited] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035112#comment-16035112 ] Chen Liang edited comment on HDFS-11907 at 6/2/17 5:51 PM: --- Thanks

[jira] [Commented] (HDFS-11913) Ozone: TestKeySpaceManager#testDeleteVolume fails

2017-06-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035123#comment-16035123 ] Anu Engineer commented on HDFS-11913: - Converted this to a sub-task of ozone. resolving now. >

[jira] [Updated] (HDFS-11913) Ozone: TestKeySpaceManager#testDeleteVolume fails

2017-06-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11913: Issue Type: Sub-task (was: Bug) Parent: HDFS-7240 > Ozone:

[jira] [Resolved] (HDFS-11913) Ozone: TestKeySpaceManager#testDeleteVolume fails

2017-06-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDFS-11913. - Resolution: Fixed > Ozone: TestKeySpaceManager#testDeleteVolume fails >

[jira] [Reopened] (HDFS-11913) Ozone: TestKeySpaceManager#testDeleteVolume fails

2017-06-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reopened HDFS-11913: - > Ozone: TestKeySpaceManager#testDeleteVolume fails >

[jira] [Commented] (HDFS-11907) NameNodeResourceChecker should avoid calling df.getAvailable too frequently

2017-06-02 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035112#comment-16035112 ] Chen Liang commented on HDFS-11907: --- Thanks [~andrew.wang] for the reply! df does seem to be a fairly

[jira] [Updated] (HDFS-11737) ibdcgditutibrcn

2017-06-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-11737: - Summary: ibdcgditutibrcn (was: Backport HDFS-7964 to branch-2.7: add support for async edit logging) >

[jira] [Updated] (HDFS-11737) Backport HDFS-7964 to branch-2.7: add support for async edit logging

2017-06-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-11737: - Summary: Backport HDFS-7964 to branch-2.7: add support for async edit logging (was: ibdcgditutibrcn) >

[jira] [Commented] (HDFS-11914) Add more diagnosis info for fsimage transfer failure.

2017-06-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035093#comment-16035093 ] Wei-Chiu Chuang commented on HDFS-11914: Hi [~yzhangal] I reviewed the patch and mostly good. I

[jira] [Commented] (HDFS-11914) Add more diagnosis info for fsimage transfer failure.

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035091#comment-16035091 ] Hadoop QA commented on HDFS-11914: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11905) Fix license header inconsistency in hdfs

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035081#comment-16035081 ] Hadoop QA commented on HDFS-11905: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11887) XceiverClientManager should close XceiverClient on eviction from cache

2017-06-02 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11887: - Description: XceiverClientManager doesn't close client on eviction which can leak

[jira] [Commented] (HDFS-11472) Fix inconsistent replica size after a data pipeline failure

2017-06-02 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035058#comment-16035058 ] Erik Krogen commented on HDFS-11472: [~jojochuang] in v002 patch I see your change to check for RBW

[jira] [Commented] (HDFS-11887) XceiverClientManager should close XceiverClient on eviction from cache

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035049#comment-16035049 ] Hadoop QA commented on HDFS-11887: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11887) XceiverClientManager should close XceiverClient on eviction from cache

2017-06-02 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035039#comment-16035039 ] Mukul Kumar Singh commented on HDFS-11887: -- Hi [~cheersyang], thanks for the review. My apologies

[jira] [Updated] (HDFS-11743) Revert HDFS-7933 from branch-2.7 (fsck reporting decommissioning replicas)

2017-06-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-11743: - Labels: release-blocker (was: ) > Revert HDFS-7933 from branch-2.7 (fsck reporting decommissioning

[jira] [Assigned] (HDFS-7295) Support arbitrary max expiration times for delegation token

2017-06-02 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot reassigned HDFS-7295: --- Assignee: (was: Anubhav Dhoot) > Support arbitrary max expiration times for delegation

[jira] [Commented] (HDFS-11887) XceiverClientManager should close XceiverClient on eviction from cache

2017-06-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035000#comment-16035000 ] Weiwei Yang commented on HDFS-11887: Hi [~msingh] I thought the purpose of this jira is to fix the

[jira] [Updated] (HDFS-11914) Add more diagnosis info for fsimage transfer failure.

2017-06-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11914: - Issue Type: Improvement (was: Bug) > Add more diagnosis info for fsimage transfer failure. >

[jira] [Updated] (HDFS-11914) Add more diagnosis info for fsimage transfer failure.

2017-06-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11914: - Labels: supportability (was: ) > Add more diagnosis info for fsimage transfer failure. >

[jira] [Commented] (HDFS-11914) Add more diagnosis info for fsimage transfer failure.

2017-06-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034880#comment-16034880 ] Yongjun Zhang commented on HDFS-11914: -- Uploaded rev 002 to include some more info. The failed tests

[jira] [Updated] (HDFS-11914) Add more diagnosis info for fsimage transfer failure.

2017-06-02 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-11914: - Attachment: HDFS-11914.002.patch > Add more diagnosis info for fsimage transfer failure. >

[jira] [Updated] (HDFS-11779) Ozone: KSM: add listBuckets

2017-06-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11779: --- Attachment: HDFS-11779-HDFS-7240.012.patch Rebase again... > Ozone: KSM: add listBuckets >

[jira] [Comment Edited] (HDFS-11781) Ozone: KSM: Add deleteKey

2017-06-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034850#comment-16034850 ] Weiwei Yang edited comment on HDFS-11781 at 6/2/17 3:17 PM: Hi [~yuanbo]

[jira] [Commented] (HDFS-11781) Ozone: KSM: Add deleteKey

2017-06-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034850#comment-16034850 ] Weiwei Yang commented on HDFS-11781: Hi [~yuanbo] Thanks for the update. But the modification you did

[jira] [Commented] (HDFS-11905) Fix license header inconsistency in hdfs

2017-06-02 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034798#comment-16034798 ] Yeliang Cang commented on HDFS-11905: - Thank you for bringing out the the pre-commit branch-2 jekins

[jira] [Updated] (HDFS-11905) Fix license header inconsistency in hdfs

2017-06-02 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11905: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha4

[jira] [Commented] (HDFS-11905) Fix license header inconsistency in hdfs

2017-06-02 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034773#comment-16034773 ] Brahma Reddy Battula commented on HDFS-11905: - Following is the {{branch-2}} jenkins

[jira] [Commented] (HDFS-5042) Completed files lost after power failure

2017-06-02 Thread Dave Latham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034757#comment-16034757 ] Dave Latham commented on HDFS-5042: --- +1, hear hear! Thanks [~vinayrpet] for driving this in after 4

[jira] [Commented] (HDFS-11887) XceiverClientManager should close XceiverClient on eviction from cache

2017-06-02 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034753#comment-16034753 ] Mukul Kumar Singh commented on HDFS-11887: -- Thanks for the review [~vagarychen] and [~cheersyang]

[jira] [Updated] (HDFS-11887) XceiverClientManager should close XceiverClient on eviction from cache

2017-06-02 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11887: - Attachment: HDFS-11887-HDFS-7240.002.patch > XceiverClientManager should close

[jira] [Commented] (HDFS-10816) TestComputeInvalidateWork#testDatanodeReRegistration fails due to race between test and replication monitor

2017-06-02 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034741#comment-16034741 ] Eric Badger commented on HDFS-10816: Not sure why hadoopqa isn't running on the latest patches.

[jira] [Commented] (HDFS-11918) Ozone: Encapsulate KSM metadata key into protobuf messages for better (de)serialization

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034593#comment-16034593 ] Hadoop QA commented on HDFS-11918: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11916) Extend TestErasureCodingPolicies/TestErasureCodingPolicyWithSnapshot with a random EC policy

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034557#comment-16034557 ] Hadoop QA commented on HDFS-11916: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11781) Ozone: KSM: Add deleteKey

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034539#comment-16034539 ] Hadoop QA commented on HDFS-11781: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11914) Add more diagnosis info for fsimage transfer failure.

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034472#comment-16034472 ] Hadoop QA commented on HDFS-11914: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (HDFS-11917) Why when using the hdfs nfs gateway, a file which is smaller than one block size required a block

2017-06-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-11917. Resolution: Not A Problem Assignee: Weiwei Yang > Why when using the hdfs nfs gateway, a file

[jira] [Commented] (HDFS-11917) Why when using the hdfs nfs gateway, a file which is smaller than one block size required a block

2017-06-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034455#comment-16034455 ] Weiwei Yang commented on HDFS-11917: Hi [~fireling] This is not a bug, this is how HDFS works. A file

[jira] [Commented] (HDFS-11918) Ozone: Encapsulate KSM metadata key into protobuf messages for better (de)serialization

2017-06-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034433#comment-16034433 ] Weiwei Yang commented on HDFS-11918: Attached an initial patch for this work. Please take a look how

[jira] [Updated] (HDFS-11918) Ozone: Encapsulate KSM metadata key into protobuf messages for better (de)serialization

2017-06-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11918: --- Status: Patch Available (was: Open) > Ozone: Encapsulate KSM metadata key into protobuf messages for

[jira] [Updated] (HDFS-11918) Ozone: Encapsulate KSM metadata key into protobuf messages for better (de)serialization

2017-06-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11918: --- Attachment: HDFS-11918-HDFS-7240.001.patch > Ozone: Encapsulate KSM metadata key into protobuf

  1   2   >