[jira] [Commented] (HDFS-11895) Committed block should be completed during block report if usable replicas are enough

2017-05-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027268#comment-16027268 ] Hadoop QA commented on HDFS-11895: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-11893) Fix TestDFSShell.testMoveWithTargetPortEmpty failure on branch-2.7

2017-05-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned HDFS-11893: --- Assignee: Brahma Reddy Battula > Fix

[jira] [Commented] (HDFS-11883) [SPS] : Handle NPE in BlockStorageMovementTracker when dropSPSWork() called

2017-05-26 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027199#comment-16027199 ] Surendra Singh Lilhore commented on HDFS-11883: --- Thanks [~umamaheswararao] for review.. bq.

[jira] [Issue Comment Deleted] (HDFS-11890) Handle NPE in BlockRecoveryWorker when DN is getting shoutdown.

2017-05-26 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-11890: -- Comment: was deleted (was: Thanks [~umamaheswararao] for review.. bq. From

[jira] [Updated] (HDFS-11895) Committed block should be completed during block report if usable replicas are enough

2017-05-26 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-11895: Status: Patch Available (was: Open) > Committed block should be completed during block report if

[jira] [Updated] (HDFS-11895) Committed block should be completed during block report if usable replicas are enough

2017-05-26 Thread zhouyingchao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhouyingchao updated HDFS-11895: Attachment: HDFS-11895-001.patch A patch for the issue. > Committed block should be completed

[jira] [Created] (HDFS-11895) Committed block should be completed during block report if usable replicas are enough

2017-05-26 Thread zhouyingchao (JIRA)
zhouyingchao created HDFS-11895: --- Summary: Committed block should be completed during block report if usable replicas are enough Key: HDFS-11895 URL: https://issues.apache.org/jira/browse/HDFS-11895

[jira] [Commented] (HDFS-11853) Ozone: KSM: Add getKey

2017-05-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027161#comment-16027161 ] Hadoop QA commented on HDFS-11853: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027157#comment-16027157 ] Anu Engineer commented on HDFS-11779: - bq. javax.annotation because I found many other places in HDFS

[jira] [Commented] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027152#comment-16027152 ] Weiwei Yang commented on HDFS-11779: Hello [~anu] and [~xyao] Thanks for your comments, I will submit

[jira] [Assigned] (HDFS-11844) Ozone: Recover SCM state when SCM is restarted

2017-05-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-11844: --- Assignee: Anu Engineer (was: Weiwei Yang) > Ozone: Recover SCM state when SCM is restarted

[jira] [Commented] (HDFS-11894) Ozone: Cleanup imports

2017-05-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027150#comment-16027150 ] Anu Engineer commented on HDFS-11894: - [~cheersyang] Assigning to you based on your earlier comments.

[jira] [Assigned] (HDFS-11894) Ozone: Cleanup imports

2017-05-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-11894: --- Assignee: Weiwei Yang > Ozone: Cleanup imports > -- > >

[jira] [Created] (HDFS-11894) Ozone: Cleanup imports

2017-05-26 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11894: --- Summary: Ozone: Cleanup imports Key: HDFS-11894 URL: https://issues.apache.org/jira/browse/HDFS-11894 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-11873) Ozone: Object store handler cannot serve multiple requests from single http client

2017-05-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027142#comment-16027142 ] Weiwei Yang commented on HDFS-11873: Thanks [~anu] for taking care of this. > Ozone: Object store

[jira] [Commented] (HDFS-11844) Ozone: Recover SCM state when SCM is restarted

2017-05-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027138#comment-16027138 ] Weiwei Yang commented on HDFS-11844: Sure go ahead [~anu]. > Ozone: Recover SCM state when SCM is

[jira] [Commented] (HDFS-11893) Fix TestDFSShell.testMoveWithTargetPortEmpty failure on branch-2.7

2017-05-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027136#comment-16027136 ] Konstantin Shvachko commented on HDFS-11893: With this stack trace. {code} Running

[jira] [Created] (HDFS-11893) Fix TestDFSShell.testMoveWithTargetPortEmpty failure on branch-2.7

2017-05-26 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-11893: -- Summary: Fix TestDFSShell.testMoveWithTargetPortEmpty failure on branch-2.7 Key: HDFS-11893 URL: https://issues.apache.org/jira/browse/HDFS-11893

[jira] [Updated] (HDFS-8674) Improve performance of postponed block scans

2017-05-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-8674: -- Attachment: HDFS-8674-branch-2.7.patch Attaching backport patch from HDFS-11868.

[jira] [Updated] (HDFS-11868) Backport HDFS-8674 to branch 2.7

2017-05-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11868: --- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Commented] (HDFS-11890) Handle NPE in BlockRecoveryWorker when DN is getting shoutdown.

2017-05-26 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027124#comment-16027124 ] Surendra Singh Lilhore commented on HDFS-11890: --- Thanks [~umamaheswararao] for review.. bq.

[jira] [Commented] (HDFS-11846) Ozone: Fix Http connection leaks in ozone clients

2017-05-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027119#comment-16027119 ] Weiwei Yang commented on HDFS-11846: Hi [~anu] Thanks for catching up that, that is not my intention.

[jira] [Created] (HDFS-11892) Azure: handle failure gracefully in case of missing account key

2017-05-26 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-11892: Summary: Azure: handle failure gracefully in case of missing account key Key: HDFS-11892 URL: https://issues.apache.org/jira/browse/HDFS-11892 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11853) Ozone: KSM: Add getKey

2017-05-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027087#comment-16027087 ] Hadoop QA commented on HDFS-11853: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11583) Parent spans not initialized to NullScope for every DFSPacket

2017-05-26 Thread Karan Mehta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027082#comment-16027082 ] Karan Mehta commented on HDFS-11583: [~iwasakims] When will this get committed? > Parent spans not

[jira] [Commented] (HDFS-11446) TestMaintenanceState#testWithNNAndDNRestart fails intermittently

2017-05-26 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027081#comment-16027081 ] Ming Ma commented on HDFS-11446: +1. > TestMaintenanceState#testWithNNAndDNRestart fails intermittently >

[jira] [Commented] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2017-05-26 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027065#comment-16027065 ] Chris Douglas commented on HDFS-6984: - This is ready for review. None of the unit test failures are

[jira] [Commented] (HDFS-10480) Add an admin command to list currently open files

2017-05-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027061#comment-16027061 ] Hadoop QA commented on HDFS-10480: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-11853) Ozone: KSM: Add getKey

2017-05-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027049#comment-16027049 ] Chen Liang edited comment on HDFS-11853 at 5/27/17 12:19 AM: - Thanks [~xyao]

[jira] [Updated] (HDFS-11853) Ozone: KSM: Add getKey

2017-05-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11853: -- Attachment: HDFS-11853-HDFS-7240.003.patch Thanks [~xyao] for the comments! all addressed in v003

[jira] [Commented] (HDFS-11891) DU#refresh should print the path of the directory when an exception is caught

2017-05-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027044#comment-16027044 ] Hudson commented on HDFS-11891: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11791 (See

[jira] [Commented] (HDFS-11883) [SPS] : Handle NPE in BlockStorageMovementTracker when dropSPSWork() called

2017-05-26 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027028#comment-16027028 ] Uma Maheswara Rao G commented on HDFS-11883: Thank you [~surendrasingh] for catching this

[jira] [Commented] (HDFS-11359) DFSAdmin report command supports displaying maintenance state datanodes

2017-05-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027027#comment-16027027 ] Hadoop QA commented on HDFS-11359: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11446) TestMaintenanceState#testWithNNAndDNRestart fails intermittently

2017-05-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027021#comment-16027021 ] Manoj Govindassamy commented on HDFS-11446: --- [~linyiqun], Thanks for reporting this issue and

[jira] [Commented] (HDFS-11853) Ozone: KSM: Add getKey

2017-05-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16027019#comment-16027019 ] Xiaoyu Yao commented on HDFS-11853: --- Thanks [~vagarychen] for the patch. The patch looks great to me

[jira] [Updated] (HDFS-11891) DU#refresh should print the path of the directory when an exception is caught

2017-05-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11891: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.2

[jira] [Commented] (HDFS-11359) DFSAdmin report command supports displaying maintenance state datanodes

2017-05-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026997#comment-16026997 ] Manoj Govindassamy commented on HDFS-11359: --- [~linyiqun], Thanks for the patch revision. Looks

[jira] [Commented] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026980#comment-16026980 ] Xiaoyu Yao commented on HDFS-11779: --- Thanks [~cheersyang] for the patch. The v6 patch looks excellent to

[jira] [Updated] (HDFS-11853) Ozone: KSM: Add getKey

2017-05-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11853: -- Attachment: HDFS-11853-HDFS-7240.002.patch The failed test {{TestKeySpaceManager}} is related, fixed in

[jira] [Commented] (HDFS-11868) Backport HDFS-8674 to branch 2.7

2017-05-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026914#comment-16026914 ] Hadoop QA commented on HDFS-11868: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11853) Ozone: KSM: Add getKey

2017-05-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026912#comment-16026912 ] Hadoop QA commented on HDFS-11853: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11890) Handle NPE in BlockRecoveryWorker when DN is getting shoutdown.

2017-05-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026908#comment-16026908 ] Hadoop QA commented on HDFS-11890: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2017-05-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026855#comment-16026855 ] Hadoop QA commented on HDFS-6984: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10480) Add an admin command to list currently open files

2017-05-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10480: -- Attachment: HDFS-10480.06.patch [~andrew.wang], Attached v06 patch to address the

[jira] [Commented] (HDFS-11891) DU#refresh should print the path of the directory when an exception is caught

2017-05-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026818#comment-16026818 ] Hadoop QA commented on HDFS-11891: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11078) NPE in LazyPersistFileScrubber

2017-05-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11078: --- Affects Version/s: 2.7.3 > NPE in LazyPersistFileScrubber >

[jira] [Updated] (HDFS-11869) Backport HDFS-11078 to branch 2.7

2017-05-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11869: --- Resolution: Duplicate Status: Resolved (was: Patch Available) Resolving as

[jira] [Resolved] (HDFS-11078) NPE in LazyPersistFileScrubber

2017-05-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko resolved HDFS-11078. Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.2

[jira] [Commented] (HDFS-11771) Ozone: KSM: Add checkVolumeAccess

2017-05-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026803#comment-16026803 ] Anu Engineer commented on HDFS-11771: - one minor comment : Only small letters are valid in volume

[jira] [Commented] (HDFS-11078) NPE in LazyPersistFileScrubber

2017-05-26 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026765#comment-16026765 ] Konstantin Shvachko commented on HDFS-11078: +1 for the patch. Looks like the failed tests are

[jira] [Comment Edited] (HDFS-11885) createEncryptionZone should not block on initializing EDEK cache

2017-05-26 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026731#comment-16026731 ] Rushabh S Shah edited comment on HDFS-11885 at 5/26/17 7:41 PM: We have an

[jira] [Commented] (HDFS-11885) createEncryptionZone should not block on initializing EDEK cache

2017-05-26 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026731#comment-16026731 ] Rushabh S Shah commented on HDFS-11885: --- We have an internal patch for namenode throwing retriable

[jira] [Commented] (HDFS-11891) DU#refresh should print the path of the directory when an exception is caught

2017-05-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026699#comment-16026699 ] Wei-Chiu Chuang commented on HDFS-11891: Good catch! [~vagarychen] +1 pending Jenkins. >

[jira] [Updated] (HDFS-11853) Ozone: KSM: Add getKey

2017-05-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11853: -- Status: Patch Available (was: Open) > Ozone: KSM: Add getKey > --- > >

[jira] [Updated] (HDFS-11853) Ozone: KSM: Add getKey

2017-05-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11853: -- Attachment: HDFS-11853-HDFS-7240.001.patch Post initial v001 patch. This patch also includes a number

[jira] [Commented] (HDFS-11762) [SPS] : Empty files should be ignored in StoragePolicySatisfier.

2017-05-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026664#comment-16026664 ] Hadoop QA commented on HDFS-11762: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11891) DU#refresh should print the path of the directory when an exception is caught

2017-05-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11891: -- Attachment: HDFS-11891.001.patch > DU#refresh should print the path of the directory when an exception

[jira] [Updated] (HDFS-11891) DU#refresh should print the path of the directory when an exception is caught

2017-05-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11891: -- Status: Patch Available (was: Open) > DU#refresh should print the path of the directory when an

[jira] [Commented] (HDFS-11883) [SPS] : Handle NPE in BlockStorageMovementTracker when dropSPSWork() called

2017-05-26 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026661#comment-16026661 ] Surendra Singh Lilhore commented on HDFS-11883: --- 1.

[jira] [Created] (HDFS-11891) DU#refresh should print the path of the directory when an exception is caught

2017-05-26 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11891: - Summary: DU#refresh should print the path of the directory when an exception is caught Key: HDFS-11891 URL: https://issues.apache.org/jira/browse/HDFS-11891 Project:

[jira] [Updated] (HDFS-11890) Handle NPE in BlockRecoveryWorker when DN is getting shoutdown.

2017-05-26 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-11890: -- Status: Patch Available (was: Open) > Handle NPE in BlockRecoveryWorker when

[jira] [Updated] (HDFS-11890) Handle NPE in BlockRecoveryWorker when DN is getting shoutdown.

2017-05-26 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-11890: -- Attachment: HDFS-11890-001.patch Attached initial patch. Please review.. >

[jira] [Created] (HDFS-11890) Handle NPE in BlockRecoveryWorker when DN is getting shoutdown.

2017-05-26 Thread Surendra Singh Lilhore (JIRA)
Surendra Singh Lilhore created HDFS-11890: - Summary: Handle NPE in BlockRecoveryWorker when DN is getting shoutdown. Key: HDFS-11890 URL: https://issues.apache.org/jira/browse/HDFS-11890

[jira] [Commented] (HDFS-11776) Ozone: KSM: add SetBucketProperty

2017-05-26 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026617#comment-16026617 ] Nandakumar commented on HDFS-11776: --- Thanks for the review [~cheersyang]. bq. why we need to check the

[jira] [Updated] (HDFS-11732) Backport HDFS-8498 to branch-2.7: Blocks can be committed with wrong size

2017-05-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11732: --- Fix Version/s: 2.7.4 > Backport HDFS-8498 to branch-2.7: Blocks can be committed with wrong

[jira] [Updated] (HDFS-11762) [SPS] : Empty files should be ignored in StoragePolicySatisfier.

2017-05-26 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-11762: -- Attachment: HDFS-11762-HDFS-10285.004.patch Re-based patch, please review.. >

[jira] [Commented] (HDFS-11846) Ozone: Fix Http connection leaks in ozone clients

2017-05-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026586#comment-16026586 ] Anu Engineer commented on HDFS-11846: - [~xyao] thanks for committing this and [~cheersyang] Thanks for

[jira] [Commented] (HDFS-11886) Ozone : improve error handling for putkey operation

2017-05-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026564#comment-16026564 ] Anu Engineer commented on HDFS-11886: - [~vagarychen] Very important questions. Let me try to share

[jira] [Commented] (HDFS-11856) Ability to re-add Upgrading Nodes (remote) to pipeline for future pipeline updates

2017-05-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026551#comment-16026551 ] Hadoop QA commented on HDFS-11856: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11741) Long running balancer may fail due to expired DataEncryptionKey

2017-05-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026536#comment-16026536 ] Xiao Chen commented on HDFS-11741: -- Thanks for revving Wei-Chiu, good analysis! As talked offline I

[jira] [Commented] (HDFS-11886) Ozone : improve error handling for putkey operation

2017-05-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026534#comment-16026534 ] Chen Liang commented on HDFS-11886: --- Thanks [~anu] for looking at this! No decision has been made at all

[jira] [Updated] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2017-05-26 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-6984: Release Note: FileStatus and FsPermission Writable serialization is deprecated and its

[jira] [Commented] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026529#comment-16026529 ] Anu Engineer commented on HDFS-11779: - [~cheersyang] Thanks for the patch. My comments are based on

[jira] [Commented] (HDFS-11844) Ozone: Recover SCM state when SCM is restarted

2017-05-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026512#comment-16026512 ] Anu Engineer commented on HDFS-11844: - [~cheersyang] Thanks for reporting it, if you are not working

[jira] [Assigned] (HDFS-11873) Ozone: Object store handler cannot serve multiple requests from single http client

2017-05-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-11873: --- Assignee: Anu Engineer (was: Weiwei Yang) > Ozone: Object store handler cannot serve

[jira] [Commented] (HDFS-11873) Ozone: Object store handler cannot serve multiple requests from single http client

2017-05-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026507#comment-16026507 ] Anu Engineer commented on HDFS-11873: - [~cheersyang] Thanks for the test cases, I will take a look

[jira] [Commented] (HDFS-11886) Ozone : improve error handling for putkey operation

2017-05-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026504#comment-16026504 ] Anu Engineer commented on HDFS-11886: - [~vagarychen] Just wondering if we should just do what HDFS

[jira] [Updated] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2017-05-26 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-6984: Attachment: HDFS-6984.013.patch > In Hadoop 3, make FileStatus serialize itself via protobuf >

[jira] [Commented] (HDFS-5042) Completed files lost after power failure

2017-05-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026424#comment-16026424 ] Kihwal Lee commented on HDFS-5042: -- bq. +1 the latest patch looks good. Hold on.

[jira] [Commented] (HDFS-5042) Completed files lost after power failure

2017-05-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026416#comment-16026416 ] Kihwal Lee commented on HDFS-5042: -- +1 the latest patch looks good. > Completed files lost after power

[jira] [Updated] (HDFS-11856) Ability to re-add Upgrading Nodes (remote) to pipeline for future pipeline updates

2017-05-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11856: -- Attachment: HDFS-11856-02.branch-2.patch Reattaching the branch-2 patch with a different name to kick

[jira] [Commented] (HDFS-11679) Ozone: SCM CLI: Implement list container command

2017-05-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026391#comment-16026391 ] Weiwei Yang commented on HDFS-11679: Hi [~yuanbo] Thanks for the update, it looks pretty good. Some

[jira] [Commented] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026303#comment-16026303 ] Weiwei Yang commented on HDFS-11779: [~xyao], [~nandakumar131] and [~linyiqun], please see if latest

[jira] [Comment Edited] (HDFS-11882) TestDFSRSDefault10x4StripedOutputStreamWithFailure and TestDFSStripedOutputStreamWithFailure010 fail

2017-05-26 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026217#comment-16026217 ] Takanobu Asanuma edited comment on HDFS-11882 at 5/26/17 12:53 PM: ---

[jira] [Commented] (HDFS-11882) TestDFSRSDefault10x4StripedOutputStreamWithFailure and TestDFSStripedOutputStreamWithFailure010 fail

2017-05-26 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026217#comment-16026217 ] Takanobu Asanuma commented on HDFS-11882: - Thanks for catching this issue and submitting the

[jira] [Commented] (HDFS-11679) Ozone: SCM CLI: Implement list container command

2017-05-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026190#comment-16026190 ] Hadoop QA commented on HDFS-11679: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026135#comment-16026135 ] Hadoop QA commented on HDFS-11779: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10480) Add an admin command to list currently open files

2017-05-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026112#comment-16026112 ] Hadoop QA commented on HDFS-10480: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11883) [SPS] : Handle NPE in BlockStorageMovementTracker when dropSPSWork() called

2017-05-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026067#comment-16026067 ] Hadoop QA commented on HDFS-11883: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11679) Ozone: SCM CLI: Implement list container command

2017-05-26 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-11679: -- Attachment: HDFS-11679-HDFS-7240.002.patch upload v2 patch to address Weiwei's comments. > Ozone: SCM

[jira] [Assigned] (HDFS-11889) Datanodes should skip reading replicas from cache during Rollback

2017-05-26 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B reassigned HDFS-11889: Assignee: Vinayakumar B Description: During rolling upgrade rollback, Datanodes

[jira] [Created] (HDFS-11889) Datanodes should skip reading replicas from cache during Rollback

2017-05-26 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-11889: Summary: Datanodes should skip reading replicas from cache during Rollback Key: HDFS-11889 URL: https://issues.apache.org/jira/browse/HDFS-11889 Project: Hadoop HDFS

[jira] [Updated] (HDFS-10480) Add an admin command to list currently open files

2017-05-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10480: -- Attachment: HDFS-10480.05.patch > Add an admin command to list currently open files >

[jira] [Updated] (HDFS-10480) Add an admin command to list currently open files

2017-05-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10480: -- Attachment: (was: HDFS-10480.05.patch) > Add an admin command to list currently

[jira] [Comment Edited] (HDFS-10480) Add an admin command to list currently open files

2017-05-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025965#comment-16025965 ] Manoj Govindassamy edited comment on HDFS-10480 at 5/26/17 8:17 AM:

[jira] [Updated] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11779: --- Attachment: HDFS-11779-HDFS-7240.006.patch > Ozone: KSM: add listBuckets >

[jira] [Updated] (HDFS-10480) Add an admin command to list currently open files

2017-05-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10480: -- Attachment: HDFS-10480.05.patch bq. One high-level question first, what do we envision

[jira] [Commented] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025947#comment-16025947 ] Hadoop QA commented on HDFS-11779: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11779: --- Attachment: HDFS-11779-HDFS-7240.005.patch Rebased to latest code base. > Ozone: KSM: add

[jira] [Commented] (HDFS-11779) Ozone: KSM: add listBuckets

2017-05-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025883#comment-16025883 ] Hadoop QA commented on HDFS-11779: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >