[jira] [Commented] (HDFS-9850) DiskBalancer : Explore removing references to FsVolumeSpi

2016-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523771#comment-15523771 ] Anu Engineer commented on HDFS-9850: [~manojg] Thanks for updating the patch as well providing a fix

[jira] [Updated] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-09-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10903: - Description: In *Hadoop HDFS*, there are some places that use config key literal strings instead

[jira] [Updated] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10892: - Description: I did not find unit test in {{trunk}} code for following cases: - HDFS command {{dfs

[jira] [Commented] (HDFS-9444) Add utility to find set of available ephemeral ports to ServerSocketUtil

2016-09-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523745#comment-15523745 ] Brahma Reddy Battula commented on HDFS-9444: Ok.. will commit.. > Add utility to find set of

[jira] [Commented] (HDFS-10851) FSDirStatAndListingOp: stop passing path as string

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523757#comment-15523757 ] Hadoop QA commented on HDFS-10851: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Moved] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-09-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu moved HADOOP-13644 to HDFS-10903: --- Target Version/s: 2.8.0 (was: 2.8.0) Component/s: (was:

[jira] [Commented] (HDFS-9885) In distcp cmd ouput, Display name should be given for org.apache.hadoop.tools.mapred.CopyMapper$Counter.

2016-09-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523789#comment-15523789 ] Yongjun Zhang commented on HDFS-9885: - Thanks for pinging me [~brahmareddy], I took a look and the

[jira] [Created] (HDFS-10904) Need a new Result state for DiskBalancerWorkStatus to indicate the final Plan step errors and stuck rebalancing

2016-09-26 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-10904: - Summary: Need a new Result state for DiskBalancerWorkStatus to indicate the final Plan step errors and stuck rebalancing Key: HDFS-10904 URL:

[jira] [Commented] (HDFS-8312) Trash does not descent into child directories to check for permissions

2016-09-26 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523753#comment-15523753 ] Daryn Sharp commented on HDFS-8312: --- Encountered a minor conflict with this patch so I took a look. If

[jira] [Updated] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10892: - Attachment: HDFS-10892.002.patch > Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat' >

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523763#comment-15523763 ] Xiaoyu Yao commented on HDFS-10690: --- [~fenghua_hu], thanks for updating the patch. The patch v05 looks

[jira] [Commented] (HDFS-10609) Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications

2016-09-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523899#comment-15523899 ] Wei-Chiu Chuang commented on HDFS-10609: Committing this based on Andrew's +1. > Uncaught

[jira] [Updated] (HDFS-9390) Block management for maintenance states

2016-09-26 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9390: -- Attachment: HDFS-9390-2.patch Updated patch to address the checkstyle and test code issues. > Block management

[jira] [Updated] (HDFS-9444) Add utility to find set of available ephemeral ports to ServerSocketUtil

2016-09-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9444: --- Affects Version/s: test > Add utility to find set of available ephemeral ports to

[jira] [Updated] (HDFS-10904) Need a new Result state for DiskBalancerWorkStatus to indicate the final Plan step errors and stuck rebalancing

2016-09-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10904: -- Description: * A DiskBalancer {{NodePlan}} might include a Single {{MoveStep}} or a

[jira] [Updated] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-09-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10896: --- Status: Patch Available (was: Open) > Move lock logging logic from FSNamesystem into

[jira] [Updated] (HDFS-9482) Replace DatanodeInfo constructors with a builder pattern

2016-09-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9482: --- Description: From [~arpitagarwal] comment

[jira] [Updated] (HDFS-9482) Replace DatanodeInfo constructors with a builder pattern

2016-09-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9482: --- Description: As per [~arpitagarwal] comment

[jira] [Updated] (HDFS-9482) Replace DatanodeInfo constructors with a builder pattern

2016-09-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9482: --- Status: Patch Available (was: Open) uploaded the patch..[~arpitagarwal] can you

[jira] [Commented] (HDFS-10887) Provide admin/debug tool to dump block map

2016-09-26 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523305#comment-15523305 ] Kihwal Lee commented on HDFS-10887: --- Missing blocks during start-up is caused by datanodes not sending

[jira] [Updated] (HDFS-10851) FSDirStatAndListingOp: stop passing path as string

2016-09-26 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10851: --- Attachment: HDFS-10851.1.patch Removed dead assignment flagged by findbugs. > FSDirStatAndListingOp:

[jira] [Commented] (HDFS-9444) Add utility to find set of available ephemeral ports to ServerSocketUtil

2016-09-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523562#comment-15523562 ] Xiao Chen commented on HDFS-9444: - Thanks for the reviews [~iwasakims] and [~brahmareddy]. I also feel

[jira] [Commented] (HDFS-10900) DiskBalancer: Complete the documents for the report command

2016-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524195#comment-15524195 ] Anu Engineer commented on HDFS-10900: - I was about to commit this, and I noticed that hadoop

[jira] [Commented] (HDFS-10797) Disk usage summary of snapshots causes renamed blocks to get counted twice

2016-09-26 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524191#comment-15524191 ] Jing Zhao commented on HDFS-10797: -- Thanks for working on this, Sean. This is actually a known issue and

[jira] [Updated] (HDFS-10900) DiskBalancer: Complete the documents for the report command

2016-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10900: Fix Version/s: (was: 2.9.0) 3.0.0-alpha2 > DiskBalancer: Complete the

[jira] [Commented] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524223#comment-15524223 ] Hadoop QA commented on HDFS-10896: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10897) Ozone: SCM: Add NodeManager

2016-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524169#comment-15524169 ] Anu Engineer commented on HDFS-10897: - [~xyao] Thanks for the comments, I will post an updated patch

[jira] [Commented] (HDFS-10609) Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications

2016-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524236#comment-15524236 ] Hudson commented on HDFS-10609: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10489 (See

[jira] [Updated] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-09-26 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10896: --- Attachment: HDFS-10896.001.patch Rebased for patch v001. > Move lock logging logic from FSNamesystem

[jira] [Commented] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-26 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524258#comment-15524258 ] Chris Nauroth commented on HDFS-10824: -- [~xiaobingo], thank you for sharing patch 004. Adding the

[jira] [Updated] (HDFS-10897) Ozone: SCM: Add NodeManager

2016-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10897: Attachment: HDFS-10897-HDFS-7240.002.patch Fix the timeout issue in the test. > Ozone: SCM: Add

[jira] [Commented] (HDFS-9482) Replace DatanodeInfo constructors with a builder pattern

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524104#comment-15524104 ] Hadoop QA commented on HDFS-9482: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524103#comment-15524103 ] Hadoop QA commented on HDFS-10903: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524006#comment-15524006 ] Hadoop QA commented on HDFS-10903: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10897) Ozone: SCM: Add NodeManager

2016-09-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524153#comment-15524153 ] Xiaoyu Yao commented on HDFS-10897: --- Thanks [~anu] for working on this and post the patch. I took a look

[jira] [Commented] (HDFS-8406) Lease recovery continually failed

2016-09-26 Thread Noe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524189#comment-15524189 ] Noe commented on HDFS-8406: --- for those that run into this, but need to get system working again: 1) move problem

[jira] [Commented] (HDFS-9390) Block management for maintenance states

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524221#comment-15524221 ] Hadoop QA commented on HDFS-9390: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10826) The result of fsck should be CRITICAL when there are unrecoverable ec block groups.

2016-09-26 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522530#comment-15522530 ] Takanobu Asanuma commented on HDFS-10826: - [~ajisakaa] Thank you for your kind review! I will

[jira] [Commented] (HDFS-10902) QJM should not consider stale/failed txn available in any one of JNs.

2016-09-26 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522464#comment-15522464 ] Vinayakumar B commented on HDFS-10902: -- One possible solution could be as below: 1. From all

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522171#comment-15522171 ] Hadoop QA commented on HDFS-10690: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10902) QJM should not consider stale/failed txn available in any one of JNs.

2016-09-26 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522200#comment-15522200 ] Vinayakumar B commented on HDFS-10902: -- Analysis 1. startLogSegment success in JN1 and

[jira] [Created] (HDFS-10902) QJM should not consider stale/failed txn available in any one of JNs.

2016-09-26 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-10902: Summary: QJM should not consider stale/failed txn available in any one of JNs. Key: HDFS-10902 URL: https://issues.apache.org/jira/browse/HDFS-10902 Project: Hadoop

[jira] [Created] (HDFS-10901) QJM should not consider stale/failed txn available in any one of JNs.

2016-09-26 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-10901: Summary: QJM should not consider stale/failed txn available in any one of JNs. Key: HDFS-10901 URL: https://issues.apache.org/jira/browse/HDFS-10901 Project: Hadoop

[jira] [Updated] (HDFS-10609) Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications

2016-09-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10609: --- Release Note: If pipeline recovery fails due to expired encryption key, attempt to refresh

[jira] [Updated] (HDFS-10609) Uncaught InvalidEncryptionKeyException during pipeline recovery may abort downstream applications

2016-09-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10609: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-10637) Modifications to remove the assumption that FsVolumes are backed by java.io.File.

2016-09-26 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10637: -- Attachment: HDFS-10637.009.patch Thanks [~eddyxu] for the clarification. I am posting a

[jira] [Updated] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10892: - Attachment: HDFS-10892.003.patch > Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat' >

[jira] [Updated] (HDFS-9482) Replace DatanodeInfo constructors with a builder pattern

2016-09-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9482: --- Attachment: HDFS-9482.patch > Replace DatanodeInfo constructors with a builder pattern

[jira] [Updated] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-26 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-10713: -- Attachment: HDFS-10713.branch-2.000.patch Thank you [~arpitagarwal] for reviewing and

[jira] [Commented] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524658#comment-15524658 ] Hadoop QA commented on HDFS-10896: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524693#comment-15524693 ] Hudson commented on HDFS-10713: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10491 (See

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-26 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524699#comment-15524699 ] Fenghua Hu commented on HDFS-10690: --- Thanks [~xyao] for your suggestion. How about we just remove "if

[jira] [Updated] (HDFS-9850) DiskBalancer : Explore removing references to FsVolumeSpi

2016-09-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-9850: - Attachment: HDFS-9850.003.patch Attaching v03 patch to address checkstyle and review

[jira] [Commented] (HDFS-9444) Add utility to find set of available ephemeral ports to ServerSocketUtil

2016-09-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524733#comment-15524733 ] Brahma Reddy Battula commented on HDFS-9444: Committed to trunk...[~iwasakims] patch will not

[jira] [Reopened] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-10713: -- > Throttle FsNameSystem lock warnings > --- > >

[jira] [Updated] (HDFS-10828) Fix usage of FsDatasetImpl object lock in ReplicaMap

2016-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10828: - Priority: Blocker (was: Major) > Fix usage of FsDatasetImpl object lock in ReplicaMap >

[jira] [Updated] (HDFS-10828) Fix usage of FsDatasetImpl object lock in ReplicaMap

2016-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10828: - Target Version/s: 2.8.0, 3.0.0-alpha2 (was: 2.8.0) > Fix usage of FsDatasetImpl object lock in

[jira] [Commented] (HDFS-10828) Fix usage of FsDatasetImpl object lock in ReplicaMap

2016-09-26 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524786#comment-15524786 ] Fenghua Hu commented on HDFS-10828: --- [~arpitagarwal], Actually, i opened another JIRA

[jira] [Updated] (HDFS-10804) Use separate lock for ReplicaMap

2016-09-26 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fenghua Hu updated HDFS-10804: -- Summary: Use separate lock for ReplicaMap (was: Use finer-granularity lock for ReplicaMap) > Use

[jira] [Commented] (HDFS-10897) Ozone: SCM: Add NodeManager

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524671#comment-15524671 ] Hadoop QA commented on HDFS-10897: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-10900) DiskBalancer: Complete the documents for the report command

2016-09-26 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524698#comment-15524698 ] Yiqun Lin edited comment on HDFS-10900 at 9/27/16 1:18 AM: --- Thanks [~anu] for

[jira] [Commented] (HDFS-10900) DiskBalancer: Complete the documents for the report command

2016-09-26 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524698#comment-15524698 ] Yiqun Lin commented on HDFS-10900: -- Thanks [~anu] for the review. One comment from me: {quote} I will

[jira] [Commented] (HDFS-9850) DiskBalancer : Explore removing references to FsVolumeSpi

2016-09-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524718#comment-15524718 ] Manoj Govindassamy commented on HDFS-9850: -- Thanks for the review and comments [~anu]. Will be

[jira] [Updated] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10713: - Status: Patch Available (was: Reopened) > Throttle FsNameSystem lock warnings >

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-26 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524750#comment-15524750 ] Fenghua Hu commented on HDFS-10690: --- Removed unnessary "if (eldestKey == null)" statement, and updated

[jira] [Updated] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-26 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fenghua Hu updated HDFS-10690: -- Attachment: HDFS-10690.006.patch > Optimize insertion/removal of replica in ShortCircuitCache.java >

[jira] [Comment Edited] (HDFS-10828) Fix usage of FsDatasetImpl object lock in ReplicaMap

2016-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524766#comment-15524766 ] Arpit Agarwal edited comment on HDFS-10828 at 9/27/16 1:54 AM: --- Hi

[jira] [Commented] (HDFS-10828) Fix usage of FsDatasetImpl object lock in ReplicaMap

2016-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524766#comment-15524766 ] Arpit Agarwal commented on HDFS-10828: -- Hi [~fenghua_hu], that probably makes sense although we may

[jira] [Commented] (HDFS-8312) Trash does not descent into child directories to check for permissions

2016-09-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524781#comment-15524781 ] Weiwei Yang commented on HDFS-8312: --- Hello [~daryn] bq. The NN should not be deleting directories as the

[jira] [Deleted] (HDFS-10901) QJM should not consider stale/failed txn available in any one of JNs.

2016-09-26 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B deleted HDFS-10901: - > QJM should not consider stale/failed txn available in any one of JNs. >

[jira] [Updated] (HDFS-10801) [SPS]: Protocol buffer changes for sending storage movement commands from NN to DN

2016-09-26 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10801: Attachment: HDFS-10801-HDFS-10285-00.patch Attached patch to execute the block movement command to satisfy

[jira] [Updated] (HDFS-10801) [SPS]: Protocol buffer changes for sending storage movement commands from NN to DN

2016-09-26 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10801: Affects Version/s: HDFS-10285 Target Version/s: HDFS-10285 Status: Patch Available

[jira] [Commented] (HDFS-10801) [SPS]: Protocol buffer changes for sending storage movement commands from NN to DN

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522865#comment-15522865 ] Hadoop QA commented on HDFS-10801: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10828) Fix usage of FsDatasetImpl object lock in ReplicaMap

2016-09-26 Thread Fenghua Hu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523110#comment-15523110 ] Fenghua Hu commented on HDFS-10828: --- [~arpitagarwal], Currently datasetLock is a big lock, which is

[jira] [Resolved] (HDFS-10863) hadoop superusergroup supergroup issue

2016-09-26 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-10863. --- Resolution: Not A Problem > hadoop superusergroup supergroup issue >

[jira] [Updated] (HDFS-10903) Replace config key literal strings with config key names II: hadoop hdfs

2016-09-26 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10903: - Status: Open (was: Patch Available) > Replace config key literal strings with config key names

[jira] [Commented] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-26 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524599#comment-15524599 ] Xiaobing Zhou commented on HDFS-10824: -- Thanks [~cnauroth] for review. v005 is posted by moving

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15525118#comment-15525118 ] Hadoop QA commented on HDFS-10713: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9885) Correct the distcp counters name while displaying counters

2016-09-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9885: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.7.4

[jira] [Created] (HDFS-10906) Add unit tests for Trash with HDFS encryption zones

2016-09-26 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-10906: - Summary: Add unit tests for Trash with HDFS encryption zones Key: HDFS-10906 URL: https://issues.apache.org/jira/browse/HDFS-10906 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-10828) Fix usage of FsDatasetImpl object lock in ReplicaMap

2016-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15525081#comment-15525081 ] Anu Engineer commented on HDFS-10828: - [~arpitagarwal] Thanks for the patch. +1, LGTM. > Fix usage

[jira] [Updated] (HDFS-9885) Correct the distcp counters name while displaying counters

2016-09-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9885: --- Summary: Correct the distcp counters name while displaying counters (was: Correct the

[jira] [Updated] (HDFS-9885) Correct the distcp counters name wh

2016-09-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9885: --- Summary: Correct the distcp counters name wh (was: In distcp cmd ouput, Display name

[jira] [Commented] (HDFS-10906) Add unit tests for Trash with HDFS encryption zones

2016-09-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15525143#comment-15525143 ] Xiaoyu Yao commented on HDFS-10906: --- Below is a proposed test plan for list of test cases to add: #

[jira] [Commented] (HDFS-9885) Correct the distcp counters name while displaying counters

2016-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15525141#comment-15525141 ] Hudson commented on HDFS-9885: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10494 (See

[jira] [Comment Edited] (HDFS-10906) Add unit tests for Trash with HDFS encryption zones

2016-09-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15525143#comment-15525143 ] Xiaoyu Yao edited comment on HDFS-10906 at 9/27/16 5:50 AM: Below is a

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache.java

2016-09-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15525167#comment-15525167 ] Xiaoyu Yao commented on HDFS-10690: --- Thanks [~fenghua_hu] for updating the patch. +1 for patch v6

[jira] [Updated] (HDFS-9895) Remove unnecessary conf cache from DataNode

2016-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9895: Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524856#comment-15524856 ] Hadoop QA commented on HDFS-10824: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524943#comment-15524943 ] Arpit Agarwal commented on HDFS-10713: -- +1 for the branch-2 patch, pending Jenkins. > Throttle

[jira] [Commented] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-26 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524980#comment-15524980 ] Xiaobing Zhou commented on HDFS-10824: -- The test failure is not related to the patch. It actually

[jira] [Updated] (HDFS-9482) Replace DatanodeInfo constructors with a builder pattern

2016-09-26 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9482: --- Attachment: HDFS-9482-002.patch Uploaded the patch to fix applicable checksystyle and

[jira] [Assigned] (HDFS-10905) Refactor DataStreamer#createBlockOutputStream

2016-09-26 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu reassigned HDFS-10905: - Assignee: Yuanbo Liu > Refactor DataStreamer#createBlockOutputStream >

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524968#comment-15524968 ] Arpit Agarwal commented on HDFS-10301: -- bq. As all storage reports in the single RPC BR satisfy the

[jira] [Commented] (HDFS-9850) DiskBalancer : Explore removing references to FsVolumeSpi

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15525002#comment-15525002 ] Hadoop QA commented on HDFS-9850: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10892) Add unit tests for HDFS command 'dfs -tail' and 'dfs -stat'

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524824#comment-15524824 ] Hadoop QA commented on HDFS-10892: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9444) Add utility to find set of available ephemeral ports to ServerSocketUtil

2016-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524878#comment-15524878 ] Hudson commented on HDFS-9444: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10492 (See

[jira] [Commented] (HDFS-9850) DiskBalancer : Explore removing references to FsVolumeSpi

2016-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524963#comment-15524963 ] Anu Engineer commented on HDFS-9850: [~manojg] Thanks for quick turnaround. I was reading code and

[jira] [Comment Edited] (HDFS-9850) DiskBalancer : Explore removing references to FsVolumeSpi

2016-09-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524963#comment-15524963 ] Anu Engineer edited comment on HDFS-9850 at 9/27/16 3:59 AM: - [~manojg] Thanks

[jira] [Created] (HDFS-10905) Refactor DataStreamer#createBlockOutputStream

2016-09-26 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10905: -- Summary: Refactor DataStreamer#createBlockOutputStream Key: HDFS-10905 URL: https://issues.apache.org/jira/browse/HDFS-10905 Project: Hadoop HDFS Issue

  1   2   >