[jira] [Commented] (HDFS-9046) Any Error during BPOfferService run can leads to Missing DN.

2015-09-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14902857#comment-14902857 ] Chris Nauroth commented on HDFS-9046: - [~vinayrpet], thanks for the notification. This one is near the

[jira] [Updated] (HDFS-9103) Retry reads on DN failure

2015-09-22 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9103: - Attachment: HDFS-9103.HDFS-8707.5.patch > Retry reads on DN failure > - > >

[jira] [Commented] (HDFS-9107) Prevent NN's unrecoverable death spiral after full GC

2015-09-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903077#comment-14903077 ] Colin Patrick McCabe commented on HDFS-9107: Also (although I don't feel strongly about this),

[jira] [Work started] (HDFS-9062) Add a parameter to MiniDFSCluster to turn off security checks on the domain socked path

2015-09-22 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-9062 started by James Clampffer. - > Add a parameter to MiniDFSCluster to turn off security checks on the domain

[jira] [Commented] (HDFS-7529) Consolidate encryption zone related implementation into a single class

2015-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903282#comment-14903282 ] Hadoop QA commented on HDFS-7529: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8873) throttle directoryScanner

2015-09-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903220#comment-14903220 ] Colin Patrick McCabe commented on HDFS-8873: Thanks, [~templedf]. {code} 416 if

[jira] [Commented] (HDFS-8632) Erasure Coding: Add InterfaceAudience annotation to the erasure coding classes

2015-09-22 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903242#comment-14903242 ] Rakesh R commented on HDFS-8632: Thanks again [~zhz]. Attached another patch addressing the above comment.

[jira] [Commented] (HDFS-8632) Erasure Coding: Add InterfaceAudience annotation to the erasure coding classes

2015-09-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903167#comment-14903167 ] Zhe Zhang commented on HDFS-8632: - Thanks Andrew for the input. Per the above discussion I think we should

[jira] [Updated] (HDFS-8632) Erasure Coding: Add InterfaceAudience annotation to the erasure coding classes

2015-09-22 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8632: --- Attachment: HDFS-8632-HDFS-7285-04.patch > Erasure Coding: Add InterfaceAudience annotation to the erasure

[jira] [Commented] (HDFS-9109) dfs.datanode.dns.interface does not work with hosts file based setups

2015-09-22 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903232#comment-14903232 ] Anu Engineer commented on HDFS-9109: +1 (non-binding) Had some minor nitpicks : # In the DNS.java, we

[jira] [Commented] (HDFS-8632) Erasure Coding: Add InterfaceAudience annotation to the erasure coding classes

2015-09-22 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903165#comment-14903165 ] Rakesh R commented on HDFS-8632: Thank you [~zhz], [~andrew.wang] for the reviews. Hi [~zhz], is there

[jira] [Commented] (HDFS-9013) Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk

2015-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903196#comment-14903196 ] Hadoop QA commented on HDFS-9013: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9076) Log full path instead of inodeId in DFSClient#closeAllFilesBeingWritten()

2015-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903238#comment-14903238 ] Hadoop QA commented on HDFS-9076: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-8920) Erasure Coding: when recovering lost blocks, logs can be too verbose and hurt performance

2015-09-22 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8920: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) It was

[jira] [Commented] (HDFS-9111) Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient

2015-09-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14902008#comment-14902008 ] Hudson commented on HDFS-9111: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1161 (See

[jira] [Updated] (HDFS-8920) Erasure Coding: when recovering lost blocks, logs can be too verbose and hurt performance

2015-09-22 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8920: Fix Version/s: HDFS-7285 > Erasure Coding: when recovering lost blocks, logs can be too verbose and hurt >

[jira] [Commented] (HDFS-8920) Erasure Coding: when recovering lost blocks, logs can be too verbose and hurt performance

2015-09-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14902027#comment-14902027 ] Zhe Zhang commented on HDFS-8920: - Thanks Rui for the work and Kai for the final review. Moving this back

[jira] [Updated] (HDFS-8780) Fetching live/dead datanode list with arg true for removeDecommissionNode,returns list with decom node.

2015-09-22 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8780: Priority: Major (was: Critical) > Fetching live/dead datanode list with arg true for >

[jira] [Updated] (HDFS-8780) Fetching live/dead datanode list with arg true for removeDecommissionNode,returns list with decom node.

2015-09-22 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8780: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Updated] (HDFS-9013) Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk

2015-09-22 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-9013: - Status: Open (was: Patch Available) > Deprecate NameNodeMXBean#getNNStarted in

[jira] [Commented] (HDFS-9111) Move hdfs-client protobuf convert methods from PBHelper to PBHelperClient

2015-09-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14902013#comment-14902013 ] Hudson commented on HDFS-9111: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #429 (See

[jira] [Updated] (HDFS-9013) Deprecate NameNodeMXBean#getNNStarted in branch2 and remove from trunk

2015-09-22 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-9013: - Attachment: (was: HDFS-9013.003-branch-2.patch) > Deprecate

[jira] [Updated] (HDFS-8920) Erasure Coding: when recovering lost blocks, logs can be too verbose and hurt performance

2015-09-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8920: Parent Issue: HDFS-7285 (was: HDFS-8031) > Erasure Coding: when recovering lost blocks, logs can be too

[jira] [Commented] (HDFS-8920) Erasure Coding: when recovering lost blocks, logs can be too verbose and hurt performance

2015-09-22 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14902070#comment-14902070 ] Rui Li commented on HDFS-8920: -- Thanks guys for the review. > Erasure Coding: when recovering lost blocks,

[jira] [Created] (HDFS-9123) Validation of a path ended with a '/'

2015-09-22 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-9123: - Summary: Validation of a path ended with a '/' Key: HDFS-9123 URL: https://issues.apache.org/jira/browse/HDFS-9123 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9057) allow/disallow snapshots via webhdfs

2015-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14902975#comment-14902975 ] Hadoop QA commented on HDFS-9057: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9095) RPC client should fail gracefully when the connection is timed out or reset

2015-09-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9095: - Attachment: HDFS-9095.001.patch > RPC client should fail gracefully when the connection is timed out or

[jira] [Commented] (HDFS-7955) Improve naming of classes, methods, and variables related to block replication and recovery

2015-09-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903030#comment-14903030 ] Zhe Zhang commented on HDFS-7955: - [~rakeshr] I think Andrew's suggestion above is consistent with your

[jira] [Commented] (HDFS-9124) NullPointerException when underreplicated blocks are there

2015-09-22 Thread Syed Akram (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903060#comment-14903060 ] Syed Akram commented on HDFS-9124: -- when under replicated blocks are transferring from source to

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

2015-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903050#comment-14903050 ] Hadoop QA commented on HDFS-9103: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-9109) dfs.datanode.dns.interface does not work with hosts file based setups

2015-09-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9109: Attachment: HDFS-9109.03.patch v03 patch attached. This fix is hard to add a unit test without

[jira] [Updated] (HDFS-9110) Improve upon HDFS-8480

2015-09-22 Thread Charlie Helin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charlie Helin updated HDFS-9110: Status: Open (was: Patch Available) > Improve upon HDFS-8480 > -- > >

[jira] [Updated] (HDFS-9110) Improve upon HDFS-8480

2015-09-22 Thread Charlie Helin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charlie Helin updated HDFS-9110: Status: Patch Available (was: Open) > Improve upon HDFS-8480 > -- > >

[jira] [Updated] (HDFS-9110) Improve upon HDFS-8480

2015-09-22 Thread Charlie Helin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charlie Helin updated HDFS-9110: Attachment: HDFS-9110.05.patch Removed unused imports > Improve upon HDFS-8480 >

[jira] [Commented] (HDFS-9095) RPC client should fail gracefully when the connection is timed out or reset

2015-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903152#comment-14903152 ] Hadoop QA commented on HDFS-9095: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-8873) throttle directoryScanner

2015-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8873: --- Attachment: HDFS-8873.005.patch Here's a new patch with greatly reduced scope. [~cmccabe] and

[jira] [Moved] (HDFS-9124) NullPointerException when underreplicated blocks are there

2015-09-22 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash moved HADOOP-12429 to HDFS-9124: - Affects Version/s: (was: 2.7.1) 2.7.1

[jira] [Commented] (HDFS-9124) NullPointerException when underreplicated blocks are there

2015-09-22 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903023#comment-14903023 ] Ravi Prakash commented on HDFS-9124: Thanks for reporting the issue Syed! Could you please detail when

[jira] [Commented] (HDFS-9110) Improve upon HDFS-8480

2015-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903033#comment-14903033 ] Hadoop QA commented on HDFS-9110: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-8696) Reduce the variances of latency of WebHDFS

2015-09-22 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-8696: - Attachment: HDFS-8696.005.patch That seems a good, low-risk approach to the issue. I took the liberty of

[jira] [Commented] (HDFS-9107) Prevent NN's unrecoverable death spiral after full GC

2015-09-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903048#comment-14903048 ] Colin Patrick McCabe commented on HDFS-9107: I guess if we want to be 100% correct, we have to

[jira] [Updated] (HDFS-9109) dfs.datanode.dns.interface does not work with hosts file based setups

2015-09-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9109: Attachment: (was: HDFS-9109.03.patch) > dfs.datanode.dns.interface does not work with hosts file

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

2015-09-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903140#comment-14903140 ] Haohui Mai commented on HDFS-9103: -- bq. I propose (perhaps in another jira), that we separate FileHandle

[jira] [Commented] (HDFS-7955) Improve naming of classes, methods, and variables related to block replication and recovery

2015-09-22 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903144#comment-14903144 ] Rakesh R commented on HDFS-7955: OK, thank [~zhz] for the reply. As the jira is marked for second phase,

[jira] [Updated] (HDFS-9076) Log full path instead of inodeId in DFSClient#closeAllFilesBeingWritten()

2015-09-22 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-9076: - Attachment: HDFS-9076.01.patch Thanks [~vinayrpet] for review, Attached updated

[jira] [Commented] (HDFS-9122) DN automatically add more volumes to avoid large volume

2015-09-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14902920#comment-14902920 ] Colin Patrick McCabe commented on HDFS-9122: It is an interesting idea, but I think moving to

[jira] [Updated] (HDFS-8882) Use datablocks, parityblocks and cell size from ErasureCodingPolicy

2015-09-22 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8882: Attachment: HDFS-8882-HDFS-7285-03.patch Updated the patch as per [~zhz]'s comments. Please review.

[jira] [Updated] (HDFS-9109) dfs.datanode.dns.interface does not work with hosts file based setups

2015-09-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9109: Attachment: HDFS-9109.03.patch > dfs.datanode.dns.interface does not work with hosts file based

[jira] [Commented] (HDFS-9095) RPC client should fail gracefully when the connection is timed out or reset

2015-09-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903134#comment-14903134 ] Haohui Mai commented on HDFS-9095: -- Thanks [~James Clampffer] and [~bobhansen] for the reviews. The v1

[jira] [Commented] (HDFS-8873) throttle directoryScanner

2015-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903415#comment-14903415 ] Daniel Templeton commented on HDFS-8873: bq. Can we have a constant here for MS_PER_SEC? I think I

[jira] [Comment Edited] (HDFS-9053) Support large directories efficiently using B-Tree

2015-09-22 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903725#comment-14903725 ] Yi Liu edited comment on HDFS-9053 at 9/23/15 12:40 AM: The Jenkins has some issue

[jira] [Commented] (HDFS-9080) update htrace version to 4.0

2015-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903721#comment-14903721 ] Hadoop QA commented on HDFS-9080: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8882) Use datablocks, parityblocks and cell size from ErasureCodingPolicy

2015-09-22 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903813#comment-14903813 ] Walter Su commented on HDFS-8882: - +1 > Use datablocks, parityblocks and cell size from

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-09-22 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903774#comment-14903774 ] Ming Ma commented on HDFS-8647: --- Thanks [~brahmareddy] for the useful analysis! My preference is to keep the

[jira] [Updated] (HDFS-7529) Consolidate encryption zone related implementation into a single class

2015-09-22 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-7529: --- Attachment: HDFS-7529-004.patch > Consolidate encryption zone related implementation into a single class >

[jira] [Commented] (HDFS-9053) Support large directories efficiently using B-Tree

2015-09-22 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903725#comment-14903725 ] Yi Liu commented on HDFS-9053: -- The Jenkins has some issue and the test failures are not related. The reason

[jira] [Commented] (HDFS-9109) dfs.datanode.dns.interface does not work with hosts file based setups

2015-09-22 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903739#comment-14903739 ] Jitendra Nath Pandey commented on HDFS-9109: [~arpitagarwal], getIPs method has some common

[jira] [Commented] (HDFS-9039) Split o.a.h.hdfs.NameNodeProxies class into two classes in hadoop-hdfs-client and hadoop-hdfs modules respectively

2015-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903858#comment-14903858 ] Hadoop QA commented on HDFS-9039: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9039) Split o.a.h.hdfs.NameNodeProxies class into two classes in hadoop-hdfs-client and hadoop-hdfs modules respectively

2015-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903420#comment-14903420 ] Hadoop QA commented on HDFS-9039: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9110) Improve upon HDFS-8480

2015-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903544#comment-14903544 ] Hadoop QA commented on HDFS-9110: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9039) Split o.a.h.hdfs.NameNodeProxies class into two classes in hadoop-hdfs-client and hadoop-hdfs modules respectively

2015-09-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903429#comment-14903429 ] Haohui Mai commented on HDFS-9039: -- +1 > Split o.a.h.hdfs.NameNodeProxies class into two classes in

[jira] [Commented] (HDFS-8733) Keep server related definition in hdfs.proto on server side

2015-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903519#comment-14903519 ] Hadoop QA commented on HDFS-8733: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8882) Use datablocks, parityblocks and cell size from ErasureCodingPolicy

2015-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903492#comment-14903492 ] Hadoop QA commented on HDFS-8882: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8873) throttle directoryScanner

2015-09-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903507#comment-14903507 ] Colin Patrick McCabe commented on HDFS-8873: bq. I didn't do that in this patch because I

[jira] [Commented] (HDFS-8696) Reduce the variances of latency of WebHDFS

2015-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903432#comment-14903432 ] Hadoop QA commented on HDFS-8696: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9108) InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

2015-09-22 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903536#comment-14903536 ] James Clampffer commented on HDFS-9108: --- Thanks for the patch! Looks like everything works; I'm

[jira] [Commented] (HDFS-9040) Erasure coding: Refactor DFSStripedOutputStream (Move Namenode RPC Requests to Coordinator)

2015-09-22 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903889#comment-14903889 ] Walter Su commented on HDFS-9040: - bq. 1. Flush out all the enqueued data to DataNodes before handling

[jira] [Updated] (HDFS-9039) Separate client and server side methods of o.a.h.hdfs.NameNodeProxies

2015-09-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9039: - Summary: Separate client and server side methods of o.a.h.hdfs.NameNodeProxies (was: Split

[jira] [Commented] (HDFS-8733) Keep server related definition in hdfs.proto on server side

2015-09-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903909#comment-14903909 ] Haohui Mai commented on HDFS-8733: -- +1. Will commit shortly. > Keep server related definition in

[jira] [Updated] (HDFS-9039) Separate client and server side methods of o.a.h.hdfs.NameNodeProxies

2015-09-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9039: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Created] (HDFS-9125) Display help if the command option to "hdfs dfs " is not valid

2015-09-22 Thread nijel (JIRA)
nijel created HDFS-9125: --- Summary: Display help if the command option to "hdfs dfs " is not valid Key: HDFS-9125 URL: https://issues.apache.org/jira/browse/HDFS-9125 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-9039) Split o.a.h.hdfs.NameNodeProxies class into two classes in hadoop-hdfs-client and hadoop-hdfs modules respectively

2015-09-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903901#comment-14903901 ] Haohui Mai commented on HDFS-9039: -- +1 on the latest patch. Will commit shortly. > Split

[jira] [Commented] (HDFS-9040) Erasure coding: Refactor DFSStripedOutputStream (Move Namenode RPC Requests to Coordinator)

2015-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903906#comment-14903906 ] Hadoop QA commented on HDFS-9040: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9039) Separate client and server side methods of o.a.h.hdfs.NameNodeProxies

2015-09-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903921#comment-14903921 ] Hudson commented on HDFS-9039: -- FAILURE: Integrated in Hadoop-trunk-Commit #8501 (See

[jira] [Commented] (HDFS-8733) Keep server related definition in hdfs.proto on server side

2015-09-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903922#comment-14903922 ] Hudson commented on HDFS-8733: -- FAILURE: Integrated in Hadoop-trunk-Commit #8501 (See

[jira] [Updated] (HDFS-9123) Validation of a path ended with a '/'

2015-09-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9123: -- Attachment: HDFS-9123.002.patch > Validation of a path ended with a '/' >

[jira] [Updated] (HDFS-9123) Validation of a path ended with a '/'

2015-09-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9123: -- Status: Open (was: Patch Available) > Validation of a path ended with a '/' >

[jira] [Commented] (HDFS-9120) Metric logging values are truncated in NN Metrics log.

2015-09-22 Thread Kanaka Kumar Avvaru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14904002#comment-14904002 ] Kanaka Kumar Avvaru commented on HDFS-9120: --- Thanks for reporting the issue [~archanat]. I think

[jira] [Commented] (HDFS-9039) Separate client and server side methods of o.a.h.hdfs.NameNodeProxies

2015-09-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903948#comment-14903948 ] Hudson commented on HDFS-9039: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #425 (See

[jira] [Commented] (HDFS-8733) Keep server related definition in hdfs.proto on server side

2015-09-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903949#comment-14903949 ] Hudson commented on HDFS-8733: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #425 (See

[jira] [Commented] (HDFS-7529) Consolidate encryption zone related implementation into a single class

2015-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903956#comment-14903956 ] Hadoop QA commented on HDFS-7529: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-8733) Keep server related definition in hdfs.proto on server side

2015-09-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903984#comment-14903984 ] Hudson commented on HDFS-8733: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1165 (See

[jira] [Commented] (HDFS-9039) Separate client and server side methods of o.a.h.hdfs.NameNodeProxies

2015-09-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903983#comment-14903983 ] Hudson commented on HDFS-9039: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1165 (See

[jira] [Updated] (HDFS-8053) Move DFSIn/OutputStream and related classes to hadoop-hdfs-client

2015-09-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-8053: Attachment: HDFS-8053.000.patch The v0 patch is the first effort of addressing this jira. As many

[jira] [Updated] (HDFS-9040) Erasure coding: Refactor DFSStripedOutputStream (Move Namenode RPC Requests to Coordinator)

2015-09-22 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9040: Description: The general idea is to simplify error handling logic. -Proposal 1:- -A BlockGroupDataStreamer

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2015-09-22 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903897#comment-14903897 ] Zhe Zhang commented on HDFS-7285: - The Jenkins [job |

[jira] [Commented] (HDFS-9123) Validation of a path ended with a '/'

2015-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903912#comment-14903912 ] Hadoop QA commented on HDFS-9123: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-8733) Keep server related definition in hdfs.proto on server side

2015-09-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8733: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Updated] (HDFS-9123) Validation of a path ended with a '/'

2015-09-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9123: -- Status: Patch Available (was: Open) My patch did not touch IPC at all. I ran all tests locally

[jira] [Commented] (HDFS-8733) Keep server related definition in hdfs.proto on server side

2015-09-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903968#comment-14903968 ] Hudson commented on HDFS-8733: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2371 (See

[jira] [Commented] (HDFS-9039) Separate client and server side methods of o.a.h.hdfs.NameNodeProxies

2015-09-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903967#comment-14903967 ] Hudson commented on HDFS-9039: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2371 (See

[jira] [Commented] (HDFS-9108) InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

2015-09-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903575#comment-14903575 ] Haohui Mai commented on HDFS-9108: -- I'm able to reproduce the issue by just using the main thread to run

[jira] [Commented] (HDFS-9004) Add upgrade domain to DatanodeInfo

2015-09-22 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903600#comment-14903600 ] Ming Ma commented on HDFS-9004: --- Thanks [~eddyxu], [~shahrs87] and [~ctrezzo]. > Add upgrade domain to

[jira] [Updated] (HDFS-9123) Validation of a path ended with a '/'

2015-09-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9123: -- Attachment: (was: HDFS-9123.001.patch) > Validation of a path ended with a '/' >

[jira] [Updated] (HDFS-9040) Erasure coding: Refactor DFSStripedOutputStream (Move Namenode RPC Requests to Coordinator)

2015-09-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9040: Attachment: HDFS-9040-HDFS-7285.004.patch Update the patch based on our discussion. The main changes

[jira] [Updated] (HDFS-9123) Validation of a path ended with a '/'

2015-09-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9123: -- Attachment: HDFS-9123.001.patch My first patch, along with a test case > Validation of a path

[jira] [Updated] (HDFS-9039) Split o.a.h.hdfs.NameNodeProxies class into two classes in hadoop-hdfs-client and hadoop-hdfs modules respectively

2015-09-22 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9039: Attachment: HDFS-9039.002.patch Thanks [~wheat9] for your review. The findbugs warning is caused by

[jira] [Updated] (HDFS-9080) update htrace version to 4.0

2015-09-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9080: --- Attachment: HDFS-9080.010.patch address latest comments > update htrace version to

[jira] [Updated] (HDFS-9123) Validation of a path ended with a '/'

2015-09-22 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9123: -- Status: Patch Available (was: Open) Fixed the buy by checking to see if the path is ended with

[jira] [Commented] (HDFS-9108) InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

2015-09-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903649#comment-14903649 ] Haohui Mai commented on HDFS-9108: -- I used your reproducer and called IoService::Run() directly. Your

  1   2   3   >