[jira] [Commented] (HDFS-9916) OzoneHandler : Add Key handler

2016-03-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184471#comment-15184471 ] Chris Nauroth commented on HDFS-9916: - Hi [~anu]. In {{KeyProcessTemplate#handleCall}}, there is a

[jira] [Updated] (HDFS-9891) Ozone: Add container transport client

2016-03-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9891: Status: Patch Available (was: Open) > Ozone: Add container transport client >

[jira] [Updated] (HDFS-9891) Ozone: Add container transport client

2016-03-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9891: Hadoop Flags: Reviewed [~anu], thank you for updating the patch. +1 pending pre-commit. > Ozone:

[jira] [Updated] (HDFS-9891) Ozone: Add container transport client

2016-03-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9891: Target Version/s: HDFS-7240 > Ozone: Add container transport client >

[jira] [Updated] (HDFS-9873) Ozone: Add container transport server

2016-03-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9873: Resolution: Fixed Status: Resolved (was: Patch Available) The Findbugs warning is

[jira] [Commented] (HDFS-9812) Streamer threads leak if failure happens when closing DFSOutputStream

2016-03-07 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184441#comment-15184441 ] Lin Yiqun commented on HDFS-9812: - Thanks [~ajisakaa] for commit! > Streamer threads leak if failure

[jira] [Commented] (HDFS-9882) Add heartbeatsTotal in Datanode metrics

2016-03-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184426#comment-15184426 ] Hudson commented on HDFS-9882: -- SUCCESS: Integrated in Hadoop-trunk-Commit #9441 (See

[jira] [Commented] (HDFS-8786) Erasure coding: DataNode should transfer striped blocks before being decommissioned

2016-03-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184419#comment-15184419 ] Jing Zhao commented on HDFS-8786: - Thanks [~rakeshr]! For #1 I think I misread your patch so please ignore

[jira] [Updated] (HDFS-9882) Add heartbeatsTotal in Datanode metrics

2016-03-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9882: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Updated] (HDFS-9882) Add heartbeatsTotal in Datanode metrics

2016-03-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9882: Issue Type: Improvement (was: New Feature) > Add heartbeatsTotal in Datanode metrics >

[jira] [Commented] (HDFS-9882) Add heartbeatsTotal in Datanode metrics

2016-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184393#comment-15184393 ] Hadoop QA commented on HDFS-9882: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8786) Erasure coding: DataNode should transfer striped blocks before being decommissioned

2016-03-07 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184373#comment-15184373 ] Rakesh R commented on HDFS-8786: Thanks [~jingzhao] for the reviews and good comments. Could you please

[jira] [Assigned] (HDFS-9405) When starting a file, NameNode should generate EDEK in a separate thread

2016-03-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reassigned HDFS-9405: --- Assignee: Xiao Chen > When starting a file, NameNode should generate EDEK in a separate thread >

[jira] [Commented] (HDFS-9405) When starting a file, NameNode should generate EDEK in a separate thread

2016-03-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184370#comment-15184370 ] Xiao Chen commented on HDFS-9405: - Thanks all for the discussions and thoughts here. I'd like to work on

[jira] [Updated] (HDFS-9904) testCheckpointCancellationDuringUpload occasionally fails

2016-03-07 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9904: Attachment: HDFS-9904.002.patch > testCheckpointCancellationDuringUpload occasionally fails >

[jira] [Commented] (HDFS-9904) testCheckpointCancellationDuringUpload occasionally fails

2016-03-07 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184333#comment-15184333 ] Lin Yiqun commented on HDFS-9904: - Thanks [~kihwal] for concrete analysation. I am ignored for that.

[jira] [Created] (HDFS-9917) IBR accumulate more objects when SNN was down for sometime.

2016-03-07 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-9917: -- Summary: IBR accumulate more objects when SNN was down for sometime. Key: HDFS-9917 URL: https://issues.apache.org/jira/browse/HDFS-9917 Project: Hadoop

[jira] [Commented] (HDFS-9882) Add heartbeatsTotal in Datanode metrics

2016-03-07 Thread Hua Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184312#comment-15184312 ] Hua Liu commented on HDFS-9882: --- Hi [~arpiagariu] I submitted the V4 patch a few hours ago but seems jenkins

[jira] [Commented] (HDFS-9719) Refactoring ErasureCodingWorker into smaller reusable constructs

2016-03-07 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184304#comment-15184304 ] Kai Zheng commented on HDFS-9719: - Thanks Uma and Rakesh for the taking care of this, and your much time

[jira] [Commented] (HDFS-9873) Ozone: Add container transport server

2016-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184302#comment-15184302 ] Hadoop QA commented on HDFS-9873: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-03-07 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184300#comment-15184300 ] Rui Li commented on HDFS-7866: -- Thanks Walter for the suggestions. bq. separating the logic of manipulation of

[jira] [Commented] (HDFS-9719) Refactoring ErasureCodingWorker into smaller reusable constructs

2016-03-07 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184285#comment-15184285 ] Uma Maheswara Rao G commented on HDFS-9719: --- Thanks [~rakeshr] for pinging me. I will take a look

[jira] [Commented] (HDFS-9812) Streamer threads leak if failure happens when closing DFSOutputStream

2016-03-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184272#comment-15184272 ] Hudson commented on HDFS-9812: -- FAILURE: Integrated in Hadoop-trunk-Commit #9440 (See

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-03-07 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184267#comment-15184267 ] Walter Su commented on HDFS-7866: - 1. Not only javadoc, what I mean was separating the logic of

[jira] [Commented] (HDFS-9882) Add heartbeatsTotal in Datanode metrics

2016-03-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184253#comment-15184253 ] Arpit Agarwal commented on HDFS-9882: - +1 pending jenkins for the v4 patch. > Add heartbeatsTotal in

[jira] [Updated] (HDFS-9812) Streamer threads leak if failure happens when closing DFSOutputStream

2016-03-07 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-9812: Attachment: HDFS-9812-branch-2.7.patch HDFS-9812.branch-2.patch Attaching patches

[jira] [Updated] (HDFS-9812) Streamer threads leak if failure happens when closing DFSOutputStream

2016-03-07 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-9812: Resolution: Fixed Fix Version/s: 2.7.3 2.8.0 Status: Resolved

[jira] [Updated] (HDFS-9882) Add heartbeatsTotal in Datanode metrics

2016-03-07 Thread Hua Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hua Liu updated HDFS-9882: -- Status: Patch Available (was: Open) > Add heartbeatsTotal in Datanode metrics >

[jira] [Updated] (HDFS-9882) Add heartbeatsTotal in Datanode metrics

2016-03-07 Thread Hua Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hua Liu updated HDFS-9882: -- Status: Open (was: Patch Available) > Add heartbeatsTotal in Datanode metrics >

[jira] [Updated] (HDFS-9812) Streamer threads leak if failure happens when closing DFSOutputStream

2016-03-07 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-9812: Hadoop Flags: Reviewed Description: In HDFS-9794, it has solved problem of that stream thread

[jira] [Commented] (HDFS-9865) TestBlockReplacement fails intermittently in trunk

2016-03-07 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184170#comment-15184170 ] Lin Yiqun commented on HDFS-9865: - Thanks [~iwasakims] for commit! > TestBlockReplacement fails

[jira] [Updated] (HDFS-9625) set replication for empty file failed when set storage policy

2016-03-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9625: Fix Version/s: 2.8.0 > set replication for empty file failed when set storage policy >

[jira] [Commented] (HDFS-9916) OzoneHandler : Add Key handler

2016-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184157#comment-15184157 ] Hadoop QA commented on HDFS-9916: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9902) dfs.datanode.du.reserved should be difference between StorageType DISK and RAM_DISK

2016-03-07 Thread Pan Yuxuan (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184151#comment-15184151 ] Pan Yuxuan commented on HDFS-9902: -- [~brahmareddy] thanks for your quick reply and fix this issue. I think

[jira] [Updated] (HDFS-9891) Ozone: Add container transport client

2016-03-07 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9891: --- Attachment: HDFS-9891-HDFS-7240.002.patch [~cnauroth] Thanks for the review and your comments. bq. I

[jira] [Updated] (HDFS-9882) Add heartbeatsTotal in Datanode metrics

2016-03-07 Thread Hua Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hua Liu updated HDFS-9882: -- Status: Patch Available (was: Open) > Add heartbeatsTotal in Datanode metrics >

[jira] [Updated] (HDFS-9882) Add heartbeatsTotal in Datanode metrics

2016-03-07 Thread Hua Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hua Liu updated HDFS-9882: -- Attachment: 0004-HDFS-9882.Add-heartbeatsTotal-in-Datanode-metrics.patch > Add heartbeatsTotal in Datanode

[jira] [Updated] (HDFS-9882) Add heartbeatsTotal in Datanode metrics

2016-03-07 Thread Hua Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hua Liu updated HDFS-9882: -- Status: Open (was: Patch Available) > Add heartbeatsTotal in Datanode metrics >

[jira] [Updated] (HDFS-9723) Improve Namenode Throttling Against Bad Jobs with FCQ and CallerContext

2016-03-07 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9723: - Description: HDFS namenode handles RPC requests from DFS clients and internal processing from datanodes.

[jira] [Commented] (HDFS-9694) Make existing DFSClient#getFileChecksum() work for striped blocks

2016-03-07 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184046#comment-15184046 ] Kai Zheng commented on HDFS-9694: - Hi [~andrew.wang], the reported findbugs were introduced by the

[jira] [Updated] (HDFS-9873) Ozone: Add container transport server

2016-03-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9873: Hadoop Flags: Reviewed [~anu], thank you for the update. +1 for patch v003 pending pre-commit. >

[jira] [Updated] (HDFS-9873) Ozone: Add container transport server

2016-03-07 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9873: --- Attachment: HDFS-9873-HDFS-7240.003.patch [~cnauroth] Thanks for the comments and sample code

[jira] [Commented] (HDFS-9914) Fix configurable WebhDFS connect/read timeout

2016-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15184000#comment-15184000 ] Hadoop QA commented on HDFS-9914: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-03-07 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183969#comment-15183969 ] Zhe Zhang commented on HDFS-7866: - Thanks Rui for updating the patch. The latest version (v12) LGTM. I

[jira] [Updated] (HDFS-9914) Fix configurable WebhDFS connect/read timeout

2016-03-07 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9914: - Attachment: HDFS-9914.001.patch > Fix configurable WebhDFS connect/read timeout >

[jira] [Updated] (HDFS-9914) Fix configurable WebhDFS connect/read timeout

2016-03-07 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9914: - Status: Patch Available (was: Open) > Fix configurable WebhDFS connect/read timeout >

[jira] [Updated] (HDFS-9914) Fix configurable WebhDFS connect/read timeout

2016-03-07 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9914: - Description: Webhdfs specific read/connect timeout as added HDFS-9887. This ticket is opened to fix the

[jira] [Commented] (HDFS-9882) Add heartbeatsTotal in Datanode metrics

2016-03-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183887#comment-15183887 ] Arpit Agarwal commented on HDFS-9882: - bq. We think heartbeatsTotal may be a good alternative. Makes

[jira] [Commented] (HDFS-8786) Erasure coding: DataNode should transfer striped blocks before being decommissioned

2016-03-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183810#comment-15183810 ] Jing Zhao commented on HDFS-8786: - Thanks for updating the patch, [~rakeshr]! The 004 patch looks pretty

[jira] [Updated] (HDFS-9916) OzoneHandler : Add Key handler

2016-03-07 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9916: --- Attachment: HDFS-9916-HDFS-7240.001.patch > OzoneHandler : Add Key handler >

[jira] [Updated] (HDFS-9916) OzoneHandler : Add Key handler

2016-03-07 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9916: --- Status: Patch Available (was: Open) > OzoneHandler : Add Key handler > --

[jira] [Created] (HDFS-9916) OzoneHandler : Add Key handler

2016-03-07 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-9916: -- Summary: OzoneHandler : Add Key handler Key: HDFS-9916 URL: https://issues.apache.org/jira/browse/HDFS-9916 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-9913) DispCp doesn't use Trash with -delete option

2016-03-07 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9913: -- Affects Version/s: (was: 2.7.2) 2.6.0 Target Version/s: 2.8.0 > DispCp

[jira] [Commented] (HDFS-9906) Remove spammy log spew when a datanode is restarted

2016-03-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183662#comment-15183662 ] Hudson commented on HDFS-9906: -- FAILURE: Integrated in Hadoop-trunk-Commit #9438 (See

[jira] [Updated] (HDFS-9906) Remove spammy log spew when a datanode is restarted

2016-03-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9906: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Updated] (HDFS-9906) Remove spammy log spew when a datanode is restarted

2016-03-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9906: Issue Type: Improvement (was: Bug) > Remove spammy log spew when a datanode is restarted >

[jira] [Updated] (HDFS-9817) Use SLF4J in new classes

2016-03-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9817: Target Version/s: (was: HDFS-1312) > Use SLF4J in new classes > > >

[jira] [Updated] (HDFS-9817) Use SLF4J in new classes

2016-03-07 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9817: Fix Version/s: HDFS-1312 > Use SLF4J in new classes > > >

[jira] [Commented] (HDFS-9913) DispCp doesn't use Trash with -delete option

2016-03-07 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183607#comment-15183607 ] John Zhuge commented on HDFS-9913: -- The problem exists in CDH5.8.0 (2.6.0) based on my quick test. >

[jira] [Commented] (HDFS-9427) HDFS should not default to ephemeral ports

2016-03-07 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183478#comment-15183478 ] Xiao Chen commented on HDFS-9427: - bq. I know nothing about KMS so not sure if it is safe to change the

[jira] [Commented] (HDFS-9427) HDFS should not default to ephemeral ports

2016-03-07 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183446#comment-15183446 ] Colin Patrick McCabe commented on HDFS-9427: Great idea, but can we please not use port 9075?

[jira] [Created] (HDFS-9915) Typo in DistCp.html

2016-03-07 Thread John Zhuge (JIRA)
John Zhuge created HDFS-9915: Summary: Typo in DistCp.html Key: HDFS-9915 URL: https://issues.apache.org/jira/browse/HDFS-9915 Project: Hadoop HDFS Issue Type: Improvement Components:

[jira] [Assigned] (HDFS-9913) DispCp doesn't use Trash with -delete option

2016-03-07 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HDFS-9913: Assignee: John Zhuge > DispCp doesn't use Trash with -delete option >

[jira] [Commented] (HDFS-7597) DNs should not open new NN connections when webhdfs clients seek

2016-03-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183351#comment-15183351 ] Chris Nauroth commented on HDFS-7597: - bq. I'm still not sure why HDFS-8855 is/was necessary because

[jira] [Commented] (HDFS-9865) TestBlockReplacement fails intermittently in trunk

2016-03-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1518#comment-1518 ] Hudson commented on HDFS-9865: -- FAILURE: Integrated in Hadoop-trunk-Commit #9436 (See

[jira] [Assigned] (HDFS-9914) Fix configurable WebhDFS connect/read timeout

2016-03-07 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-9914: Assignee: Xiaoyu Yao > Fix configurable WebhDFS connect/read timeout >

[jira] [Commented] (HDFS-9887) WebHdfs socket timeouts should be configurable

2016-03-07 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183322#comment-15183322 ] Xiaoyu Yao commented on HDFS-9887: -- Filed HDFS-9914 for the fix. > WebHdfs socket timeouts should be

[jira] [Created] (HDFS-9914) Fix configurable WebhDFS connect/read timeout

2016-03-07 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-9914: Summary: Fix configurable WebhDFS connect/read timeout Key: HDFS-9914 URL: https://issues.apache.org/jira/browse/HDFS-9914 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9887) WebHdfs socket timeouts should be configurable

2016-03-07 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183301#comment-15183301 ] Xiaoyu Yao commented on HDFS-9887: -- Thanks [~jojochuang] for reporting this. Further reading found that

[jira] [Updated] (HDFS-9865) TestBlockReplacement fails intermittently in trunk

2016-03-07 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9865: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3

[jira] [Commented] (HDFS-9904) testCheckpointCancellationDuringUpload occasionally fails

2016-03-07 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183248#comment-15183248 ] Kihwal Lee commented on HDFS-9904: -- Thanks for working on the fix. The config is used to determine whether

[jira] [Commented] (HDFS-9887) WebHdfs socket timeouts should be configurable

2016-03-07 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183241#comment-15183241 ] Xiaoyu Yao commented on HDFS-9887: -- Agree, this is a bug. Webhdfs with ssl configuration exception will

[jira] [Commented] (HDFS-9634) webhdfs client side exceptions don't provide enough details

2016-03-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183227#comment-15183227 ] Wei-Chiu Chuang commented on HDFS-9634: --- This seems to contain a bug: After the exception is

[jira] [Commented] (HDFS-9905) TestWebHdfsTimeouts fails occasionally

2016-03-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183225#comment-15183225 ] Wei-Chiu Chuang commented on HDFS-9905: --- [~kihwal]: you are right. This is unrelated to HDFS-9887,

[jira] [Commented] (HDFS-9887) WebHdfs socket timeouts should be configurable

2016-03-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183218#comment-15183218 ] Wei-Chiu Chuang commented on HDFS-9887: --- I think this patch is not complete -- if for some reason SSL

[jira] [Commented] (HDFS-9905) TestWebHdfsTimeouts fails occasionally

2016-03-07 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183214#comment-15183214 ] Kihwal Lee commented on HDFS-9905: -- bq. Looks like a regression introduced after HDFS-9887 We were seeing

[jira] [Commented] (HDFS-9905) TestWebHdfsTimeouts fails occasionally

2016-03-07 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183212#comment-15183212 ] Wei-Chiu Chuang commented on HDFS-9905: --- This is the full stacktrace: unfortunately, the exception

[jira] [Commented] (HDFS-9874) Long living DataXceiver threads cause volume shutdown to block.

2016-03-07 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183159#comment-15183159 ] Daryn Sharp commented on HDFS-9874: --- The synchronization on {{FSDatasetImpl#stopAllDataxceiverThreads}}

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-03-07 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183118#comment-15183118 ] Walter Su commented on HDFS-7866: - What do you think let it diverge instead of forcing unification? It

[jira] [Commented] (HDFS-7597) DNs should not open new NN connections when webhdfs clients seek

2016-03-07 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183095#comment-15183095 ] Daryn Sharp commented on HDFS-7597: --- [~cnauroth] We can re-brand this as a more general improvement since

[jira] [Commented] (HDFS-9865) TestBlockReplacement fails intermittently in trunk

2016-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183061#comment-15183061 ] Hadoop QA commented on HDFS-9865: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9902) dfs.datanode.du.reserved should be difference between StorageType DISK and RAM_DISK

2016-03-07 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182982#comment-15182982 ] Brahma Reddy Battula commented on HDFS-9902: [~panyuxuan] thanks for reporting this issue.. I

[jira] [Updated] (HDFS-9902) dfs.datanode.du.reserved should be difference between StorageType DISK and RAM_DISK

2016-03-07 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9902: --- Attachment: HDFS-9902.patch > dfs.datanode.du.reserved should be difference between

[jira] [Commented] (HDFS-9521) TransferFsImage.receiveFile should account and log separate times for image download and fsync to disk

2016-03-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182950#comment-15182950 ] Hudson commented on HDFS-9521: -- FAILURE: Integrated in Hadoop-trunk-Commit #9433 (See

[jira] [Updated] (HDFS-9521) TransferFsImage.receiveFile should account and log separate times for image download and fsync to disk

2016-03-07 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-9521: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Status: Resolved (was:

[jira] [Commented] (HDFS-9521) TransferFsImage.receiveFile should account and log separate times for image download and fsync to disk

2016-03-07 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182915#comment-15182915 ] Harsh J commented on HDFS-9521: --- +1. The check-point related tests in one of the tests seemed relevant but

[jira] [Commented] (HDFS-9865) TestBlockReplacement fails intermittently in trunk

2016-03-07 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182887#comment-15182887 ] Lin Yiqun commented on HDFS-9865: - Thanks [~iwasakims] for review. Update the latest patch for addressing

[jira] [Updated] (HDFS-9865) TestBlockReplacement fails intermittently in trunk

2016-03-07 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9865: Attachment: HDFS-9865.002.patch > TestBlockReplacement fails intermittently in trunk >

[jira] [Commented] (HDFS-9521) TransferFsImage.receiveFile should account and log separate times for image download and fsync to disk

2016-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182879#comment-15182879 ] Hadoop QA commented on HDFS-9521: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7866) Erasure coding: NameNode manages multiple erasure coding policies

2016-03-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15182845#comment-15182845 ] Hadoop QA commented on HDFS-7866: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9521) TransferFsImage.receiveFile should account and log separate times for image download and fsync to disk

2016-03-07 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J updated HDFS-9521: -- Attachment: HDFS-9521.004.patch LGTM. Just had two checkstyle nits I've corrected in this variant, aside of