[jira] [Commented] (HDFS-11067) DFS#listStatusIterator(..) should throw FileNotFoundException if the directory deleted before fetching next batch of entries

2017-03-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950370#comment-15950370 ] Andrew Wang commented on HDFS-11067: Hi folks, should we revive this one? I'm hoping to get all

[jira] [Commented] (HDFS-240) Should HDFS restrict the names used for files?

2017-03-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950369#comment-15950369 ] Andrew Wang commented on HDFS-240: -- Hi [~jzhuge] do you still plan to work on this for Hadoop 3? Given the

[jira] [Updated] (HDFS-4389) Non-HA DFSClients do not attempt reconnects

2017-03-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-4389: -- Priority: Major (was: Critical) Downgrading this to Major since it's been inactive for years. I think

[jira] [Updated] (HDFS-11551) Handle SlowDiskReport from DataNode at the NameNode

2017-03-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11551: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Comment Edited] (HDFS-11519) Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis

2017-03-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950355#comment-15950355 ] Tsz Wo Nicholas Sze edited comment on HDFS-11519 at 3/31/17 5:39 AM: -

[jira] [Updated] (HDFS-11519) Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis

2017-03-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11519: --- Attachment: HDFS-11519-HDFS-7240.20170331.patch Thanks [~anu], the have been sync'ed

[jira] [Commented] (HDFS-11519) Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis

2017-03-30 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950353#comment-15950353 ] Tsz Wo Nicholas Sze commented on HDFS-11519: > ... One comment, probably we should a file JIRA

[jira] [Updated] (HDFS-4493) webhdfs fails after SPNEGO token expires

2017-03-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-4493: -- Priority: Major (was: Critical) I'm downgrading this to major so it stops showing up on the release

[jira] [Updated] (HDFS-11603) Make slow mirror/disk warnings in BlockReceiver more useful

2017-03-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11603: - Attachment: HDFS-11603.01.patch > Make slow mirror/disk warnings in BlockReceiver more useful >

[jira] [Updated] (HDFS-11603) Make slow mirror/disk warnings in BlockReceiver more useful

2017-03-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11603: - Status: Patch Available (was: Open) > Make slow mirror/disk warnings in BlockReceiver more

[jira] [Updated] (HDFS-11583) Parent spans not initialized to NullScope for every DFSPacket

2017-03-30 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-11583: Affects Version/s: (was: 2.7.3) 2.7.1 > Parent spans not

[jira] [Updated] (HDFS-11583) Parent spans not initialized to NullScope for every DFSPacket

2017-03-30 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-11583: Affects Version/s: 2.7.3 > Parent spans not initialized to NullScope for every DFSPacket >

[jira] [Created] (HDFS-11603) Make slow mirror/disk warnings in BlockReceiver more useful

2017-03-30 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-11603: Summary: Make slow mirror/disk warnings in BlockReceiver more useful Key: HDFS-11603 URL: https://issues.apache.org/jira/browse/HDFS-11603 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11583) Parent spans not initialized to NullScope for every DFSPacket

2017-03-30 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950332#comment-15950332 ] Masatake Iwasaki commented on HDFS-11583: - bq. hadoop-2.7 depends on htrace-4 while hbase-1 depend

[jira] [Commented] (HDFS-11583) Parent spans not initialized to NullScope for every DFSPacket

2017-03-30 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950328#comment-15950328 ] Masatake Iwasaki commented on HDFS-11583: - [~karanmehta93] , the test code of PHOENIX-3752 uses

[jira] [Commented] (HDFS-11551) Handle SlowDiskReport from DataNode at the NameNode

2017-03-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950318#comment-15950318 ] Hadoop QA commented on HDFS-11551: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11546) Federation Router RPC server

2017-03-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950304#comment-15950304 ] Hadoop QA commented on HDFS-11546: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11470) Ozone: SCM: Add SCM CLI

2017-03-30 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950295#comment-15950295 ] Yuanbo Liu commented on HDFS-11470: --- [~anu] Thanks for pinging us. Some comments: * Do we support

[jira] [Commented] (HDFS-11538) Move ClientProtocol HA proxies into hadoop-hdfs-client

2017-03-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950286#comment-15950286 ] Hadoop QA commented on HDFS-11538: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11470) Ozone: SCM: Add SCM CLI

2017-03-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950247#comment-15950247 ] Anu Engineer commented on HDFS-11470: - [~cheersyang] Thanks you for the comments and questions.

[jira] [Updated] (HDFS-11551) Handle SlowDiskReport from DataNode at the NameNode

2017-03-30 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11551: -- Attachment: HDFS-11551.010.patch Fixed unit test error in patch v10. > Handle SlowDiskReport

[jira] [Commented] (HDFS-11470) Ozone: SCM: Add SCM CLI

2017-03-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950224#comment-15950224 ] Weiwei Yang commented on HDFS-11470: Hi [~anu] Thanks for creating this, looks really good. I have

[jira] [Updated] (HDFS-11546) Federation Router RPC server

2017-03-30 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11546: --- Attachment: HDFS-11546-HDFS-10467-004.patch Fixed unit tests. > Federation Router RPC server >

[jira] [Commented] (HDFS-11538) Move ClientProtocol HA proxies into hadoop-hdfs-client

2017-03-30 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950213#comment-15950213 ] Huafeng Wang commented on HDFS-11538: - Thanks [~busbey] for your advice. I have moved the related unit

[jira] [Updated] (HDFS-11538) Move ClientProtocol HA proxies into hadoop-hdfs-client

2017-03-30 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huafeng Wang updated HDFS-11538: Attachment: HDFS-11538.002.patch > Move ClientProtocol HA proxies into hadoop-hdfs-client >

[jira] [Commented] (HDFS-10974) Document replication factor for EC files.

2017-03-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950202#comment-15950202 ] Yiqun Lin commented on HDFS-10974: -- Thanks a lot for the review and commit, [~jojochuang]! {quote}

[jira] [Assigned] (HDFS-11598) Improve -setrep for Erasure Coded files

2017-03-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin reassigned HDFS-11598: Assignee: Yiqun Lin > Improve -setrep for Erasure Coded files >

[jira] [Created] (HDFS-11602) Enable HttpFS Tomcat access logging

2017-03-30 Thread John Zhuge (JIRA)
John Zhuge created HDFS-11602: - Summary: Enable HttpFS Tomcat access logging Key: HDFS-11602 URL: https://issues.apache.org/jira/browse/HDFS-11602 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-11566) Ozone: Document missing metrics for container operations

2017-03-30 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950184#comment-15950184 ] Yiqun Lin commented on HDFS-11566: -- Thanks for the updating the patch, [~anu]. LGTM, +1. > Ozone:

[jira] [Updated] (HDFS-11569) Ozone: Implement listKey function for KeyManager

2017-03-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11569: --- Attachment: HDFS-11569-HDFS-7240.004.patch Fixed the checkstyle issue. > Ozone: Implement listKey

[jira] [Commented] (HDFS-11601) Ozone: Compact DB should be called on Open Containers.

2017-03-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950164#comment-15950164 ] Anu Engineer commented on HDFS-11601: - Thanks for the offer. I have assigned this JIRA to you. >

[jira] [Assigned] (HDFS-11601) Ozone: Compact DB should be called on Open Containers.

2017-03-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-11601: --- Assignee: Weiwei Yang > Ozone: Compact DB should be called on Open Containers. >

[jira] [Commented] (HDFS-11601) Ozone: Compact DB should be called on Open Containers.

2017-03-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950161#comment-15950161 ] Weiwei Yang commented on HDFS-11601: Hi [~anu] I think we need to do some performance evaluation to

[jira] [Commented] (HDFS-11515) -du throws ConcurrentModificationException

2017-03-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950158#comment-15950158 ] Hadoop QA commented on HDFS-11515: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11582) Block Storage : add SCSI target access daemon

2017-03-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950136#comment-15950136 ] Hadoop QA commented on HDFS-11582: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11594) Ozone: close container should call compactDB

2017-03-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950130#comment-15950130 ] Anu Engineer commented on HDFS-11594: - [~cheersyang] Thanks for the comment. This was the same point

[jira] [Created] (HDFS-11601) Ozone: Compact DB should be called on Open Containers.

2017-03-30 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11601: --- Summary: Ozone: Compact DB should be called on Open Containers. Key: HDFS-11601 URL: https://issues.apache.org/jira/browse/HDFS-11601 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11594) Ozone: close container should call compactDB

2017-03-30 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950123#comment-15950123 ] Weiwei Yang commented on HDFS-11594: Hi [~anu], [~xyao], you maybe already aware, YARN-5008

[jira] [Updated] (HDFS-11538) Move ClientProtocol HA proxies into hadoop-hdfs-client

2017-03-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11538: --- Summary: Move ClientProtocol HA proxies into hadoop-hdfs-client (was: Move

[jira] [Commented] (HDFS-11538) Move ConfiguredFailoverProxyProvider into hadoop-hdfs-client

2017-03-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950116#comment-15950116 ] Andrew Wang commented on HDFS-11538: Thanks for working on this [~HuafengWang] this looks really,

[jira] [Commented] (HDFS-11519) Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis

2017-03-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950112#comment-15950112 ] Anu Engineer commented on HDFS-11519: - [~szetszwo] One comment, probably we should a file JIRA for

[jira] [Commented] (HDFS-11519) Ozone: Implement XceiverServerSpi and XceiverClientSpi using Ratis

2017-03-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950108#comment-15950108 ] Anu Engineer commented on HDFS-11519: - [~szetszwo] The changes look quite good. However there is a

[jira] [Updated] (HDFS-11594) Ozone: close container should call compactDB

2017-03-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11594: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target

[jira] [Updated] (HDFS-11515) -du throws ConcurrentModificationException

2017-03-30 Thread Istvan Fajth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Fajth updated HDFS-11515: Release Note: In case a directory with subdirectories were removed from a directory that has a

[jira] [Commented] (HDFS-11551) Handle SlowDiskReport from DataNode at the NameNode

2017-03-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950073#comment-15950073 ] Hadoop QA commented on HDFS-11551: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11515) -du throws ConcurrentModificationException

2017-03-30 Thread Istvan Fajth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Fajth updated HDFS-11515: Attachment: HDFS-11515.001.patch Thanks [~jojochuang] for the assignment, and the possibility to

[jira] [Work started] (HDFS-11515) -du throws ConcurrentModificationException

2017-03-30 Thread Istvan Fajth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-11515 started by Istvan Fajth. --- > -du throws ConcurrentModificationException >

[jira] [Created] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2017-03-30 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-11600: -- Summary: Refactor TestDFSStripedOutputStreamWithFailure test classes Key: HDFS-11600 URL: https://issues.apache.org/jira/browse/HDFS-11600 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11566) Ozone: Document missing metrics for container operations

2017-03-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950061#comment-15950061 ] Hadoop QA commented on HDFS-11566: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-11598) Improve -setrep for Erasure Coded files

2017-03-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11598: --- Labels: hdfs-ec-3.0-nice-to-have (was: ) > Improve -setrep for Erasure Coded files >

[jira] [Commented] (HDFS-11594) Ozone: close container should call compactDB

2017-03-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950042#comment-15950042 ] Xiaoyu Yao commented on HDFS-11594: --- +1 patch v001. Discussed with [~anu] offline, will open separate

[jira] [Commented] (HDFS-11538) Move ConfiguredFailoverProxyProvider into hadoop-hdfs-client

2017-03-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950038#comment-15950038 ] Hadoop QA commented on HDFS-11538: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11592) Closing a file has a wasteful preconditions in NameNode

2017-03-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950037#comment-15950037 ] Hudson commented on HDFS-11592: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11504 (See

[jira] [Updated] (HDFS-11566) Ozone: Document missing metrics for container operations

2017-03-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11566: Attachment: HDFS-11566-HDFS-7240.004.patch [~linyiqun] I have simplified the documentation a bit.

[jira] [Updated] (HDFS-11582) Block Storage : add SCSI target access daemon

2017-03-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11582: -- Attachment: HDFS-11582-HDFS-7240.004.patch Post v004 patch to fix the license issue, the failed tests

[jira] [Updated] (HDFS-11592) Closing a file has a wasteful preconditions in NameNode

2017-03-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11592: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.1

[jira] [Commented] (HDFS-11592) Closing a file has a wasteful preconditions in NameNode

2017-03-30 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950007#comment-15950007 ] Eric Badger commented on HDFS-11592: Thanks, [~liuml07]! > Closing a file has a wasteful

[jira] [Updated] (HDFS-11592) Closing a file has a wasteful preconditions in NameNode

2017-03-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11592: - Target Version/s: 3.0.0-alpha3, 2.8.1 (was: 2.8.1) Component/s: namenode

[jira] [Commented] (HDFS-7054) Make DFSOutputStream tracing more fine-grained

2017-03-30 Thread Karan Mehta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949993#comment-15949993 ] Karan Mehta commented on HDFS-7054: --- I have hit a corner case bug from the Apache Phoenix Test documented

[jira] [Commented] (HDFS-11551) Handle SlowDiskReport from DataNode at the NameNode

2017-03-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949980#comment-15949980 ] Arpit Agarwal commented on HDFS-11551: -- +1 for the v09 patch pending Jenkins. Thanks

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-03-30 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949978#comment-15949978 ] Vinitha Reddy Gankidi commented on HDFS-11384: -- [~shv] I'm leaning towards reading from (4)

[jira] [Comment Edited] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-03-30 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949978#comment-15949978 ] Vinitha Reddy Gankidi edited comment on HDFS-11384 at 3/30/17 10:29 PM:

[jira] [Commented] (HDFS-11557) Empty directories may be recursively deleted without being listable

2017-03-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949958#comment-15949958 ] Chen Liang commented on HDFS-11557: --- [~dmtucker] I did another quick, I think this is consistent to the

[jira] [Created] (HDFS-11599) distcp interrupt does not kill hadoop job

2017-03-30 Thread David Fagnan (JIRA)
David Fagnan created HDFS-11599: --- Summary: distcp interrupt does not kill hadoop job Key: HDFS-11599 URL: https://issues.apache.org/jira/browse/HDFS-11599 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-11538) Move ConfiguredFailoverProxyProvider into hadoop-hdfs-client

2017-03-30 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949925#comment-15949925 ] Sean Busbey commented on HDFS-11538: Please do the test moves now as well. If we wait we're likely to

[jira] [Updated] (HDFS-11551) Handle SlowDiskReport from DataNode at the NameNode

2017-03-30 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11551: -- Attachment: HDFS-11551.009.patch Thank you [~arpitagarwal] for reviewing the patch and for the

[jira] [Updated] (HDFS-8874) Add DN metrics for balancer and other block movement scenarios

2017-03-30 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-8874: --- Status: In Progress (was: Patch Available) > Add DN metrics for balancer and other block movement

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-03-30 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949905#comment-15949905 ] Konstantin Shvachko commented on HDFS-11384: Combining my and Vinitha's proposals in a common

[jira] [Commented] (HDFS-10882) Federation State Store Interface API

2017-03-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949902#comment-15949902 ] Hadoop QA commented on HDFS-10882: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11470) Ozone: SCM: Add SCM CLI

2017-03-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949901#comment-15949901 ] Anu Engineer commented on HDFS-11470: - very good suggestions. I will add those to the document. >

[jira] [Commented] (HDFS-11470) Ozone: SCM: Add SCM CLI

2017-03-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949897#comment-15949897 ] Chen Liang commented on HDFS-11470: --- Thanks [~anu] for putting this up, looks good! Another thought

[jira] [Commented] (HDFS-11356) figure out what to do about hadoop-hdfs-project/hadoop-hdfs/src/main/native

2017-03-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949883#comment-15949883 ] Andrew Wang commented on HDFS-11356: There is the main libhdfs page:

[jira] [Updated] (HDFS-11538) Move ConfiguredFailoverProxyProvider into hadoop-hdfs-client

2017-03-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11538: --- Status: Patch Available (was: Open) > Move ConfiguredFailoverProxyProvider into hadoop-hdfs-client >

[jira] [Commented] (HDFS-11596) hadoop-hdfs-client jar is in the wrong directory in release tarball

2017-03-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949850#comment-15949850 ] Andrew Wang commented on HDFS-11596: Hi [~yuanbo] thanks for working on this! I ran {{mvn clean

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-03-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949824#comment-15949824 ] Mingliang Liu commented on HDFS-11384: -- Ping [~szetszwo]. > Add option for balancer to disperse

[jira] [Commented] (HDFS-11594) Ozone: close container should call compactDB

2017-03-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949822#comment-15949822 ] Anu Engineer commented on HDFS-11594: - [~xyao] Something to consider when we integrate Ratis. The

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-03-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949815#comment-15949815 ] Zhe Zhang commented on HDFS-11384: -- Also pinging [~mingma] and [~andrew.wang] since this is related to

[jira] [Commented] (HDFS-11006) Ozone: support setting chunk size in streaming API

2017-03-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949814#comment-15949814 ] Xiaoyu Yao commented on HDFS-11006: --- [~anu], I have the same suggestion on restricting the maximum chunk

[jira] [Commented] (HDFS-10533) Make DistCpOptions class immutable

2017-03-30 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949811#comment-15949811 ] Mingliang Liu commented on HDFS-10533: -- Thanks [~jnp] for review! Hi watchers, I'll commit this

[jira] [Commented] (HDFS-10533) Make DistCpOptions class immutable

2017-03-30 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949777#comment-15949777 ] Jitendra Nath Pandey commented on HDFS-10533: - +1 for the patch. > Make DistCpOptions class

[jira] [Commented] (HDFS-11594) Ozone: close container should call compactDB

2017-03-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949778#comment-15949778 ] Xiaoyu Yao commented on HDFS-11594: --- Thanks [~anu] for working on this. Patch looks good to me. I only

[jira] [Comment Edited] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-03-30 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949757#comment-15949757 ] Vinitha Reddy Gankidi edited comment on HDFS-11384 at 3/30/17 8:36 PM:

[jira] [Comment Edited] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-03-30 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949757#comment-15949757 ] Vinitha Reddy Gankidi edited comment on HDFS-11384 at 3/30/17 8:36 PM:

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-03-30 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949757#comment-15949757 ] Vinitha Reddy Gankidi commented on HDFS-11384: -- If we were to offload the calls to DN,

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-03-30 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949731#comment-15949731 ] Zhe Zhang commented on HDFS-11384: -- Great discussions [~shv] and [~redvine]. I suggest we keep this JIRA

[jira] [Updated] (HDFS-10882) Federation State Store Interface API

2017-03-30 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-10882: --- Attachment: HDFS-10882-HDFS-10467-004.patch Fixed checkstyle, javadocs and findbugs. > Federation

[jira] [Updated] (HDFS-11470) Ozone: SCM: Add SCM CLI

2017-03-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11470: Description: This jira the describes the SCM CLI. Since CLI will have lots of commands, we will

[jira] [Updated] (HDFS-11470) Ozone: SCM: Add SCM CLI to access node and container information

2017-03-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11470: Attachment: storage-container-manager-cli-v001.pdf [~cheersyang] [~yuanbo] [~vagarychen] [~msingh]

[jira] [Updated] (HDFS-11470) Ozone: SCM: Add SCM CLI

2017-03-30 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11470: Summary: Ozone: SCM: Add SCM CLI (was: Ozone: SCM: Add SCM CLI to access node and container

[jira] [Commented] (HDFS-10974) Document replication factor for EC files.

2017-03-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949624#comment-15949624 ] Hudson commented on HDFS-10974: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11500 (See

[jira] [Updated] (HDFS-11546) Federation Router RPC server

2017-03-30 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated HDFS-11546: --- Attachment: HDFS-11546-HDFS-10467-003.patch Fixing bind host and check style. > Federation Router

[jira] [Commented] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-03-30 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949593#comment-15949593 ] Vinitha Reddy Gankidi commented on HDFS-11384: -- Two other approaches to fix this: 1. In

[jira] [Commented] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-03-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949590#comment-15949590 ] Chen Liang commented on HDFS-11530: --- Thanks [~linyiqun] for looking into it! I would definitely want to

[jira] [Comment Edited] (HDFS-11557) Empty directories may be recursively deleted without being listable

2017-03-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949564#comment-15949564 ] Chen Liang edited comment on HDFS-11557 at 3/30/17 6:34 PM: [~dmtucker], I'm

[jira] [Commented] (HDFS-7573) Consolidate the implementation of delete() into a single class

2017-03-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949567#comment-15949567 ] Chen Liang commented on HDFS-7573: -- Hi [~wheat9], do you mind taking a quick like at HDFS-11557? There is

[jira] [Commented] (HDFS-11557) Empty directories may be recursively deleted without being listable

2017-03-30 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949564#comment-15949564 ] Chen Liang commented on HDFS-11557: --- [~dmtucker], I'm no expert on this code path, but given that it

[jira] [Commented] (HDFS-11472) Fix inconsistent replica size after a data pipeline failure

2017-03-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949543#comment-15949543 ] Hadoop QA commented on HDFS-11472: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-10974) Document replication factor for EC files.

2017-03-30 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10974: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3

[jira] [Commented] (HDFS-11503) Integrate Chocolate Cloud RS coder implementation

2017-03-30 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949507#comment-15949507 ] Andrew Wang commented on HDFS-11503: If the CC implementation isn't open-source or at least freely

[jira] [Created] (HDFS-11598) Improve -setrep for Erasure Coded files

2017-03-30 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11598: -- Summary: Improve -setrep for Erasure Coded files Key: HDFS-11598 URL: https://issues.apache.org/jira/browse/HDFS-11598 Project: Hadoop HDFS Issue Type:

  1   2   >