[jira] [Updated] (HDFS-10835) Typo in httpfs.sh hadoop_usage

2016-09-02 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10835: -- Attachment: HDFS-10835.004.patch Patch 004: * Fix misspelled "top" with "stop" [~xiaochen], thanks for

[jira] [Commented] (HDFS-10835) Typo in httpfs.sh hadoop_usage

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15460412#comment-15460412 ] Xiao Chen commented on HDFS-10835: -- {{hadoop_add_subcommand "top n" "Stop $name, waiting up to n seconds

[jira] [Updated] (HDFS-10835) Typo in httpfs.sh hadoop_usage

2016-09-02 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10835: -- Attachment: HDFS-10835.003.patch Patch 003: * Use {{HttpFS}} in the comment Thanks [~xiaochen] for the

[jira] [Commented] (HDFS-10835) Typo in httpfs.sh hadoop_usage

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15460388#comment-15460388 ] Xiao Chen commented on HDFS-10835: -- Thanks [~jzhuge] for working on this, and [~aw] for commenting. To

[jira] [Commented] (HDFS-10835) Typo in httpfs.sh hadoop_usage

2016-09-02 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15460386#comment-15460386 ] John Zhuge commented on HDFS-10835: --- Fixed. Thanks for catching my mistakes. > Typo in httpfs.sh

[jira] [Updated] (HDFS-10835) Typo in httpfs.sh hadoop_usage

2016-09-02 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10835: -- Target Version/s: 3.0.0-alpha2 (was: 2.8.0) > Typo in httpfs.sh hadoop_usage >

[jira] [Updated] (HDFS-10835) Typo in httpfs.sh hadoop_usage

2016-09-02 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10835: -- Affects Version/s: (was: 2.6.0) 3.0.0-alpha1 > Typo in httpfs.sh

[jira] [Updated] (HDFS-10835) Typo in httpfs.sh hadoop_usage

2016-09-02 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10835: -- Attachment: HDFS-10835.002.patch Patch 002: * Use the official name {{HttpFS}} > Typo in httpfs.sh

[jira] [Commented] (HDFS-10835) Typo in httpfs.sh hadoop_usage

2016-09-02 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15460311#comment-15460311 ] Allen Wittenauer commented on HDFS-10835: - Why is this marked as affecting 2.6.0? How can this

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15460302#comment-15460302 ] Xiao Chen commented on HDFS-9781: - Findbugs warning is due to HDFS-10745, I left a comment on that jira. >

[jira] [Commented] (HDFS-10745) Directly resolve paths into INodesInPath

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15460300#comment-15460300 ] Xiao Chen commented on HDFS-10745: -- Thanks for working on this, Daryn and Kihwal. It seems this change

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15460191#comment-15460191 ] Hadoop QA commented on HDFS-10713: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15460177#comment-15460177 ] Hadoop QA commented on HDFS-9781: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15460174#comment-15460174 ] Manoj Govindassamy commented on HDFS-9781: -- As [~xiaochen] mentioned, the updated test case

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15460168#comment-15460168 ] Hadoop QA commented on HDFS-9781: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-02 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-10713: -- Attachment: HDFS-10713.003.patch Capturing and logging the longest lock held interval in each

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459992#comment-15459992 ] Xiao Chen commented on HDFS-9781: - Discussed this offline with Manoj. This jira fixes the NPE, and also

[jira] [Updated] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9781: Attachment: HDFS-9781.branch-2.001.patch Hm, when I locally ran the test it actually timed out. Attaching a

[jira] [Commented] (HDFS-10819) BlockManager fails to store a good block for a datanode storage after it reported a corrupt block — block replication stuck

2016-09-02 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459935#comment-15459935 ] Manoj Govindassamy commented on HDFS-10819: --- [~andrew.wang], Thanks for reviewing the patch.

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459931#comment-15459931 ] Xiao Chen commented on HDFS-9781: - Branch-2 patch looks good too, committing shortly. >

[jira] [Updated] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-9781: - Attachment: HDFS-9781-branch-2.001.patch > FsDatasetImpl#getBlockReports can occasionally

[jira] [Updated] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-9781: - Attachment: (was: HDFS-9781-branch2.001.patch) > FsDatasetImpl#getBlockReports can

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459916#comment-15459916 ] Hadoop QA commented on HDFS-9781: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-9781: - Attachment: HDFS-9781-branch2.001.patch Attaching branch2 patch. Removed the test

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459831#comment-15459831 ] Hudson commented on HDFS-9781: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10394 (See

[jira] [Commented] (HDFS-10475) Adding metrics for long FSNamesystem read and write locks

2016-09-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459801#comment-15459801 ] Mingliang Liu commented on HDFS-10475: -- A complete op->lock time will be feasible for sure. To obtain

[jira] [Commented] (HDFS-10834) Add concat to libhdfs API

2016-09-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459784#comment-15459784 ] Hadoop QA commented on HDFS-10834: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459773#comment-15459773 ] Xiao Chen commented on HDFS-9781: - I have committed this to trunk. There are some minor conflicts

[jira] [Updated] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9781: Fix Version/s: 3.0.0-alpha2 > FsDatasetImpl#getBlockReports can occasionally throw NullPointerException >

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-02 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459771#comment-15459771 ] Erik Krogen commented on HDFS-10713: In HDFS-10475 we hope to add more detailed metrics for which

[jira] [Comment Edited] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459700#comment-15459700 ] Xiao Chen edited comment on HDFS-9781 at 9/2/16 10:33 PM: -- [~jojochuang] ping'ed

[jira] [Commented] (HDFS-10819) BlockManager fails to store a good block for a datanode storage after it reported a corrupt block — block replication stuck

2016-09-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459764#comment-15459764 ] Andrew Wang commented on HDFS-10819: Thanks for working on this Manoj. Great investigation here. IIUC

[jira] [Commented] (HDFS-10713) Throttle FsNameSystem lock warnings

2016-09-02 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459759#comment-15459759 ] Mingliang Liu commented on HDFS-10713: -- {quote} If we just capture the longest lock held interval but

[jira] [Commented] (HDFS-10835) Typo in httpfs.sh hadoop_usage

2016-09-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459742#comment-15459742 ] Hadoop QA commented on HDFS-10835: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10833) Fix JSON errors in WebHDFS.md examples

2016-09-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459741#comment-15459741 ] Hudson commented on HDFS-10833: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10393 (See

[jira] [Updated] (HDFS-10834) Add concat to libhdfs API

2016-09-02 Thread Gary Helmling (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Helmling updated HDFS-10834: - Status: Patch Available (was: Open) > Add concat to libhdfs API > - > >

[jira] [Updated] (HDFS-10834) Add concat to libhdfs API

2016-09-02 Thread Gary Helmling (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Helmling updated HDFS-10834: - Attachment: HDFS-10834.001.patch Here is a patch from [~sunchensamurai] adding hdfsConcat to the

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-02 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459718#comment-15459718 ] Manoj Govindassamy commented on HDFS-10830: --- Sounds good to me. Thanks a lot [~xiaochen]. >

[jira] [Updated] (HDFS-10835) Typo in httpfs.sh hadoop_usage

2016-09-02 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10835: -- Status: Patch Available (was: Open) > Typo in httpfs.sh hadoop_usage > --

[jira] [Updated] (HDFS-10835) Typo in httpfs.sh hadoop_usage

2016-09-02 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10835: -- Attachment: HDFS-10835.001.patch Patch 001: * Replace words {{kms}} with {{https}} * No unit test for

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459708#comment-15459708 ] Xiao Chen commented on HDFS-10830: -- Thanks for working on this [~arpitagarwal] and [~manojg]. Just

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459700#comment-15459700 ] Xiao Chen commented on HDFS-9781: - [~jojochuang] ping'ed me offline saying this looks fine to me too. I'll

[jira] [Updated] (HDFS-10833) Fix JSON errors in WebHDFS.md examples

2016-09-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10833: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.8.0 Status:

[jira] [Updated] (HDFS-10822) Log DataNodes in the write pipeline

2016-09-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10822: --- Fix Version/s: (was: 3.0.0-beta1) 3.0.0-alpha2 > Log DataNodes in the write

[jira] [Commented] (HDFS-10813) DiskBalancer: Add the getNodeList method in Command

2016-09-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459670#comment-15459670 ] Andrew Wang commented on HDFS-10813: Gentle reminder to include the appropriate 3.0.0 fix version when

[jira] [Updated] (HDFS-10813) DiskBalancer: Add the getNodeList method in Command

2016-09-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10813: --- Fix Version/s: 3.0.0-alpha2 > DiskBalancer: Add the getNodeList method in Command >

[jira] [Updated] (HDFS-9392) Admins support for maintenance state

2016-09-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9392: -- Fix Version/s: 3.0.0-alpha2 > Admins support for maintenance state >

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459659#comment-15459659 ] Arpit Agarwal commented on HDFS-10830: -- [~manojg], you're right. findbugs caught it too. I'll post an

[jira] [Created] (HDFS-10836) libhdfs++: Add a NO_TOOLS and NO_EXAMPLES flag to cmake

2016-09-02 Thread Bob Hansen (JIRA)
Bob Hansen created HDFS-10836: - Summary: libhdfs++: Add a NO_TOOLS and NO_EXAMPLES flag to cmake Key: HDFS-10836 URL: https://issues.apache.org/jira/browse/HDFS-10836 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459653#comment-15459653 ] Xiao Chen commented on HDFS-9781: - Patch 3 LGTM, +1. Will wait to see if any comments from others. >

[jira] [Updated] (HDFS-10834) Add concat to libhdfs API

2016-09-02 Thread Gary Helmling (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Helmling updated HDFS-10834: - Component/s: hdfs > Add concat to libhdfs API > - > >

[jira] [Comment Edited] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-02 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459633#comment-15459633 ] Manoj Govindassamy edited comment on HDFS-10830 at 9/2/16 9:25 PM: ---

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-02 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459633#comment-15459633 ] Manoj Govindassamy commented on HDFS-10830: --- [~arpitagarwal], {quote} void

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459622#comment-15459622 ] Hadoop QA commented on HDFS-9781: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10787) libhdfs++: hdfs_configuration and configuration_loader should be accessible from our public API

2016-09-02 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459611#comment-15459611 ] Bob Hansen commented on HDFS-10787: --- For the sake of simplicity, I think we should introduce a public

[jira] [Created] (HDFS-10835) Typo in httpfs.sh hadoop_usage

2016-09-02 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10835: - Summary: Typo in httpfs.sh hadoop_usage Key: HDFS-10835 URL: https://issues.apache.org/jira/browse/HDFS-10835 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-10832) HttpFS does not use the ephemeral ACL bit introduced in HDFS-6326

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459593#comment-15459593 ] Xiao Chen commented on HDFS-10832: -- Good find Andrew! Patch looks great too. Some comments: -

[jira] [Commented] (HDFS-10475) Adding metrics for long FSNamesystem read and write locks

2016-09-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459579#comment-15459579 ] Zhe Zhang commented on HDFS-10475: -- Thanks for confirming this Xiaoyu. [~xkrogen] Has started some work

[jira] [Updated] (HDFS-10475) Adding metrics for long FSNamesystem read and write locks

2016-09-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10475: - Summary: Adding metrics for long FSNamesystem read and write locks (was: Adding metrics for long FSD

[jira] [Commented] (HDFS-10684) WebHDFS DataNode calls fail without parameter createparent

2016-09-02 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459574#comment-15459574 ] John Zhuge commented on HDFS-10684: --- Thanks [~andrew.wang] for the comment. I am looking into unit

[jira] [Updated] (HDFS-10475) Adding metrics for long FSD read and write locks

2016-09-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10475: - Summary: Adding metrics for long FSD read and write locks (was: Adding metrics for long FSD lock) >

[jira] [Updated] (HDFS-10475) Adding metrics for long FSD lock

2016-09-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10475: - Assignee: Erik Krogen (was: Xiaoyu Yao) > Adding metrics for long FSD lock >

[jira] [Updated] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-9781: - Attachment: HDFS-9781.003.patch Attaching v003 patch with review comments incorporated. >

[jira] [Updated] (HDFS-10450) libhdfs++: Implement Cyrus SASL implementation in sasl_enigne.cc

2016-09-02 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-10450: -- Attachment: HDFS-10450.HDFS-8707.000.patch > libhdfs++: Implement Cyrus SASL implementation in

[jira] [Commented] (HDFS-10705) libhdfs++: FileSystem should have a convenience no-args ctor

2016-09-02 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459400#comment-15459400 ] Bob Hansen commented on HDFS-10705: --- +1 > libhdfs++: FileSystem should have a convenience no-args ctor

[jira] [Commented] (HDFS-10705) libhdfs++: FileSystem should have a convenience no-args ctor

2016-09-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459291#comment-15459291 ] Hadoop QA commented on HDFS-10705: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10833) Fix JSON errors in WebHDFS.md examples

2016-09-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459277#comment-15459277 ] Xiao Chen commented on HDFS-10833: -- +1. Thanks for taking care of this, Andrew. > Fix JSON errors in

[jira] [Commented] (HDFS-10823) Implement HttpFSFileSystem#listStatusIterator

2016-09-02 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459264#comment-15459264 ] Andrew Wang commented on HDFS-10823: I asked Tucu about this offline, and he told me it's because

[jira] [Commented] (HDFS-10822) Log DataNodes in the write pipeline

2016-09-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459231#comment-15459231 ] Hudson commented on HDFS-10822: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10391 (See

[jira] [Commented] (HDFS-10822) Log DataNodes in the write pipeline

2016-09-02 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459222#comment-15459222 ] John Zhuge commented on HDFS-10822: --- Thanks [~eddyxu] for the review and commit. > Log DataNodes in the

[jira] [Updated] (HDFS-10822) Log DataNodes in the write pipeline

2016-09-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-10822: - Resolution: Fixed Fix Version/s: 3.0.0-beta1 2.9.0 Status:

[jira] [Commented] (HDFS-10822) Log DataNodes in the write pipeline

2016-09-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459198#comment-15459198 ] Lei (Eddy) Xu commented on HDFS-10822: -- +1. Thanks for adding more debug information, [~jzhuge]

[jira] [Commented] (HDFS-10789) Route webhdfs through the RPC call queue

2016-09-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459176#comment-15459176 ] Kihwal Lee commented on HDFS-10789: --- What happens when the call queue is full and backoff is on? What

[jira] [Updated] (HDFS-10705) libhdfs++: FileSystem should have a convenience no-args ctor

2016-09-02 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10705: --- Attachment: HDFS-10705.HDFS-8707.001.patch Thanks for the review [~bobhansen]. Updated the

[jira] [Commented] (HDFS-10772) Reduce byte/string conversions for get listing

2016-09-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459119#comment-15459119 ] Kihwal Lee commented on HDFS-10772: --- Found its way to branch-2.8. > Reduce byte/string conversions for

[jira] [Updated] (HDFS-10772) Reduce byte/string conversions for get listing

2016-09-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10772: -- Fix Version/s: (was: 2.9.0) 2.8.0 > Reduce byte/string conversions for get

[jira] [Updated] (HDFS-10768) Optimize mkdir ops

2016-09-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10768: -- Fix Version/s: (was: 2.9.0) 2.8.0 > Optimize mkdir ops > -- > >

[jira] [Commented] (HDFS-10768) Optimize mkdir ops

2016-09-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459109#comment-15459109 ] Kihwal Lee commented on HDFS-10768: --- Picked to 2.8. > Optimize mkdir ops > -- > >

[jira] [Updated] (HDFS-10762) Pass IIP for file status related methods

2016-09-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10762: -- Fix Version/s: (was: 2.9.0) 2.8.0 > Pass IIP for file status related methods >

[jira] [Commented] (HDFS-10762) Pass IIP for file status related methods

2016-09-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459093#comment-15459093 ] Kihwal Lee commented on HDFS-10762: --- Commited this to branch-2.8. > Pass IIP for file status related

[jira] [Commented] (HDFS-10762) Pass IIP for file status related methods

2016-09-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459087#comment-15459087 ] Kihwal Lee commented on HDFS-10762: --- Cherry-picked HDFS-9621 to branch-2.8, which moves target into IIP.

[jira] [Updated] (HDFS-9621) getListing wrongly associates Erasure Coding policy to pre-existing replicated files under an EC directory

2016-09-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9621: - Fix Version/s: (was: 2.9.0) 2.8.0 > getListing wrongly associates Erasure Coding

[jira] [Commented] (HDFS-9621) getListing wrongly associates Erasure Coding policy to pre-existing replicated files under an EC directory

2016-09-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459084#comment-15459084 ] Kihwal Lee commented on HDFS-9621: -- Picked to branch-2.8. Although it does not have the same bug, but it

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

2016-09-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459076#comment-15459076 ] Hadoop QA commented on HDFS-8901: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

2016-09-02 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459053#comment-15459053 ] Zhe Zhang commented on HDFS-8901: - Thanks Sammi. I think all my previous comments have been addressed. But

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-02 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459047#comment-15459047 ] Manoj Govindassamy commented on HDFS-10830: --- sure, lets track the wait/signal improvements with

[jira] [Commented] (HDFS-10705) libhdfs++: FileSystem should have a convenience no-args ctor

2016-09-02 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459023#comment-15459023 ] Bob Hansen commented on HDFS-10705: --- One change, if we could: remove "convenience factory" from the

[jira] [Updated] (HDFS-10745) Directly resolve paths into INodesInPath

2016-09-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10745: -- Fix Version/s: (was: 2.9.0) 2.8.0 > Directly resolve paths into INodesInPath >

[jira] [Commented] (HDFS-10745) Directly resolve paths into INodesInPath

2016-09-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15459012#comment-15459012 ] Kihwal Lee commented on HDFS-10745: --- Committed to branch-2.8. > Directly resolve paths into

[jira] [Updated] (HDFS-10744) Internally optimize path component resolution

2016-09-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10744: -- Fix Version/s: (was: 2.9.0) 2.8.0 > Internally optimize path component

[jira] [Commented] (HDFS-10744) Internally optimize path component resolution

2016-09-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15458990#comment-15458990 ] Kihwal Lee commented on HDFS-10744: --- Committed to branch-2.8. > Internally optimize path component

[jira] [Updated] (HDFS-10711) Optimize FSPermissionChecker group membership check

2016-09-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10711: -- Fix Version/s: (was: 2.9.0) 2.8.0 > Optimize FSPermissionChecker group

[jira] [Commented] (HDFS-10711) Optimize FSPermissionChecker group membership check

2016-09-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15458975#comment-15458975 ] Kihwal Lee commented on HDFS-10711: --- Committed to 2.8. > Optimize FSPermissionChecker group membership

[jira] [Created] (HDFS-10834) Add concat to libhdfs API

2016-09-02 Thread Gary Helmling (JIRA)
Gary Helmling created HDFS-10834: Summary: Add concat to libhdfs API Key: HDFS-10834 URL: https://issues.apache.org/jira/browse/HDFS-10834 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15458960#comment-15458960 ] Arpit Agarwal commented on HDFS-10830: -- bq. Wouldn't it be better to go for the following ..wait and

[jira] [Assigned] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-10830: Assignee: Arpit Agarwal (was: Manoj Govindassamy) > FsDatasetImpl#removeVolumes() crashes

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-02 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15458948#comment-15458948 ] Manoj Govindassamy commented on HDFS-10830: --- Thanks for working on this [~arpitagarwal] and

[jira] [Commented] (HDFS-10828) Fix usage of FsDatasetImpl object lock in ReplicaMap

2016-09-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15458906#comment-15458906 ] Hadoop QA commented on HDFS-10828: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-9781) FsDatasetImpl#getBlockReports can occasionally throw NullPointerException

2016-09-02 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15458891#comment-15458891 ] Manoj Govindassamy commented on HDFS-9781: -- Thanks for the review [~jojochuang]. * sure, will add

[jira] [Commented] (HDFS-10830) FsDatasetImpl#removeVolumes() crashes with IllegalMonitorStateException when vol being removed is in use

2016-09-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15458843#comment-15458843 ] Hadoop QA commented on HDFS-10830: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >