[jira] [Commented] (HDFS-9368) Implement reads with implicit offset state in libhdfs++

2015-11-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002748#comment-15002748 ] Hadoop QA commented on HDFS-9368: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9410) TestDFSAdminWithHA#tearDown may throw NPE

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9410: Attachment: HDFS-9410.003.patch > TestDFSAdminWithHA#tearDown may throw NPE >

[jira] [Commented] (HDFS-8968) Erasure coding: a comprehensive I/O throughput benchmark tool

2015-11-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002756#comment-15002756 ] Hudson commented on HDFS-8968: -- FAILURE: Integrated in Hadoop-trunk-Commit #8799 (See

[jira] [Updated] (HDFS-9410) Fix all HDFS unit tests to correctly reset to sysout and syserr

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9410: Description: Originally found in {{TestDFSAdminWithHA#tearDown}} where System.out.flush() throws an NPE.

[jira] [Updated] (HDFS-9410) Fix all HDFS unit tests to correctly reset to sysout and syserr

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9410: Status: Open (was: Patch Available) > Fix all HDFS unit tests to correctly reset to sysout and syserr >

[jira] [Commented] (HDFS-9410) Fix all HDFS unit tests to correctly reset to sysout and syserr

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002916#comment-15002916 ] Xiao Chen commented on HDFS-9410: - Hi [~walter.k.su], here comes patch 003 which fixes all similar errors,

[jira] [Updated] (HDFS-7984) webhdfs:// needs to support provided delegation tokens

2015-11-12 Thread HeeSoo Kim (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HeeSoo Kim updated HDFS-7984: - Attachment: HDFS-7984.007.patch Add hadoop.token.files property in core-site.xml. In addition, it checks

[jira] [Created] (HDFS-9420) DiskBalancer : Add DataModels

2015-11-12 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-9420: -- Summary: DiskBalancer : Add DataModels Key: HDFS-9420 URL: https://issues.apache.org/jira/browse/HDFS-9420 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-8968) Erasure coding: a comprehensive I/O throughput benchmark tool

2015-11-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003004#comment-15003004 ] Hudson commented on HDFS-8968: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #675 (See

[jira] [Updated] (HDFS-9419) Add Optional class to libhdfs++

2015-11-12 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9419: - Attachment: HDFS-9419.HDFS-8707.002.patch Rename TR2->tr2 per [~wheat9]'s request > Add Optional class to

[jira] [Commented] (HDFS-7163) WebHdfsFileSystem should retry reads according to the configured retry policy.

2015-11-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002873#comment-15002873 ] Hadoop QA commented on HDFS-7163: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9358) TestNodeCount#testNodeCount timed out

2015-11-12 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002872#comment-15002872 ] Wei-Chiu Chuang commented on HDFS-9358: --- [~iwasakims] Thanks for the patch. I looked at the patch,

[jira] [Commented] (HDFS-9117) Config file reader / options classes for libhdfs++

2015-11-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002991#comment-15002991 ] Haohui Mai commented on HDFS-9117: -- Thanks for splitting it up. {code} +bool

[jira] [Commented] (HDFS-9144) Refactor libhdfs into stateful/ephemeral objects

2015-11-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003043#comment-15003043 ] Haohui Mai commented on HDFS-9144: -- A pretty large patch. Can you explain what you're trying to achieve

[jira] [Updated] (HDFS-9410) Fix all HDFS unit tests to correctly reset to sysout and syserr

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9410: Summary: Fix all HDFS unit tests to correctly reset to sysout and syserr (was: TestDFSAdminWithHA#tearDown

[jira] [Commented] (HDFS-8968) Erasure coding: a comprehensive I/O throughput benchmark tool

2015-11-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002981#comment-15002981 ] Hudson commented on HDFS-8968: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1399 (See

[jira] [Updated] (HDFS-9410) Fix all HDFS unit tests to correctly reset to sysout and syserr

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9410: Status: Patch Available (was: Open) > Fix all HDFS unit tests to correctly reset to sysout and syserr >

[jira] [Commented] (HDFS-9419) Add Optional class to libhdfs++

2015-11-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003071#comment-15003071 ] Hadoop QA commented on HDFS-9419: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9387) Parse namenodeUri parameter only once in NNThroughputBenchmark$OperationStatsBase#verifyOpArgument()

2015-11-12 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003288#comment-15003288 ] Xiaoyu Yao commented on HDFS-9387: -- bq. Is it possible to run the -namenode arguments for replication

[jira] [Commented] (HDFS-9387) Parse namenodeUri parameter only once in NNThroughputBenchmark$OperationStatsBase#verifyOpArgument()

2015-11-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003294#comment-15003294 ] Mingliang Liu commented on HDFS-9387: - Yes, I agree with you. Fixing it provides obvious value while I

[jira] [Commented] (HDFS-9408) extend the build system to produce static and dynamic libhdfspp libs

2015-11-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003087#comment-15003087 ] Haohui Mai commented on HDFS-9408: -- {code} +IF(UNIX) + # linking a shared library from static ones

[jira] [Updated] (HDFS-9420) DiskBalancer : Add DataModels

2015-11-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9420: --- Attachment: HDFS-9420.001.patch > DiskBalancer : Add DataModels > - > >

[jira] [Comment Edited] (HDFS-9117) Config file reader / options classes for libhdfs++

2015-11-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002991#comment-15002991 ] Haohui Mai edited comment on HDFS-9117 at 11/12/15 10:35 PM: - Thanks for

[jira] [Commented] (HDFS-9387) Parse namenodeUri parameter only once in NNThroughputBenchmark$OperationStatsBase#verifyOpArgument()

2015-11-12 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003235#comment-15003235 ] Xiaoyu Yao commented on HDFS-9387: -- Hit a different NPE issue during my validation of this one and filed

[jira] [Updated] (HDFS-9421) NNThroughputBenchmark replication test NPE with -namenode option

2015-11-12 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9421: - Description: Hit the following NPE when reviewing fix for HDFS-9387 with manual tests as

[jira] [Commented] (HDFS-9410) Fix all HDFS unit tests to correctly reset to sysout and syserr

2015-11-12 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003343#comment-15003343 ] Walter Su commented on HDFS-9410: - +1 pending jenkins. > Fix all HDFS unit tests to correctly reset to

[jira] [Updated] (HDFS-9410) Fix all HDFS unit tests to correctly reset to sysout and syserr

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9410: Attachment: HDFS-9410.003.patch > Fix all HDFS unit tests to correctly reset to sysout and syserr >

[jira] [Commented] (HDFS-9419) Add Optional class to libhdfs++

2015-11-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003074#comment-15003074 ] Haohui Mai commented on HDFS-9419: -- +1 after fixing the whitespaces and tabs. > Add Optional class to

[jira] [Commented] (HDFS-8968) Erasure coding: a comprehensive I/O throughput benchmark tool

2015-11-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003125#comment-15003125 ] Hudson commented on HDFS-8968: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2603 (See

[jira] [Commented] (HDFS-8968) Erasure coding: a comprehensive I/O throughput benchmark tool

2015-11-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003149#comment-15003149 ] Hudson commented on HDFS-8968: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #601 (See

[jira] [Commented] (HDFS-9239) DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness

2015-11-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003219#comment-15003219 ] Ming Ma commented on HDFS-9239: --- Sorry for the jumping in late for the discussion. While we haven't seen any

[jira] [Commented] (HDFS-9413) getContentSummary() on standby should throw StandbyException

2015-11-12 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003365#comment-15003365 ] Ming Ma commented on HDFS-9413: --- Thanks [~brahmareddy]. You bring up an interesting point, why

[jira] [Commented] (HDFS-9419) Add Optional class to libhdfs++

2015-11-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003086#comment-15003086 ] Haohui Mai commented on HDFS-9419: -- Actually since the change of whitespace is trivial I'll just fix them

[jira] [Updated] (HDFS-9419) Import the optional library into libhdfs++

2015-11-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9419: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-8707 Status: Resolved

[jira] [Commented] (HDFS-8968) Erasure coding: a comprehensive I/O throughput benchmark tool

2015-11-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003102#comment-15003102 ] Hudson commented on HDFS-8968: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #663 (See

[jira] [Commented] (HDFS-9420) DiskBalancer : Add DataModels

2015-11-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003339#comment-15003339 ] Anu Engineer commented on HDFS-9420: I have looked at the unit tests failures and they are not related

[jira] [Assigned] (HDFS-9421) NNThroughputBenchmark replication test NPE with -namenode option

2015-11-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-9421: --- Assignee: Mingliang Liu > NNThroughputBenchmark replication test NPE with -namenode option >

[jira] [Commented] (HDFS-9420) DiskBalancer : Add DataModels

2015-11-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003349#comment-15003349 ] Anu Engineer commented on HDFS-9420: Yetus JIRA https://issues.apache.org/jira/browse/YETUS-181 >

[jira] [Commented] (HDFS-9410) Fix all HDFS unit tests to correctly reset to sysout and syserr

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003368#comment-15003368 ] Xiao Chen commented on HDFS-9410: - Seems [jenkins run into some docker

[jira] [Updated] (HDFS-9410) Fix all HDFS unit tests to correctly reset to sysout and syserr

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9410: Status: Open (was: Patch Available) > Fix all HDFS unit tests to correctly reset to sysout and syserr >

[jira] [Updated] (HDFS-9410) Fix all HDFS unit tests to correctly reset to sysout and syserr

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9410: Status: Patch Available (was: Open) > Fix all HDFS unit tests to correctly reset to sysout and syserr >

[jira] [Updated] (HDFS-9410) Fix all HDFS unit tests to correctly reset to sysout and syserr

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9410: Attachment: (was: HDFS-9410.003.patch) > Fix all HDFS unit tests to correctly reset to sysout and syserr

[jira] [Created] (HDFS-9421) NNThroughputBenchmark replication test NPE with -namenode option

2015-11-12 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-9421: Summary: NNThroughputBenchmark replication test NPE with -namenode option Key: HDFS-9421 URL: https://issues.apache.org/jira/browse/HDFS-9421 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8968) New benchmark throughput tool for striping erasure coding

2015-11-12 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HDFS-8968: - Attachment: HDFS-8968.5.patch Update patch to avoid generating random buffers each time before writing to a file,

[jira] [Updated] (HDFS-7663) Erasure Coding: Append on striped file

2015-11-12 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-7663: Affects Version/s: 3.0.0 Target Version/s: 3.0.0 Status: Patch Available (was: In

[jira] [Created] (HDFS-9422) Unnecessary FsDatasetImpl locking in DirectoryScanner cause periodic datanode pauses

2015-11-12 Thread He Liangliang (JIRA)
He Liangliang created HDFS-9422: --- Summary: Unnecessary FsDatasetImpl locking in DirectoryScanner cause periodic datanode pauses Key: HDFS-9422 URL: https://issues.apache.org/jira/browse/HDFS-9422

[jira] [Commented] (HDFS-7984) webhdfs:// needs to support provided delegation tokens

2015-11-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003608#comment-15003608 ] Hadoop QA commented on HDFS-7984: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9410) Some tests should always reset sysout and syserr

2015-11-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003619#comment-15003619 ] Hudson commented on HDFS-9410: -- FAILURE: Integrated in Hadoop-trunk-Commit #8801 (See

[jira] [Updated] (HDFS-9410) Some tests should always reset sysout and syserr

2015-11-12 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9410: Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: 2.8.0 Status:

[jira] [Updated] (HDFS-9338) in webhdfs Null pointer exception will be thrown when xattrname is not given

2015-11-12 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9338: Resolution: Duplicate Status: Resolved (was: Patch Available) Let's fix the same issues together at

[jira] [Commented] (HDFS-9410) Some tests should always reset sysout and syserr

2015-11-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003661#comment-15003661 ] Hudson commented on HDFS-9410: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #664 (See

[jira] [Commented] (HDFS-9410) Some tests should always reset sysout and syserr

2015-11-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003673#comment-15003673 ] Hudson commented on HDFS-9410: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #676 (See

[jira] [Commented] (HDFS-9410) Some tests should always reset sysout and syserr

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003630#comment-15003630 ] Xiao Chen commented on HDFS-9410: - Thanks Walter for the review and commit. > Some tests should always

[jira] [Commented] (HDFS-9410) Some tests should always reset sysout and syserr

2015-11-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003639#comment-15003639 ] Hudson commented on HDFS-9410: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1400 (See

[jira] [Updated] (HDFS-7663) Erasure Coding: Append on striped file

2015-11-12 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-7663: Attachment: HDFS-7663.01.patch > Erasure Coding: Append on striped file >

[jira] [Updated] (HDFS-9410) Some tests should always reset sysout and syserr

2015-11-12 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9410: Summary: Some tests should always reset sysout and syserr (was: Fix all HDFS unit tests to correctly reset

[jira] [Updated] (HDFS-9333) Some tests using MiniDFSCluster errored complaining port in use

2015-11-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9333: --- Attachment: HDFS-9333.002.patch I attached 002 which uses {{ServerSocketUtil#getPort}} to get

[jira] [Updated] (HDFS-9337) Should check required params in WebHDFS to avoid NPE

2015-11-12 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9337: Summary: Should check required params in WebHDFS to avoid NPE (was: In webhdfs Nullpoint exception will be

[jira] [Commented] (HDFS-9337) Should check required params in WebHDFS to avoid NPE

2015-11-12 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003637#comment-15003637 ] Walter Su commented on HDFS-9337: - Close HDFS-9338 as duplicated. Update JIRA description, upgrade it to

[jira] [Commented] (HDFS-7663) Erasure Coding: Append on striped file

2015-11-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003652#comment-15003652 ] Hadoop QA commented on HDFS-7663: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9358) TestNodeCount#testNodeCount timed out

2015-11-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9358: --- Status: Patch Available (was: Open) > TestNodeCount#testNodeCount timed out >

[jira] [Updated] (HDFS-9144) Refactor libhdfs into stateful/ephemeral objects

2015-11-12 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9144: - Status: Patch Available (was: Open) > Refactor libhdfs into stateful/ephemeral objects >

[jira] [Updated] (HDFS-9358) TestNodeCount#testNodeCount timed out

2015-11-12 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9358: --- Attachment: HDFS-9358.001.patch Thanks for reporting this, [~jojochuang]. The testNodeCount

[jira] [Commented] (HDFS-9408) extend the build system to produce static and dynamic libhdfspp libs

2015-11-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002147#comment-15002147 ] Hadoop QA commented on HDFS-9408: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9144) Refactor libhdfs into stateful/ephemeral objects

2015-11-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002148#comment-15002148 ] Hadoop QA commented on HDFS-9144: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9117) Config file reader / options classes for libhdfs++

2015-11-12 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9117: - Attachment: HDFS-9117.HDFS-8707.014.patch Moved to use std::experimental::optional as submitted for

[jira] [Commented] (HDFS-9117) Config file reader / options classes for libhdfs++

2015-11-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002058#comment-15002058 ] Hadoop QA commented on HDFS-9117: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9408) extend the build system to produce static and dynamic libhdfspp libs

2015-11-12 Thread Stephen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen updated HDFS-9408: -- Attachment: HDFS-9408.HDFS-8707.005.patch Thanks for the suggestions. Updated patch is attached. {quote}It

[jira] [Commented] (HDFS-8968) New benchmark throughput tool for striping erasure coding

2015-11-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002152#comment-15002152 ] Hadoop QA commented on HDFS-8968: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9368) Implement reads with implicit offset state in libhdfs++

2015-11-12 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9368: -- Attachment: HDFS-9368.HDFS-8707.001.patch New patch: -Added bounds checks, turns out

[jira] [Commented] (HDFS-8968) New benchmark throughput tool for striping erasure coding

2015-11-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002690#comment-15002690 ] Zhe Zhang commented on HDFS-8968: - Great work Rui! The latest patch LGTM (thanks for adding the UT!). +1

[jira] [Updated] (HDFS-8968) New benchmark throughput tool for striping erasure coding

2015-11-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8968: Affects Version/s: 3.0.0 Target Version/s: 3.0.0 Component/s: test

[jira] [Updated] (HDFS-8968) Erasure coding: a comprehensive I/O throughput benchmark tool

2015-11-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8968: Summary: Erasure coding: a comprehensive I/O throughput benchmark tool (was: New benchmark throughput tool

[jira] [Updated] (HDFS-8968) Erasure coding: a comprehensive I/O throughput benchmark tool

2015-11-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8968: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved (was:

[jira] [Updated] (HDFS-7663) Erasure Coding: Append on striped file

2015-11-12 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-7663: Description: Append should be easy if we have variable length block support from HDFS-3689, i.e., the new

[jira] [Commented] (HDFS-9410) Fix all HDFS unit tests to correctly reset to sysout and syserr

2015-11-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003547#comment-15003547 ] Hadoop QA commented on HDFS-9410: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9239) DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness

2015-11-12 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002293#comment-15002293 ] Kihwal Lee commented on HDFS-9239: -- bq. NN heartbeat processing with a lockless + tryLock implementation

[jira] [Commented] (HDFS-9419) Add Optional class to libhdfs++

2015-11-12 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002298#comment-15002298 ] James Clampffer commented on HDFS-9419: --- Not much to it. Looks good to me. +1 > Add Optional class

[jira] [Updated] (HDFS-9328) Formalize coding standards for libhdfs++ and put them in a README.txt

2015-11-12 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9328: -- Attachment: HDFS-9328.HDFS-8707.004.patch New patch: -added ASF license like

[jira] [Updated] (HDFS-9414) Moving reconfiguration protocol out of ClientDatanodeProtocol for reusability

2015-11-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9414: Attachment: HDFS-9414.001.patch Posted patch v001, kindly review. > Moving reconfiguration protocol

[jira] [Commented] (HDFS-9419) Add Optional class to libhdfs++

2015-11-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002546#comment-15002546 ] Haohui Mai commented on HDFS-9419: -- s/TR2/tr2 so that it looks consistent under both Windows and UNIX. +1

[jira] [Updated] (HDFS-9328) Formalize coding standards for libhdfs++

2015-11-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9328: - Summary: Formalize coding standards for libhdfs++ (was: Formalize coding standards for libhdfs++ and put

[jira] [Updated] (HDFS-9414) Moving reconfiguration protocol out of ClientDatanodeProtocol for reusability

2015-11-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9414: Status: Patch Available (was: Open) > Moving reconfiguration protocol out of ClientDatanodeProtocol

[jira] [Commented] (HDFS-9328) Formalize coding standards for libhdfs++ and put them in a README.txt

2015-11-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002551#comment-15002551 ] Haohui Mai commented on HDFS-9328: -- +1. I'll commit it shortly. > Formalize coding standards for

[jira] [Updated] (HDFS-9328) Formalize coding standards for libhdfs++

2015-11-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9328: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-8707 Status: Resolved

[jira] [Commented] (HDFS-7163) WebHdfsFileSystem should retry reads according to the configured retry policy.

2015-11-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002422#comment-15002422 ] Haohui Mai commented on HDFS-7163: -- Sure. Will look into it next week. > WebHdfsFileSystem should retry

[jira] [Commented] (HDFS-9358) TestNodeCount#testNodeCount timed out

2015-11-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002355#comment-15002355 ] Hadoop QA commented on HDFS-9358: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-7163) WebHdfsFileSystem should retry reads according to the configured retry policy.

2015-11-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated HDFS-7163: - Attachment: HDFS-7163-branch-2.7.003.patch HDFS-7163-branch-2.003.patch As documented

[jira] [Commented] (HDFS-8412) Fix the test failures in HTTPFS: In some tests setReplication called after fs close.

2015-11-12 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002396#comment-15002396 ] Yongjun Zhang commented on HDFS-8412: - Hi [~umamaheswararao], Thanks for your earlier work here. It

[jira] [Commented] (HDFS-9408) extend the build system to produce static and dynamic libhdfspp libs

2015-11-12 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002302#comment-15002302 ] James Clampffer commented on HDFS-9408: --- Looks good to me. +1 > extend the build system to produce

[jira] [Commented] (HDFS-8770) ReplicationMonitor thread received Runtime exception: NullPointerException when BlockManager.chooseExcessReplicates

2015-11-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002599#comment-15002599 ] Xiao Chen commented on HDFS-8770: - Hi [~aderen], Thanks for reporting the issue and providing a patch. The

[jira] [Updated] (HDFS-9419) Import the optional library into libhdfs++

2015-11-12 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9419: - Summary: Import the optional library into libhdfs++ (was: Add Optional class to libhdfs++) > Import the

[jira] [Updated] (HDFS-9421) NNThroughputBenchmark replication test NPE with -namenode option

2015-11-12 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9421: - Component/s: benchmarks > NNThroughputBenchmark replication test NPE with -namenode option >

[jira] [Commented] (HDFS-9387) Parse namenodeUri parameter only once in NNThroughputBenchmark$OperationStatsBase#verifyOpArgument()

2015-11-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003280#comment-15003280 ] Mingliang Liu commented on HDFS-9387: - Thanks for your comment. It's a good catch. I realized that I

[jira] [Commented] (HDFS-8968) Erasure coding: a comprehensive I/O throughput benchmark tool

2015-11-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003312#comment-15003312 ] Hudson commented on HDFS-8968: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2539 (See

[jira] [Commented] (HDFS-9420) DiskBalancer : Add DataModels

2015-11-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15003325#comment-15003325 ] Hadoop QA commented on HDFS-9420: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||