[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964638#comment-14964638 ] Hadoop QA commented on HDFS-8647: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9208) Disabling atime may fail clients like distCp

2015-10-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964633#comment-14964633 ] Hudson commented on HDFS-9208: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2504 (See [htt

[jira] [Commented] (HDFS-9250) Add Precondition check to LocatedBlock#addCachedLoc

2015-10-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964624#comment-14964624 ] Hudson commented on HDFS-9250: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #516 (See [htt

[jira] [Commented] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

2015-10-19 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964620#comment-14964620 ] Walter Su commented on HDFS-9079: - 1. bq. DataStreamer#shouldStop should check internal err

[jira] [Commented] (HDFS-9208) Disabling atime may fail clients like distCp

2015-10-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964587#comment-14964587 ] Hudson commented on HDFS-9208: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1292 (See [https://

[jira] [Commented] (HDFS-3059) ssl-server.xml causes NullPointer

2015-10-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964582#comment-14964582 ] Xiao Chen commented on HDFS-3059: - Patch 08 fixed the test failure. > ssl-server.xml cause

[jira] [Updated] (HDFS-3059) ssl-server.xml causes NullPointer

2015-10-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-3059: Attachment: HDFS-3059.08.patch > ssl-server.xml causes NullPointer > - > >

[jira] [Updated] (HDFS-3059) ssl-server.xml causes NullPointer

2015-10-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-3059: Status: Patch Available (was: Open) > ssl-server.xml causes NullPointer > -

[jira] [Updated] (HDFS-3059) ssl-server.xml causes NullPointer

2015-10-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-3059: Status: Open (was: Patch Available) > ssl-server.xml causes NullPointer > -

[jira] [Commented] (HDFS-9252) Change TestFileTruncate to use FsDatasetTestUtils to get block file size and genstamp.

2015-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964565#comment-14964565 ] Hadoop QA commented on HDFS-9252: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9250) Add Precondition check to LocatedBlock#addCachedLoc

2015-10-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964549#comment-14964549 ] Hudson commented on HDFS-9250: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2453 (See [https://

[jira] [Commented] (HDFS-9264) Minor cleanup of operations on FsVolumeList#volumes

2015-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964526#comment-14964526 ] Hadoop QA commented on HDFS-9264: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9251) Refactor TestWriteToReplica and TestFsDatasetImpl to avoid explicitly creating Files in tests code.

2015-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964517#comment-14964517 ] Hadoop QA commented on HDFS-9251: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-10-19 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964506#comment-14964506 ] Ming Ma commented on HDFS-8647: --- Thanks [~brahmareddy]. It seems you also need to change the

[jira] [Commented] (HDFS-9208) Disabling atime may fail clients like distCp

2015-10-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964495#comment-14964495 ] Hudson commented on HDFS-9208: -- FAILURE: Integrated in Hadoop-trunk-Commit #8669 (See [https:

[jira] [Commented] (HDFS-9208) Disabling atime may fail clients like distCp

2015-10-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964479#comment-14964479 ] Hudson commented on HDFS-9208: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #571 (See [htt

[jira] [Updated] (HDFS-9208) Disabling atime may fail clients like distCp

2015-10-19 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-9208: - Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Committed to trun

[jira] [Commented] (HDFS-3059) ssl-server.xml causes NullPointer

2015-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964458#comment-14964458 ] Hadoop QA commented on HDFS-3059: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-10-19 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964442#comment-14964442 ] Brahma Reddy Battula commented on HDFS-8647: [~mingma] Agree with you,Even it w

[jira] [Updated] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-10-19 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8647: --- Attachment: HDFS-8647-008.patch > Abstract BlockManager's rack policy into BlockPlaceme

[jira] [Commented] (HDFS-9053) Support large directories efficiently using B-Tree

2015-10-19 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964433#comment-14964433 ] Yi Liu commented on HDFS-9053: -- Update the patch: # Fix some checkstyles and the whitespace. #

[jira] [Updated] (HDFS-9053) Support large directories efficiently using B-Tree

2015-10-19 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-9053: - Attachment: HDFS-9053.007.patch > Support large directories efficiently using B-Tree >

[jira] [Updated] (HDFS-9264) Minor cleanup of operations on FsVolumeList#volumes

2015-10-19 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9264: Attachment: HDFS-9264.02.patch 02 patch fix checkstyles > Minor cleanup of operations on FsVolumeList#volume

[jira] [Commented] (HDFS-7896) HDFS Slow disk detection

2015-10-19 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964385#comment-14964385 ] Walter Su commented on HDFS-7896: - Slow disk is different with failed disk. A slow disk sti

[jira] [Updated] (HDFS-3059) ssl-server.xml causes NullPointer

2015-10-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-3059: Status: Patch Available (was: Open) > ssl-server.xml causes NullPointer > -

[jira] [Commented] (HDFS-3059) ssl-server.xml causes NullPointer

2015-10-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964376#comment-14964376 ] Xiao Chen commented on HDFS-3059: - Hi Andrew, Thanks a lot for the review. {quote} I'm not

[jira] [Commented] (HDFS-9250) Add Precondition check to LocatedBlock#addCachedLoc

2015-10-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964375#comment-14964375 ] Hudson commented on HDFS-9250: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2502 (See [htt

[jira] [Commented] (HDFS-9250) Add Precondition check to LocatedBlock#addCachedLoc

2015-10-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964373#comment-14964373 ] Hudson commented on HDFS-9250: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #553 (See

[jira] [Commented] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

2015-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964363#comment-14964363 ] Hadoop QA commented on HDFS-9079: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9250) Add Precondition check to LocatedBlock#addCachedLoc

2015-10-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964361#comment-14964361 ] Hudson commented on HDFS-9250: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1290 (See [https://

[jira] [Commented] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

2015-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964359#comment-14964359 ] Hadoop QA commented on HDFS-9079: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-3059) ssl-server.xml causes NullPointer

2015-10-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-3059: Status: Open (was: Patch Available) > ssl-server.xml causes NullPointer > -

[jira] [Updated] (HDFS-3059) ssl-server.xml causes NullPointer

2015-10-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-3059: Attachment: HDFS-3059.07.patch > ssl-server.xml causes NullPointer > - > >

[jira] [Updated] (HDFS-9208) Disabling atime may fail clients like distCp

2015-10-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9208: Hadoop Flags: Reviewed +1 for patch v2. Thank you, Kihwal. > Disabling atime may fail clients like

[jira] [Updated] (HDFS-9077) webhdfs client requires SPNEGO to do renew

2015-10-19 Thread HeeSoo Kim (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HeeSoo Kim updated HDFS-9077: - Status: Patch Available (was: In Progress) > webhdfs client requires SPNEGO to do renew >

[jira] [Updated] (HDFS-9070) Allow fsck display pending replica location information for being-written blocks

2015-10-19 Thread GAO Rui (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-9070: -- Status: Patch Available (was: Open) > Allow fsck display pending replica location information for being-written

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-10-19 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964327#comment-14964327 ] Ming Ma commented on HDFS-8647: --- Thanks [~brahmareddy]! It looks great. Sorry, there is one q

[jira] [Commented] (HDFS-3059) ssl-server.xml causes NullPointer

2015-10-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964321#comment-14964321 ] Andrew Wang commented on HDFS-3059: --- Hi Xiao, code-wise looks functionally good, only sty

[jira] [Commented] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

2015-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964296#comment-14964296 ] Hadoop QA commented on HDFS-9263: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-19 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964272#comment-14964272 ] Haohui Mai commented on HDFS-9241: -- bq. most of the problematic dependencies like Jackson,

[jira] [Commented] (HDFS-9250) Add Precondition check to LocatedBlock#addCachedLoc

2015-10-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964270#comment-14964270 ] Hudson commented on HDFS-9250: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #569 (See [htt

[jira] [Commented] (HDFS-7087) Ability to list /.reserved

2015-10-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964261#comment-14964261 ] Andrew Wang commented on HDFS-7087: --- Looks good, thanks for revving Xiao. Patch needs a s

[jira] [Commented] (HDFS-7087) Ability to list /.reserved

2015-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964253#comment-14964253 ] Hadoop QA commented on HDFS-7087: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9259) Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario

2015-10-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964250#comment-14964250 ] Colin Patrick McCabe commented on HDFS-9259: That seems reasonable to me. It s

[jira] [Commented] (HDFS-9250) Add Precondition check to LocatedBlock#addCachedLoc

2015-10-19 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964235#comment-14964235 ] Xiao Chen commented on HDFS-9250: - Thanks very much [~andrew.wang] for the review! > Add P

[jira] [Commented] (HDFS-9251) Refactor TestWriteToReplica and TestFsDatasetImpl to avoid explicitly creating Files in tests code.

2015-10-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964246#comment-14964246 ] Colin Patrick McCabe commented on HDFS-9251: +1 pending Jenkins. Thanks, [~edd

[jira] [Commented] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

2015-10-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964241#comment-14964241 ] Andrew Wang commented on HDFS-9263: --- Other sort of related comment is that we have all th

[jira] [Updated] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

2015-10-19 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9079: Attachment: HDFS-9079.04.patch The only locally reproducible failure is {{testDatanodeFailureRandomLength}}.

[jira] [Commented] (HDFS-9250) Add Precondition check to LocatedBlock#addCachedLoc

2015-10-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964237#comment-14964237 ] Hudson commented on HDFS-9250: -- FAILURE: Integrated in Hadoop-trunk-Commit #8666 (See [https:

[jira] [Commented] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

2015-10-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964233#comment-14964233 ] Andrew Wang commented on HDFS-9263: --- I retriggered the build on this, some of these seem

[jira] [Commented] (HDFS-9252) Change TestFileTruncate to use FsDatasetTestUtils to get block file size and genstamp.

2015-10-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964229#comment-14964229 ] Colin Patrick McCabe commented on HDFS-9252: bq. The data length and genstemp r

[jira] [Updated] (HDFS-9250) Add Precondition check to LocatedBlock#addCachedLoc

2015-10-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9250: -- Resolution: Fixed Fix Version/s: 2.8.0 Target Version/s: 2.8.0 Status: Reso

[jira] [Updated] (HDFS-9250) Add Precondition check to LocatedBlock#addCachedLoc

2015-10-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9250: -- Affects Version/s: 2.4.0 > Add Precondition check to LocatedBlock#addCachedLoc >

[jira] [Updated] (HDFS-9250) Add Precondition check to LocatedBlock#addCachedLoc

2015-10-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9250: -- Issue Type: Improvement (was: Bug) > Add Precondition check to LocatedBlock#addCachedLoc > -

[jira] [Commented] (HDFS-9124) NullPointerException when underreplicated blocks are there

2015-10-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964219#comment-14964219 ] Lei (Eddy) Xu commented on HDFS-9124: - Thanks a lot for reporting this, [~syedakram]. I

[jira] [Updated] (HDFS-9250) Add Precondition check to LocatedBlock#addCachedLoc

2015-10-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9250: -- Summary: Add Precondition check to LocatedBlock#addCachedLoc (was: LocatedBlock#addCachedLoc may throw A

[jira] [Commented] (HDFS-9250) LocatedBlock#addCachedLoc may throw ArrayStoreException when cache is empty

2015-10-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964218#comment-14964218 ] Andrew Wang commented on HDFS-9250: --- LGTM, thanks Xiao. I'll update the summary and commi

[jira] [Commented] (HDFS-9117) Config file reader / options classes for libhdfs++

2015-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964214#comment-14964214 ] Hadoop QA commented on HDFS-9117: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-9117) Config file reader / options classes for libhdfs++

2015-10-19 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9117: - Attachment: HDFS-9117.HDFS-8707.001.patch Implemented config files and Options creations. Gluing the optio

[jira] [Updated] (HDFS-9117) Config file reader / options classes for libhdfs++

2015-10-19 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9117: - Status: Patch Available (was: Open) > Config file reader / options classes for libhdfs++ > ---

[jira] [Updated] (HDFS-9077) webhdfs client requires SPNEGO to do renew

2015-10-19 Thread HeeSoo Kim (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HeeSoo Kim updated HDFS-9077: - Status: In Progress (was: Patch Available) > webhdfs client requires SPNEGO to do renew >

[jira] [Updated] (HDFS-9077) webhdfs client requires SPNEGO to do renew

2015-10-19 Thread HeeSoo Kim (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HeeSoo Kim updated HDFS-9077: - Attachment: HDFS-9077.001.patch > webhdfs client requires SPNEGO to do renew >

[jira] [Commented] (HDFS-9098) Erasure coding: emulate race conditions among striped streamers in write pipeline

2015-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964151#comment-14964151 ] Hadoop QA commented on HDFS-9098: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-9267) TestDiskError should get stored replicas through FsDatasetTestUtils.

2015-10-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9267: Attachment: HDFS-9267.00.patch > TestDiskError should get stored replicas through FsDatasetTestUtils.

[jira] [Updated] (HDFS-9267) TestDiskError should get stored replicas through FsDatasetTestUtils.

2015-10-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9267: Status: Patch Available (was: Open) > TestDiskError should get stored replicas through FsDatasetTest

[jira] [Created] (HDFS-9267) TestDiskError should get stored replicas through FsDatasetTestUtils.

2015-10-19 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-9267: --- Summary: TestDiskError should get stored replicas through FsDatasetTestUtils. Key: HDFS-9267 URL: https://issues.apache.org/jira/browse/HDFS-9267 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9208) Disabling atime may fail clients like distCp

2015-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964062#comment-14964062 ] Hadoop QA commented on HDFS-9208: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-19 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964044#comment-14964044 ] Colin Patrick McCabe commented on HDFS-9241: bq. I see your point, but I will n

[jira] [Updated] (HDFS-9265) Use of undefined behavior in remote_block_reader causing deterministic crashes.

2015-10-19 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9265: -- Description: The remote block reader relies on undefined behavior in how it uses enable_shared_f

[jira] [Commented] (HDFS-9077) webhdfs client requires SPNEGO to do renew

2015-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964025#comment-14964025 ] Hadoop QA commented on HDFS-9077: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-19 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14964024#comment-14964024 ] James Clampffer commented on HDFS-8766: --- Thanks Bob and Haohui for the feedback. Bob

[jira] [Updated] (HDFS-9098) Erasure coding: emulate race conditions among striped streamers in write pipeline

2015-10-19 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9098: Attachment: HDFS-9098.wip.patch WIP patch to demonstrate the idea. It leverages ideas from the [IMUnit | htt

[jira] [Updated] (HDFS-9098) Erasure coding: emulate race conditions among striped streamers in write pipeline

2015-10-19 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9098: Target Version/s: 3.0.0 Status: Patch Available (was: Open) > Erasure coding: emulate race con

[jira] [Commented] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-19 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963963#comment-14963963 ] Bob Hansen commented on HDFS-8766: -- Haohui - thanks for those explicit and actionable item

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963918#comment-14963918 ] Hadoop QA commented on HDFS-8647: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8914) Documentation conflict regarding fail-over of Namenode

2015-10-19 Thread Lars Francke (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963898#comment-14963898 ] Lars Francke commented on HDFS-8914: I missed the -1, thanks for the heads up. I'll try

[jira] [Updated] (HDFS-9208) Disabling atime may fail clients like distCp

2015-10-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9208: - Attachment: HDFS-9208.v2.patch Thanks for the review, Chris. Attaching a new patch that removes the unused

[jira] [Commented] (HDFS-8914) Documentation conflict regarding fail-over of Namenode

2015-10-19 Thread Ravindra Babu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963857#comment-14963857 ] Ravindra Babu commented on HDFS-8914: - Current report of QA says -1 due to white space

[jira] [Commented] (HDFS-8914) Documentation conflict regarding fail-over of Namenode

2015-10-19 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963812#comment-14963812 ] Allen Wittenauer commented on HDFS-8914: The process is relatively simple: a) cont

[jira] [Commented] (HDFS-8914) Documentation conflict regarding fail-over of Namenode

2015-10-19 Thread Ravindra Babu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963792#comment-14963792 ] Ravindra Babu commented on HDFS-8914: - Still I did not get the process. Can you please

[jira] [Updated] (HDFS-8914) Documentation conflict regarding fail-over of Namenode

2015-10-19 Thread Ravindra Babu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Babu updated HDFS-8914: Attachment: (was: HDFS-8914.1.patch.txt) > Documentation conflict regarding fail-over of Namenode

[jira] [Updated] (HDFS-8914) Documentation conflict regarding fail-over of Namenode

2015-10-19 Thread Ravindra Babu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Babu updated HDFS-8914: Attachment: HDFS-8914.1.patch.txt Review this patch > Documentation conflict regarding fail-over of

[jira] [Commented] (HDFS-8914) Documentation conflict regarding fail-over of Namenode

2015-10-19 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963717#comment-14963717 ] Allen Wittenauer commented on HDFS-8914: No, it isn't reviewed. You might find ht

[jira] [Commented] (HDFS-8914) Documentation conflict regarding fail-over of Namenode

2015-10-19 Thread Ravindra Babu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963714#comment-14963714 ] Ravindra Babu commented on HDFS-8914: - so it this patch reviewed currently? I see test

[jira] [Updated] (HDFS-9077) webhdfs client requires SPNEGO to do renew

2015-10-19 Thread HeeSoo Kim (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HeeSoo Kim updated HDFS-9077: - Status: Patch Available (was: In Progress) > webhdfs client requires SPNEGO to do renew >

[jira] [Commented] (HDFS-9266) hadoop-hdfs - Avoid unsafe split and append on fields that might be IPv6 literals

2015-10-19 Thread Nemanja Matkovic (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963705#comment-14963705 ] Nemanja Matkovic commented on HDFS-9266: For context on why things are broken up th

[jira] [Commented] (HDFS-9266) hadoop-hdfs - Avoid unsafe split and append on fields that might be IPv6 literals

2015-10-19 Thread Nemanja Matkovic (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963689#comment-14963689 ] Nemanja Matkovic commented on HDFS-9266: Cannot make this task to sub-task of HADOO

[jira] [Created] (HDFS-9266) hadoop-hdfs - Avoid unsafe split and append on fields that might be IPv6 literals

2015-10-19 Thread Nemanja Matkovic (JIRA)
Nemanja Matkovic created HDFS-9266: -- Summary: hadoop-hdfs - Avoid unsafe split and append on fields that might be IPv6 literals Key: HDFS-9266 URL: https://issues.apache.org/jira/browse/HDFS-9266 Pro

[jira] [Commented] (HDFS-9237) NPE at TestDataNodeVolumeFailureToleration#tearDown

2015-10-19 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963667#comment-14963667 ] Brahma Reddy Battula commented on HDFS-9237: Thanks [~ozawa] for review and com

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-10-19 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963662#comment-14963662 ] Brahma Reddy Battula commented on HDFS-8647: [~mingma] {quote}BlockManager sho

[jira] [Updated] (HDFS-9252) Change TestFileTruncate to use FsDatasetTestUtils to get block file size and genstamp.

2015-10-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9252: Attachment: HDFS-9252.01.patch Thanks a lot for the feedbacks, [~cmccabe]. bq. It seems like blockF

[jira] [Commented] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-19 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963652#comment-14963652 ] Mingliang Liu commented on HDFS-9241: - I think you two [~wheat9] and [~steve_l] have ma

[jira] [Commented] (HDFS-9241) HDFS clients can't construct HdfsConfiguration instances

2015-10-19 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963625#comment-14963625 ] Haohui Mai commented on HDFS-9241: -- Totally agree. Let's go ahead with your proposals :-)

[jira] [Updated] (HDFS-9251) Refactor TestWriteToReplica and TestFsDatasetImpl to avoid explicitly creating Files in tests code.

2015-10-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9251: Attachment: HDFS-9251.02.patch Thanks for the inputs, [~cmccabe]. I removed the precondition checks

[jira] [Updated] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-10-19 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-8647: --- Attachment: HDFS-8647-007.patch > Abstract BlockManager's rack policy into BlockPlaceme

[jira] [Commented] (HDFS-9260) Improve performance and GC friendliness of startup and FBRs

2015-10-19 Thread Staffan Friberg (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963610#comment-14963610 ] Staffan Friberg commented on HDFS-9260: --- Hi Walter 1) I think this is part could red

[jira] [Work started] (HDFS-9077) webhdfs client requires SPNEGO to do renew

2015-10-19 Thread HeeSoo Kim (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-9077 started by HeeSoo Kim. > webhdfs client requires SPNEGO to do renew > --

[jira] [Updated] (HDFS-9077) webhdfs client requires SPNEGO to do renew

2015-10-19 Thread HeeSoo Kim (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HeeSoo Kim updated HDFS-9077: - Attachment: HDFS-9077.patch > webhdfs client requires SPNEGO to do renew >

[jira] [Assigned] (HDFS-9077) webhdfs client requires SPNEGO to do renew

2015-10-19 Thread HeeSoo Kim (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HeeSoo Kim reassigned HDFS-9077: Assignee: HeeSoo Kim > webhdfs client requires SPNEGO to do renew >

[jira] [Commented] (HDFS-9263) tests are using /test/build/data; breaking Jenkins

2015-10-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14963575#comment-14963575 ] Hadoop QA commented on HDFS-9263: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

  1   2   >