[jira] [Commented] (HDFS-11668) Ozone: misc improvements for SCM CLI

2017-04-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976140#comment-15976140 ] Xiaoyu Yao commented on HDFS-11668: --- Can we guard the {{LOG.debug(...}} with {{if

[jira] [Updated] (HDFS-11504) Ozone: SCM: Add Block APIs

2017-04-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11504: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-11668) Ozone: misc improvements for SCM CLI

2017-04-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976125#comment-15976125 ] Hadoop QA commented on HDFS-11668: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11504) Ozone: SCM: Add Block APIs

2017-04-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11504: -- Summary: Ozone: SCM: Add Block APIs (was: Ozone: SCM: Add AllocateBlock/DeleteBlock/GetBlock APIs) >

[jira] [Commented] (HDFS-11667) Block Storage:Handling flushing of incomplete block id buffers during shutdown

2017-04-19 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976116#comment-15976116 ] Mukul Kumar Singh commented on HDFS-11667: -- Hi Chen, Thanks for the review. Following are my

[jira] [Commented] (HDFS-11666) Ozone: Fix compile error due to inconsistent package name

2017-04-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976113#comment-15976113 ] Hadoop QA commented on HDFS-11666: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11605) Allow user to customize and add new erasure code codecs and policies

2017-04-19 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huafeng Wang updated HDFS-11605: Status: Patch Available (was: Open) > Allow user to customize and add new erasure code codecs and

[jira] [Updated] (HDFS-11685) TestDistributedFileSystem.java fails to compile

2017-04-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11685: -- Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch Available) >

[jira] [Commented] (HDFS-11685) TestDistributedFileSystem.java fails to compile

2017-04-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976092#comment-15976092 ] John Zhuge commented on HDFS-11685: --- Committed to branch-2. Thanks [~chris.douglas] for the review. >

[jira] [Commented] (HDFS-11685) TestDistributedFileSystem.java fails to compile

2017-04-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976087#comment-15976087 ] John Zhuge commented on HDFS-11685: --- The unit test failures are unrelated. Committing shortly. >

[jira] [Commented] (HDFS-11685) TestDistributedFileSystem.java fails to compile

2017-04-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976080#comment-15976080 ] Hadoop QA commented on HDFS-11685: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11493) Ozone: SCM: Add the ability to handle container reports

2017-04-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976065#comment-15976065 ] Anu Engineer commented on HDFS-11493: - javac warnings are not related to this patch, neither are test

[jira] [Commented] (HDFS-11666) Ozone: Fix compile error due to inconsistent package name

2017-04-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976061#comment-15976061 ] Hadoop QA commented on HDFS-11666: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11643) Balancer fencing fails when writing erasure coded lock file

2017-04-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976049#comment-15976049 ] SammiChen commented on HDFS-11643: -- Uploaded a new patch, improved based on Andrew's suggestion. >

[jira] [Updated] (HDFS-11643) Balancer fencing fails when writing erasure coded lock file

2017-04-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11643: - Attachment: HDFS-11643.004.patch > Balancer fencing fails when writing erasure coded lock file >

[jira] [Commented] (HDFS-11685) TestDistributedFileSystem.java fails to compile

2017-04-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976040#comment-15976040 ] John Zhuge commented on HDFS-11685: --- Thanks [~chris.douglas]. Branch-2 still will not compile until

[jira] [Commented] (HDFS-11613) Ozone: Cleanup findbugs issues

2017-04-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976039#comment-15976039 ] Weiwei Yang commented on HDFS-11613: Trunk moves to SpotBugs, see HADOOP-14316. Not sure how much it

[jira] [Commented] (HDFS-11668) Ozone: misc improvements for SCM CLI

2017-04-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976024#comment-15976024 ] Weiwei Yang commented on HDFS-11668: Sure [~xyao], thanks for the review, I just updated the log level

[jira] [Updated] (HDFS-11668) Ozone: misc improvements for SCM CLI

2017-04-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11668: --- Attachment: HDFS-11668-HDFS-7240.003.patch > Ozone: misc improvements for SCM CLI >

[jira] [Commented] (HDFS-11666) Ozone: Fix compile error due to inconsistent package name

2017-04-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15976015#comment-15976015 ] Xiaoyu Yao commented on HDFS-11666: --- +1 pending Jenkins. > Ozone: Fix compile error due to inconsistent

[jira] [Updated] (HDFS-11666) Ozone: Fix compile error due to inconsistent package name

2017-04-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11666: - Attachment: HDFS-11666-HDFS-7240.003.patch Thanks Xiaoyu for the quick review! Attach the new patch to

[jira] [Commented] (HDFS-11666) Ozone: Fix compile error due to inconsistent package name

2017-04-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975984#comment-15975984 ] Xiaoyu Yao commented on HDFS-11666: --- I think we should move NodeStat into the same package/dir with

[jira] [Commented] (HDFS-11504) Ozone: SCM: Add AllocateBlock/DeleteBlock/GetBlock APIs

2017-04-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975977#comment-15975977 ] Xiaoyu Yao commented on HDFS-11504: --- Thanks [~anu] for the review. I will fix the checkstyle issue while

[jira] [Updated] (HDFS-11666) Ozone: Fix compile error due to inconsistent package name

2017-04-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11666: - Attachment: HDFS-11666-HDFS-7240.002.patch Thanks [~xyao] for taking a look. Attach the updated patch to

[jira] [Commented] (HDFS-11604) Define and parse erasure code codecs, schemas and policies

2017-04-19 Thread Lin Zeng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975949#comment-15975949 ] Lin Zeng commented on HDFS-11604: - Hi [Kai

[jira] [Commented] (HDFS-11685) TestDistributedFileSystem.java fails to compile

2017-04-19 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975943#comment-15975943 ] Chris Douglas commented on HDFS-11685: -- +1 assuming Jenkins comes back clean. >

[jira] [Updated] (HDFS-11685) TestDistributedFileSystem.java fails to compile

2017-04-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11685: -- Attachment: HDFS-11685.branch-2.001.patch Patch branch-2.001 * Call {{DataNodeFaultInjector.set}} to

[jira] [Updated] (HDFS-11685) TestDistributedFileSystem.java fails to compile

2017-04-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-11685: -- Status: Patch Available (was: Open) > TestDistributedFileSystem.java fails to compile >

[jira] [Commented] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-04-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975935#comment-15975935 ] Hadoop QA commented on HDFS-11402: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-11678) Ozone: SCM CLI: Implement get container metrics command

2017-04-19 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu reassigned HDFS-11678: - Assignee: Yuanbo Liu > Ozone: SCM CLI: Implement get container metrics command >

[jira] [Created] (HDFS-11685) TestDistributedFileSystem.java fails to compile

2017-04-19 Thread John Zhuge (JIRA)
John Zhuge created HDFS-11685: - Summary: TestDistributedFileSystem.java fails to compile Key: HDFS-11685 URL: https://issues.apache.org/jira/browse/HDFS-11685 Project: Hadoop HDFS Issue Type:

[jira] [Assigned] (HDFS-11680) Ozone: SCM CLI: Implement info container command

2017-04-19 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu reassigned HDFS-11680: - Assignee: Yuanbo Liu > Ozone: SCM CLI: Implement info container command >

[jira] [Commented] (HDFS-11604) Define and parse erasure code codecs, schemas and policies

2017-04-19 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975925#comment-15975925 ] Kai Zheng commented on HDFS-11604: -- Thanks [~zenglinx] for actively working on the updates. It looks very

[jira] [Assigned] (HDFS-11679) Ozone: SCM CLI: Implement list container command

2017-04-19 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu reassigned HDFS-11679: - Assignee: Yuanbo Liu > Ozone: SCM CLI: Implement list container command >

[jira] [Commented] (HDFS-11504) Ozone: SCM: Add AllocateBlock/DeleteBlock/GetBlock APIs

2017-04-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975907#comment-15975907 ] Anu Engineer commented on HDFS-11504: - +1, [~xyao] Thanks for updating the patch. There are 2 check

[jira] [Commented] (HDFS-11659) TestDataNodeHotSwapVolumes.testRemoveVolumeBeingWritten fail due to no DataNode available for pipeline recovery.

2017-04-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975880#comment-15975880 ] Hadoop QA commented on HDFS-11659: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10212) HDFS: Upgrade Hadoop MiniKDC with Kerby

2017-04-19 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-10212: - Resolution: Duplicate Status: Resolved (was: Patch Available) > HDFS: Upgrade Hadoop MiniKDC

[jira] [Commented] (HDFS-11660) TestFsDatasetCache#testPageRounder fails intermittently with AssertionError

2017-04-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975878#comment-15975878 ] Hudson commented on HDFS-11660: --- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #11614 (See

[jira] [Updated] (HDFS-11660) TestFsDatasetCache#testPageRounder fails intermittently with AssertionError

2017-04-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11660: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha3 2.9.0 Status:

[jira] [Commented] (HDFS-11493) Ozone: SCM: Add the ability to handle container reports

2017-04-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975836#comment-15975836 ] Hadoop QA commented on HDFS-11493: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-04-19 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975800#comment-15975800 ] Manoj Govindassamy edited comment on HDFS-11402 at 4/20/17 12:23 AM: -

[jira] [Updated] (HDFS-11402) HDFS Snapshots should capture point-in-time copies of OPEN files

2017-04-19 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-11402: -- Attachment: HDFS-11402.05.patch Thanks for the review [~jojochuang] and [~andrew.wang].

[jira] [Commented] (HDFS-11681) DatanodeStorageInfo#getBlockIterator() should return an iterator to an unmodifiable set.

2017-04-19 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975712#comment-15975712 ] Virajith Jalaparti commented on HDFS-11681: --- Pinging [~jingzhao], [~szetszwo] and [~cmccabe] who

[jira] [Commented] (HDFS-11660) TestFsDatasetCache#testPageRounder fails intermittently with AssertionError

2017-04-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975711#comment-15975711 ] Hadoop QA commented on HDFS-11660: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11684) Potential scalability bug on datanode recommission

2017-04-19 Thread Riza Suminto (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Riza Suminto updated HDFS-11684: Description: We are academic researcher working on scalability bug detection. Upon analyzing

[jira] [Updated] (HDFS-11684) Potential scalability bug on datanode recommission

2017-04-19 Thread Riza Suminto (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Riza Suminto updated HDFS-11684: Description: We are academic researcher working on scalability bug detection. Upon analyzing

[jira] [Updated] (HDFS-11684) Potential scalability bug on datanode recommission

2017-04-19 Thread Riza Suminto (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Riza Suminto updated HDFS-11684: Description: We are academic researcher working on scalability bug detection. Upon analyzing

[jira] [Updated] (HDFS-11684) Potential scalability bug on datanode recommission

2017-04-19 Thread Riza Suminto (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Riza Suminto updated HDFS-11684: Description: We are academic researcher working on scalability bug detection. Upon analyzing

[jira] [Updated] (HDFS-11684) Potential scalability bug on datanode recommission

2017-04-19 Thread Riza Suminto (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Riza Suminto updated HDFS-11684: Description: We are academic researcher working on scalability bug detection. Upon analyzing

[jira] [Comment Edited] (HDFS-11493) Ozone: SCM: Add the ability to handle container reports

2017-04-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975636#comment-15975636 ] Anu Engineer edited comment on HDFS-11493 at 4/19/17 10:19 PM: --- [~szetszwo],

[jira] [Updated] (HDFS-11493) Ozone: SCM: Add the ability to handle container reports

2017-04-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11493: Status: Patch Available (was: Open) > Ozone: SCM: Add the ability to handle container reports >

[jira] [Commented] (HDFS-11660) TestFsDatasetCache#testPageRounder fails intermittently with AssertionError

2017-04-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975641#comment-15975641 ] John Zhuge commented on HDFS-11660: --- +1 LGTM. Great work, Andrew. > TestFsDatasetCache#testPageRounder

[jira] [Created] (HDFS-11684) Potential scalability bug on datanode recommission

2017-04-19 Thread Riza Suminto (JIRA)
Riza Suminto created HDFS-11684: --- Summary: Potential scalability bug on datanode recommission Key: HDFS-11684 URL: https://issues.apache.org/jira/browse/HDFS-11684 Project: Hadoop HDFS Issue

[jira] [Comment Edited] (HDFS-11493) Ozone: SCM: Add the ability to handle container reports

2017-04-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975636#comment-15975636 ] Anu Engineer edited comment on HDFS-11493 at 4/19/17 10:11 PM: --- [~szetszwo],

[jira] [Updated] (HDFS-11493) Ozone: SCM: Add the ability to handle container reports

2017-04-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11493: Attachment: HDFS-11493-HDFS-7240.001.patch container-replication-storage.pdf

[jira] [Commented] (HDFS-11671) TestReconstructStripedBlocks#test2RecoveryTasksForSameBlockGroup fails

2017-04-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975533#comment-15975533 ] Hudson commented on HDFS-11671: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11613 (See

[jira] [Commented] (HDFS-11660) TestFsDatasetCache#testPageRounder fails intermittently with AssertionError

2017-04-19 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975502#comment-15975502 ] Aaron T. Myers commented on HDFS-11660: --- +1, latest patch looks good to me. Good improvements all

[jira] [Updated] (HDFS-11671) TestReconstructStripedBlocks#test2RecoveryTasksForSameBlockGroup fails

2017-04-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11671: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha3 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-11660) TestFsDatasetCache#testPageRounder fails intermittently with AssertionError

2017-04-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11660: --- Attachment: HDFS-11660.003.patch Thanks for the review John, good points! This also reminded me that

[jira] [Commented] (HDFS-11671) TestReconstructStripedBlocks#test2RecoveryTasksForSameBlockGroup fails

2017-04-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975469#comment-15975469 ] Hadoop QA commented on HDFS-11671: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11660) TestFsDatasetCache#testPageRounder fails intermittently with AssertionError

2017-04-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975453#comment-15975453 ] John Zhuge commented on HDFS-11660: --- Thanks [~andrew.wang] for working on this tricky issue.

[jira] [Commented] (HDFS-11643) Balancer fencing fails when writing erasure coded lock file

2017-04-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975451#comment-15975451 ] Andrew Wang commented on HDFS-11643: Hi Sammi, took a deeper look at this, mostly just nitty and API

[jira] [Resolved] (HDFS-11683) getErasureCodingPolicyByName should throw a checked exception

2017-04-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-11683. Resolution: Not A Problem Looking more, it seems like this is actually pretty common in our API.

[jira] [Commented] (HDFS-11683) getErasureCodingPolicyByName should throw a checked exception

2017-04-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975424#comment-15975424 ] Andrew Wang commented on HDFS-11683: I also see this same thing happening in setNewINodeStoragePolicy

[jira] [Commented] (HDFS-11683) getErasureCodingPolicyByName should throw a checked exception

2017-04-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975414#comment-15975414 ] Andrew Wang commented on HDFS-11683: I think an InvalidRequestException might be more appropriate,

[jira] [Created] (HDFS-11683) getErasureCodingPolicyByName should throw a checked exception

2017-04-19 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-11683: -- Summary: getErasureCodingPolicyByName should throw a checked exception Key: HDFS-11683 URL: https://issues.apache.org/jira/browse/HDFS-11683 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11681) DatanodeStorageInfo#getBlockIterator() should return an iterator to an unmodifiable set.

2017-04-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975404#comment-15975404 ] Hadoop QA commented on HDFS-11681: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11677) OZone: SCM CLI: Implement get container command

2017-04-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975381#comment-15975381 ] Anu Engineer commented on HDFS-11677: - [~vagarychen] You need any API for this to be implimented in

[jira] [Assigned] (HDFS-11676) Ozone: SCM CLI: Implement close container command

2017-04-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang reassigned HDFS-11676: - Assignee: Chen Liang > Ozone: SCM CLI: Implement close container command >

[jira] [Assigned] (HDFS-11677) OZone: SCM CLI: Implement get container command

2017-04-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang reassigned HDFS-11677: - Assignee: Chen Liang > OZone: SCM CLI: Implement get container command >

[jira] [Commented] (HDFS-11572) [SPS]: SPS should clean Xattrs when no blocks required to satisfy for a file

2017-04-19 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975353#comment-15975353 ] Rakesh R commented on HDFS-11572: - Thanks [~umamaheswararao] for the patch. I'm almost OK, need to rebase

[jira] [Comment Edited] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-04-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975343#comment-15975343 ] Chen Liang edited comment on HDFS-11530 at 4/19/17 7:25 PM: Thanks [~linyiqun]

[jira] [Commented] (HDFS-11530) Use HDFS specific network topology to choose datanode in BlockPlacementPolicyDefault

2017-04-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975343#comment-15975343 ] Chen Liang commented on HDFS-11530: --- Thanks [~linyiqun] for the updated patch! Regarding the earlier

[jira] [Commented] (HDFS-11668) Ozone: misc improvements for SCM CLI

2017-04-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975317#comment-15975317 ] Xiaoyu Yao commented on HDFS-11668: --- Thanks [~cheersyang] for working on this. The patch looks good to

[jira] [Commented] (HDFS-11682) TestBalancer#testBalancerWithStripedFile is flaky

2017-04-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975282#comment-15975282 ] Andrew Wang commented on HDFS-11682: Eddy expressed interest in fixing this, assigned to him. >

[jira] [Assigned] (HDFS-11682) TestBalancer#testBalancerWithStripedFile is flaky

2017-04-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-11682: -- Assignee: Lei (Eddy) Xu > TestBalancer#testBalancerWithStripedFile is flaky >

[jira] [Updated] (HDFS-11682) TestBalancer#testBalancerWithStripedFile is flaky

2017-04-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11682: --- Attachment: IndexOutOfBoundsException.log timeout.log Attached logs from precommit

[jira] [Commented] (HDFS-11666) Ozone: Fix compile error due to inconsistent package name

2017-04-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975278#comment-15975278 ] Xiaoyu Yao commented on HDFS-11666: --- Agree with Yuanbo that we should move the class

[jira] [Created] (HDFS-11682) TestBalancer#testBalancerWithStripedFile is flaky

2017-04-19 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-11682: -- Summary: TestBalancer#testBalancerWithStripedFile is flaky Key: HDFS-11682 URL: https://issues.apache.org/jira/browse/HDFS-11682 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-11671) TestReconstructStripedBlocks#test2RecoveryTasksForSameBlockGroup fails

2017-04-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11671: --- Attachment: HDFS-11671.002.patch Thanks John for reviewing! New patch, I tested compilation locally.

[jira] [Commented] (HDFS-11604) Define and parse erasure code codecs, schemas and policies

2017-04-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975233#comment-15975233 ] Hadoop QA commented on HDFS-11604: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11681) DatanodeStorageInfo#getBlockIterator() should return an iterator to an unmodifiable set.

2017-04-19 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11681: -- Status: Patch Available (was: Open) > DatanodeStorageInfo#getBlockIterator() should

[jira] [Updated] (HDFS-11681) DatanodeStorageInfo#getBlockIterator() should return an iterator to an unmodifiable set.

2017-04-19 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11681: -- Attachment: HDFS-11681.001.patch Attaching an initial version of the patch. >

[jira] [Updated] (HDFS-11681) DatanodeStorageInfo#getBlockIterator() should return an iterator to an unmodifiable set.

2017-04-19 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11681: -- Attachment: (was: HDFS-11681.001.patch) > DatanodeStorageInfo#getBlockIterator()

[jira] [Updated] (HDFS-11681) DatanodeStorageInfo#getBlockIterator() should return an iterator to an unmodifiable set.

2017-04-19 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11681: -- Attachment: HDFS-11681.001.patch > DatanodeStorageInfo#getBlockIterator() should return

[jira] [Commented] (HDFS-11681) DatanodeStorageInfo#getBlockIterator() should return an iterator to an unmodifiable set.

2017-04-19 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975221#comment-15975221 ] Virajith Jalaparti commented on HDFS-11681: --- Currently,

[jira] [Created] (HDFS-11681) DatanodeStorageInfo#getBlockIterator() should return an iterator to an unmodifiable set.

2017-04-19 Thread Virajith Jalaparti (JIRA)
Virajith Jalaparti created HDFS-11681: - Summary: DatanodeStorageInfo#getBlockIterator() should return an iterator to an unmodifiable set. Key: HDFS-11681 URL: https://issues.apache.org/jira/browse/HDFS-11681

[jira] [Commented] (HDFS-11667) Block Storage:Handling flushing of incomplete block id buffers during shutdown

2017-04-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975190#comment-15975190 ] Chen Liang commented on HDFS-11667: --- Thanks [~msingh] for working on this! Looks good to me overall,

[jira] [Commented] (HDFS-11316) TestDataNodeVolumeFailure#testUnderReplicationAfterVolFailure fails in trunk

2017-04-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975156#comment-15975156 ] Eric Payne commented on HDFS-11316: --- Thanks [~linyiqun]. I backported this to branch-2 and branch-2.8 >

[jira] [Updated] (HDFS-11316) TestDataNodeVolumeFailure#testUnderReplicationAfterVolFailure fails in trunk

2017-04-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated HDFS-11316: -- Fix Version/s: 2.8.1 2.9.0 >

[jira] [Comment Edited] (HDFS-11671) TestReconstructStripedBlocks#test2RecoveryTasksForSameBlockGroup fails

2017-04-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975143#comment-15975143 ] John Zhuge edited comment on HDFS-11671 at 4/19/17 5:37 PM: +1 LGTM with 1

[jira] [Commented] (HDFS-11671) TestReconstructStripedBlocks#test2RecoveryTasksForSameBlockGroup fails

2017-04-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975143#comment-15975143 ] John Zhuge commented on HDFS-11671: --- +1 LGTM with 1 nit: TestReconstructStripedBlocks#214: the cast to

[jira] [Updated] (HDFS-11604) Define and parse erasure code codecs, schemas and policies

2017-04-19 Thread Lin Zeng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Zeng updated HDFS-11604: Attachment: HDFS-11604-v6.patch # Add @InterfaceAudience.Private to public class ECPolicyLoader. # Add

[jira] [Commented] (HDFS-11668) Ozone: misc improvements for SCM CLI

2017-04-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974785#comment-15974785 ] Hadoop QA commented on HDFS-11668: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-11675) Ozone: SCM CLI: Implement delete container command

2017-04-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned HDFS-11675: -- Assignee: Weiwei Yang > Ozone: SCM CLI: Implement delete container command >

[jira] [Commented] (HDFS-11661) GetContentSummary uses excessive amounts of memory

2017-04-19 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15974701#comment-15974701 ] Wei-Chiu Chuang commented on HDFS-11661: I am +1 for reverting HDFS-10797. In fact, that's what I

[jira] [Created] (HDFS-11680) Ozone: SCM CLI: Implement info container command

2017-04-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11680: -- Summary: Ozone: SCM CLI: Implement info container command Key: HDFS-11680 URL: https://issues.apache.org/jira/browse/HDFS-11680 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-11679) Ozone: SCM CLI: Implement list container command

2017-04-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11679: -- Summary: Ozone: SCM CLI: Implement list container command Key: HDFS-11679 URL: https://issues.apache.org/jira/browse/HDFS-11679 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-11678) Ozone: SCM CLI: Implement get container metrics command

2017-04-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11678: -- Summary: Ozone: SCM CLI: Implement get container metrics command Key: HDFS-11678 URL: https://issues.apache.org/jira/browse/HDFS-11678 Project: Hadoop HDFS

[jira] [Updated] (HDFS-11676) Ozone: SCM CLI: Implement close container command

2017-04-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11676: --- Description: Implement close container command {code} hdfs scm -container close {code} This

  1   2   >