[jira] [Updated] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11031: - Attachment: HDFS-11031-branch-2.002.patch > Add additional unit test for DataNode startup

[jira] [Updated] (HDFS-11011) Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

2016-10-20 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11011: - Attachment: HDFS-11011.006.patch Posted v006 patch to fix check style issues. Thanks for reviews.

[jira] [Updated] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11031: - Attachment: HDFS-11031.002.patch V2 patch addresses [~brahmareddy]'s comments. > Add additional

[jira] [Commented] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593926#comment-15593926 ] Hadoop QA commented on HDFS-11031: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10638) Modifications to remove the assumption that StorageLocation is associated with java.io.File in Datanode.

2016-10-20 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593906#comment-15593906 ] Virajith Jalaparti commented on HDFS-10638: --- Failing test case is unrelated to the patch. >

[jira] [Commented] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593873#comment-15593873 ] Mingliang Liu commented on HDFS-11031: -- [~brahmareddy] that's a good idea. I'll update the patch with

[jira] [Commented] (HDFS-10730) Fix some failed tests due to BindException

2016-10-20 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593843#comment-15593843 ] Brahma Reddy Battula commented on HDFS-10730: - [~linyiqun] thanks for updating the

[jira] [Commented] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-20 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593836#comment-15593836 ] Brahma Reddy Battula commented on HDFS-11031: - [~liuml07] thanks for working on this. One

[jira] [Commented] (HDFS-10998) Add unit tests for HDFS command 'dfsadmin -fetchImage' in HA

2016-10-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593810#comment-15593810 ] Hudson commented on HDFS-10998: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10650 (See

[jira] [Commented] (HDFS-11011) Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593785#comment-15593785 ] Mingliang Liu commented on HDFS-11011: -- +1 after the checkstyle warning is addressed. Thanks. > Add

[jira] [Updated] (HDFS-10998) Add unit tests for HDFS command 'dfsadmin -fetchImage' in HA

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10998: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-10638) Modifications to remove the assumption that StorageLocation is associated with java.io.File in Datanode.

2016-10-20 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10638: -- Status: Open (was: Patch Available) > Modifications to remove the assumption that

[jira] [Commented] (HDFS-10638) Modifications to remove the assumption that StorageLocation is associated with java.io.File in Datanode.

2016-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593750#comment-15593750 ] Hadoop QA commented on HDFS-10638: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593747#comment-15593747 ] Mingliang Liu commented on HDFS-11031: -- I'd like to ping [~jnp] for code review. > Add additional

[jira] [Updated] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11031: - Attachment: HDFS-11031.001.patch > Add additional unit test for DataNode startup behavior when

[jira] [Updated] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11031: - Attachment: HDFS-11031-branch-2.001.patch > Add additional unit test for DataNode startup

[jira] [Commented] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593639#comment-15593639 ] Hadoop QA commented on HDFS-11031: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11011) Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

2016-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593637#comment-15593637 ] Hadoop QA commented on HDFS-11011: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10638) Modifications to remove the assumption that StorageLocation is associated with java.io.File in Datanode.

2016-10-20 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10638: -- Status: Patch Available (was: Open) > Modifications to remove the assumption that

[jira] [Updated] (HDFS-10638) Modifications to remove the assumption that StorageLocation is associated with java.io.File in Datanode.

2016-10-20 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-10638: -- Attachment: HDFS-10638.005.patch Attaching a new patch based on [~eddyxu]'s comments.

[jira] [Commented] (HDFS-10998) Add unit tests for HDFS command 'dfsadmin -fetchImage' in HA

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593541#comment-15593541 ] Mingliang Liu commented on HDFS-10998: -- +1 Will commit shortly. > Add unit tests for HDFS command

[jira] [Commented] (HDFS-11005) Ozone: TestBlockPoolManager fails in ozone branch.

2016-10-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593514#comment-15593514 ] Arpit Agarwal commented on HDFS-11005: -- Thanks for the heads up [~vagarychen]. I will also review

[jira] [Commented] (HDFS-10730) Fix some failed tests due to BindException

2016-10-20 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593496#comment-15593496 ] Yiqun Lin commented on HDFS-10730: -- The jenkins's result seems good, feel free to commit, [~brahmareddy].

[jira] [Commented] (HDFS-11025) TestDiskspaceQuotaUpdate fails in trunk due to Bind exception

2016-10-20 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593480#comment-15593480 ] Yiqun Lin commented on HDFS-11025: -- Thanks [~brahmareddy] for the commit in this JIRA and in HDFS-10699!

[jira] [Commented] (HDFS-11018) Incorrect check and message in FsDatasetImpl#invalidate

2016-10-20 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593466#comment-15593466 ] Yiqun Lin commented on HDFS-11018: -- Thanks [~jojochuang] for the commit! > Incorrect check and message

[jira] [Commented] (HDFS-10757) KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used

2016-10-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593419#comment-15593419 ] Xiao Chen commented on HDFS-10757: -- Thanks [~xyao] for the new rev, looks good to me. Could you clarify

[jira] [Commented] (HDFS-11011) Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

2016-10-20 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593422#comment-15593422 ] Xiaobing Zhou commented on HDFS-11011: -- Thank you [~liuml07] for the patch. I posted another patch

[jira] [Commented] (HDFS-10935) TestFileChecksum tests are failing after HDFS-10460 (Mac only?)

2016-10-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593423#comment-15593423 ] Wei-Chiu Chuang commented on HDFS-10935: I have two local Hadoop repo, one is built with native

[jira] [Updated] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11031: - Status: Patch Available (was: Open) > Add additional unit test for DataNode startup behavior

[jira] [Updated] (HDFS-11011) Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

2016-10-20 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11011: - Attachment: HDFS-11011.005.patch > Add unit tests for HDFS command 'dfsadmin -set/clrSpaceQuota'

[jira] [Updated] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11031: - Attachment: HDFS-11031.000.patch > Add additional unit test for DataNode startup behavior when

[jira] [Commented] (HDFS-11005) Ozone: TestBlockPoolManager fails in ozone branch.

2016-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593413#comment-15593413 ] Hadoop QA commented on HDFS-11005: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10757) KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used

2016-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593376#comment-15593376 ] Hadoop QA commented on HDFS-10757: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11030) TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)

2016-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593363#comment-15593363 ] Hadoop QA commented on HDFS-11030: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-6440) Support more than 2 NameNodes

2016-10-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593343#comment-15593343 ] Arpit Agarwal commented on HDFS-6440: - Thank you for the quick response Jesse. > Support more than 2

[jira] [Commented] (HDFS-9462) DiskBalancer: Add Scan Command

2016-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593331#comment-15593331 ] Hadoop QA commented on HDFS-9462: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10757) KMSClientProvider combined with KeyProviderCache can result in wrong UGI being used

2016-10-20 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10757: -- Attachment: HDFS-10757.03.patch Thanks [~xiaochen] for the feedback. Attach a new patch that removes

[jira] [Commented] (HDFS-11005) Ozone: TestBlockPoolManager fails in ozone branch.

2016-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593258#comment-15593258 ] Hadoop QA commented on HDFS-11005: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11005) Ozone: TestBlockPoolManager fails in ozone branch.

2016-10-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11005: -- Attachment: HDFS-11005-HDFS-7240.002.patch Thanks [~xyao] for the review! The issue here was that if

[jira] [Resolved] (HDFS-11017) dfsadmin set/clrSpaceQuota fail to recognize StorageType option

2016-10-20 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou resolved HDFS-11017. -- Resolution: Invalid It seems there's a flaky error in my script. It's not an issue anymore,

[jira] [Resolved] (HDFS-11038) DiskBalancer: support running multiple commands under one setup of disk balancer

2016-10-20 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou resolved HDFS-11038. -- Resolution: Implemented As explained, it's already implemented in HDFS-9462 patch. Closed this

[jira] [Commented] (HDFS-11038) DiskBalancer: support running multiple commands under one setup of disk balancer

2016-10-20 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593134#comment-15593134 ] Xiaobing Zhou commented on HDFS-11038: -- This can be fixed by closing FileSystem instance maintaine by

[jira] [Commented] (HDFS-9462) DiskBalancer: Add Scan Command

2016-10-20 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593122#comment-15593122 ] Xiaobing Zhou commented on HDFS-9462: - Thanks [~anu] for reviews. Posted patch v002, added a couple of

[jira] [Updated] (HDFS-9462) DiskBalancer: Add Scan Command

2016-10-20 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9462: Attachment: HDFS-9462.002.patch > DiskBalancer: Add Scan Command > -- >

[jira] [Commented] (HDFS-11005) Ozone: TestBlockPoolManager fails in ozone branch.

2016-10-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593068#comment-15593068 ] Chen Liang commented on HDFS-11005: --- [~arpitagarwal] do you mind taking a look at the patch? as the

[jira] [Updated] (HDFS-11005) Ozone: TestBlockPoolManager fails in ozone branch.

2016-10-20 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11005: -- Assignee: Chen Liang Status: Patch Available (was: Open) > Ozone: TestBlockPoolManager fails in

[jira] [Updated] (HDFS-11030) TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11030: - Status: Patch Available (was: Open) > TestDataNodeVolumeFailure#testVolumeFailure is flaky

[jira] [Assigned] (HDFS-11031) Add additional unit test for DataNode startup behavior when volumes fail

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu reassigned HDFS-11031: Assignee: Mingliang Liu > Add additional unit test for DataNode startup behavior when

[jira] [Updated] (HDFS-11030) TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11030: - Attachment: HDFS-11030-branch-2.000.patch > TestDataNodeVolumeFailure#testVolumeFailure is flaky

[jira] [Commented] (HDFS-11036) Ozone : reuse Xceiver connection

2016-10-20 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592986#comment-15592986 ] Anu Engineer commented on HDFS-11036: - [~vagarychen] Thanks for this patch. It is a greatly needed

[jira] [Updated] (HDFS-11030) TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11030: - Attachment: HDFS-11030.000.patch Anyone can review the JIRA and the patch? Thanks, Ping [~jnp]

[jira] [Updated] (HDFS-11030) TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11030: - Description: TestDataNodeVolumeFailure#testVolumeFailure fails a volume and verifies the blocks

[jira] [Issue Comment Deleted] (HDFS-11030) TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11030: - Comment: was deleted (was: Sending block report code seems complex. This is the internal logic of

[jira] [Updated] (HDFS-11030) TestDataNodeVolumeFailure#testVolumeFailure is flaky (though passing)

2016-10-20 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-11030: - Description: TestDataNodeVolumeFailure#testVolumeFailure fails a volume and verifies the blocks

[jira] [Updated] (HDFS-10423) Increase default value of httpfs maxHttpHeaderSize

2016-10-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10423: - Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-6440) Support more than 2 NameNodes

2016-10-20 Thread Jesse Yates (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592925#comment-15592925 ] Jesse Yates commented on HDFS-6440: --- Upgrades/downgrades between major versions isn't supported AFAIK.

[jira] [Commented] (HDFS-6440) Support more than 2 NameNodes

2016-10-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592918#comment-15592918 ] Arpit Agarwal commented on HDFS-6440: - Hi [~jesse_yates], was it a design goal to ensure compatibility

[jira] [Commented] (HDFS-10976) Report erasure coding policy of EC files in Fsck

2016-10-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592894#comment-15592894 ] Hudson commented on HDFS-10976: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10648 (See

[jira] [Updated] (HDFS-11018) Incorrect check and message in FsDatasetImpl#invalidate

2016-10-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11018: --- Release Note: Improves the error message when datanode removes a replica which is not found.

[jira] [Updated] (HDFS-10976) Report erasure coding policy of EC files in Fsck

2016-10-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10976: --- Release Note: Fsck now reports whether a file is replicated and erasure-coded. If it is

[jira] [Updated] (HDFS-10976) Report erasure coding policy of EC files in Fsck

2016-10-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10976: --- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Updated] (HDFS-10976) Report erasure coding policy of EC files in Fsck

2016-10-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10976: --- Fix Version/s: 3.0.0-alpha2 > Report erasure coding policy of EC files in Fsck >

[jira] [Updated] (HDFS-10976) Report erasure coding policy of EC files in Fsck

2016-10-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10976: --- Summary: Report erasure coding policy of EC files in Fsck (was: Fsck should mark EC files

[jira] [Commented] (HDFS-11033) Add documents for native raw erasure coder in XOR codes

2016-10-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592827#comment-15592827 ] Wei-Chiu Chuang commented on HDFS-11033: Thanks for the patch. The last patch looks good to me.

[jira] [Commented] (HDFS-10423) Increase default value of httpfs maxHttpHeaderSize

2016-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592812#comment-15592812 ] Hadoop QA commented on HDFS-10423: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11018) Incorrect check and message in FsDatasetImpl#invalidate

2016-10-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11018: --- Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.8.0

[jira] [Commented] (HDFS-7343) HDFS smart storage management

2016-10-20 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592678#comment-15592678 ] Andrew Wang commented on HDFS-7343: --- Thanks for the replies Wei Zhou, inline: {quote} To solve this, we

[jira] [Commented] (HDFS-11018) Incorrect check and message in FsDatasetImpl#invalidate

2016-10-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592572#comment-15592572 ] Hudson commented on HDFS-11018: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10646 (See

[jira] [Commented] (HDFS-11018) Incorrect check and message in FsDatasetImpl#invalidate

2016-10-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592523#comment-15592523 ] Wei-Chiu Chuang commented on HDFS-11018: Committed this to trunk. I'll commit this to branch-2 and

[jira] [Commented] (HDFS-10423) Increase default value of httpfs maxHttpHeaderSize

2016-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592508#comment-15592508 ] Hadoop QA commented on HDFS-10423: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (HDFS-11019) Inconsistent number of corrupt replicas if a corrupt replica is reported multiple times

2016-10-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-11019. Resolution: Duplicate I am pretty sure this is a dup of HDFS-9958 . Thanks [~kshukla] for

[jira] [Updated] (HDFS-10423) Increase default value of httpfs maxHttpHeaderSize

2016-10-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10423: - Status: Patch Available (was: Reopened) > Increase default value of httpfs maxHttpHeaderSize >

[jira] [Updated] (HDFS-10423) Increase default value of httpfs maxHttpHeaderSize

2016-10-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10423: - Attachment: HDFS-10423.branch-2.patch Sorry, reopening to run a pre-commit. Attaching a branch-2 patch.

[jira] [Reopened] (HDFS-10423) Increase default value of httpfs maxHttpHeaderSize

2016-10-20 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reopened HDFS-10423: -- > Increase default value of httpfs maxHttpHeaderSize > -- >

[jira] [Commented] (HDFS-10885) [SPS]: Mover tool should not be allowed to run when Storage Policy Satisfier is on

2016-10-20 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592413#comment-15592413 ] Wei Zhou commented on HDFS-10885: - Hi [~umamaheswararao], thank you very much for reviewing this patch.

[jira] [Commented] (HDFS-7343) HDFS smart storage management

2016-10-20 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592342#comment-15592342 ] Wei Zhou commented on HDFS-7343: Continue on comments from [~andrew.wang], {quote} Could you talk a little

[jira] [Commented] (HDFS-11027) libhdfs++: Don't retry if there is an authentication failure

2016-10-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592340#comment-15592340 ] James Clampffer commented on HDFS-11027: [~xiaowei.zhu] I agree, no point in retrying if it's not

[jira] [Commented] (HDFS-11027) libhdfs++: Don't retry if there is an authentication failure

2016-10-20 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592273#comment-15592273 ] Xiaowei Zhu commented on HDFS-11027: We should consider that if there are more cases we do not want to

[jira] [Commented] (HDFS-10699) Log object instance get incorrectly in TestDFSAdmin

2016-10-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592267#comment-15592267 ] Hudson commented on HDFS-10699: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10644 (See

[jira] [Commented] (HDFS-10627) Volume Scanner marks a block as "suspect" even if the exception is network-related

2016-10-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592265#comment-15592265 ] Hudson commented on HDFS-10627: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10644 (See

[jira] [Updated] (HDFS-10699) Log object instance get incorrectly in TestDFSAdmin

2016-10-20 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-10699: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-10627) Volume Scanner marks a block as "suspect" even if the exception is network-related

2016-10-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10627: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-10699) Log object instance get incorrectly in TestDFSAdmin

2016-10-20 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-10699: Attachment: HDFS-10699.002.patch Uploading the committed patch,Just conflict in

[jira] [Commented] (HDFS-10627) Volume Scanner marks a block as "suspect" even if the exception is network-related

2016-10-20 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592195#comment-15592195 ] Wei-Chiu Chuang commented on HDFS-10627: I think this is okay. In a data transfer scenario

[jira] [Updated] (HDFS-10627) Volume Scanner marks a block as "suspect" even if the exception is network-related

2016-10-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10627: -- Summary: Volume Scanner marks a block as "suspect" even if the exception is network-related (was:

[jira] [Commented] (HDFS-10627) Volume Scanner marks a block as "suspect" even if the block sender encounters 'Broken pipe' or 'Connection reset by peer' exception

2016-10-20 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592168#comment-15592168 ] Kihwal Lee commented on HDFS-10627: --- bq. +1 Will check in tomorrow afternoon unless there are further

[jira] [Commented] (HDFS-9480) Expose nonDfsUsed via StorageTypeStats

2016-10-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592164#comment-15592164 ] Hudson commented on HDFS-9480: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10643 (See

[jira] [Updated] (HDFS-11034) Provide a command line tool to clear decommissioned DataNode information from the NameNode without restarting.

2016-10-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-11034: - Assignee: Gergely Novák > Provide a command line tool to clear decommissioned DataNode

[jira] [Updated] (HDFS-9480) Expose nonDfsUsed via StorageTypeStats

2016-10-20 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9480: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10997) Reduce number of path resolving methods

2016-10-20 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15591923#comment-15591923 ] Daryn Sharp commented on HDFS-10997: Test failures unrelated and pass locally. TestFileCreationDelete

[jira] [Commented] (HDFS-6708) StorageType should be encoded in the block token

2016-10-20 Thread Pieter Reuse (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15591757#comment-15591757 ] Pieter Reuse commented on HDFS-6708: The changes in the protobuf for the BlockTokenIdentifier will be

[jira] [Commented] (HDFS-9096) Issue in Rollback (after rolling upgrade) from hadoop 2.7.1 to 2.4.0

2016-10-20 Thread Dinesh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15591592#comment-15591592 ] Dinesh commented on HDFS-9096: -- Hi [~kihwal], Yes. Did by mistake. Let me change version in both name nodes

[jira] [Commented] (HDFS-6984) In Hadoop 3, make FileStatus serialize itself via protobuf

2016-10-20 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15591402#comment-15591402 ] Steve Loughran commented on HDFS-6984: -- wow, thanks for that extra work! appreciated. I didn't go into

[jira] [Commented] (HDFS-10815) The state of the EC file is erroneously recognized when you restart the NameNode.

2016-10-20 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15591320#comment-15591320 ] SammiChen commented on HDFS-10815: -- Hi Eisuke Umeda, thanks for provide more information! Have you ever

[jira] [Commented] (HDFS-10815) The state of the EC file is erroneously recognized when you restart the NameNode.

2016-10-20 Thread Eisuke Umeda (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15591310#comment-15591310 ] Eisuke Umeda commented on HDFS-10815: - I'm sorry I'm so late. It was possible to reproduce the bug by

[jira] [Commented] (HDFS-11033) Add documents for native raw erasure coder in XOR codes

2016-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15591086#comment-15591086 ] Hadoop QA commented on HDFS-11033: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8410) Add computation time metrics to datanode for ECWorker

2016-10-20 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15591061#comment-15591061 ] SammiChen commented on HDFS-8410: - 1. The failed test is irrelevant. The failure reason is "Adress already

[jira] [Commented] (HDFS-8410) Add computation time metrics to datanode for ECWorker

2016-10-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15591033#comment-15591033 ] Hadoop QA commented on HDFS-8410: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7343) HDFS smart storage management

2016-10-20 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15590949#comment-15590949 ] Wei Zhou commented on HDFS-7343: Hi [~andrew.wang], thank you for reviewing the document and great