[jira] [Updated] (HDFS-12462) Erasure coding policy extra options should be sorted by key value

2017-09-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12462: - Labels: hdfs-ec-3.0-nice-to-have (was: ) > Erasure coding policy extra options should be sorted by key

[jira] [Updated] (HDFS-12462) Erasure coding policy extra options should be sorted by key value

2017-09-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12462: - Component/s: erasure-coding > Erasure coding policy extra options should be sorted by key value >

[jira] [Created] (HDFS-12462) Erasure coding policy extra options should be sorted by key value

2017-09-14 Thread SammiChen (JIRA)
SammiChen created HDFS-12462: Summary: Erasure coding policy extra options should be sorted by key value Key: HDFS-12462 URL: https://issues.apache.org/jira/browse/HDFS-12462 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12456) TestNamenodeMetrics.testSyncAndBlockReportMetric fails

2017-09-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167364#comment-16167364 ] Hudson commented on HDFS-12456: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12880 (See

[jira] [Commented] (HDFS-12459) Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-09-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167359#comment-16167359 ] Weiwei Yang commented on HDFS-12459: UT failures were not related. [~shahrs87], [~daryn] and

[jira] [Updated] (HDFS-12447) Refactor addErasureCodingPolicy

2017-09-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12447: - Attachment: HDFS-12447.001.patch > Refactor addErasureCodingPolicy > --- > >

[jira] [Updated] (HDFS-12447) Refactor addErasureCodingPolicy

2017-09-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12447: - Status: Patch Available (was: Open) > Refactor addErasureCodingPolicy > ---

[jira] [Updated] (HDFS-12456) TestNamenodeMetrics.testSyncAndBlockReportMetric fails

2017-09-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12456: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1 Status:

[jira] [Commented] (HDFS-12415) Ozone: TestXceiverClientManager and TestAllocateContainer occasionally fails

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167343#comment-16167343 ] Hadoop QA commented on HDFS-12415: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12456) TestNamenodeMetrics.testSyncAndBlockReportMetric fails

2017-09-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12456: - Summary: TestNamenodeMetrics.testSyncAndBlockReportMetric fails (was: Test NameNode metrics test

[jira] [Commented] (HDFS-12437) TestLeaseRecoveryStriped fails in trunk

2017-09-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167339#comment-16167339 ] Arpit Agarwal commented on HDFS-12437: -- Okay I've downgraded it. Thanks Andrew for taking a look. We

[jira] [Updated] (HDFS-12437) TestLeaseRecoveryStriped fails in trunk

2017-09-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12437: - Priority: Major (was: Blocker) > TestLeaseRecoveryStriped fails in trunk >

[jira] [Commented] (HDFS-12444) Reduce runtime of TestWriteReadStripedFile

2017-09-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167333#comment-16167333 ] Kai Zheng commented on HDFS-12444: -- Thanks [~HuafengWang] for the update. Could you help check the

[jira] [Commented] (HDFS-12459) Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167315#comment-16167315 ] Hadoop QA commented on HDFS-12459: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12329) Ozone: Ratis: Readonly calls in XceiverClientRatis should use sendReadOnly

2017-09-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167302#comment-16167302 ] Weiwei Yang commented on HDFS-12329: I see, SCM node manager has some lag on reporting DN states,

[jira] [Commented] (HDFS-12444) Reduce runtime of TestWriteReadStripedFile

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167296#comment-16167296 ] Hadoop QA commented on HDFS-12444: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12461) Ozone: Ozone data placement is not even

2017-09-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167273#comment-16167273 ] Anu Engineer commented on HDFS-12461: - Sorry, I found out why I thought this mapping was wrong. This

[jira] [Commented] (HDFS-12461) Ozone: Ozone data placement is not even

2017-09-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167272#comment-16167272 ] Anu Engineer commented on HDFS-12461: - it is mapped like this. {noformat}

[jira] [Commented] (HDFS-12461) Ozone: Ozone data placement is not even

2017-09-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167271#comment-16167271 ] Weiwei Yang commented on HDFS-12461: Hi [~anu] A quick check, is your data dir configured to respect

[jira] [Commented] (HDFS-12461) Ozone: Ozone data placement is not even

2017-09-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167270#comment-16167270 ] Anu Engineer commented on HDFS-12461: - [~xyao] , [~cheersyang], [~vagarychen], [~msingh] Could any one

[jira] [Created] (HDFS-12461) Ozone: Ozone data placement is not even

2017-09-14 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-12461: --- Summary: Ozone: Ozone data placement is not even Key: HDFS-12461 URL: https://issues.apache.org/jira/browse/HDFS-12461 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-12415) Ozone: TestXceiverClientManager and TestAllocateContainer occasionally fails

2017-09-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12415: --- Status: Patch Available (was: Open) > Ozone: TestXceiverClientManager and TestAllocateContainer

[jira] [Commented] (HDFS-12454) Ozone : the sample ozone-site.xml in OzoneGettingStarted does not work

2017-09-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167267#comment-16167267 ] Anu Engineer commented on HDFS-12454: - bq. At present, ozone.container.metadata.dirs is actually used

[jira] [Commented] (HDFS-12454) Ozone : the sample ozone-site.xml in OzoneGettingStarted does not work

2017-09-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167266#comment-16167266 ] Weiwei Yang commented on HDFS-12454: Hi [~vagarychen], [~anu], [~xyao] Based on Chen Liang's comment,

[jira] [Commented] (HDFS-12445) Spelling mistakes in the Hadoop java source files viz. choosen instead of chosen.

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167263#comment-16167263 ] Hadoop QA commented on HDFS-12445: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-12460) TestNamenodeRetryCache.testRetryCacheRebuild unit test case failure

2017-09-14 Thread SammiChen (JIRA)
SammiChen created HDFS-12460: Summary: TestNamenodeRetryCache.testRetryCacheRebuild unit test case failure Key: HDFS-12460 URL: https://issues.apache.org/jira/browse/HDFS-12460 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2017-09-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167244#comment-16167244 ] Weiwei Yang commented on HDFS-6874: --- Hi [~andrew.wang] Why this one is also reverted? This one doesn't

[jira] [Updated] (HDFS-12459) Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-09-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12459: --- Status: Patch Available (was: Open) > Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST

[jira] [Updated] (HDFS-12459) Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-09-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12459: --- Attachment: HDFS-12459.001.patch > Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API >

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167239#comment-16167239 ] SammiChen commented on HDFS-7859: - Sure. Release note is ready. Thanks [~drankye], [~eddyxu],

[jira] [Commented] (HDFS-12444) Reduce runtime of TestWriteReadStripedFile

2017-09-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167238#comment-16167238 ] Kai Zheng commented on HDFS-12444: -- Triggered the build manually. > Reduce runtime of

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-09-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167237#comment-16167237 ] Weiwei Yang commented on HDFS-11156: Hi [~andrew.wang], thank you, I have created HDFS-12459 to track

[jira] [Created] (HDFS-12459) Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-09-14 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12459: -- Summary: Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API Key: HDFS-12459 URL: https://issues.apache.org/jira/browse/HDFS-12459 Project: Hadoop HDFS

[jira] [Updated] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-7859: Release Note: Persist all built-in erasure coding policies and user defined erasure coding policies into

[jira] [Commented] (HDFS-12395) Support erasure coding policy operations in namenode edit log

2017-09-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167226#comment-16167226 ] Hudson commented on HDFS-12395: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12879 (See

[jira] [Commented] (HDFS-12437) TestLeaseRecoveryStriped fails in trunk

2017-09-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167227#comment-16167227 ] Andrew Wang commented on HDFS-12437: I've spent some time digging through this failure, and it's still

[jira] [Resolved] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-09-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-11156. Resolution: Fixed Target Version/s: 3.0.0-alpha2, 2.8.0 (was: 2.8.0, 3.0.0-alpha2) Hi

[jira] [Reopened] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-09-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reopened HDFS-11156: > Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API >

[jira] [Updated] (HDFS-12395) Support erasure coding policy operations in namenode edit log

2017-09-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-12395: - Resolution: Fixed Hadoop Flags: Incompatible change,Reviewed Fix Version/s: 3.0.0-beta1

[jira] [Updated] (HDFS-12449) TestReconstructStripedFile.testNNSendsErasureCodingTasks randomly cannot finish in 60s

2017-09-14 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12449: - Description: TestReconstructStripedFile.testNNSendsErasureCodingTasks randomly cannot finish in 60s

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-09-14 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167211#comment-16167211 ] Weiwei Yang commented on HDFS-11156: Thanks [~shahrs87], [~daryn] and [~andrew.wang], bq. Remove dfs

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167200#comment-16167200 ] Hudson commented on HDFS-7859: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12878 (See

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167195#comment-16167195 ] Kai Zheng commented on HDFS-7859: - [~Sammi], would you help with the release notes? Thanks again! >

[jira] [Updated] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-7859: Resolution: Fixed Hadoop Flags: Incompatible change,Reviewed Fix Version/s: 3.0.0-beta1

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167182#comment-16167182 ] Kai Zheng commented on HDFS-7859: - The building looks good. Will commit it shortly. > Erasure Coding:

[jira] [Commented] (HDFS-12395) Support erasure coding policy operations in namenode edit log

2017-09-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167178#comment-16167178 ] Kai Zheng commented on HDFS-12395: -- Checked the building results and it looks good. The relevant failure

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167176#comment-16167176 ] Hadoop QA commented on HDFS-7859: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12349) Improve log message when it could not alloc enough blocks for EC

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167171#comment-16167171 ] Hadoop QA commented on HDFS-12349: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12395) Support erasure coding policy operations in namenode edit log

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167168#comment-16167168 ] Hadoop QA commented on HDFS-12395: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12456) Test NameNode metrics test failure in testSyncAndBlockReportMetric

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167162#comment-16167162 ] Hadoop QA commented on HDFS-12456: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12378) TestClientProtocolForPipelineRecovery#testZeroByteBlockRecovery fails on trunk

2017-09-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167151#comment-16167151 ] Hudson commented on HDFS-12378: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12877 (See

[jira] [Commented] (HDFS-12420) Disable Namenode format for prod clusters when data already exists

2017-09-14 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167148#comment-16167148 ] Rushabh S Shah commented on HDFS-12420: --- Couple of minor comments from me. 1. bq. + public static

[jira] [Updated] (HDFS-12445) Spelling mistakes in the Hadoop java source files viz. choosen instead of chosen.

2017-09-14 Thread hu xiaodong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hu xiaodong updated HDFS-12445: --- Target Version/s: 3.0.0-alpha3 Status: Patch Available (was: In Progress) > Spelling

[jira] [Updated] (HDFS-12378) TestClientProtocolForPipelineRecovery#testZeroByteBlockRecovery fails on trunk

2017-09-14 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12378: - Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-12420) Disable Namenode format for prod clusters when data already exists

2017-09-14 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12420: -- Attachment: HDFS-12420.05.patch [~arpitagarwal],[~anu] thanks for review, attaching new patch for

[jira] [Comment Edited] (HDFS-12375) Fail to start/stop journalnodes using start-dfs.sh/stop-dfs.sh.

2017-09-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167122#comment-16167122 ] Bharat Viswanadham edited comment on HDFS-12375 at 9/14/17 11:40 PM: -

[jira] [Comment Edited] (HDFS-12375) Fail to start/stop journalnodes using start-dfs.sh/stop-dfs.sh.

2017-09-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167122#comment-16167122 ] Bharat Viswanadham edited comment on HDFS-12375 at 9/14/17 11:40 PM: -

[jira] [Commented] (HDFS-12375) Fail to start/stop journalnodes using start-dfs.sh/stop-dfs.sh.

2017-09-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167122#comment-16167122 ] Bharat Viswanadham commented on HDFS-12375: --- [~vincent he] dfs.namenode.checkpoint.edits.dir is

[jira] [Commented] (HDFS-12450) Fixing TestNamenodeHeartbeat and support non-HA

2017-09-14 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167120#comment-16167120 ] Íñigo Goiri commented on HDFS-12450: The {{TestNamenodeHeartbeat}} is fixed now. Not sure I agree with

[jira] [Commented] (HDFS-12323) NameNode terminates after full GC thinking QJM unresponsive if full GC is much longer than timeout

2017-09-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167115#comment-16167115 ] Konstantin Shvachko commented on HDFS-12323: Looks like you need to declare variable

[jira] [Commented] (HDFS-12437) TestLeaseRecoveryStriped fails in trunk

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167114#comment-16167114 ] Hadoop QA commented on HDFS-12437: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12378) TestClientProtocolForPipelineRecovery#testZeroByteBlockRecovery fails on trunk

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167111#comment-16167111 ] Hadoop QA commented on HDFS-12378: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12458) TestReencryptionWithKMS fails regularly

2017-09-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167104#comment-16167104 ] Konstantin Shvachko commented on HDFS-12458: Here is the stack trace: {code} Tests run: 32,

[jira] [Created] (HDFS-12458) TestReencryptionWithKMS fails regularly

2017-09-14 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-12458: -- Summary: TestReencryptionWithKMS fails regularly Key: HDFS-12458 URL: https://issues.apache.org/jira/browse/HDFS-12458 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-12375) Fail to start/stop journalnodes using start-dfs.sh/stop-dfs.sh.

2017-09-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDFS-12375: - Assignee: Bharat Viswanadham > Fail to start/stop journalnodes using

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167073#comment-16167073 ] Kai Zheng commented on HDFS-7859: - Manually triggered, see if it works. > Erasure Coding: Persist erasure

[jira] [Commented] (HDFS-12454) Ozone : the sample ozone-site.xml in OzoneGettingStarted does not work

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167051#comment-16167051 ] Hadoop QA commented on HDFS-12454: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-09-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167053#comment-16167053 ] Hudson commented on HDFS-11156: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12876 (See

[jira] [Commented] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2017-09-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167052#comment-16167052 ] Hudson commented on HDFS-6874: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12876 (See

[jira] [Commented] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-09-14 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167047#comment-16167047 ] John Zhuge commented on HDFS-11851: --- Please upload hs_err*.log. Probably a SEGV in

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-09-14 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167045#comment-16167045 ] Rushabh S Shah commented on HDFS-11156: --- bq. What was the need for this jira ? Reading back all the

[jira] [Updated] (HDFS-12349) Improve log message when it could not alloc enough blocks for EC

2017-09-14 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12349: - Attachment: HDFS-12349.04.patch Fix {{TestBlockStatsMXBean}} > Improve log message when it could

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-09-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167040#comment-16167040 ] Andrew Wang commented on HDFS-11156: Reverted HDFS-6874 and HDFS-11156, using HDFS-12457 to track the

[jira] [Resolved] (HDFS-12457) Revert HDFS-11156 Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-09-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-12457. Resolution: Fixed Assignee: Andrew Wang Fix Version/s: 3.0.0-beta1 Reverted per

[jira] [Created] (HDFS-12457) Revert HDFS-11156 Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-09-14 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-12457: -- Summary: Revert HDFS-11156 Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API Key: HDFS-12457 URL: https://issues.apache.org/jira/browse/HDFS-12457 Project: Hadoop

[jira] [Updated] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-09-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11156: --- Fix Version/s: (was: 2.9.0) > Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API >

[jira] [Reopened] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2017-09-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reopened HDFS-6874: --- Reverted this per discussion on HDFS-11156. > Add GETFILEBLOCKLOCATIONS operation to HttpFS >

[jira] [Updated] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2017-09-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6874: -- Fix Version/s: (was: 3.0.0-beta1) (was: 2.9.0) > Add GETFILEBLOCKLOCATIONS

[jira] [Work started] (HDFS-12456) Test NameNode metrics test failure in testSyncAndBlockReportMetric

2017-09-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12456 started by Bharat Viswanadham. - > Test NameNode metrics test failure in testSyncAndBlockReportMetric >

[jira] [Work started] (HDFS-12456) Test NameNode metrics test failure in testSyncAndBlockReportMetric

2017-09-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12456 started by Bharat Viswanadham. - > Test NameNode metrics test failure in testSyncAndBlockReportMetric >

[jira] [Updated] (HDFS-12456) Test NameNode metrics test failure in testSyncAndBlockReportMetric

2017-09-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12456: -- Attachment: HADOOP-12456.00.patch > Test NameNode metrics test failure in

[jira] [Commented] (HDFS-12456) Test NameNode metrics test failure in testSyncAndBlockReportMetric

2017-09-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167032#comment-16167032 ] Arpit Agarwal commented on HDFS-12456: -- +1 pending Jenkins. > Test NameNode metrics test failure in

[jira] [Work stopped] (HDFS-12456) Test NameNode metrics test failure in testSyncAndBlockReportMetric

2017-09-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12456 stopped by Bharat Viswanadham. - > Test NameNode metrics test failure in testSyncAndBlockReportMetric >

[jira] [Work started] (HDFS-12456) Test NameNode metrics test failure in testSyncAndBlockReportMetric

2017-09-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12456 started by Bharat Viswanadham. - > Test NameNode metrics test failure in testSyncAndBlockReportMetric >

[jira] [Work stopped] (HDFS-12456) Test NameNode metrics test failure in testSyncAndBlockReportMetric

2017-09-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12456 stopped by Bharat Viswanadham. - > Test NameNode metrics test failure in testSyncAndBlockReportMetric >

[jira] [Comment Edited] (HDFS-12442) WebHdfsFileSystem#getFileBlockLocations will always return BlockLocation#corrupt as false

2017-09-14 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167031#comment-16167031 ] Rushabh S Shah edited comment on HDFS-12442 at 9/14/17 10:09 PM: - Thanks

[jira] [Updated] (HDFS-12456) Test NameNode metrics test failure in testSyncAndBlockReportMetric

2017-09-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12456: -- Status: Patch Available (was: In Progress) > Test NameNode metrics test failure in

[jira] [Commented] (HDFS-12456) Test NameNode metrics test failure in testSyncAndBlockReportMetric

2017-09-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167030#comment-16167030 ] Bharat Viswanadham commented on HDFS-12456: --- Updated the code, to update sync count to 4.

[jira] [Commented] (HDFS-12442) WebHdfsFileSystem#getFileBlockLocations will always return BlockLocation#corrupt as false

2017-09-14 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167031#comment-16167031 ] Rushabh S Shah commented on HDFS-12442: --- Thanks [~cheersyang] for the review. I don't know whether

[jira] [Commented] (HDFS-12456) Test NameNode metrics test failure in testSyncAndBlockReportMetric

2017-09-14 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167029#comment-16167029 ] Bharat Viswanadham commented on HDFS-12456: --- Here 4 syncs are happening as below: 1. Load

[jira] [Updated] (HDFS-12454) Ozone : the sample ozone-site.xml in OzoneGettingStarted does not work

2017-09-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12454: -- Status: Patch Available (was: Open) > Ozone : the sample ozone-site.xml in OzoneGettingStarted does

[jira] [Updated] (HDFS-12454) Ozone : the sample ozone-site.xml in OzoneGettingStarted does not work

2017-09-14 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12454: -- Attachment: HDFS-12454-HDFS-7240.001.patch Thanks Anu! Looks like the minimal config for ksm, scm and

[jira] [Updated] (HDFS-12426) Ozone: BlockManager MBean unregister failure upon shutdown

2017-09-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12426: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-12420) Disable Namenode format for prod clusters when data already exists

2017-09-14 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167015#comment-16167015 ] Anu Engineer commented on HDFS-12420: - +1, from me. I am not going to commit this till Monday

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167014#comment-16167014 ] Kai Zheng commented on HDFS-7859: - Some issues like this and HDFS-12395 don't build, not sure what's wrong.

[jira] [Commented] (HDFS-12445) Spelling mistakes in the Hadoop java source files viz. choosen instead of chosen.

2017-09-14 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167016#comment-16167016 ] Rushabh S Shah commented on HDFS-12445: --- +1 ltgm non-binding. > Spelling mistakes in the Hadoop

[jira] [Commented] (HDFS-12420) Disable Namenode format for prod clusters when data already exists

2017-09-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167013#comment-16167013 ] Arpit Agarwal commented on HDFS-12420: -- Thanks [~ajayydv]. I liked the idea of disallowing format

[jira] [Commented] (HDFS-12446) FSNamesystem#internalReleaseLease throw IllegalStateException

2017-09-14 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167012#comment-16167012 ] Rushabh S Shah commented on HDFS-12446: --- bq. NameNode always print following logs. What do you mean

[jira] [Commented] (HDFS-11156) Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-09-14 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167010#comment-16167010 ] Andrew Wang commented on HDFS-11156: I'm going to revert this for now in the absence of agreement or a

[jira] [Updated] (HDFS-12447) Refactor addErasureCodingPolicy

2017-09-14 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-12447: - Description: As a follow on to handle some issues discussed in HDFS-12395, this is to majorly refactor

  1   2   3   >