[jira] [Work started] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-09-19 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12499 started by Bharat Viswanadham. - > dfs.namenode.shared.edits.dir property is currently namenode

[jira] [Commented] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-09-19 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172567#comment-16172567 ] Bharat Viswanadham commented on HDFS-12499: --- This change is brought by HDFS-2934 jira. Refer

[jira] [Assigned] (HDFS-12497) Re-enable TestDFSStripedOutputStreamWithFailure tests

2017-09-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-12497: Assignee: SammiChen > Re-enable TestDFSStripedOutputStreamWithFailure tests >

[jira] [Commented] (HDFS-12329) Ozone: Ratis: Readonly calls in XceiverClientRatis should use sendReadOnly

2017-09-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172618#comment-16172618 ] Weiwei Yang commented on HDFS-12329: I am going to commit this shortly. > Ozone: Ratis: Readonly

[jira] [Commented] (HDFS-12489) Ozone: OzoneRestClientException swallows exceptions which makes client hard to debug failures

2017-09-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172638#comment-16172638 ] Yiqun Lin commented on HDFS-12489: -- Thanks for the comments, [~cheersyang] and [~anu]. bq. Shall file

[jira] [Commented] (HDFS-12489) Ozone: OzoneRestClientException swallows exceptions which makes client hard to debug failures

2017-09-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172643#comment-16172643 ] Weiwei Yang commented on HDFS-12489: FYI HDFS-12500 created to track the logging improvements. >

[jira] [Commented] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172674#comment-16172674 ] Hadoop QA commented on HDFS-12499: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12487) FsDatasetSpi.isValidBlock() lacks null pointer check inside and neither do the callers

2017-09-19 Thread liumi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liumi updated HDFS-12487: - Target Version/s: 3.0.0 (was: 3.1.0) > FsDatasetSpi.isValidBlock() lacks null pointer check inside and neither

[jira] [Updated] (HDFS-12329) Ozone: Ratis: Readonly calls in XceiverClientRatis should use sendReadOnly

2017-09-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12329: --- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-12466) Ozone: KSM: Make "ozone.ksm.address" as mandatory property for client

2017-09-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172632#comment-16172632 ] Weiwei Yang commented on HDFS-12466: Hi [~nandakumar131] One more minor thing, sorry I did not

[jira] [Updated] (HDFS-12489) Ozone: OzoneRestClientException swallows exceptions which makes client hard to debug failures

2017-09-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12489: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Updated] (HDFS-12487) FsDatasetSpi.isValidBlock() lacks null pointer check inside and neither do the callers

2017-09-19 Thread liumi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liumi updated HDFS-12487: - Status: Patch Available (was: Open) > FsDatasetSpi.isValidBlock() lacks null pointer check inside and neither do

[jira] [Commented] (HDFS-12485) expunge may not remove trash from encryption zone

2017-09-19 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172209#comment-16172209 ] Rushabh S Shah commented on HDFS-12485: --- Good catch [~jojochuang]. It should just replace

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-09-19 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172208#comment-16172208 ] Chris Douglas commented on HDFS-7878: - Any other feedback on the patch? As an API for open-exact, one

[jira] [Updated] (HDFS-12495) TestPendingInvalidateBlock.testPendingDeleteUnknownBlocks fails intermittently

2017-09-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HDFS-12495: --- Affects Version/s: 2.8.2 3.0.0-beta1 2.9.0 >

[jira] [Updated] (HDFS-12473) Change hosts JSON file format

2017-09-19 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-12473: --- Attachment: HDFS-12473-6.patch Thanks [~manojg]. Here is the new patch to address your comments, except for

[jira] [Updated] (HDFS-12486) GetConf to get journalnodeslist

2017-09-19 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12486: -- Attachment: HDFS-12486.03.patch > GetConf to get journalnodeslist >

[jira] [Updated] (HDFS-12496) Make QuorumJournalManager timeout properties configurable

2017-09-19 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12496: -- Attachment: HDFS-12496.01.patch > Make QuorumJournalManager timeout properties configurable >

[jira] [Updated] (HDFS-12496) Make QuorumJournalManager timeout properties configurable

2017-09-19 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-12496: - Status: Patch Available (was: Open) > Make QuorumJournalManager timeout properties configurable

[jira] [Updated] (HDFS-12495) TestPendingInvalidateBlock.testPendingDeleteUnknownBlocks fails intermittently

2017-09-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12495: --- Labels: flaky-test (was: ) > TestPendingInvalidateBlock.testPendingDeleteUnknownBlocks fails

[jira] [Commented] (HDFS-12060) Ozone: OzoneClient: Add list calls in RpcClient

2017-09-19 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172367#comment-16172367 ] Nandakumar commented on HDFS-12060: --- Patch updated. > Ozone: OzoneClient: Add list calls in RpcClient >

[jira] [Commented] (HDFS-12454) Ozone : the sample ozone-site.xml in OzoneGettingStarted does not work

2017-09-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172597#comment-16172597 ] Weiwei Yang commented on HDFS-12454: +1 on v4 patch, pending on jenkins. > Ozone : the sample

[jira] [Commented] (HDFS-12399) Improve erasure coding codec framework adding more unit tests

2017-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172678#comment-16172678 ] Hadoop QA commented on HDFS-12399: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12449) TestReconstructStripedFile.testNNSendsErasureCodingTasks randomly cannot finish in 60s

2017-09-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172611#comment-16172611 ] SammiChen commented on HDFS-12449: -- Thanks [~eddyxu] for review and commit the patch! >

[jira] [Commented] (HDFS-12489) Ozone: OzoneRestClientException swallows exceptions which makes client hard to debug failures

2017-09-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172640#comment-16172640 ] Weiwei Yang commented on HDFS-12489: Thanks [~linyiqun] and [~anu] for the comments, so I would like

[jira] [Updated] (HDFS-12487) FsDatasetSpi.isValidBlock() lacks null pointer check inside and neither do the callers

2017-09-19 Thread liumi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liumi updated HDFS-12487: - Attachment: HDFS-12487.001.patch > FsDatasetSpi.isValidBlock() lacks null pointer check inside and neither do >

[jira] [Commented] (HDFS-12475) Ozone : add document for port sharing with WebHDFS

2017-09-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172661#comment-16172661 ] Weiwei Yang commented on HDFS-12475: Hi [~vagarychen]/[~ljain] WebHDFS is using namenode HTTP port,

[jira] [Commented] (HDFS-6874) Add GETFILEBLOCKLOCATIONS operation to HttpFS

2017-09-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172581#comment-16172581 ] Weiwei Yang commented on HDFS-6874: --- Hi [~andrew.wang], got it thanks. So this one now waits for

[jira] [Commented] (HDFS-12329) Ozone: Ratis: Readonly calls in XceiverClientRatis should use sendReadOnly

2017-09-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172612#comment-16172612 ] Weiwei Yang commented on HDFS-12329: +1 to the v4 patch, the findbugs and javadoc warnings are not

[jira] [Commented] (HDFS-12447) Refactor addErasureCodingPolicy

2017-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172616#comment-16172616 ] Hadoop QA commented on HDFS-12447: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-12500) Ozone: add logger for oz shell commands and move error stack traces to DEBUG level

2017-09-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12500: -- Summary: Ozone: add logger for oz shell commands and move error stack traces to DEBUG level Key: HDFS-12500 URL: https://issues.apache.org/jira/browse/HDFS-12500

[jira] [Updated] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-09-19 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12499: -- Status: Patch Available (was: In Progress) > dfs.namenode.shared.edits.dir property is

[jira] [Updated] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-09-19 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12499: -- Attachment: HDFS-12499.01.patch > dfs.namenode.shared.edits.dir property is currently

[jira] [Commented] (HDFS-12437) TestLeaseRecoveryStriped fails in trunk

2017-09-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172484#comment-16172484 ] Lei (Eddy) Xu commented on HDFS-12437: -- +1. Thanks [~andrew.wang] > TestLeaseRecoveryStriped fails

[jira] [Updated] (HDFS-12398) Use JUnit Parameterized test suite in TestWriteReadStripedFile

2017-09-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12398: --- Summary: Use JUnit Parameterized test suite in TestWriteReadStripedFile (was: Use JUnit

[jira] [Commented] (HDFS-12398) Use JUnit Paramaterized test suite in TestWriteReadStripedFile

2017-09-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172531#comment-16172531 ] Andrew Wang commented on HDFS-12398: Hi Huafeng, agree that this doesn't reduce duplication much, my

[jira] [Updated] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-09-19 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12499: -- Description: HDFS + Federation cluster +QJM dfs.shared.edits.dir property can be set

[jira] [Comment Edited] (HDFS-12486) GetConf to get journalnodeslist

2017-09-19 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172542#comment-16172542 ] Hanisha Koneru edited comment on HDFS-12486 at 9/20/17 12:38 AM: - Thanks

[jira] [Updated] (HDFS-12469) Ozone: Create docker-compose definition to easily test real clusters

2017-09-19 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12469: Attachment: HDFS-12469-HDFS-7240.WIP2.patch Second, 'almost done' version. I refactored the

[jira] [Updated] (HDFS-12386) Add fsserver defaults call to WebhdfsFileSystem.

2017-09-19 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12386: -- Status: Patch Available (was: Open) > Add fsserver defaults call to WebhdfsFileSystem. >

[jira] [Created] (HDFS-12496) Make QuorumJournalManager timeout properties configurable

2017-09-19 Thread Ajay Kumar (JIRA)
Ajay Kumar created HDFS-12496: - Summary: Make QuorumJournalManager timeout properties configurable Key: HDFS-12496 URL: https://issues.apache.org/jira/browse/HDFS-12496 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12445) Correct spellings of choosen to chosen.

2017-09-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12445: --- Summary: Correct spellings of choosen to chosen. (was: Spelling mistakes in the Hadoop java source

[jira] [Updated] (HDFS-12445) Correct spellings of choosen to chosen.

2017-09-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12445: --- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-12445) Spelling mistakes in the Hadoop java source files viz. choosen instead of chosen.

2017-09-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172318#comment-16172318 ] Andrew Wang commented on HDFS-12445: LGTM, will commit shortly. > Spelling mistakes in the Hadoop

[jira] [Commented] (HDFS-12447) Refactor addErasureCodingPolicy

2017-09-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172330#comment-16172330 ] Andrew Wang commented on HDFS-12447: I think the build failure is due to HADOOP-14771, which we just

[jira] [Commented] (HDFS-12444) Reduce runtime of TestWriteReadStripedFile

2017-09-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172339#comment-16172339 ] Hudson commented on HDFS-12444: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12918 (See

[jira] [Updated] (HDFS-12060) Ozone: OzoneClient: Add list calls in RpcClient

2017-09-19 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12060: -- Attachment: HDFS-12060-HDFS-7240.001.patch > Ozone: OzoneClient: Add list calls in RpcClient >

[jira] [Updated] (HDFS-12497) Re-enable TestDFSStripedOutputStreamWithFailure tests

2017-09-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12497: --- Labels: flaky-test hdfs-ec-3.0-must-do (was: hdfs-ec-3.0-must-do) > Re-enable

[jira] [Updated] (HDFS-12060) Ozone: OzoneClient: Add list calls in RpcClient

2017-09-19 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12060: -- Status: Patch Available (was: Open) > Ozone: OzoneClient: Add list calls in RpcClient >

[jira] [Commented] (HDFS-12496) Make QuorumJournalManager timeout properties configurable

2017-09-19 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172366#comment-16172366 ] Hanisha Koneru commented on HDFS-12496: --- Thanks for the improvement [~ajayydv]. The patch LGTM. One

[jira] [Updated] (HDFS-12497) Re-enable TestDFSStripedOutputStreamWithFailure tests

2017-09-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12497: --- Labels: hdfs-ec-3.0-must-do (was: ) > Re-enable TestDFSStripedOutputStreamWithFailure tests >

[jira] [Commented] (HDFS-12496) Make QuorumJournalManager timeout properties configurable

2017-09-19 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172382#comment-16172382 ] Arpit Agarwal commented on HDFS-12496: -- Hi [~ajayydv], couple of comments: # We should retain this

[jira] [Commented] (HDFS-12495) TestPendingInvalidateBlock.testPendingDeleteUnknownBlocks fails intermittently

2017-09-19 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172496#comment-16172496 ] Hanisha Koneru commented on HDFS-12495: --- Thanks for the fix [~ebadger]. The patch LGTM. +1

[jira] [Commented] (HDFS-12437) Fix test setup in TestLeaseRecoveryStriped

2017-09-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172514#comment-16172514 ] Hudson commented on HDFS-12437: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12920 (See

[jira] [Assigned] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-09-19 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey reassigned HDFS-12499: --- Assignee: Bharat Viswanadham > dfs.namenode.shared.edits.dir property is

[jira] [Created] (HDFS-12498) Journal Syncer is not started in Federated + HA cluster

2017-09-19 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HDFS-12498: - Summary: Journal Syncer is not started in Federated + HA cluster Key: HDFS-12498 URL: https://issues.apache.org/jira/browse/HDFS-12498 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12437) Fix test setup in TestLeaseRecoveryStriped

2017-09-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12437: --- Summary: Fix test setup in TestLeaseRecoveryStriped (was: TestLeaseRecoveryStriped fails in trunk)

[jira] [Assigned] (HDFS-12498) Journal Syncer is not started in Federated + HA cluster

2017-09-19 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDFS-12498: - Assignee: Bharat Viswanadham > Journal Syncer is not started in Federated + HA

[jira] [Created] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-09-19 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HDFS-12499: - Summary: dfs.namenode.shared.edits.dir property is currently namenode specific key Key: HDFS-12499 URL: https://issues.apache.org/jira/browse/HDFS-12499

[jira] [Updated] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-09-19 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12499: -- Labels: Incompatible (was: ) > dfs.namenode.shared.edits.dir property is currently

[jira] [Updated] (HDFS-12399) Improve erasure coding codec framework adding more unit tests

2017-09-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12399: --- Status: Patch Available (was: Open) > Improve erasure coding codec framework adding more unit tests

[jira] [Commented] (HDFS-11601) Ozone: Compact DB should be called on Open Containers.

2017-09-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172499#comment-16172499 ] Weiwei Yang commented on HDFS-11601: Hi [~anu] I think the problem is a bit more complex, with 3

[jira] [Commented] (HDFS-12496) Make QuorumJournalManager timeout properties configurable

2017-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172541#comment-16172541 ] Hadoop QA commented on HDFS-12496: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-09-19 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12499: -- Description: HDFS + Federation cluster +QJM dfs.shared.edits.dir property can be set

[jira] [Comment Edited] (HDFS-12486) GetConf to get journalnodeslist

2017-09-19 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172542#comment-16172542 ] Hanisha Koneru edited comment on HDFS-12486 at 9/20/17 12:37 AM: - Thanks

[jira] [Commented] (HDFS-12386) Add fsserver defaults call to WebhdfsFileSystem.

2017-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172564#comment-16172564 ] Hadoop QA commented on HDFS-12386: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12487) FsDatasetSpi.isValidBlock() lacks null pointer check inside and neither do the callers

2017-09-19 Thread liumi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172563#comment-16172563 ] liumi commented on HDFS-12487: -- [~anu] Thank you. > FsDatasetSpi.isValidBlock() lacks null pointer check

[jira] [Updated] (HDFS-12498) Journal Syncer is not started in Federated + HA cluster

2017-09-19 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12498: -- Attachment: hdfs-site.xml > Journal Syncer is not started in Federated + HA cluster >

[jira] [Updated] (HDFS-12437) Fix test setup in TestLeaseRecoveryStriped

2017-09-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12437: --- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch

[jira] [Comment Edited] (HDFS-12486) GetConf to get journalnodeslist

2017-09-19 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172542#comment-16172542 ] Hanisha Koneru edited comment on HDFS-12486 at 9/20/17 12:33 AM: - Thanks

[jira] [Comment Edited] (HDFS-12486) GetConf to get journalnodeslist

2017-09-19 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172542#comment-16172542 ] Hanisha Koneru edited comment on HDFS-12486 at 9/20/17 12:33 AM: - Thanks

[jira] [Commented] (HDFS-12486) GetConf to get journalnodeslist

2017-09-19 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172542#comment-16172542 ] Hanisha Koneru commented on HDFS-12486: --- Thanks for the improvement, [~bharatviswa]. A few

[jira] [Commented] (HDFS-12480) TestNameNodeMetrics#testTransactionAndCheckpointMetrics Fails in trunk

2017-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171167#comment-16171167 ] Hadoop QA commented on HDFS-12480: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12488) Ozone: OzoneRestClient needs to be configuration awareness

2017-09-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12488: --- Summary: Ozone: OzoneRestClient needs to be configuration awareness (was: Ozone: OzoneRestClient has

[jira] [Commented] (HDFS-12395) Support erasure coding policy operations in namenode edit log

2017-09-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171232#comment-16171232 ] SammiChen commented on HDFS-12395: -- Thanks [~kihwal] for the reminder of taking care the NN layout

[jira] [Updated] (HDFS-11968) ViewFS: StoragePolicies commands fail with HDFS federation

2017-09-19 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11968: - Attachment: HDFS-11968.007.patch > ViewFS: StoragePolicies commands fail with HDFS

[jira] [Commented] (HDFS-12449) TestReconstructStripedFile.testNNSendsErasureCodingTasks randomly cannot finish in 60s

2017-09-19 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171236#comment-16171236 ] SammiChen commented on HDFS-12449: -- Hi [~eddyxu], do you have time to take a look at the patch? I double

[jira] [Created] (HDFS-12488) Ozone: OzoneRestClient has no notion of configuration

2017-09-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12488: -- Summary: Ozone: OzoneRestClient has no notion of configuration Key: HDFS-12488 URL: https://issues.apache.org/jira/browse/HDFS-12488 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-11968) ViewFS: StoragePolicies commands fail with HDFS federation

2017-09-19 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171294#comment-16171294 ] Mukul Kumar Singh commented on HDFS-11968: -- Thanks for the review [~surendrasingh], 1)

[jira] [Updated] (HDFS-12487) FsDatasetSpi.isValidBlock() lacks null pointer check inside and neither do the callers

2017-09-19 Thread liumi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liumi updated HDFS-12487: - Flags: Patch,Important Affects Version/s: (was: 3.0.0-alpha1)

[jira] [Commented] (HDFS-12488) Ozone: OzoneRestClient needs to be configuration awareness

2017-09-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171346#comment-16171346 ] Weiwei Yang commented on HDFS-12488: Hi [~anu]/[~xyao] Could you please take a look at this problem?

[jira] [Updated] (HDFS-12487) FsDatasetSpi.isValidBlock() lacks null pointer check inside and neither do the callers

2017-09-19 Thread liumi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liumi updated HDFS-12487: - Affects Version/s: (was: 3.0.0-alpha4) 3.0.0 Target Version/s: 3.0.0 (was:

[jira] [Commented] (HDFS-12486) GetConf to get journalnodeslist

2017-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171377#comment-16171377 ] Hadoop QA commented on HDFS-12486: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11851) getGlobalJNIEnv() may deadlock if exception is thrown

2017-09-19 Thread Ruslan Dautkhanov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171172#comment-16171172 ] Ruslan Dautkhanov commented on HDFS-11851: -- {quote} Please set "ulimit -c unlimited" before

[jira] [Comment Edited] (HDFS-11968) ViewFS: StoragePolicies commands fail with HDFS federation

2017-09-19 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144821#comment-16144821 ] Surendra Singh Lilhore edited comment on HDFS-11968 at 9/19/17 6:18 AM:

[jira] [Commented] (HDFS-12205) Ozone: List Key on an empty ozone bucket fails with command failed error

2017-09-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171206#comment-16171206 ] Yiqun Lin commented on HDFS-12205: -- Thanks [~ljain] for updating the patch! I noticed one detail change:

[jira] [Created] (HDFS-12487) FsDatasetSpi.isValidBlock() lacks null pointer check inside and neither do the callers

2017-09-19 Thread liumi (JIRA)
liumi created HDFS-12487: Summary: FsDatasetSpi.isValidBlock() lacks null pointer check inside and neither do the callers Key: HDFS-12487 URL: https://issues.apache.org/jira/browse/HDFS-12487 Project: Hadoop

[jira] [Created] (HDFS-12489) Ozone: OzoneRestClientException swallows exceptions which makes client hard to debug failures

2017-09-19 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12489: -- Summary: Ozone: OzoneRestClientException swallows exceptions which makes client hard to debug failures Key: HDFS-12489 URL: https://issues.apache.org/jira/browse/HDFS-12489

[jira] [Commented] (HDFS-12466) Ozone: KSM: Add log message to print host and port used by KSM during startup

2017-09-19 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171166#comment-16171166 ] Nandakumar commented on HDFS-12466: --- [~anu], [~cheersyang] We can throw exception in client if

[jira] [Updated] (HDFS-12486) GetConf to get journalnodeslist

2017-09-19 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12486: -- Attachment: HDFS-12486.01.patch > GetConf to get journalnodeslist >

[jira] [Updated] (HDFS-12487) FsDatasetSpi.isValidBlock() lacks null pointer check inside and neither do the callers

2017-09-19 Thread liumi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liumi updated HDFS-12487: - Release Note: null pointer check Status: Patch Available (was: Open) > FsDatasetSpi.isValidBlock()

[jira] [Updated] (HDFS-12487) FsDatasetSpi.isValidBlock() lacks null pointer check inside and neither do the callers

2017-09-19 Thread liumi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liumi updated HDFS-12487: - Status: Open (was: Patch Available) > FsDatasetSpi.isValidBlock() lacks null pointer check inside and neither do

[jira] [Updated] (HDFS-12486) GetConf to get journalnodeslist

2017-09-19 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12486: -- Status: Patch Available (was: In Progress) > GetConf to get journalnodeslist >

[jira] [Commented] (HDFS-11799) Introduce a config to allow setting up write pipeline with fewer nodes than replication factor

2017-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171218#comment-16171218 ] Hadoop QA commented on HDFS-11799: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-12488) Ozone: OzoneRestClient needs to be configuration awareness

2017-09-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned HDFS-12488: -- Assignee: Weiwei Yang > Ozone: OzoneRestClient needs to be configuration awareness >

[jira] [Commented] (HDFS-12205) Ozone: List Key on an empty ozone bucket fails with command failed error

2017-09-19 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171335#comment-16171335 ] Lokesh Jain commented on HDFS-12205: I think an exception can be thrown in such a case as bucket

[jira] [Updated] (HDFS-12489) Ozone: OzoneRestClientException swallows exceptions which makes client hard to debug failures

2017-09-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12489: --- Attachment: HDFS-12489-HDFS-7240.001.patch > Ozone: OzoneRestClientException swallows exceptions

[jira] [Updated] (HDFS-12489) Ozone: OzoneRestClientException swallows exceptions which makes client hard to debug failures

2017-09-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12489: --- Status: Patch Available (was: Open) > Ozone: OzoneRestClientException swallows exceptions which

[jira] [Updated] (HDFS-12486) GetConf to get journalnodeslist

2017-09-19 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12486: -- Attachment: (was: HDFS-12486.01.patch) > GetConf to get journalnodeslist >

[jira] [Updated] (HDFS-12486) GetConf to get journalnodeslist

2017-09-19 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12486: -- Attachment: (was: HDFS-12486.02.patch) > GetConf to get journalnodeslist >

  1   2   3   >