[jira] [Commented] (HDFS-10679) libhdfs++: Implement parallel find with wildcards tool

2016-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15411908#comment-15411908 ] Hadoop QA commented on HDFS-10679: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10731) FSDirectory#verifyMaxDirItems does not log path name

2016-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10731: --- Description: {quote} 2016-08-05 14:42:04,687 ERROR

[jira] [Updated] (HDFS-10731) FSDirectory#verifyMaxDirItems does not log path name

2016-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10731: --- Attachment: HDFS-10731.001.patch Attach v01 patch to add path name in the constructor of

[jira] [Created] (HDFS-10731) FSDirectory#verifyMaxDirItems does not log path name

2016-08-08 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10731: -- Summary: FSDirectory#verifyMaxDirItems does not log path name Key: HDFS-10731 URL: https://issues.apache.org/jira/browse/HDFS-10731 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10679) libhdfs++: Implement parallel find with wildcards tool

2016-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412023#comment-15412023 ] Hadoop QA commented on HDFS-10679: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10729) NameNode crashes when loading edits because max directory items is exceeded

2016-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412016#comment-15412016 ] Wei-Chiu Chuang commented on HDFS-10729: Hi Kihwal, thanks for the comment. The SbNN crashed when

[jira] [Comment Edited] (HDFS-10729) NameNode crashes when loading edits because max directory items is exceeded

2016-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412016#comment-15412016 ] Wei-Chiu Chuang edited comment on HDFS-10729 at 8/8/16 4:12 PM: Hi Kihwal,

[jira] [Commented] (HDFS-10729) NameNode crashes when loading edits because max directory items is exceeded

2016-08-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15411901#comment-15411901 ] Kihwal Lee commented on HDFS-10729: --- Do you know how it got into this state? If the serving namenode

[jira] [Updated] (HDFS-10679) libhdfs++: Implement parallel find with wildcards tool

2016-08-08 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10679: - Attachment: HDFS-10679.HDFS-8707.003.patch Another small correction > libhdfs++: Implement

[jira] [Commented] (HDFS-10342) BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt

2016-08-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412148#comment-15412148 ] Kihwal Lee commented on HDFS-10342: --- [~kshukla], can you rebase the patch? >

[jira] [Updated] (HDFS-10659) Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory

2016-08-08 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-10659: -- Attachment: HDFS-10659.000.patch > Namenode crashes after Journalnode re-installation in an HA

[jira] [Commented] (HDFS-10731) FSDirectory#verifyMaxDirItems does not log path name

2016-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412114#comment-15412114 ] Hadoop QA commented on HDFS-10731: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10659) Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory

2016-08-08 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-10659: -- Status: Patch Available (was: Open) When startLogSegment is called for a JN with fresh disk,

[jira] [Commented] (HDFS-10678) Documenting NNThroughputBenchmark tool

2016-08-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412489#comment-15412489 ] Konstantin Shvachko commented on HDFS-10678: There is some type in "Please usage, please see

[jira] [Comment Edited] (HDFS-10678) Documenting NNThroughputBenchmark tool

2016-08-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412489#comment-15412489 ] Konstantin Shvachko edited comment on HDFS-10678 at 8/8/16 9:17 PM:

[jira] [Updated] (HDFS-10678) Documenting NNThroughputBenchmark tool

2016-08-08 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10678: - Attachment: HDFS-10678.004.patch > Documenting NNThroughputBenchmark tool >

[jira] [Commented] (HDFS-10678) Documenting NNThroughputBenchmark tool

2016-08-08 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412526#comment-15412526 ] Mingliang Liu commented on HDFS-10678: -- Thanks [~shv] for your comments. I apologize for my omission

[jira] [Updated] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-08 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Attachment: HDFS-10682.branch-2.8.001.patch > Replace FsDatasetImpl object lock with a separate lock

[jira] [Reopened] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-10682: -- > Replace FsDatasetImpl object lock with a separate lock object >

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-08 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412587#comment-15412587 ] Chen Liang commented on HDFS-10682: --- Thanks [~arpitagarwal]! I attached a patch for branch-2.8, but I'm

[jira] [Updated] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10682: - Status: Patch Available (was: Reopened) > Replace FsDatasetImpl object lock with a separate lock

[jira] [Updated] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-08 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Status: In Progress (was: Patch Available) > Replace FsDatasetImpl object lock with a separate lock

[jira] [Updated] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-08 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Status: Patch Available (was: In Progress) > Replace FsDatasetImpl object lock with a separate lock

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412595#comment-15412595 ] Arpit Agarwal commented on HDFS-10682: -- Thanks [~vagarychen], I've reopened the Jira. I think Jenkins

[jira] [Updated] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-08 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Attachment: HDFS-10682-branch-2.001.patch > Replace FsDatasetImpl object lock with a separate lock

[jira] [Updated] (HDFS-10391) Always enable NameNode service RPC port

2016-08-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10391: - Target Version/s: 3.0.0-alpha2 (was: 2.9.0) > Always enable NameNode service RPC port >

[jira] [Updated] (HDFS-10391) Always enable NameNode service RPC port

2016-08-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10391: - Labels: Incompatible (was: ) > Always enable NameNode service RPC port >

[jira] [Updated] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-08 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Status: In Progress (was: Patch Available) > Replace FsDatasetImpl object lock with a separate lock

[jira] [Updated] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-08 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Attachment: (was: HDFS-10682.branch-2.8.001.patch) > Replace FsDatasetImpl object lock with a

[jira] [Updated] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-08 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Status: Patch Available (was: In Progress) > Replace FsDatasetImpl object lock with a separate lock

[jira] [Updated] (HDFS-10391) Always enable NameNode service RPC port

2016-08-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10391: - Description: The NameNode should always be setup with a service RPC port so that it does not have

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-08 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412603#comment-15412603 ] Chen Liang commented on HDFS-10682: --- Was not aware of this.Thanks [~arpitagarwal]. > Replace

[jira] [Updated] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-08-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-6962: - Attachment: unit_tests Uploaded script {{unit_tests}} that runs regression unit tests. > ACLs inheritance

[jira] [Commented] (HDFS-10391) Always enable NameNode service RPC port

2016-08-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412601#comment-15412601 ] Arpit Agarwal commented on HDFS-10391: -- It's complicated to do this in a backwards-compatible manner.

[jira] [Commented] (HDFS-4176) EditLogTailer should call rollEdits with a timeout

2016-08-08 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412609#comment-15412609 ] Xiao Chen commented on HDFS-4176: - I was pinged to review the branch-2 patch, 003 LGTM +1. Thanks Eddy and

[jira] [Updated] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-08-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-6962: - Attachment: test_plan.md Upload {{test_plan.md}}. > ACLs inheritance conflict with umaskmode >

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412623#comment-15412623 ] Hadoop QA commented on HDFS-10682: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-08-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-10301: --- Status: Patch Available (was: Reopened) > BlockReport retransmissions may lead to

[jira] [Commented] (HDFS-10723) TestRenameWhileOpen tries to restart NN with the same rpc port

2016-08-08 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412183#comment-15412183 ] Vrushali C commented on HDFS-10723: --- Gentle ping [~kihwal] and [~linyiqun] for your thoughts on the

[jira] [Commented] (HDFS-10659) Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory

2016-08-08 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412105#comment-15412105 ] Hanisha Koneru commented on HDFS-10659: --- Thank you [~jingzhao] for the guidance. > Namenode crashes

[jira] [Updated] (HDFS-10342) BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt

2016-08-08 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10342: --- Attachment: HDFS-10342.003.patch > BlockManager#createLocatedBlocks should not check corrupt replicas

[jira] [Commented] (HDFS-9591) FSImage.loadEdits threw NullPointerException

2016-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412227#comment-15412227 ] Wei-Chiu Chuang commented on HDFS-9591: --- Saw it again:

[jira] [Commented] (HDFS-10457) DataNode should not auto-format block pool directory if VERSION is missing

2016-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412236#comment-15412236 ] Wei-Chiu Chuang commented on HDFS-10457: [~eddyxu] could you review the patch? Thanks very much!

[jira] [Commented] (HDFS-10731) FSDirectory#verifyMaxDirItems does not log path name

2016-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412223#comment-15412223 ] Wei-Chiu Chuang commented on HDFS-10731: Filed HDFS-10732 for the failure of

[jira] [Comment Edited] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-08 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412249#comment-15412249 ] Chen Liang edited comment on HDFS-10682 at 8/8/16 6:44 PM: --- The failed tests are

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-08 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412249#comment-15412249 ] Chen Liang commented on HDFS-10682: --- The failed tests are unrelated and seem to be failing frequently

[jira] [Commented] (HDFS-10608) Include event for AddBlock in Inotify Event Stream

2016-08-08 Thread churro morales (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412248#comment-15412248 ] churro morales commented on HDFS-10608: --- [~surendrasingh] sure thing, sorry for getting back late to

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412278#comment-15412278 ] Arpit Agarwal commented on HDFS-10682: -- +1 lgtm. I will commit it shortly. > Replace FsDatasetImpl

[jira] [Updated] (HDFS-10694) BlockManager.processReport() should print blockReportId in each log message.

2016-08-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-10694: --- Target Version/s: 2.7.4 (was: 2.6.4) Hadoop Flags: Reviewed Hey Yuanbo,

[jira] [Commented] (HDFS-10731) FSDirectory#verifyMaxDirItems does not log path name

2016-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412205#comment-15412205 ] Wei-Chiu Chuang commented on HDFS-10731:

[jira] [Comment Edited] (HDFS-10731) FSDirectory#verifyMaxDirItems does not log path name

2016-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412205#comment-15412205 ] Wei-Chiu Chuang edited comment on HDFS-10731 at 8/8/16 6:34 PM:

[jira] [Created] (HDFS-10732) TestTracing#testTracing is failing in trunk

2016-08-08 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-10732: -- Summary: TestTracing#testTracing is failing in trunk Key: HDFS-10732 URL: https://issues.apache.org/jira/browse/HDFS-10732 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-10601) Improve log message to include hostname when the NameNode is in safemode

2016-08-08 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-10601: --- Attachment: HDFS-10601.003.patch > Improve log message to include hostname when the NameNode is in

[jira] [Updated] (HDFS-10731) FSDirectory#verifyMaxDirItems does not log path name

2016-08-08 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-10731: --- Status: Patch Available (was: Open) > FSDirectory#verifyMaxDirItems does not log path name >

[jira] [Commented] (HDFS-10601) Improve log message to include hostname when the NameNode is in safemode

2016-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412398#comment-15412398 ] Hadoop QA commented on HDFS-10601: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10342) BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt

2016-08-08 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412417#comment-15412417 ] Kuhu Shukla commented on HDFS-10342: TestTracing, TestRefreshUserMappings fail with or without the

[jira] [Commented] (HDFS-4176) EditLogTailer should call rollEdits with a timeout

2016-08-08 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412437#comment-15412437 ] Lei (Eddy) Xu commented on HDFS-4176: - Hi, [~surendrasingh] The patch has already committed to trunk.

[jira] [Commented] (HDFS-10659) Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory

2016-08-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412462#comment-15412462 ] Jing Zhao commented on HDFS-10659: -- Thanks for working on this, [~hkoneru]! The patch looks good to me

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412294#comment-15412294 ] Arpit Agarwal commented on HDFS-10682: -- I've committed this to trunk. Thanks for the contribution

[jira] [Comment Edited] (HDFS-10723) TestRenameWhileOpen tries to restart NN with the same rpc port

2016-08-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15409513#comment-15409513 ] Kihwal Lee edited comment on HDFS-10723 at 8/8/16 7:10 PM: --- It is more likely

[jira] [Commented] (HDFS-10659) Namenode crashes after Journalnode re-installation in an HA cluster due to missing paxos directory

2016-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412305#comment-15412305 ] Hadoop QA commented on HDFS-10659: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10723) TestRenameWhileOpen tries to restart NN with the same rpc port

2016-08-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412331#comment-15412331 ] Kihwal Lee commented on HDFS-10723: --- When a {{MiniDFSCluster}} is brought up without setting the rpc

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412341#comment-15412341 ] Hadoop QA commented on HDFS-10301: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10342) BlockManager#createLocatedBlocks should not check corrupt replicas if none are corrupt

2016-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412342#comment-15412342 ] Hadoop QA commented on HDFS-10342: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10608) Include event for AddBlock in Inotify Event Stream

2016-08-08 Thread churro morales (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] churro morales updated HDFS-10608: -- Attachment: HDFS-10608.v1.patch [~surendrasingh] here is the new rebased patch. > Include

[jira] [Updated] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-10682: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Updated] (HDFS-10730) Fix some failed tests due to BindException

2016-08-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-10730: -- Description: In HDFS-10723, [~kihwal] suggested that {quote} it is not a good idea to hard-code or

[jira] [Assigned] (HDFS-10732) TestTracing#testTracing is failing in trunk

2016-08-08 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp reassigned HDFS-10732: -- Assignee: Daryn Sharp > TestTracing#testTracing is failing in trunk >

[jira] [Commented] (HDFS-10732) TestTracing#testTracing is failing in trunk

2016-08-08 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412352#comment-15412352 ] Daryn Sharp commented on HDFS-10732: Htrace expects the instantiated ipc value object's toString to be

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-08 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412638#comment-15412638 ] Chen Liang commented on HDFS-10682: --- The patch was originally generated based on branch-2.8, it seems it

[jira] [Updated] (HDFS-10457) DataNode should not auto-format block pool directory if VERSION is missing

2016-08-08 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-10457: - Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.9.0 Target

[jira] [Created] (HDFS-10733) NameNode terminated after full GC thinking QJM is unresponsive.

2016-08-08 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-10733: -- Summary: NameNode terminated after full GC thinking QJM is unresponsive. Key: HDFS-10733 URL: https://issues.apache.org/jira/browse/HDFS-10733 Project:

[jira] [Commented] (HDFS-10678) Documenting NNThroughputBenchmark tool

2016-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412647#comment-15412647 ] Hadoop QA commented on HDFS-10678: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-08 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Status: Patch Available (was: In Progress) > Replace FsDatasetImpl object lock with a separate lock

[jira] [Updated] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-08 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-10682: -- Attachment: HDFS-10682-branch-2.002.patch re-submitted a patch for branch-2 > Replace FsDatasetImpl

[jira] [Created] (HDFS-10735) Distcp using webhdfs on secure HA clusters fails with StandbyException

2016-08-08 Thread Benoy Antony (JIRA)
Benoy Antony created HDFS-10735: --- Summary: Distcp using webhdfs on secure HA clusters fails with StandbyException Key: HDFS-10735 URL: https://issues.apache.org/jira/browse/HDFS-10735 Project: Hadoop

[jira] [Issue Comment Deleted] (HDFS-10735) Distcp using webhdfs on secure HA clusters fails with StandbyException

2016-08-08 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-10735: Comment: was deleted (was: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10735) Distcp using webhdfs on secure HA clusters fails with StandbyException

2016-08-08 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-10735: Attachment: (was: HDFS-10735-001.patch) > Distcp using webhdfs on secure HA clusters fails with

[jira] [Updated] (HDFS-10694) BlockManager.processReport() should print blockReportId in each log message.

2016-08-08 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10694: -- Attachment: HDFS-10694-branch-2.001.patch > BlockManager.processReport() should print blockReportId in

[jira] [Updated] (HDFS-10694) BlockManager.processReport() should print blockReportId in each log message.

2016-08-08 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-10694: -- Attachment: HDFS-10694-branch-2.7.001.patch > BlockManager.processReport() should print blockReportId

[jira] [Updated] (HDFS-10718) Prefer direct ByteBuffer in native RS encoder and decoder

2016-08-08 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-10718: - Attachment: (was: HDFS-8668-v4.patch) > Prefer direct ByteBuffer in native RS encoder and decoder >

[jira] [Updated] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-08-08 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-6962: - Attachment: test_plan.md > ACLs inheritance conflict with umaskmode >

[jira] [Updated] (HDFS-10735) Distcp using webhdfs on secure HA clusters fails with StandbyException

2016-08-08 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-10735: Attachment: exception.txt > Distcp using webhdfs on secure HA clusters fails with StandbyException

[jira] [Commented] (HDFS-10735) Distcp using webhdfs on secure HA clusters fails with StandbyException

2016-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412820#comment-15412820 ] Hadoop QA commented on HDFS-10735: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10723) TestRenameWhileOpen tries to restart NN with the same rpc port

2016-08-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412821#comment-15412821 ] Yiqun Lin commented on HDFS-10723: -- Hi, [~vrushalic], some comments from me: 1.We can just removed the

[jira] [Updated] (HDFS-10735) Distcp using webhdfs on secure HA clusters fails with StandbyException

2016-08-08 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-10735: Status: Patch Available (was: Open) > Distcp using webhdfs on secure HA clusters fails with

[jira] [Comment Edited] (HDFS-10723) TestRenameWhileOpen tries to restart NN with the same rpc port

2016-08-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412821#comment-15412821 ] Yiqun Lin edited comment on HDFS-10723 at 8/9/16 1:59 AM: -- Hi, [~vrushalic], some

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412837#comment-15412837 ] Hadoop QA commented on HDFS-10682: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10608) Include event for AddBlock in Inotify Event Stream

2016-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412866#comment-15412866 ] Hadoop QA commented on HDFS-10608: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10735) Distcp using webhdfs on secure HA clusters fails with StandbyException

2016-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412755#comment-15412755 ] Hadoop QA commented on HDFS-10735: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10608) Include event for AddBlock in Inotify Event Stream

2016-08-08 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412807#comment-15412807 ] Rakesh R commented on HDFS-10608: - [~churromorales], I'm assuming the patch is ready? Click the {{Submit

[jira] [Commented] (HDFS-10730) Fix some failed tests due to BindException

2016-08-08 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412808#comment-15412808 ] Yiqun Lin commented on HDFS-10730: -- The failed test were not related. The test

[jira] [Commented] (HDFS-10694) BlockManager.processReport() should print blockReportId in each log message.

2016-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412940#comment-15412940 ] Hadoop QA commented on HDFS-10694: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

2016-08-08 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412992#comment-15412992 ] SammiChen commented on HDFS-8668: - Thanks for Kai's suggestion. The heap buffer convert process is removed

[jira] [Updated] (HDFS-4176) EditLogTailer should call rollEdits with a timeout

2016-08-08 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-4176: Resolution: Fixed Fix Version/s: 3.0.0-alpha2 2.9.0 Status:

[jira] [Commented] (HDFS-10682) Replace FsDatasetImpl object lock with a separate lock object

2016-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412759#comment-15412759 ] Hadoop QA commented on HDFS-10682: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10678) Documenting NNThroughputBenchmark tool

2016-08-08 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412758#comment-15412758 ] Konstantin Shvachko commented on HDFS-10678: +1 looks good. > Documenting

[jira] [Commented] (HDFS-10694) BlockManager.processReport() should print blockReportId in each log message.

2016-08-08 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412809#comment-15412809 ] Yuanbo Liu commented on HDFS-10694: --- Sure > BlockManager.processReport() should print blockReportId in

[jira] [Commented] (HDFS-10694) BlockManager.processReport() should print blockReportId in each log message.

2016-08-08 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15412844#comment-15412844 ] Yuanbo Liu commented on HDFS-10694: --- uploaded branch-2, branch-2.7 patch for this issue. [~shv] Please

[jira] [Updated] (HDFS-10735) Distcp using webhdfs on secure HA clusters fails with StandbyException

2016-08-08 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-10735: Attachment: HDFS-10735-001.patch > Distcp using webhdfs on secure HA clusters fails with

  1   2   >