[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223251#comment-16223251 ] Hadoop QA commented on HDFS-12711: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-7878) API - expose an unique file identifier

2017-10-27 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-7878: Attachment: HDFS-7878.21.patch Fixed checkstyle warning. > API - expose an unique file identifier >

[jira] [Commented] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223212#comment-16223212 ] Hadoop QA commented on HDFS-12681: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12498) Journal Syncer is not started in Federated + HA cluster

2017-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223196#comment-16223196 ] Hadoop QA commented on HDFS-12498: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-27 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223191#comment-16223191 ] Allen Wittenauer commented on HDFS-12711: - bq. Max. thread count 3114 5000 proc limit is

[jira] [Updated] (HDFS-12711) deadly hdfs test

2017-10-27 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-12711: Attachment: (was: MAPREDUCE-4980.016.patch) > deadly hdfs test > > >

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223185#comment-16223185 ] Hadoop QA commented on HDFS-12711: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-7240) Object store in HDFS

2017-10-27 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-7240: Attachment: HDFS-7240.003.patch Re-uploading v3 patch to trigger jenkins again. > Object

[jira] [Commented] (HDFS-12582) Replace HdfsFileStatus constructor with a builder pattern.

2017-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223124#comment-16223124 ] Hadoop QA commented on HDFS-12582: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223105#comment-16223105 ] Hadoop QA commented on HDFS-7878: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223071#comment-16223071 ] Hadoop QA commented on HDFS-12697: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12482) Provide a configuration to adjust the weight of EC recovery tasks to adjust the speed of recovery

2017-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223047#comment-16223047 ] Hadoop QA commented on HDFS-12482: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Open (was: Patch Available) > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Patch Available (was: Open) > [READ] Merge BlockFormatProvider and

[jira] [Commented] (HDFS-12582) Replace HdfsFileStatus constructor with a builder pattern.

2017-10-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223032#comment-16223032 ] Bharat Viswanadham commented on HDFS-12582: --- [~chris.douglas] Thanks for committing the patch.

[jira] [Commented] (HDFS-12737) Thousands of sockets lingering in TIME_WAIT state due to frequent file open operations

2017-10-27 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223009#comment-16223009 ] Wei-Chiu Chuang commented on HDFS-12737: I don't understand why the client needs to make a dummy

[jira] [Commented] (HDFS-12731) Ozone: Fix inconsistent default value in ozone settings

2017-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223010#comment-16223010 ] Hadoop QA commented on HDFS-12731: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12582) Replace HdfsFileStatus constructor with a builder pattern.

2017-10-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223008#comment-16223008 ] Hudson commented on HDFS-12582: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13150 (See

[jira] [Created] (HDFS-12738) Namenode logs many "SSL renegotiate denied" warnings after enable HTTPS for HDFS

2017-10-27 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-12738: - Summary: Namenode logs many "SSL renegotiate denied" warnings after enable HTTPS for HDFS Key: HDFS-12738 URL: https://issues.apache.org/jira/browse/HDFS-12738 Project:

[jira] [Comment Edited] (HDFS-12737) Thousands of sockets lingering in TIME_WAIT state due to frequent file open operations

2017-10-27 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222989#comment-16222989 ] Kihwal Lee edited comment on HDFS-12737 at 10/27/17 10:49 PM: -- You quoted

[jira] [Commented] (HDFS-12737) Thousands of sockets lingering in TIME_WAIT state due to frequent file open operations

2017-10-27 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222994#comment-16222994 ] Wei-Chiu Chuang commented on HDFS-12737: Correct. This issue (new connection for every call) only

[jira] [Commented] (HDFS-12737) Thousands of sockets lingering in TIME_WAIT state due to frequent file open operations

2017-10-27 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222989#comment-16222989 ] Kihwal Lee commented on HDFS-12737: --- You quoted {{ClientDatanodeProtocol}}, so I guess they are the

[jira] [Commented] (HDFS-12648) DN should provide feedback to NN for throttling commands

2017-10-27 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222987#comment-16222987 ] Hanisha Koneru commented on HDFS-12648: --- Thanks for clarifying, Daryn. Will wait for progress on

[jira] [Commented] (HDFS-12737) Thousands of sockets lingering in TIME_WAIT state due to frequent file open operations

2017-10-27 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222981#comment-16222981 ] Kihwal Lee commented on HDFS-12737: --- If the same user (i.e. the same UGI instance) talks to the same

[jira] [Commented] (HDFS-12499) dfs.namenode.shared.edits.dir property is currently namenode specific key

2017-10-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222979#comment-16222979 ] Bharat Viswanadham commented on HDFS-12499: --- Ran failed test locally, the test has passed. Test

[jira] [Updated] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-27 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Status: Patch Available (was: Open) > Fold HdfsLocatedFileStatus into HdfsFileStatus >

[jira] [Updated] (HDFS-12582) Replace HdfsFileStatus constructor with a builder pattern.

2017-10-27 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12582: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status:

[jira] [Commented] (HDFS-12582) Replace HdfsFileStatus constructor with a builder pattern.

2017-10-27 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222969#comment-16222969 ] Chris Douglas commented on HDFS-12582: -- {noformat} | Vote | Subsystem | Runtime | Comment

[jira] [Updated] (HDFS-12498) Journal Syncer is not started in Federated + HA cluster

2017-10-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12498: -- Attachment: HDFS-12498.04.patch > Journal Syncer is not started in Federated + HA

[jira] [Commented] (HDFS-12498) Journal Syncer is not started in Federated + HA cluster

2017-10-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222968#comment-16222968 ] Bharat Viswanadham commented on HDFS-12498: --- Attached patch v04 to address review comments in

[jira] [Updated] (HDFS-12737) Thousands of sockets lingering in TIME_WAIT state due to frequent file open operations

2017-10-27 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12737: --- Description: On a HBase cluster we found HBase RegionServers have thousands of sockets in

[jira] [Updated] (HDFS-12737) Thousands of sockets lingering in TIME_WAIT state due to frequent file open operations

2017-10-27 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12737: --- Description: On a HBase cluster we found HBase RegionServers have thousands of sockets in

[jira] [Updated] (HDFS-12737) Thousands of sockets lingering in TIME_WAIT state due to frequent file open operations

2017-10-27 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12737: --- Description: On a HBase cluster we found HBase RegionServers have thousands of sockets in

[jira] [Created] (HDFS-12737) Thousands of sockets lingering in TIME_WAIT state due to frequent file open operations

2017-10-27 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-12737: -- Summary: Thousands of sockets lingering in TIME_WAIT state due to frequent file open operations Key: HDFS-12737 URL: https://issues.apache.org/jira/browse/HDFS-12737

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222930#comment-16222930 ] Hadoop QA commented on HDFS-11096: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-12733) Option to disable to namenode local edits

2017-10-27 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222907#comment-16222907 ] Hanisha Koneru edited comment on HDFS-12733 at 10/27/17 10:04 PM: -- Thanks

[jira] [Commented] (HDFS-12733) Option to disable to namenode local edits

2017-10-27 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222907#comment-16222907 ] Hanisha Koneru commented on HDFS-12733: --- Thanks for the patch [~brahmareddy]. I have a few

[jira] [Commented] (HDFS-12582) Replace HdfsFileStatus constructor with a builder pattern.

2017-10-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222885#comment-16222885 ] Bharat Viswanadham commented on HDFS-12582: --- [~chris.douglas] Thanks for addressing. *In

[jira] [Updated] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-27 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Attachment: HDFS-12681.08.patch Rebase on HDFS-12582 > Fold HdfsLocatedFileStatus into

[jira] [Updated] (HDFS-12582) Replace HdfsFileStatus constructor with a builder pattern.

2017-10-27 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12582: - Attachment: HDFS-12582.06.patch Removed redundant assignments > Replace HdfsFileStatus

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-27 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222841#comment-16222841 ] Allen Wittenauer commented on HDFS-12711: - Adding some better metrics gathering for YETUS-561 so

[jira] [Created] (HDFS-12736) Enable SSL Documentation

2017-10-27 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HDFS-12736: - Summary: Enable SSL Documentation Key: HDFS-12736 URL: https://issues.apache.org/jira/browse/HDFS-12736 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-12582) Replace HdfsFileStatus constructor with a builder pattern.

2017-10-27 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222833#comment-16222833 ] Arpit Agarwal commented on HDFS-12582: -- bq. Yes, this was to fix a findbugs warning. v04 of the patch

[jira] [Commented] (HDFS-12582) Replace HdfsFileStatus constructor with a builder pattern.

2017-10-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222814#comment-16222814 ] Bharat Viswanadham commented on HDFS-12582: --- [~chris.douglas] It is minor, if you are okay to

[jira] [Updated] (HDFS-7878) API - expose an unique file identifier

2017-10-27 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-7878: Attachment: HDFS-7878.20.patch Removed the change to {{HdfsFileStatusProto}}. > API - expose an

[jira] [Updated] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-27 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Attachment: HDFS-12681.07.patch Rebase on HDFS-12582 > Fold HdfsLocatedFileStatus into

[jira] [Commented] (HDFS-12582) Replace HdfsFileStatus constructor with a builder pattern.

2017-10-27 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222809#comment-16222809 ] Chris Douglas commented on HDFS-12582: -- bq. there seems to be a behavior change. We now make copies

[jira] [Work started] (HDFS-12714) Hadoop 3 missing fix for HDFS-5169

2017-10-27 Thread Joe McDonnell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12714 started by Joe McDonnell. > Hadoop 3 missing fix for HDFS-5169 > -- > >

[jira] [Comment Edited] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222756#comment-16222756 ] Bharat Viswanadham edited comment on HDFS-12697 at 10/27/17 8:43 PM: -

[jira] [Commented] (HDFS-12714) Hadoop 3 missing fix for HDFS-5169

2017-10-27 Thread Joe McDonnell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222774#comment-16222774 ] Joe McDonnell commented on HDFS-12714: -- Uploaded a patch for review. [~jzhuge] FYI > Hadoop 3

[jira] [Updated] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-10-27 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HDFS-11096: - Attachment: HDFS-11096.007.patch Okay - I'm now pretty happy with how this is working. I saw the

[jira] [Updated] (HDFS-12714) Hadoop 3 missing fix for HDFS-5169

2017-10-27 Thread Joe McDonnell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe McDonnell updated HDFS-12714: - Attachment: HDFS-12714.001.patch > Hadoop 3 missing fix for HDFS-5169 >

[jira] [Commented] (HDFS-12731) Ozone: Fix inconsistent default value in ozone settings

2017-10-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222759#comment-16222759 ] Bharat Viswanadham commented on HDFS-12731: --- [~linyiqun] Thank You for info. Attached patch v01

[jira] [Assigned] (HDFS-12714) Hadoop 3 missing fix for HDFS-5169

2017-10-27 Thread Joe McDonnell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe McDonnell reassigned HDFS-12714: Assignee: Joe McDonnell > Hadoop 3 missing fix for HDFS-5169 >

[jira] [Updated] (HDFS-12731) Ozone: Fix inconsistent default value in ozone settings

2017-10-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12731: -- Status: Patch Available (was: In Progress) > Ozone: Fix inconsistent default value in

[jira] [Updated] (HDFS-12731) Ozone: Fix inconsistent default value in ozone settings

2017-10-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12731: -- Attachment: HDFS-12731-HDFS-7240.00.patch > Ozone: Fix inconsistent default value in

[jira] [Comment Edited] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222756#comment-16222756 ] Bharat Viswanadham edited comment on HDFS-12697 at 10/27/17 8:31 PM: -

[jira] [Commented] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222756#comment-16222756 ] Bharat Viswanadham commented on HDFS-12697: --- [~elek] Thanks for review. Addressed the review

[jira] [Updated] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-10-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12697: -- Attachment: HDFS-12697-HDFS-7240.03.patch > Ozone services must stay disabled in secure

[jira] [Commented] (HDFS-12582) Replace HdfsFileStatus constructor with a builder pattern.

2017-10-27 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222748#comment-16222748 ] Bharat Viswanadham commented on HDFS-12582: --- Thanks Chris, for rebasing the patch. One minor

[jira] [Commented] (HDFS-12582) Replace HdfsFileStatus constructor with a builder pattern.

2017-10-27 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222738#comment-16222738 ] Arpit Agarwal commented on HDFS-12582: -- Thanks Chris, the patch lgtm. Perhaps I misread this, but

[jira] [Updated] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-27 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Status: Open (was: Patch Available) > Fold HdfsLocatedFileStatus into HdfsFileStatus >

[jira] [Commented] (HDFS-12582) Replace HdfsFileStatus constructor with a builder pattern.

2017-10-27 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222730#comment-16222730 ] Chris Douglas commented on HDFS-12582: -- ASF license warnings are on trunk, unit test failures are

[jira] [Updated] (HDFS-12735) Make ContainerStateMachine#applyTransaction async

2017-10-27 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-12735: --- Labels: performance (was: ) > Make ContainerStateMachine#applyTransaction async >

[jira] [Created] (HDFS-12735) Make ContainerStateMachine#applyTransaction async

2017-10-27 Thread Lokesh Jain (JIRA)
Lokesh Jain created HDFS-12735: -- Summary: Make ContainerStateMachine#applyTransaction async Key: HDFS-12735 URL: https://issues.apache.org/jira/browse/HDFS-12735 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-27 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Status: Open (was: Patch Available) > Fold HdfsLocatedFileStatus into HdfsFileStatus >

[jira] [Updated] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-27 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12681: - Status: Patch Available (was: Open) > Fold HdfsLocatedFileStatus into HdfsFileStatus >

[jira] [Commented] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-27 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222648#comment-16222648 ] Chris Douglas commented on HDFS-12681: -- bq. Mockito seems unhappy in TestDFSOutputStream. That should

[jira] [Updated] (HDFS-12730) Verify open files captured in the snapshots across config disable and enable

2017-10-27 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12730: -- Status: Patch Available (was: Open) > Verify open files captured in the snapshots

[jira] [Commented] (HDFS-12582) Replace HdfsFileStatus constructor with a builder pattern.

2017-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222582#comment-16222582 ] Hadoop QA commented on HDFS-12582: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12734) Ozone: generate version specific documentation during the build

2017-10-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222568#comment-16222568 ] Anu Engineer commented on HDFS-12734: - ok, hugo will fail with missing config file, so we can commit

[jira] [Updated] (HDFS-12734) Ozone: generate version specific documentation during the build

2017-10-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12734: Status: Open (was: Patch Available) > Ozone: generate version specific documentation during the

[jira] [Commented] (HDFS-12734) Ozone: generate version specific documentation during the build

2017-10-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222563#comment-16222563 ] Anu Engineer commented on HDFS-12734: - +1, I have tested this and it works as intended. I would like

[jira] [Updated] (HDFS-12734) Ozone: generate version specific documentation during the build

2017-10-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12734: Status: Patch Available (was: Open) > Ozone: generate version specific documentation during the

[jira] [Updated] (HDFS-12474) Ozone: SCM: Handling container report with key count and container usage.

2017-10-27 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-12474: --- Attachment: HDFS-12474-HDFS-7240.000.patch > Ozone: SCM: Handling container report with key count and

[jira] [Updated] (HDFS-12474) Ozone: SCM: Handling container report with key count and container usage.

2017-10-27 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-12474: --- Status: Patch Available (was: Open) > Ozone: SCM: Handling container report with key count and

[jira] [Commented] (HDFS-12667) KMSClientProvider#ValueQueue does synchronous fetch of edeks in background async thread.

2017-10-27 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222560#comment-16222560 ] Rushabh S Shah commented on HDFS-12667: --- Thanks [~xiaochen] for the review. bq. IMO we should throw

[jira] [Commented] (HDFS-12734) Ozone: generate version specific documentation during the build

2017-10-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222529#comment-16222529 ] Anu Engineer commented on HDFS-12734: - Do you want this committed after HDFS-12664 or is it ok to

[jira] [Commented] (HDFS-12664) Ozone: Documentation: Add version specific documentation site to KSM

2017-10-27 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222523#comment-16222523 ] Elek, Marton commented on HDFS-12664: - See HDFS-12734 for integrating the site generation to the build

[jira] [Updated] (HDFS-12734) Ozone: generate version specific documentation during the build

2017-10-27 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12734: Attachment: HDFS-12734-HDFS-7240.001.patch > Ozone: generate version specific documentation during

[jira] [Created] (HDFS-12734) Ozone: generate version specific documentation during the build

2017-10-27 Thread Elek, Marton (JIRA)
Elek, Marton created HDFS-12734: --- Summary: Ozone: generate version specific documentation during the build Key: HDFS-12734 URL: https://issues.apache.org/jira/browse/HDFS-12734 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9914) Fix configurable WebhDFS connect/read timeout

2017-10-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222511#comment-16222511 ] Hudson commented on HDFS-9914: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13147 (See

[jira] [Updated] (HDFS-9914) Fix configurable WebhDFS connect/read timeout

2017-10-27 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9914: Component/s: webhdfs hdfs-client > Fix configurable WebhDFS connect/read timeout >

[jira] [Updated] (HDFS-9914) Fix configurable WebhDFS connect/read timeout

2017-10-27 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9914: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.3 2.9.0

[jira] [Commented] (HDFS-12720) Ozone: Ratis options are not passed from KSM Client protobuf helper correctly.

2017-10-27 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222443#comment-16222443 ] Nanda kumar commented on HDFS-12720: [~msingh], thanks for finding the issue and working on it. The

[jira] [Commented] (HDFS-12528) Short-circuit reads getting disabled frequently in certain scenarios

2017-10-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222326#comment-16222326 ] Weiwei Yang commented on HDFS-12528: I believe we met the same issue, but triggered by a different

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1646#comment-1646 ] Hadoop QA commented on HDFS-7878: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-10-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222155#comment-16222155 ] Steve Loughran commented on HDFS-12681: --- Mockito seems unhappy in {{TestDFSOutputStream}}. {code}

[jira] [Commented] (HDFS-12729) Document special paths in HDFS

2017-10-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222032#comment-16222032 ] Steve Loughran commented on HDFS-12729: --- + all the snapshot stuff, encryption > Document special

[jira] [Updated] (HDFS-12733) Option to disable to namenode local edits

2017-10-27 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-12733: Attachment: HDFS-12733-001.patch Introduced

[jira] [Updated] (HDFS-12733) Option to disable to namenode local edits

2017-10-27 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-12733: Status: Patch Available (was: Open) > Option to disable to namenode local edits >

[jira] [Commented] (HDFS-12731) Ozone: Fix inconsistent default value in ozone settings

2017-10-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221957#comment-16221957 ] Yiqun Lin commented on HDFS-12731: -- Hi [~bharatviswa], I looked into the latest change of config file. We

[jira] [Created] (HDFS-12733) Option to disable to namenode local edits

2017-10-27 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-12733: --- Summary: Option to disable to namenode local edits Key: HDFS-12733 URL: https://issues.apache.org/jira/browse/HDFS-12733 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9914) Fix configurable WebhDFS connect/read timeout

2017-10-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221866#comment-16221866 ] Hadoop QA commented on HDFS-9914: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12482) Provide a configuration to adjust the weight of EC recovery tasks to adjust the speed of recovery

2017-10-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221827#comment-16221827 ] Xiao Chen commented on HDFS-12482: -- +1 on patch 5, pending jenkins. (Just tried to kick off one but there

[jira] [Updated] (HDFS-12726) BlockPlacementPolicyDefault's debugLoggingBuilder may not be logged

2017-10-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12726: - Summary: BlockPlacementPolicyDefault's debugLoggingBuilder may not be logged (was:

[jira] [Commented] (HDFS-12667) KMSClientProvider#ValueQueue does synchronous fetch of edeks in background async thread.

2017-10-27 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221818#comment-16221818 ] Xiao Chen commented on HDFS-12667: -- Thanks for the patch [~shahrs87], this looks to be a good improvement

[jira] [Comment Edited] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2017-10-27 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221789#comment-16221789 ] Jiandan Yang edited comment on HDFS-7060 at 10/27/17 6:38 AM: --- We have

[jira] [Updated] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2017-10-27 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-7060: Attachment: complete_failed_qps.png sendHeartbeat.png > Avoid taking locks when

[jira] [Comment Edited] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2017-10-27 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221789#comment-16221789 ] Jiandan Yang edited comment on HDFS-7060 at 10/27/17 6:36 AM: --- We have

  1   2   >