[jira] [Created] (HDFS-12728) Improve KMSClientProvider log around delegation token checking

2017-10-26 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-12728: - Summary: Improve KMSClientProvider log around delegation token checking Key: HDFS-12728 URL: https://issues.apache.org/jira/browse/HDFS-12728 Project: Hadoop HDFS

[jira] [Created] (HDFS-12729) Document special paths in HDFS

2017-10-26 Thread Chris Douglas (JIRA)
Chris Douglas created HDFS-12729: Summary: Document special paths in HDFS Key: HDFS-12729 URL: https://issues.apache.org/jira/browse/HDFS-12729 Project: Hadoop HDFS Issue Type: Task

[jira] [Commented] (HDFS-12698) Ozone: Use time units in the Ozone configuration values

2017-10-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221411#comment-16221411 ] Hadoop QA commented on HDFS-12698: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-7878) API - expose an unique file identifier

2017-10-26 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-7878: Attachment: HDFS-7878.19.patch Updated patch with a simple unit test for the {{/.reserved/.inode/file

[jira] [Updated] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-10-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12725: - Attachment: HDFS-12725.02.patch Patch 2 thanks for some chats with Eddy. Fun bug. :) Added test to ensure

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221500#comment-16221500 ] Allen Wittenauer commented on HDFS-12711: - Some status, after taking part of the a

[jira] [Updated] (HDFS-12710) HTTPFS HTTP max header size env variable is not respected in branch-2

2017-10-26 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12710: -- Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch Available) Commit

[jira] [Commented] (HDFS-12710) HTTPFS HTTP max header size env variable is not respected in branch-2

2017-10-26 Thread Istvan Fajth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221545#comment-16221545 ] Istvan Fajth commented on HDFS-12710: - Thanks [~jzhuge] for commiting it! ;) > HTTPFS

[jira] [Created] (HDFS-12730) Verify open files captured in the snapshots across config disable and enable

2017-10-26 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-12730: - Summary: Verify open files captured in the snapshots across config disable and enable Key: HDFS-12730 URL: https://issues.apache.org/jira/browse/HDFS-12730

[jira] [Updated] (HDFS-12730) Verify open files captured in the snapshots across config disable and enable

2017-10-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12730: -- Description: Open files captured in the snapshots have their meta data preserved based o

[jira] [Updated] (HDFS-12730) Verify open files captured in the snapshots across config disable and enable

2017-10-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12730: -- Attachment: HDFS-12730.01.patch Attached v01 patch to verify the attributes of the open

[jira] [Updated] (HDFS-12711) deadly hdfs test

2017-10-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-12711: Attachment: MAPREDUCE-4980.016.patch > deadly hdfs test > > >

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221575#comment-16221575 ] Allen Wittenauer commented on HDFS-12711: - This is a patch that I know how well it

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221587#comment-16221587 ] Allen Wittenauer commented on HDFS-12711: - For reference later, two branch-2 patch

[jira] [Commented] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-10-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221622#comment-16221622 ] Hadoop QA commented on HDFS-12443: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Assigned] (HDFS-12726) BlockPlacementPolicyDefault's debugLoggingBuilder is not logged

2017-10-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reassigned HDFS-12726: Assignee: (was: Xiao Chen) > BlockPlacementPolicyDefault's debugLoggingBuilder is not logged >

[jira] [Commented] (HDFS-12726) BlockPlacementPolicyDefault's debugLoggingBuilder is not logged

2017-10-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221647#comment-16221647 ] Xiao Chen commented on HDFS-12726: -- To be specific, {{debugLoggingBuilder}} itself not {{

[jira] [Updated] (HDFS-12726) BlockPlacementPolicyDefault's debugLoggingBuilder is not logged

2017-10-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12726: - Labels: supportability (was: ) > BlockPlacementPolicyDefault's debugLoggingBuilder is not logged > --

[jira] [Commented] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-10-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221649#comment-16221649 ] Xiao Chen commented on HDFS-12725: -- For anyone interested in debugging, you could tempora

[jira] [Commented] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-10-26 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221677#comment-16221677 ] Yiqun Lin commented on HDFS-12443: -- bq. But this approach makes it a bit difficult to pre

[jira] [Updated] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-10-26 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12443: - Attachment: HDFS-12443-HDFS-7240.002.patch > Ozone: Improve SCM block deletion throttling algorithm > ---

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221685#comment-16221685 ] Hadoop QA commented on HDFS-12711: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221701#comment-16221701 ] Allen Wittenauer commented on HDFS-12711: - 1500 is too strict. Trying 3000. > de

[jira] [Created] (HDFS-12731) Ozone: Fix inconsistent default value in ozone settings

2017-10-26 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-12731: Summary: Ozone: Fix inconsistent default value in ozone settings Key: HDFS-12731 URL: https://issues.apache.org/jira/browse/HDFS-12731 Project: Hadoop HDFS Issue Typ

[jira] [Updated] (HDFS-12582) Replace HdfsFileStatus constructor with a builder pattern.

2017-10-26 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12582: - Status: Open (was: Patch Available) > Replace HdfsFileStatus constructor with a builder pattern.

[jira] [Updated] (HDFS-12582) Replace HdfsFileStatus constructor with a builder pattern.

2017-10-26 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12582: - Status: Patch Available (was: Open) > Replace HdfsFileStatus constructor with a builder pattern.

[jira] [Assigned] (HDFS-12731) Ozone: Fix inconsistent default value in ozone settings

2017-10-26 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDFS-12731: - Assignee: Bharat Viswanadham > Ozone: Fix inconsistent default value in ozone set

[jira] [Work started] (HDFS-12731) Ozone: Fix inconsistent default value in ozone settings

2017-10-26 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12731 started by Bharat Viswanadham. - > Ozone: Fix inconsistent default value in ozone settings > ---

[jira] [Commented] (HDFS-12731) Ozone: Fix inconsistent default value in ozone settings

2017-10-26 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221731#comment-16221731 ] Bharat Viswanadham commented on HDFS-12731: --- [~linyiqun] For ozone.ksm.handler.

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221741#comment-16221741 ] Hadoop QA commented on HDFS-12711: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Created] (HDFS-12732) Correct spellings of ramdomly to randomly in log.

2017-10-26 Thread hu xiaodong (JIRA)
hu xiaodong created HDFS-12732: -- Summary: Correct spellings of ramdomly to randomly in log. Key: HDFS-12732 URL: https://issues.apache.org/jira/browse/HDFS-12732 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-12732) Correct spellings of ramdomly to randomly in log.

2017-10-26 Thread hu xiaodong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hu xiaodong updated HDFS-12732: --- Attachment: HDFS-12732.001.patch > Correct spellings of ramdomly to randomly in log. > ---

[jira] [Updated] (HDFS-12732) Correct spellings of ramdomly to randomly in log.

2017-10-26 Thread hu xiaodong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hu xiaodong updated HDFS-12732: --- Status: Patch Available (was: Open) > Correct spellings of ramdomly to randomly in log. > ---

[jira] [Updated] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2017-10-26 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-7060: Attachment: HDFS-7060-003.patch > Avoid taking locks when sending heartbeats from the DataNode >

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2017-10-26 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221765#comment-16221765 ] Jiandan Yang commented on HDFS-7060: - upload HDFS-7060-003.patch > Avoid taking locks

[jira] [Commented] (HDFS-12718) Ozone: fix thread number calculation in CBlockManager

2017-10-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221779#comment-16221779 ] Hadoop QA commented on HDFS-12718: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Assigned] (HDFS-12726) BlockPlacementPolicyDefault's debugLoggingBuilder is not logged

2017-10-26 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDFS-12726: - Assignee: Bharat Viswanadham > BlockPlacementPolicyDefault's debugLoggingBuilder

[jira] [Commented] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2017-10-26 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221789#comment-16221789 ] Jiandan Yang commented on HDFS-7060: - We have deploy Hadoop including patch of HDFS-70

[jira] [Comment Edited] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2017-10-26 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221789#comment-16221789 ] Jiandan Yang edited comment on HDFS-7060 at 10/27/17 6:36 AM: --

[jira] [Updated] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2017-10-26 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-7060: Attachment: complete_failed_qps.png sendHeartbeat.png > Avoid taking locks when sendi

[jira] [Comment Edited] (HDFS-7060) Avoid taking locks when sending heartbeats from the DataNode

2017-10-26 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221789#comment-16221789 ] Jiandan Yang edited comment on HDFS-7060 at 10/27/17 6:38 AM: --

[jira] [Commented] (HDFS-12667) KMSClientProvider#ValueQueue does synchronous fetch of edeks in background async thread.

2017-10-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221818#comment-16221818 ] Xiao Chen commented on HDFS-12667: -- Thanks for the patch [~shahrs87], this looks to be a

[jira] [Updated] (HDFS-12726) BlockPlacementPolicyDefault's debugLoggingBuilder may not be logged

2017-10-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12726: - Summary: BlockPlacementPolicyDefault's debugLoggingBuilder may not be logged (was: BlockPlacementPolicyDe

[jira] [Commented] (HDFS-12482) Provide a configuration to adjust the weight of EC recovery tasks to adjust the speed of recovery

2017-10-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221827#comment-16221827 ] Xiao Chen commented on HDFS-12482: -- +1 on patch 5, pending jenkins. (Just tried to kick o

<    1   2