[jira] [Updated] (HDFS-12732) Correct spellings of ramdomly to randomly in log.

2017-10-26 Thread hu xiaodong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hu xiaodong updated HDFS-12732: --- Status: Patch Available (was: Open) > Correct spellings of ramdomly to randomly in log. >

[jira] [Updated] (HDFS-12732) Correct spellings of ramdomly to randomly in log.

2017-10-26 Thread hu xiaodong (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hu xiaodong updated HDFS-12732: --- Attachment: HDFS-12732.001.patch > Correct spellings of ramdomly to randomly in log. >

[jira] [Created] (HDFS-12732) Correct spellings of ramdomly to randomly in log.

2017-10-26 Thread hu xiaodong (JIRA)
hu xiaodong created HDFS-12732: -- Summary: Correct spellings of ramdomly to randomly in log. Key: HDFS-12732 URL: https://issues.apache.org/jira/browse/HDFS-12732 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221741#comment-16221741 ] Hadoop QA commented on HDFS-12711: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12731) Ozone: Fix inconsistent default value in ozone settings

2017-10-26 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221731#comment-16221731 ] Bharat Viswanadham commented on HDFS-12731: --- [~linyiqun] For ozone.ksm.handler.count.key = 200

[jira] [Work started] (HDFS-12731) Ozone: Fix inconsistent default value in ozone settings

2017-10-26 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-12731 started by Bharat Viswanadham. - > Ozone: Fix inconsistent default value in ozone settings >

[jira] [Assigned] (HDFS-12731) Ozone: Fix inconsistent default value in ozone settings

2017-10-26 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDFS-12731: - Assignee: Bharat Viswanadham > Ozone: Fix inconsistent default value in ozone

[jira] [Updated] (HDFS-12582) Replace HdfsFileStatus constructor with a builder pattern.

2017-10-26 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12582: - Status: Patch Available (was: Open) > Replace HdfsFileStatus constructor with a builder pattern.

[jira] [Updated] (HDFS-12582) Replace HdfsFileStatus constructor with a builder pattern.

2017-10-26 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-12582: - Status: Open (was: Patch Available) > Replace HdfsFileStatus constructor with a builder pattern.

[jira] [Created] (HDFS-12731) Ozone: Fix inconsistent default value in ozone settings

2017-10-26 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-12731: Summary: Ozone: Fix inconsistent default value in ozone settings Key: HDFS-12731 URL: https://issues.apache.org/jira/browse/HDFS-12731 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221701#comment-16221701 ] Allen Wittenauer commented on HDFS-12711: - 1500 is too strict. Trying 3000. > deadly hdfs test >

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221685#comment-16221685 ] Hadoop QA commented on HDFS-12711: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-10-26 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12443: - Attachment: HDFS-12443-HDFS-7240.002.patch > Ozone: Improve SCM block deletion throttling algorithm >

[jira] [Commented] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-10-26 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221677#comment-16221677 ] Yiqun Lin commented on HDFS-12443: -- bq. But this approach makes it a bit difficult to prepare a

[jira] [Commented] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-10-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221649#comment-16221649 ] Xiao Chen commented on HDFS-12725: -- For anyone interested in debugging, you could temporarily just

[jira] [Commented] (HDFS-12726) BlockPlacementPolicyDefault's debugLoggingBuilder is not logged

2017-10-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221647#comment-16221647 ] Xiao Chen commented on HDFS-12726: -- To be specific, {{debugLoggingBuilder}} itself not {{toString}}

[jira] [Updated] (HDFS-12726) BlockPlacementPolicyDefault's debugLoggingBuilder is not logged

2017-10-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12726: - Labels: supportability (was: ) > BlockPlacementPolicyDefault's debugLoggingBuilder is not logged >

[jira] [Assigned] (HDFS-12726) BlockPlacementPolicyDefault's debugLoggingBuilder is not logged

2017-10-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reassigned HDFS-12726: Assignee: (was: Xiao Chen) > BlockPlacementPolicyDefault's debugLoggingBuilder is not logged >

[jira] [Commented] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-10-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221622#comment-16221622 ] Hadoop QA commented on HDFS-12443: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221587#comment-16221587 ] Allen Wittenauer commented on HDFS-12711: - For reference later, two branch-2 patches running on

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221575#comment-16221575 ] Allen Wittenauer commented on HDFS-12711: - This is a patch that I know how well it performs in

[jira] [Updated] (HDFS-12711) deadly hdfs test

2017-10-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-12711: Attachment: MAPREDUCE-4980.016.patch > deadly hdfs test > > >

[jira] [Updated] (HDFS-12730) Verify open files captured in the snapshots across config disable and enable

2017-10-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12730: -- Attachment: HDFS-12730.01.patch Attached v01 patch to verify the attributes of the open

[jira] [Updated] (HDFS-12730) Verify open files captured in the snapshots across config disable and enable

2017-10-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12730: -- Description: Open files captured in the snapshots have their meta data preserved based

[jira] [Created] (HDFS-12730) Verify open files captured in the snapshots across config disable and enable

2017-10-26 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-12730: - Summary: Verify open files captured in the snapshots across config disable and enable Key: HDFS-12730 URL: https://issues.apache.org/jira/browse/HDFS-12730

[jira] [Commented] (HDFS-12710) HTTPFS HTTP max header size env variable is not respected in branch-2

2017-10-26 Thread Istvan Fajth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221545#comment-16221545 ] Istvan Fajth commented on HDFS-12710: - Thanks [~jzhuge] for commiting it! ;) > HTTPFS HTTP max header

[jira] [Updated] (HDFS-12710) HTTPFS HTTP max header size env variable is not respected in branch-2

2017-10-26 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12710: -- Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221500#comment-16221500 ] Allen Wittenauer commented on HDFS-12711: - Some status, after taking part of the afternoon to do

[jira] [Updated] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-10-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12725: - Attachment: HDFS-12725.02.patch Patch 2 thanks for some chats with Eddy. Fun bug. :) Added test to

[jira] [Updated] (HDFS-7878) API - expose an unique file identifier

2017-10-26 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-7878: Attachment: HDFS-7878.19.patch Updated patch with a simple unit test for the

[jira] [Commented] (HDFS-12698) Ozone: Use time units in the Ozone configuration values

2017-10-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221411#comment-16221411 ] Hadoop QA commented on HDFS-12698: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-12729) Document special paths in HDFS

2017-10-26 Thread Chris Douglas (JIRA)
Chris Douglas created HDFS-12729: Summary: Document special paths in HDFS Key: HDFS-12729 URL: https://issues.apache.org/jira/browse/HDFS-12729 Project: Hadoop HDFS Issue Type: Task

[jira] [Created] (HDFS-12728) Improve KMSClientProvider log around delegation token checking

2017-10-26 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-12728: - Summary: Improve KMSClientProvider log around delegation token checking Key: HDFS-12728 URL: https://issues.apache.org/jira/browse/HDFS-12728 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12607) [READ] Even one dead datanode with PROVIDED storage results in ProvidedStorageInfo being marked as FAILED

2017-10-26 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12607: -- Status: Patch Available (was: Open) > [READ] Even one dead datanode with PROVIDED

[jira] [Updated] (HDFS-12607) [READ] Even one dead datanode with PROVIDED storage results in ProvidedStorageInfo being marked as FAILED

2017-10-26 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12607: -- Status: Open (was: Patch Available) > [READ] Even one dead datanode with PROVIDED

[jira] [Updated] (HDFS-12720) Ozone: Ratis options are not passed from KSM Client protobuf helper correctly.

2017-10-26 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-12720: Labels: ozoneMerge (was: ) > Ozone: Ratis options are not passed from KSM Client

[jira] [Updated] (HDFS-12727) TestPread timing out on branch-2.8

2017-10-26 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12727: -- Description: TestPread timing out on branch-2.8 and not on trunk. {noformat} 2017-10-24

[jira] [Created] (HDFS-12727) TestPread timing out on branch-2.8

2017-10-26 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created HDFS-12727: - Summary: TestPread timing out on branch-2.8 Key: HDFS-12727 URL: https://issues.apache.org/jira/browse/HDFS-12727 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-12100) Ozone: KSM: Allocate key should honour volume quota if quota is set on the volume

2017-10-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221234#comment-16221234 ] Xiaoyu Yao commented on HDFS-12100: --- [~ljain], thanks for working on this. Can you rebase the patch? >

[jira] [Created] (HDFS-12726) BlockPlacementPolicyDefault's debugLoggingBuilder is not logged

2017-10-26 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-12726: Summary: BlockPlacementPolicyDefault's debugLoggingBuilder is not logged Key: HDFS-12726 URL: https://issues.apache.org/jira/browse/HDFS-12726 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221229#comment-16221229 ] Hadoop QA commented on HDFS-12711: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-10-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12725: - Status: Patch Available (was: Open) > BlockPlacementPolicyRackFaultTolerant still fails with racks with

[jira] [Updated] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-10-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12725: - Attachment: (was: HDFS-12725.01.patch) > BlockPlacementPolicyRackFaultTolerant still fails with racks

[jira] [Comment Edited] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-10-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221224#comment-16221224 ] Xiao Chen edited comment on HDFS-12725 at 10/26/17 8:54 PM: Patch 1 to

[jira] [Updated] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-10-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12725: - Attachment: HDFS-12725.01.patch > BlockPlacementPolicyRackFaultTolerant still fails with racks with very

[jira] [Updated] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-10-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12725: - Attachment: HDFS-12725.01.patch Patch 1 to reproduce the error and fix. [~andrew.wang] and [~eddyxu],

[jira] [Created] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-10-26 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-12725: Summary: BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes Key: HDFS-12725 URL: https://issues.apache.org/jira/browse/HDFS-12725 Project:

[jira] [Updated] (HDFS-12667) KMSClientProvider#ValueQueue does synchronous fetch of edeks in background async thread.

2017-10-26 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12667: -- Status: Patch Available (was: Open) > KMSClientProvider#ValueQueue does synchronous fetch of

[jira] [Updated] (HDFS-12667) KMSClientProvider#ValueQueue does synchronous fetch of edeks in background async thread.

2017-10-26 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12667: -- Attachment: HDFS-12667-001.patch re-attaching the same patch for jenkins to pickup. >

[jira] [Updated] (HDFS-12667) KMSClientProvider#ValueQueue does synchronous fetch of edeks in background async thread.

2017-10-26 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12667: -- Status: Open (was: Patch Available) > KMSClientProvider#ValueQueue does synchronous fetch of

[jira] [Updated] (HDFS-12667) KMSClientProvider#ValueQueue does synchronous fetch of edeks in background async thread.

2017-10-26 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12667: -- Attachment: (was: HDFS-12667-001.patch) > KMSClientProvider#ValueQueue does synchronous

[jira] [Commented] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2017-10-26 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221195#comment-16221195 ] Rushabh S Shah commented on HDFS-12723: --- Failed in this pre-commit:

[jira] [Updated] (HDFS-12724) Add retry logic when data node block moves while reading

2017-10-26 Thread Deepak Majeti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Majeti updated HDFS-12724: - Attachment: HDFS-12724.HDFS-8707.000.patch > Add retry logic when data node block moves while

[jira] [Updated] (HDFS-12396) Webhdfs file system should get delegation token from kms provider.

2017-10-26 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12396: -- Status: Patch Available (was: Open) > Webhdfs file system should get delegation token from kms

[jira] [Updated] (HDFS-12396) Webhdfs file system should get delegation token from kms provider.

2017-10-26 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12396: -- Attachment: HDFS-12396.004.patch All comments from v3 of patch are addressed in v4 of patch.

[jira] [Updated] (HDFS-12724) Add retry logic when data node block moves while reading

2017-10-26 Thread Deepak Majeti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Majeti updated HDFS-12724: - Status: Patch Available (was: Open) > Add retry logic when data node block moves while reading >

[jira] [Updated] (HDFS-12720) Ozone: Ratis options are not passed from KSM Client protobuf helper correctly.

2017-10-26 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12720: - Attachment: HDFS-12720-HDFS-7240.002.patch patch v2 fixes a compilation issue in the last

[jira] [Created] (HDFS-12724) Add retry logic when data node block moves while reading

2017-10-26 Thread Deepak Majeti (JIRA)
Deepak Majeti created HDFS-12724: Summary: Add retry logic when data node block moves while reading Key: HDFS-12724 URL: https://issues.apache.org/jira/browse/HDFS-12724 Project: Hadoop HDFS

[jira] [Assigned] (HDFS-12474) Ozone: SCM: Handling container report with key count and container usage.

2017-10-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-12474: - Assignee: Nanda kumar (was: Xiaoyu Yao) > Ozone: SCM: Handling container report with key count

[jira] [Updated] (HDFS-12521) Ozone: SCM should read all Container info into memory when booting up

2017-10-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12521: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-12521) Ozone: SCM should read all Container info into memory when booting up

2017-10-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221120#comment-16221120 ] Anu Engineer commented on HDFS-12521: - +1, I will commit this shortly. I have applied this patch and

[jira] [Created] (HDFS-12723) TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently.

2017-10-26 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created HDFS-12723: - Summary: TestReadStripedFileWithMissingBlocks#testReadFileWithMissingBlocks failing consistently. Key: HDFS-12723 URL: https://issues.apache.org/jira/browse/HDFS-12723

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-26 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Patch Available (was: Open) > [READ] Merge BlockFormatProvider and

[jira] [Commented] (HDFS-12680) Ozone: SCM: Lease support for container creation

2017-10-26 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221110#comment-16221110 ] Nanda kumar commented on HDFS-12680: [~anu], thanks for the review and commit. Thanks [~linyiqun] for

[jira] [Updated] (HDFS-12720) Ozone: Ratis options are not passed from KSM Client protobuf helper correctly.

2017-10-26 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12720: - Status: Patch Available (was: Open) > Ozone: Ratis options are not passed from KSM

[jira] [Updated] (HDFS-12720) Ozone: Ratis options are not passed from KSM Client protobuf helper correctly.

2017-10-26 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12720: - Attachment: HDFS-12720-HDFS-7240.001.patch > Ozone: Ratis options are not passed from KSM

[jira] [Created] (HDFS-12722) Ozone: SCM: Lease support for pipeline creation

2017-10-26 Thread Nanda kumar (JIRA)
Nanda kumar created HDFS-12722: -- Summary: Ozone: SCM: Lease support for pipeline creation Key: HDFS-12722 URL: https://issues.apache.org/jira/browse/HDFS-12722 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-12663) Ozone: OzoneClient: Remove protobuf classes exposed to clients through OzoneBucket

2017-10-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12663: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221083#comment-16221083 ] Allen Wittenauer commented on HDFS-12711: - Note to self: Kicking off another run with proclimit

[jira] [Created] (HDFS-12721) Ozone: Ratis: Moving Ratis pipeline creation to client

2017-10-26 Thread Nanda kumar (JIRA)
Nanda kumar created HDFS-12721: -- Summary: Ozone: Ratis: Moving Ratis pipeline creation to client Key: HDFS-12721 URL: https://issues.apache.org/jira/browse/HDFS-12721 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221077#comment-16221077 ] Allen Wittenauer commented on HDFS-12711: - Success! One interesting thing: surefire is a liar.

[jira] [Created] (HDFS-12720) Ozone: Ratis options are not passed from KSM Client protobuf helper correctly.

2017-10-26 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-12720: Summary: Ozone: Ratis options are not passed from KSM Client protobuf helper correctly. Key: HDFS-12720 URL: https://issues.apache.org/jira/browse/HDFS-12720

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221076#comment-16221076 ] Hadoop QA commented on HDFS-12711: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-12719) Ozone: Fix checkstyle, javac, whitespace issues in HDFS-7240 branch

2017-10-26 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-12719: Summary: Ozone: Fix checkstyle, javac, whitespace issues in HDFS-7240 branch Key: HDFS-12719 URL: https://issues.apache.org/jira/browse/HDFS-12719 Project:

[jira] [Updated] (HDFS-12718) Ozone: fix thread number calculation in CBlockManager

2017-10-26 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12718: - Parent Issue: HDFS-8 (was: HDFS-7240) > Ozone: fix thread number calculation in

[jira] [Commented] (HDFS-12711) deadly hdfs test

2017-10-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221069#comment-16221069 ] Allen Wittenauer commented on HDFS-12711: - https://builds.apache.org/job/PreCommit-HDFS-Build2/2

[jira] [Updated] (HDFS-12678) Ozone: Corona: Add statistical information to json output

2017-10-26 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-12678: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Updated] (HDFS-12680) Ozone: SCM: Lease support for container creation

2017-10-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12680: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-12680) Ozone: SCM: Lease support for container creation

2017-10-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221015#comment-16221015 ] Anu Engineer commented on HDFS-12680: - +1, I will commit this shortly. [~xyao] I am aware that the

[jira] [Commented] (HDFS-12678) Ozone: Corona: Add statistical information to json output

2017-10-26 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221011#comment-16221011 ] Nanda kumar commented on HDFS-12678: Thanks [~ljain] for the update. +1, the patch looks good to me. I

[jira] [Updated] (HDFS-12690) Ozone: generate swagger descriptor for the Ozone REST Api

2017-10-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12690: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2017-10-26 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220974#comment-16220974 ] Uma Maheswara Rao G commented on HDFS-10285: Hi [~daryn], great to see you are getting some

[jira] [Commented] (HDFS-12106) [SPS]: Improve storage policy satisfier configurations

2017-10-26 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220949#comment-16220949 ] Rakesh R commented on HDFS-12106: - Thanks [~surendrasingh] for the patch. Adding few comments, please take

[jira] [Updated] (HDFS-12702) Ozone: Add hugo to the dev docker image

2017-10-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12702: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Updated] (HDFS-12693) Ozone: Enable XFrame options for KSM/SCM web ui

2017-10-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12693: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Updated] (HDFS-12558) Ozone: Clarify the meaning of rpc.metrics.percentiles.intervals on KSM/SCM web ui

2017-10-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12558: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Updated] (HDFS-12655) Ozone: use specific names for RPC.Server instances

2017-10-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12655: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2017-10-26 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220907#comment-16220907 ] Daryn Sharp commented on HDFS-10285: I see a few issues here but in a fire fight. Stay tuned. >

[jira] [Commented] (HDFS-12310) [SPS]: Provide an option to track the status of in progress requests

2017-10-26 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220901#comment-16220901 ] Rakesh R commented on HDFS-12310: - Thanks [~surendrasingh] for the quick updates. The new patch looks good

[jira] [Commented] (HDFS-7878) API - expose an unique file identifier

2017-10-26 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220898#comment-16220898 ] Sean Mackrory commented on HDFS-7878: - {quote}Wire compatibility with HDFS{quote} How do commented out

[jira] [Commented] (HDFS-12582) Replace HdfsFileStatus constructor with a builder pattern.

2017-10-26 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220883#comment-16220883 ] Bharat Viswanadham commented on HDFS-12582: --- [~chris.douglas] I am okay with going this change

[jira] [Commented] (HDFS-9914) Fix configurable WebhDFS connect/read timeout

2017-10-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220858#comment-16220858 ] Arpit Agarwal commented on HDFS-9914: - Thanks [~xyao]. +1 for the v2 patch, pending Jenkins. I've

[jira] [Commented] (HDFS-12690) Ozone: generate swagger descriptor for the Ozone REST Api

2017-10-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220828#comment-16220828 ] Anu Engineer commented on HDFS-12690: - +1, I am will commit this shortly. > Ozone: generate swagger

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-26 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Attachment: HDFS-11902-HDFS-9806.010.patch > [READ] Merge BlockFormatProvider and

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-26 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Attachment: (was: HDFS-11902-HDFS-9806.010.patch) > [READ] Merge

[jira] [Updated] (HDFS-11902) [READ] Merge BlockFormatProvider and FileRegionProvider.

2017-10-26 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-11902: -- Status: Open (was: Patch Available) > [READ] Merge BlockFormatProvider and

[jira] [Commented] (HDFS-12693) Ozone: Enable XFrame options for KSM/SCM web ui

2017-10-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220802#comment-16220802 ] Anu Engineer commented on HDFS-12693: - +1, I will commit this shortly. > Ozone: Enable XFrame

[jira] [Commented] (HDFS-12702) Ozone: Add hugo to the dev docker image

2017-10-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220792#comment-16220792 ] Anu Engineer commented on HDFS-12702: - +1, I will commit this shortly. > Ozone: Add hugo to the dev

[jira] [Closed] (HDFS-12715) I didn't find the "-find" command on hadoop2.6

2017-10-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal closed HDFS-12715. > I didn't find the "-find" command on hadoop2.6 > -- > >

[jira] [Updated] (HDFS-12678) Ozone: Corona: Add statistical information to json output

2017-10-26 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-12678: --- Attachment: HDFS-12678-HDFS-7240.003.patch Thanks for the review [~nandakumar131]. v3 patch addresses

  1   2   >