[jira] [Updated] (HDFS-12797) Add Test for NFS mount of not supported filesystems like (file:///)

2017-11-09 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-12797: Resolution: Fixed Fix Version/s: 3.1.0 Status: Resolved (was:

[jira] [Commented] (HDFS-12797) Add Test for NFS mount of not supported filesystems like (file:///)

2017-11-09 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247122#comment-16247122 ] Jitendra Nath Pandey commented on HDFS-12797: - +1 > Add Test for NFS mount of not supported

[jira] [Updated] (HDFS-12787) Ozone: SCM: Aggregate the metrics from all the container reports

2017-11-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12787: - Attachment: HDFS-12787-HDFS-7240.002.patch Revisit this again. There is one case we should concern:

[jira] [Commented] (HDFS-8198) Erasure Coding: system test of TeraSort

2017-11-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247101#comment-16247101 ] Lei (Eddy) Xu commented on HDFS-8198: - Hi, [~danielpol] Thanks a lot for reporting this. To help us

[jira] [Commented] (HDFS-12106) [SPS]: Improve storage policy satisfier configurations

2017-11-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247091#comment-16247091 ] Rakesh R commented on HDFS-12106: - Thanks [~surendrasingh] for the patch. Adding few comments, # Please

[jira] [Commented] (HDFS-12797) Add Test for NFS mount of not supported filesystems like (file:///)

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247044#comment-16247044 ] Hadoop QA commented on HDFS-12797: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-12796) SCM should not start if Cluster Version file does not exist

2017-11-09 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247035#comment-16247035 ] Nanda kumar commented on HDFS-12796: [~shashikant], thanks for updating the patch. Sorry for not

[jira] [Updated] (HDFS-10285) Storage Policy Satisfier in Namenode

2017-11-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10285: Attachment: HDFS-10285-consolidated-merge-patch-02.patch Thank you all the contributors in making this

[jira] [Commented] (HDFS-12781) After Datanode down, In Namenode UI Datanode tab is throwing warning message.

2017-11-09 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247018#comment-16247018 ] Brahma Reddy Battula commented on HDFS-12781: - bq.It seems the workaround() function is trying

[jira] [Updated] (HDFS-12797) Add Test for NFS mount of not supported filesystems like (file:///)

2017-11-09 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12797: - Attachment: HDFS-12797.001.patch > Add Test for NFS mount of not supported filesystems

[jira] [Updated] (HDFS-12797) Add Test for NFS mount of not supported filesystems like (file:///)

2017-11-09 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12797: - Status: Patch Available (was: Open) > Add Test for NFS mount of not supported

[jira] [Created] (HDFS-12797) Add Test for NFS mount of not supported filesystems like (file:///"

2017-11-09 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-12797: Summary: Add Test for NFS mount of not supported filesystems like (file:///" Key: HDFS-12797 URL: https://issues.apache.org/jira/browse/HDFS-12797 Project:

[jira] [Updated] (HDFS-12797) Add Test for NFS mount of not supported filesystems like (file:///)

2017-11-09 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12797: - Summary: Add Test for NFS mount of not supported filesystems like (file:///) (was: Add

[jira] [Comment Edited] (HDFS-12790) [SPS]: Rebasing HDFS-10285 branch after HDFS-10467, HDFS-12599 and HDFS-11968 commits

2017-11-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16247002#comment-16247002 ] Rakesh R edited comment on HDFS-12790 at 11/10/17 4:45 AM: --- Thanks

[jira] [Updated] (HDFS-12790) [SPS]: Rebasing HDFS-10285 branch after HDFS-10467, HDFS-12599 and HDFS-11968 commits

2017-11-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12790: Resolution: Fixed Fix Version/s: HDFS-10285 Target Version/s: (was: HDFS-10285)

[jira] [Commented] (HDFS-12791) NameNode Fsck http Connection can timeout for directories with multiple levels

2017-11-09 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246971#comment-16246971 ] Hudson commented on HDFS-12791: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13217 (See

[jira] [Commented] (HDFS-12777) [READ] Reduce memory and CPU footprint for PROVIDED volumes.

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246949#comment-16246949 ] Hadoop QA commented on HDFS-12777: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12791) NameNode Fsck http Connection can timeout for directories with multiple levels

2017-11-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246948#comment-16246948 ] Chen Liang commented on HDFS-12791: --- Committed to trunk, thanks Mukul for the contribution! > NameNode

[jira] [Updated] (HDFS-12791) NameNode Fsck http Connection can timeout for directories with multiple levels

2017-11-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12791: -- Resolution: Fixed Status: Resolved (was: Patch Available) > NameNode Fsck http Connection can

[jira] [Commented] (HDFS-12791) NameNode Fsck http Connection can timeout for directories with multiple levels

2017-11-09 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246944#comment-16246944 ] Chen Liang commented on HDFS-12791: --- Thanks for working on this [~msingh]! +1 on v001 patch, the failed

[jira] [Commented] (HDFS-12713) [READ] Refactor FileRegion and BlockAliasMap to separate out HDFS metadata and PROVIDED storage metadata

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246926#comment-16246926 ] Hadoop QA commented on HDFS-12713: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12775) [READ] Fix reporting of Provided volumes

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12775: -- Attachment: (was: HDFS-12775-HDFS-9806.001.patch) > [READ] Fix reporting of

[jira] [Commented] (HDFS-12777) [READ] Reduce memory and CPU footprint for PROVIDED volumes.

2017-11-09 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246894#comment-16246894 ] Íñigo Goiri commented on HDFS-12777: [^HDFS-12777-HDFS-9806.004.patch] should be fine for checkstyle.

[jira] [Assigned] (HDFS-12775) [READ] Fix reporting of Provided volumes

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti reassigned HDFS-12775: - Assignee: Virajith Jalaparti > [READ] Fix reporting of Provided volumes >

[jira] [Updated] (HDFS-12775) [READ] Fix reporting of Provided volumes

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12775: -- Attachment: HDFS-12775-HDFS-9806.001.patch > [READ] Fix reporting of Provided volumes >

[jira] [Updated] (HDFS-12713) [READ] Refactor FileRegion and BlockAliasMap to separate out HDFS metadata and PROVIDED storage metadata

2017-11-09 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12713: -- Attachment: HDFS-12713-HDFS-9806.002.patch Attaching patch that adds BlockPoolID to the {{getReader}}

[jira] [Commented] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246766#comment-16246766 ] Hadoop QA commented on HDFS-12665: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246742#comment-16246742 ] Hadoop QA commented on HDFS-12754: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12351) Explicitly describe the minimal number of DataNodes required to support an EC policy in EC document.

2017-11-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246722#comment-16246722 ] Lei (Eddy) Xu commented on HDFS-12351: -- [~hanishakoneru] Sure, please do. > Explicitly describe the

[jira] [Assigned] (HDFS-12351) Explicitly describe the minimal number of DataNodes required to support an EC policy in EC document.

2017-11-09 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu reassigned HDFS-12351: Assignee: Hanisha Koneru (was: Lei (Eddy) Xu) > Explicitly describe the minimal number of

[jira] [Comment Edited] (HDFS-12713) [READ] Refactor FileRegion and BlockAliasMap to separate out HDFS metadata and PROVIDED storage metadata

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246568#comment-16246568 ] Virajith Jalaparti edited comment on HDFS-12713 at 11/9/17 9:46 PM:

[jira] [Commented] (HDFS-11096) Support rolling upgrade between 2.x and 3.x

2017-11-09 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246667#comment-16246667 ] Sean Mackrory commented on HDFS-11096: -- Note that the fix to the sbin/start-yarn.sh shell script has

[jira] [Updated] (HDFS-12777) [READ] Reduce memory and CPU footprint for PROVIDED volumes.

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12777: -- Status: Patch Available (was: Open) > [READ] Reduce memory and CPU footprint for

[jira] [Commented] (HDFS-12777) [READ] Reduce memory and CPU footprint for PROVIDED volumes.

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246668#comment-16246668 ] Virajith Jalaparti commented on HDFS-12777: --- [~elgoiri] - Fixed the missing dot at the end of

[jira] [Updated] (HDFS-12777) [READ] Reduce memory and CPU footprint for PROVIDED volumes.

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12777: -- Attachment: HDFS-12777-HDFS-9806.004.patch > [READ] Reduce memory and CPU footprint for

[jira] [Updated] (HDFS-12777) [READ] Reduce memory and CPU footprint for PROVIDED volumes.

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12777: -- Status: Open (was: Patch Available) > [READ] Reduce memory and CPU footprint for

[jira] [Updated] (HDFS-12779) [READ] Allow cluster id to be specified to the Image generation tool

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12779: -- Resolution: Fixed Status: Resolved (was: Patch Available) > [READ] Allow

[jira] [Commented] (HDFS-12779) [READ] Allow cluster id to be specified to the Image generation tool

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246661#comment-16246661 ] Virajith Jalaparti commented on HDFS-12779: --- Thanks for taking a look [~chris.douglas] and

[jira] [Commented] (HDFS-12779) [READ] Allow cluster id to be specified to the Image generation tool

2017-11-09 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246634#comment-16246634 ] Íñigo Goiri commented on HDFS-12779: The failed unit tests seem unrelated. The checkstyle regarding

[jira] [Commented] (HDFS-12777) [READ] Reduce memory and CPU footprint for PROVIDED volumes.

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246658#comment-16246658 ] Hadoop QA commented on HDFS-12777: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Issue Comment Deleted] (HDFS-12779) [READ] Allow cluster id to be specified to the Image generation tool

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12779: -- Comment: was deleted (was: Checkstyle issue is from builder pattern and failed tests

[jira] [Commented] (HDFS-12779) [READ] Allow cluster id to be specified to the Image generation tool

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246640#comment-16246640 ] Virajith Jalaparti commented on HDFS-12779: --- Checkstyle issue is from builder pattern and failed

[jira] [Commented] (HDFS-12779) [READ] Allow cluster id to be specified to the Image generation tool

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246602#comment-16246602 ] Hadoop QA commented on HDFS-12779: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-12726) BlockPlacementPolicyDefault's debugLoggingBuilder may not be logged

2017-11-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reassigned HDFS-12726: Assignee: Xiao Chen (was: Bharat Viswanadham) > BlockPlacementPolicyDefault's debugLoggingBuilder

[jira] [Commented] (HDFS-12713) [READ] Refactor FileRegion and BlockAliasMap to separate out HDFS metadata and PROVIDED storage metadata

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246568#comment-16246568 ] Virajith Jalaparti commented on HDFS-12713: --- bq. I don't have a clean solution (yet) to handle

[jira] [Commented] (HDFS-12777) [READ] Reduce memory and CPU footprint for PROVIDED volumes.

2017-11-09 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246567#comment-16246567 ] Íñigo Goiri commented on HDFS-12777: The constructor comment clarifies the use of the suffixes so we

[jira] [Commented] (HDFS-12794) Ozone: Parallelize ChunkOutputSream Writes to container

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246564#comment-16246564 ] Hadoop QA commented on HDFS-12794: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12618) fsck -includeSnapshots reports wrong amount of total blocks

2017-11-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246526#comment-16246526 ] Xiao Chen commented on HDFS-12618: -- Yup, rename is what makes replaces a child inode to become

[jira] [Commented] (HDFS-12776) [READ] Increasing replication for PROVIDED files should create local replicas

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246519#comment-16246519 ] Virajith Jalaparti commented on HDFS-12776: --- Thanks [~elgoiri]. Will commit this to the branch.

[jira] [Updated] (HDFS-12776) [READ] Increasing replication for PROVIDED files should create local replicas

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12776: -- Resolution: Fixed Status: Resolved (was: Patch Available) > [READ] Increasing

[jira] [Commented] (HDFS-12351) Explicitly describe the minimal number of DataNodes required to support an EC policy in EC document.

2017-11-09 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246467#comment-16246467 ] Hanisha Koneru commented on HDFS-12351: --- Hi [~eddyxu], are you planning to work on this? If not, I

[jira] [Commented] (HDFS-12790) [SPS]: Rebasing HDFS-10285 branch after HDFS-10467, HDFS-12599 and HDFS-11968 commits

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246466#comment-16246466 ] Hadoop QA commented on HDFS-12790: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12777) [READ] Reduce memory and CPU footprint for PROVIDED volumes.

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12777: -- Attachment: HDFS-12777-HDFS-9806.003.patch Thanks a taking a look [~elgoiri]. Posting

[jira] [Updated] (HDFS-12777) [READ] Reduce memory and CPU footprint for PROVIDED volumes.

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12777: -- Status: Patch Available (was: Open) > [READ] Reduce memory and CPU footprint for

[jira] [Updated] (HDFS-12777) [READ] Reduce memory and CPU footprint for PROVIDED volumes.

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12777: -- Status: Open (was: Patch Available) > [READ] Reduce memory and CPU footprint for

[jira] [Commented] (HDFS-12618) fsck -includeSnapshots reports wrong amount of total blocks

2017-11-09 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246394#comment-16246394 ] Wellington Chevreuil commented on HDFS-12618: - Thanks [~xiaochen]. Last patch was not indeed

[jira] [Commented] (HDFS-12740) SCM should support a RPC to share the cluster Id with KSM and DataNodes

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246361#comment-16246361 ] Hadoop QA commented on HDFS-12740: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246359#comment-16246359 ] Virajith Jalaparti edited comment on HDFS-12665 at 11/9/17 7:36 PM:

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12665: -- Attachment: HDFS-12665-HDFS-9806.007.patch Thanks for the updated patch [~ehiggs]. On

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12665: -- Status: Patch Available (was: Open) > [AliasMap] Create a version of the AliasMap that

[jira] [Updated] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-09 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-12754: --- Attachment: HDFS-12754.006.patch Fixing minor checkstyle issues except the one where it asks to make

[jira] [Commented] (HDFS-12713) [READ] Refactor FileRegion and BlockAliasMap to separate out HDFS metadata and PROVIDED storage metadata

2017-11-09 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246335#comment-16246335 ] Ewan Higgs commented on HDFS-12713: --- {quote}Hi Ewan Higgs, Yes, I think that makes sense. The

[jira] [Commented] (HDFS-12705) WebHdfsFileSystem exceptions should retain the caused by exception

2017-11-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246321#comment-16246321 ] Arpit Agarwal commented on HDFS-12705: -- +1 from me also. Thanks for the reviews [~nandakumar131].

[jira] [Updated] (HDFS-12794) Ozone: Parallelize ChunkOutputSream Writes to container

2017-11-09 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12794: --- Attachment: HDFS-12794-HDFS-7240.001.patch In patch v1, an arrayBlocking queue of

[jira] [Commented] (HDFS-12776) [READ] Increasing replication for PROVIDED files should create local replicas

2017-11-09 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246293#comment-16246293 ] Íñigo Goiri commented on HDFS-12776: This looks good. The failed unit test seems unrelated. +1 >

[jira] [Updated] (HDFS-12794) Ozone: Parallelize ChunkOutputSream Writes to container

2017-11-09 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12794: --- Status: Patch Available (was: Open) > Ozone: Parallelize ChunkOutputSream Writes to

[jira] [Commented] (HDFS-12777) [READ] Reduce memory and CPU footprint for PROVIDED volumes.

2017-11-09 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246280#comment-16246280 ] Íñigo Goiri commented on HDFS-12777: The patch looks good but I think we should have a comment/javadoc

[jira] [Updated] (HDFS-12796) SCM should not start if Cluster Version file does not exist

2017-11-09 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12796: --- Status: Patch Available (was: Open) > SCM should not start if Cluster Version file

[jira] [Commented] (HDFS-12713) [READ] Refactor FileRegion and BlockAliasMap to separate out HDFS metadata and PROVIDED storage metadata

2017-11-09 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246264#comment-16246264 ] Chris Douglas commented on HDFS-12713: -- {noformat} - public abstract Writer getWriter(Writer.Options

[jira] [Updated] (HDFS-12796) SCM should not start if Cluster Version file does not exist

2017-11-09 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12796: --- Attachment: HDFS-12796-HDFS-7240.002.patch Thanks [~nandakumar131], for the review

[jira] [Commented] (HDFS-12713) [READ] Refactor FileRegion and BlockAliasMap to separate out HDFS metadata and PROVIDED storage metadata

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246229#comment-16246229 ] Virajith Jalaparti commented on HDFS-12713: --- Adding a dependency to HDFS-12665 as

[jira] [Updated] (HDFS-12719) Ozone: Fix checkstyle, javac, whitespace issues in HDFS-7240 branch

2017-11-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12719: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-12779) [READ] Allow cluster id to be specified to the Image generation tool

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12779: -- Attachment: HDFS-12779-HDFS-9806.001.patch Reattaching the same patch to trigger

[jira] [Updated] (HDFS-12779) [READ] Allow cluster id to be specified to the Image generation tool

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12779: -- Status: Patch Available (was: Open) > [READ] Allow cluster id to be specified to the

[jira] [Updated] (HDFS-12779) [READ] Allow cluster id to be specified to the Image generation tool

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12779: -- Status: Open (was: Patch Available) > [READ] Allow cluster id to be specified to the

[jira] [Updated] (HDFS-12779) [READ] Allow cluster id to be specified to the Image generation tool

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Virajith Jalaparti updated HDFS-12779: -- Attachment: (was: HDFS-12779-HDFS-9806.001.patch) > [READ] Allow cluster id to be

[jira] [Commented] (HDFS-12719) Ozone: Fix checkstyle, javac, whitespace issues in HDFS-7240 branch

2017-11-09 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246178#comment-16246178 ] Anu Engineer commented on HDFS-12719: - +1, Thank you for getting this fixed. Please feel free to

[jira] [Updated] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-11-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-12318: -- Fix Version/s: 2.9.1 2.10.0 2.8.3 > Fix IOException condition for

[jira] [Commented] (HDFS-12318) Fix IOException condition for openInfo in DFSInputStream

2017-11-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246143#comment-16246143 ] John Zhuge commented on HDFS-12318: --- Backported to branch-2, branch-2.9, and branch-2.8. Unfortunately

[jira] [Commented] (HDFS-12052) Set SWEBHDFS delegation token kind when ssl is enabled in HttpFS

2017-11-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246138#comment-16246138 ] Xiao Chen commented on HDFS-12052: -- Committed this to branch-2, after resolving minor conflicts. Ran the

[jira] [Updated] (HDFS-12052) Set SWEBHDFS delegation token kind when ssl is enabled in HttpFS

2017-11-09 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12052: - Fix Version/s: 2.10.0 > Set SWEBHDFS delegation token kind when ssl is enabled in HttpFS >

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246098#comment-16246098 ] Hadoop QA commented on HDFS-12754: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12790) [SPS]: Rebasing HDFS-10285 branch after HDFS-10467, HDFS-12599 and HDFS-11968 commits

2017-11-09 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12790: Attachment: HDFS-12790-HDFS-10285-03.patch Thanks [~surendrasingh] for the reviews. Attached another patch

[jira] [Commented] (HDFS-12776) [READ] Increasing replication for PROVIDED files should create local replicas

2017-11-09 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246074#comment-16246074 ] Virajith Jalaparti commented on HDFS-12776: --- [~elgoiri], can you take a look at this? > [READ]

[jira] [Commented] (HDFS-11246) FSNameSystem#logAuditEvent should be called outside the read or write locks

2017-11-09 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246067#comment-16246067 ] Kuhu Shukla commented on HDFS-11246: Most test failures are due to OOM causing no new thread creations

[jira] [Commented] (HDFS-12758) Ozone: Correcting assertEquals argument order in test cases

2017-11-09 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246010#comment-16246010 ] Bharat Viswanadham commented on HDFS-12758: --- Thank You [~vagarychen] for committing this patch.

[jira] [Commented] (HDFS-12763) DataStreamer should heartbeat during flush

2017-11-09 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246008#comment-16246008 ] Kuhu Shukla commented on HDFS-12763: Test failures are unrelated. [~kihwal], request for

[jira] [Commented] (HDFS-12796) SCM should not start if Cluster Version file does not exist

2017-11-09 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16245983#comment-16245983 ] Nanda kumar commented on HDFS-12796: Thanks [~shashikant] for reporting and working on the issue. The

[jira] [Updated] (HDFS-12796) SCM should not start if Cluster Version file does not exist

2017-11-09 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12796: --- Attachment: HDFS-12796-HDFS-7240.001.patch Patch v1 implements the logic to fail SCM

[jira] [Created] (HDFS-12796) SCM should not start if Cluster Version file does not exist

2017-11-09 Thread Shashikant Banerjee (JIRA)
Shashikant Banerjee created HDFS-12796: -- Summary: SCM should not start if Cluster Version file does not exist Key: HDFS-12796 URL: https://issues.apache.org/jira/browse/HDFS-12796 Project:

[jira] [Commented] (HDFS-12459) Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API

2017-11-09 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16245864#comment-16245864 ] Rushabh S Shah commented on HDFS-12459: --- +1 (non-binding) pending jenkins. Thanks [~cheersyang] for

[jira] [Updated] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-09 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-12754: --- Attachment: HDFS-12754.005.patch Uploading the same patch again since the failures are not

[jira] [Updated] (HDFS-12740) SCM should support a RPC to share the cluster Id with KSM and DataNodes

2017-11-09 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12740: --- Attachment: HDFS-12740-HDFS-7240.002.patch Thanks [~linyiqun]], [~nandakumar131], for

[jira] [Assigned] (HDFS-11600) Refactor TestDFSStripedOutputStreamWithFailure test classes

2017-11-09 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton reassigned HDFS-11600: --- Assignee: (was: Elek, Marton) > Refactor TestDFSStripedOutputStreamWithFailure test

[jira] [Commented] (HDFS-12790) [SPS]: Rebasing HDFS-10285 branch after HDFS-10467, HDFS-12599 and HDFS-11968 commits

2017-11-09 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16245642#comment-16245642 ] Surendra Singh Lilhore commented on HDFS-12790: --- Thanks [~rakeshr] for patch. Latest patch

[jira] [Updated] (HDFS-12795) Ozone: SCM: Support for Container LifeCycleState PENDING_CLOSE and LifeCycleEvent FULL_CONTAINER

2017-11-09 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-12795: --- Status: Patch Available (was: Open) > Ozone: SCM: Support for Container LifeCycleState PENDING_CLOSE

[jira] [Updated] (HDFS-12795) Ozone: SCM: Support for Container LifeCycleState PENDING_CLOSE and LifeCycleEvent FULL_CONTAINER

2017-11-09 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-12795: --- Attachment: HDFS-12795-HDFS-7240.000.patch > Ozone: SCM: Support for Container LifeCycleState

[jira] [Updated] (HDFS-12665) [AliasMap] Create a version of the AliasMap that runs in memory in the Namenode (leveldb)

2017-11-09 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-12665: -- Attachment: HDFS-12665-HDFS-9806.006.patch [~virajith], thanks for updating the patch. I'm attaching

[jira] [Created] (HDFS-12795) Ozone: SCM: Support for Container LifeCycleState PENDING_CLOSE and LifeCycleEvent FULL_CONTAINER

2017-11-09 Thread Nanda kumar (JIRA)
Nanda kumar created HDFS-12795: -- Summary: Ozone: SCM: Support for Container LifeCycleState PENDING_CLOSE and LifeCycleEvent FULL_CONTAINER Key: HDFS-12795 URL: https://issues.apache.org/jira/browse/HDFS-12795

[jira] [Updated] (HDFS-12793) Ozone : TestSCMCli is failing consistently

2017-11-09 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12793: - Issue Type: Sub-task (was: Bug) Parent: HDFS-7240 > Ozone : TestSCMCli is failing consistently >

  1   2   >