[jira] [Comment Edited] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055186#comment-16055186 ] Yiqun Lin edited comment on HDFS-11963 at 6/20/17 5:54 AM: --- Reopen the JIRA and

[jira] [Reopened] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin reopened HDFS-11963: -- > Ozone: Documentation: Add getting started page > -- > >

[jira] [Updated] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11963: - Status: Patch Available (was: Reopened) > Ozone: Documentation: Add getting started page >

[jira] [Updated] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11963: - Attachment: HDFS-11963-HDFS-7240.addendum001.patch Reopen the JIRA and attach the addendum patch for

[jira] [Commented] (HDFS-11992) Replace commons-logging APIs with slf4j in FsDatasetImpl

2017-06-19 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055180#comment-16055180 ] Akira Ajisaka commented on HDFS-11992: -- Thanks [~xiaodong.hu] for the patch. 1. {code}

[jira] [Commented] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055172#comment-16055172 ] Anu Engineer commented on HDFS-11963: - Sure enough, I just committed the patch, please feel free to

[jira] [Commented] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055171#comment-16055171 ] Yiqun Lin commented on HDFS-11963: -- Thanks for quick response, [~anu]. I did a easy test in my local with

[jira] [Updated] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11963: Resolution: Fixed Hadoop Flags: Reviewed Release Note: Thanks for all the reviews, I have

[jira] [Commented] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055163#comment-16055163 ] Hadoop QA commented on HDFS-11963: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11999) Ozone: Clarify startup error message of Datanode in case namenode is missing

2017-06-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055158#comment-16055158 ] Hadoop QA commented on HDFS-11999: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11995) HDFS Architecture documentation incorrectly describes writing to a local temporary file.

2017-06-19 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055157#comment-16055157 ] Nandakumar commented on HDFS-11995: --- Thanks [~iwasakims] for the commit. > HDFS Architecture

[jira] [Commented] (HDFS-11983) Add documentation for metrics in KSMMetrics to OzoneMetrics.md

2017-06-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055149#comment-16055149 ] Hadoop QA commented on HDFS-11983: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-11736) OIV tests should not write outside 'target' directory.

2017-06-19 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-11736: - Resolution: Fixed Fix Version/s: 2.8.2 2.9.0 Status: Resolved

[jira] [Commented] (HDFS-11736) OIV tests should not write outside 'target' directory.

2017-06-19 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055147#comment-16055147 ] Akira Ajisaka commented on HDFS-11736: -- Committed this to branch-2 and branch-2.8. Thanks! > OIV

[jira] [Commented] (HDFS-11736) OIV tests should not write outside 'target' directory.

2017-06-19 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055140#comment-16055140 ] Akira Ajisaka commented on HDFS-11736: -- +1, checking this in. > OIV tests should not write outside

[jira] [Commented] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055122#comment-16055122 ] Anu Engineer commented on HDFS-11963: - [~linyiqun] I don't think I have touched that file at all.

[jira] [Commented] (HDFS-11890) Handle NPE in BlockRecoveryWorker when DN is getting shoutdown.

2017-06-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055093#comment-16055093 ] Hudson commented on HDFS-11890: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11889 (See

[jira] [Updated] (HDFS-11890) Handle NPE in BlockRecoveryWorker when DN is getting shoutdown.

2017-06-19 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-11890: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha4

[jira] [Updated] (HDFS-11975) Provide a system-default EC policy

2017-06-19 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun updated HDFS-11975: - Status: Patch Available (was: Open) > Provide a system-default EC policy >

[jira] [Updated] (HDFS-11975) Provide a system-default EC policy

2017-06-19 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun updated HDFS-11975: - Attachment: HDFS-11975-001.patch > Provide a system-default EC policy >

[jira] [Updated] (HDFS-11983) Add documentation for metrics in KSMMetrics to OzoneMetrics.md

2017-06-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11983: - Attachment: HDFS-11983-HDFS-7240.002.patch Thanks for the review, [~anu]. Attach the updated patch. In

[jira] [Comment Edited] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055068#comment-16055068 ] Yiqun Lin edited comment on HDFS-11963 at 6/20/17 2:39 AM: --- Thanks for updating

[jira] [Commented] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-19 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055068#comment-16055068 ] Yiqun Lin commented on HDFS-11963: -- Thanks for updating the patch. Only one comment from me: can we

[jira] [Updated] (HDFS-11989) Ozone: add TestKeys with Ratis

2017-06-19 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-11989: --- Attachment: HDFS-11989-HDFS-7240.20170620.patch HDFS-11989-HDFS-7240.20170620.patch:

[jira] [Commented] (HDFS-11989) Ozone: add TestKeys with Ratis

2017-06-19 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055065#comment-16055065 ] Tsz Wo Nicholas Sze commented on HDFS-11989: Sure, will update the test. > Ozone: add

[jira] [Updated] (HDFS-11647) Add -E option in hdfs "count" command to show erasure policy summarization

2017-06-19 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun updated HDFS-11647: - Attachment: HDFS-11647-007.patch > Add -E option in hdfs "count" command to show erasure policy

[jira] [Commented] (HDFS-11647) Add -E option in hdfs "count" command to show erasure policy summarization

2017-06-19 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055064#comment-16055064 ] luhuichun commented on HDFS-11647: -- @Lei (Eddy) Xu thx Eddy, updated > Add -E option in hdfs "count"

[jira] [Commented] (HDFS-11916) Extend TestErasureCodingPolicies/TestErasureCodingPolicyWithSnapshot with a random EC policy

2017-06-19 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055025#comment-16055025 ] Takanobu Asanuma commented on HDFS-11916: - Thanks for reviewing and committing, [~eddyxu]! >

[jira] [Resolved] (HDFS-11995) HDFS Architecture documentation incorrectly describes writing to a local temporary file.

2017-06-19 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki resolved HDFS-11995. - Resolution: Fixed Fix Version/s: 2.8.2 3.0.0-alpha4

[jira] [Commented] (HDFS-11606) Add CLI cmd to remove an erasure code policy

2017-06-19 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055005#comment-16055005 ] Kai Zheng commented on HDFS-11606: -- The latest patch LGTM and +1. Thanks Tim! We might get rid of the

[jira] [Updated] (HDFS-11670) [SPS]: Add CLI command for satisfy storage policy operations

2017-06-19 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-11670: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-10285

[jira] [Commented] (HDFS-11670) [SPS]: Add CLI command for satisfy storage policy operations

2017-06-19 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054980#comment-16054980 ] Uma Maheswara Rao G commented on HDFS-11670: +1 on the latest patch. Thanks [~surendrasingh]

[jira] [Resolved] (HDFS-8672) Erasure Coding: Add EC-related Metrics to NN (seperate striped blocks count from UnderReplicatedBlocks count)

2017-06-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-8672. --- Resolution: Duplicate Closing this as I believe it dupes HDFS-10999 which Manoj completed. > Erasure

[jira] [Commented] (HDFS-11995) HDFS Architecture documentation incorrectly describes writing to a local temporary file.

2017-06-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054942#comment-16054942 ] Hudson commented on HDFS-11995: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11888 (See

[jira] [Created] (HDFS-12001) Remove documentation for "HDFS High Availability with NFS"

2017-06-19 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-12001: Summary: Remove documentation for "HDFS High Availability with NFS" Key: HDFS-12001 URL: https://issues.apache.org/jira/browse/HDFS-12001 Project: Hadoop HDFS

[jira] [Created] (HDFS-12000) Ozone: Container : Add key versioning support

2017-06-19 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-12000: --- Summary: Ozone: Container : Add key versioning support Key: HDFS-12000 URL: https://issues.apache.org/jira/browse/HDFS-12000 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-11983) Add documentation for metrics in KSMMetrics to OzoneMetrics.md

2017-06-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054933#comment-16054933 ] Anu Engineer commented on HDFS-11983: - [~linyiqun] Thanks for adding these. Two small nits: key space

[jira] [Commented] (HDFS-11995) HDFS Architecture documentation incorrectly describes writing to a local temporary file.

2017-06-19 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054913#comment-16054913 ] Masatake Iwasaki commented on HDFS-11995: - +1, committing this. If you say "local buffer in

[jira] [Commented] (HDFS-11989) Ozone: add TestKeys with Ratis

2017-06-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054910#comment-16054910 ] Xiaoyu Yao commented on HDFS-11989: --- Thanks [~szetszwo] for working on this. The patch looks good to me.

[jira] [Updated] (HDFS-11782) Ozone: KSM: Add listKey

2017-06-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11782: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target

[jira] [Commented] (HDFS-11996) Ozone : add partial read of chunks

2017-06-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054900#comment-16054900 ] Anu Engineer commented on HDFS-11996: - +1, pending jenkins. > Ozone : add partial read of chunks >

[jira] [Commented] (HDFS-11782) Ozone: KSM: Add listKey

2017-06-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054879#comment-16054879 ] Xiaoyu Yao commented on HDFS-11782: --- +1 for the latest patch given we will follow up on the remaining

[jira] [Commented] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054873#comment-16054873 ] Xiaoyu Yao commented on HDFS-11963: --- Thanks [~anu] for the update. +1 for v6, pending Jenkins. > Ozone:

[jira] [Updated] (HDFS-11996) Ozone : add partial read of chunks

2017-06-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11996: -- Status: Patch Available (was: Open) > Ozone : add partial read of chunks >

[jira] [Updated] (HDFS-11996) Ozone : add partial read of chunks

2017-06-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11996: -- Attachment: HDFS-11996-HDFS-7240.001.patch Turns out it is already possible to do partial read of a

[jira] [Commented] (HDFS-11960) Successfully closed files can stay under-replicated.

2017-06-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054870#comment-16054870 ] Hadoop QA commented on HDFS-11960: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11963: Attachment: HDFS-11963-HDFS-7240.006.patch [~xyao] Thanks for the comments. Patch v6 addresses all

[jira] [Commented] (HDFS-11999) Ozone: Clarify startup error message of Datanode in case namenode is missing

2017-06-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054830#comment-16054830 ] Anu Engineer commented on HDFS-11999: - [~elek] Thanks for the patch, Can you please rename your patch

[jira] [Commented] (HDFS-11997) ChunkManager functions do not use the argument keyName

2017-06-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054822#comment-16054822 ] Anu Engineer commented on HDFS-11997: - [~vagarychen] Thanks for your comments. You are absolutely

[jira] [Updated] (HDFS-11999) Ozone: Clarify startup error message of Datanode in case namenode is missing

2017-06-19 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-11999: Status: Patch Available (was: Open) > Ozone: Clarify startup error message of Datanode in case

[jira] [Updated] (HDFS-11999) Ozone: Clarify startup error message of Datanode in case namenode is missing

2017-06-19 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-11999: Attachment: HDFS-11999.patch > Ozone: Clarify startup error message of Datanode in case namenode is

[jira] [Updated] (HDFS-11999) Ozone: Clarify startup error message of Datanode in case namenode is missing

2017-06-19 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-11999: Summary: Ozone: Clarify startup error message of Datanode in case namenode is missing (was: Ozone:

[jira] [Created] (HDFS-11999) Ozone: Clarify error message in case namenode is missing

2017-06-19 Thread Elek, Marton (JIRA)
Elek, Marton created HDFS-11999: --- Summary: Ozone: Clarify error message in case namenode is missing Key: HDFS-11999 URL: https://issues.apache.org/jira/browse/HDFS-11999 Project: Hadoop HDFS

[jira] [Created] (HDFS-11998) Enable DFSNetworkTopology as default

2017-06-19 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11998: - Summary: Enable DFSNetworkTopology as default Key: HDFS-11998 URL: https://issues.apache.org/jira/browse/HDFS-11998 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-11997) ChunkManager functions do not use the argument keyName

2017-06-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054779#comment-16054779 ] Chen Liang commented on HDFS-11997: --- I think from the perspective of abstraction, {{ChunkManager}}

[jira] [Commented] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054755#comment-16054755 ] Xiaoyu Yao commented on HDFS-11963: --- Thanks [~anu] for working on this. Patch v5 looks good to me

[jira] [Commented] (HDFS-11997) ChunkManager functions do not use the argument keyName

2017-06-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054754#comment-16054754 ] Anu Engineer commented on HDFS-11997: - As an API for chunk calls, isn't it better to have these in the

[jira] [Created] (HDFS-11997) ChunkManager functions do not use the argument keyName

2017-06-19 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11997: - Summary: ChunkManager functions do not use the argument keyName Key: HDFS-11997 URL: https://issues.apache.org/jira/browse/HDFS-11997 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-11960) Successfully closed files can stay under-replicated.

2017-06-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11960: -- Attachment: HDFS-11960-v2.branch-2.txt The branch-2 patch is identical except for the name change from

[jira] [Commented] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054713#comment-16054713 ] Chen Liang commented on HDFS-11963: --- Thanks [~anu] for the update, v005 patch LGTM. > Ozone:

[jira] [Updated] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11963: Attachment: HDFS-11963-HDFS-7240.005.patch [~elek] Thanks for catching that, fixed in the new

[jira] [Commented] (HDFS-11518) libhdfs++: Add a build option to skip building examples, tests, and tools

2017-06-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054680#comment-16054680 ] Hadoop QA commented on HDFS-11518: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11960) Successfully closed files can stay under-replicated.

2017-06-19 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11960: -- Attachment: HDFS-11960-v2.trunk.txt Added unit test. > Successfully closed files can stay

[jira] [Commented] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-19 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054667#comment-16054667 ] Elek, Marton commented on HDFS-11963: - Just a typo, but could avoid easy copy paste: {code} - ./hdfs

[jira] [Updated] (HDFS-11518) libhdfs++: Add a build option to skip building examples, tests, and tools

2017-06-19 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-11518: - Attachment: HDFS-11518.HDFS-8707.002.patch Attached the wrong file by mistake. Reattaching. >

[jira] [Commented] (HDFS-11647) Add -E option in hdfs "count" command to show erasure policy summarization

2017-06-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054606#comment-16054606 ] Lei (Eddy) Xu commented on HDFS-11647: -- Thanks for the update, [~luhuichun] One small nits: In

[jira] [Comment Edited] (HDFS-11995) HDFS Architecture documentation incorrectly describes writing to a local temporary file.

2017-06-19 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054561#comment-16054561 ] Nandakumar edited comment on HDFS-11995 at 6/19/17 6:41 PM: This was actually

[jira] [Commented] (HDFS-11995) HDFS Architecture documentation incorrectly describes writing to a local temporary file.

2017-06-19 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054561#comment-16054561 ] Nandakumar commented on HDFS-11995: --- This was actually fixed in HDFS-1454, uploaded the patch with

[jira] [Updated] (HDFS-11995) HDFS Architecture documentation incorrectly describes writing to a local temporary file.

2017-06-19 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-11995: -- Attachment: HDFS-11995.000.patch > HDFS Architecture documentation incorrectly describes writing to a

[jira] [Commented] (HDFS-10480) Add an admin command to list currently open files

2017-06-19 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054508#comment-16054508 ] Manoj Govindassamy commented on HDFS-10480: --- sure [~shahrs87], [~andrew.wang]. Will post the

[jira] [Created] (HDFS-11996) Ozone : add partial read of chunks

2017-06-19 Thread Chen Liang (JIRA)
Chen Liang created HDFS-11996: - Summary: Ozone : add partial read of chunks Key: HDFS-11996 URL: https://issues.apache.org/jira/browse/HDFS-11996 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-11916) Extend TestErasureCodingPolicies/TestErasureCodingPolicyWithSnapshot with a random EC policy

2017-06-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054498#comment-16054498 ] Hudson commented on HDFS-11916: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11887 (See

[jira] [Commented] (HDFS-10391) Always enable NameNode service RPC port

2017-06-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054495#comment-16054495 ] Hadoop QA commented on HDFS-10391: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11992) Replace commons-logging APIs with slf4j in FsDatasetImpl

2017-06-19 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054494#comment-16054494 ] Chen Liang commented on HDFS-11992: --- Thanks [~xiaodong.hu] for the contribution! v001 patch LGTM. >

[jira] [Commented] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054475#comment-16054475 ] Hadoop QA commented on HDFS-11963: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11971) libhdfs++: A few portability issues

2017-06-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054465#comment-16054465 ] Hadoop QA commented on HDFS-11971: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-11995) HDFS Architecture documentation incorrectly describes writing to a local temporary file.

2017-06-19 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar reassigned HDFS-11995: - Assignee: Nandakumar > HDFS Architecture documentation incorrectly describes writing to a local

[jira] [Commented] (HDFS-11890) Handle NPE in BlockRecoveryWorker when DN is getting shoutdown.

2017-06-19 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054429#comment-16054429 ] Brahma Reddy Battula commented on HDFS-11890: - Test failures are unrelated. will commit

[jira] [Commented] (HDFS-9505) HDFS Architecture documentation needs to be refreshed.

2017-06-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054424#comment-16054424 ] Chris Nauroth commented on HDFS-9505: - FYI, I have filed HDFS-11995 for another inaccuracy in the HDFS

[jira] [Updated] (HDFS-11995) HDFS Architecture documentation incorrectly describes writing to a local temporary file.

2017-06-19 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-11995: - Priority: Minor (was: Major) > HDFS Architecture documentation incorrectly describes writing to

[jira] [Created] (HDFS-11995) HDFS Architecture documentation incorrectly describes writing to a local temporary file.

2017-06-19 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-11995: Summary: HDFS Architecture documentation incorrectly describes writing to a local temporary file. Key: HDFS-11995 URL: https://issues.apache.org/jira/browse/HDFS-11995

[jira] [Commented] (HDFS-11970) Ozone: TestXceiverClientManager.testFreeByEviction fails occasionally

2017-06-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054420#comment-16054420 ] Hadoop QA commented on HDFS-11970: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11991) Ozone: Ozone shell: the root is assumed to hdfs

2017-06-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054415#comment-16054415 ] Anu Engineer commented on HDFS-11991: - [~cheersyang] Thanks for picking this up. If it is not big

[jira] [Updated] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11963: Attachment: HDFS-11963-HDFS-7240.004.patch Will fix the white space issues while committing with

[jira] [Updated] (HDFS-11916) Extend TestErasureCodingPolicies/TestErasureCodingPolicyWithSnapshot with a random EC policy

2017-06-19 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-11916: - Resolution: Fixed Fix Version/s: 3.0.0-alpha4 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-10480) Add an admin command to list currently open files

2017-06-19 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054378#comment-16054378 ] Rushabh S Shah commented on HDFS-10480: --- Can we backport to branch-2.8 also ? > Add an admin

[jira] [Commented] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054389#comment-16054389 ] Hadoop QA commented on HDFS-11963: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10480) Add an admin command to list currently open files

2017-06-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054383#comment-16054383 ] Andrew Wang commented on HDFS-10480: Sure, looks like we need a new patch though since the backport

[jira] [Updated] (HDFS-11963) Ozone: Documentation: Add getting started page

2017-06-19 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11963: Attachment: HDFS-11963-HDFS-7240.003.patch Update the patch based on comments, it addresses all

[jira] [Updated] (HDFS-10480) Add an admin command to list currently open files

2017-06-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10480: --- Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-11978) Remove invalid '-usage' command of 'ec' and add missing commands 'addPolicies' 'listCodecs'

2017-06-19 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054312#comment-16054312 ] Wei-Chiu Chuang commented on HDFS-11978: [~vincent he] I added you a HDFS contributor role so feel

[jira] [Assigned] (HDFS-11978) Remove invalid '-usage' command of 'ec' and add missing commands 'addPolicies' 'listCodecs'

2017-06-19 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-11978: -- Assignee: wenxin he > Remove invalid '-usage' command of 'ec' and add missing commands

[jira] [Commented] (HDFS-11987) DistributedFileSystem#create and append do not honor CreateFlag.CREATE|APPEND

2017-06-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054284#comment-16054284 ] Andrew Wang commented on HDFS-11987: Hi Eddy, thanks for working on this! One high-level comment, I

[jira] [Updated] (HDFS-11971) libhdfs++: A few portability issues

2017-06-19 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-11971: - Attachment: HDFS-11971.HDFS-8707.003.patch I also just noticed another small portability issue.

[jira] [Commented] (HDFS-11647) Add -E option in hdfs "count" command to show erasure policy summarization

2017-06-19 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054253#comment-16054253 ] Andrew Wang commented on HDFS-11647: Unfortunately, once there's a GH PR, Yetus will always use it for

[jira] [Commented] (HDFS-11518) libhdfs++: Add a build option to skip building examples, tests, and tools

2017-06-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054157#comment-16054157 ] Hadoop QA commented on HDFS-11518: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11970) Ozone: TestXceiverClientManager.testFreeByEviction fails occasionally

2017-06-19 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11970: - Status: Patch Available (was: Open) > Ozone: TestXceiverClientManager.testFreeByEviction

[jira] [Updated] (HDFS-11970) Ozone: TestXceiverClientManager.testFreeByEviction fails occasionally

2017-06-19 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-11970: - Attachment: HDFS-11970-HDFS-7240.001.patch > Ozone:

[jira] [Commented] (HDFS-11970) Ozone: TestXceiverClientManager.testFreeByEviction fails occasionally

2017-06-19 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054144#comment-16054144 ] Mukul Kumar Singh commented on HDFS-11970: -- This test fails because with cache size of 2 for

[jira] [Commented] (HDFS-11978) Remove invalid '-usage' command of 'ec' and add missing commands 'addPolicies' 'listCodecs'

2017-06-19 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054110#comment-16054110 ] Wei-Chiu Chuang commented on HDFS-11978: +1 > Remove invalid '-usage' command of 'ec' and add

  1   2   >