[jira] [Commented] (HDFS-12735) Make ContainerStateMachine#applyTransaction async

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237126#comment-16237126 ] Hadoop QA commented on HDFS-12735: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant fails with very uneven racks

2017-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237118#comment-16237118 ] Hudson commented on HDFS-12725: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13184 (See

[jira] [Updated] (HDFS-12443) Ozone: Improve SCM block deletion throttling algorithm

2017-11-02 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12443: - Attachment: HDFS-12443-HDFS-7240.003.patch Attach the new patch. Please have a look when you get a

[jira] [Updated] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant fails with very uneven racks

2017-11-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12725: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved

[jira] [Updated] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant fails with very uneven racks

2017-11-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12725: - Summary: BlockPlacementPolicyRackFaultTolerant fails with very uneven racks (was:

[jira] [Updated] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with very uneven racks

2017-11-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12725: - Summary: BlockPlacementPolicyRackFaultTolerant still fails with very uneven racks (was:

[jira] [Commented] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-11-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237089#comment-16237089 ] Xiao Chen commented on HDFS-12725: -- Ran the 3 failed tests locally, all passed. Checkstyle same as

[jira] [Commented] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-11-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237087#comment-16237087 ] Hudson commented on HDFS-12682: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13182 (See

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-02 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237063#comment-16237063 ] Jiandan Yang commented on HDFS-12754: -- Hi, [~kshukla], thanks for you patch. This patch could

[jira] [Updated] (HDFS-12735) Make ContainerStateMachine#applyTransaction async

2017-11-02 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12735: - Status: Patch Available (was: Open) > Make ContainerStateMachine#applyTransaction async

[jira] [Updated] (HDFS-12720) Ozone: Ratis options are not passed from KSM Client protobuf helper correctly.

2017-11-02 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12720: - Resolution: Fixed Status: Resolved (was: Patch Available) Thanks

[jira] [Commented] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237043#comment-16237043 ] Hadoop QA commented on HDFS-12725: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-11-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12682: - Resolution: Fixed Hadoop Flags: Incompatible change,Reviewed Fix Version/s: 3.0.0

[jira] [Commented] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-11-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237070#comment-16237070 ] Xiao Chen commented on HDFS-12682: -- Based on Kai and Rakesh's +1's and Eddy's earlier +1, I'm committing

[jira] [Updated] (HDFS-12310) [SPS]: Provide an option to track the status of in progress requests

2017-11-02 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12310: Resolution: Fixed Fix Version/s: HDFS-10285 Status: Resolved (was: Patch Available)

[jira] [Resolved] (HDFS-12757) DeadLock Happened Between DFSOutputStream and LeaseRenewer when LeaseRenewer#renew SocketTimeException

2017-11-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved HDFS-12757. Resolution: Duplicate > DeadLock Happened Between DFSOutputStream and LeaseRenewer when >

[jira] [Commented] (HDFS-12757) DeadLock Happened Between DFSOutputStream and LeaseRenewer when LeaseRenewer#renew SocketTimeException

2017-11-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237003#comment-16237003 ] Weiwei Yang commented on HDFS-12757: Yeah, duplicate issue, lets track via HDFS-12754. > DeadLock

[jira] [Commented] (HDFS-12310) [SPS]: Provide an option to track the status of in progress requests

2017-11-02 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236992#comment-16236992 ] Rakesh R commented on HDFS-12310: - Thanks [~eddyxu] for the reviews. I will commit this shortly. > [SPS]:

[jira] [Commented] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-11-02 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236989#comment-16236989 ] Rakesh R commented on HDFS-12682: - Thanks [~xiaochen]. +1 latest patch looks good to me. > ECAdmin

[jira] [Updated] (HDFS-12766) Ozone: Ensure usage of parameterized slf4j log syntax for ozone

2017-11-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12766: --- Labels: newbie (was: ) > Ozone: Ensure usage of parameterized slf4j log syntax for ozone >

[jira] [Commented] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-11-02 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236909#comment-16236909 ] Íñigo Goiri commented on HDFS-12681: +1 My CDO would be happier with the checkstyles showing a +1

[jira] [Commented] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-11-02 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236898#comment-16236898 ] Kai Zheng commented on HDFS-12682: -- The new approach using {{ErasureCodingPolicyInfo}} looks great!! I

[jira] [Commented] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-11-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236838#comment-16236838 ] Xiao Chen commented on HDFS-12682: -- Test failures look unrelated. Specifically ran

[jira] [Comment Edited] (HDFS-12549) Ozone: OzoneClient: Support for REST protocol

2017-11-02 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236752#comment-16236752 ] Xiaoyu Yao edited comment on HDFS-12549 at 11/2/17 11:49 PM: - Thanks

[jira] [Commented] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2017-11-02 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236832#comment-16236832 ] Xiaoyu Yao commented on HDFS-9240: -- Thanks [~virajith] for working on this. The patch looks good to me

[jira] [Commented] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-11-02 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236824#comment-16236824 ] Chris Douglas commented on HDFS-12681: -- bq. The "hides a field" checkstyle can easily fixed calling

[jira] [Updated] (HDFS-12756) Ozone: Add datanodeID to heartbeat responses and container protocol

2017-11-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12756: Attachment: HDFS-12756-HDFS-7240.002.patch [~nandakumar131] & [~xyao] Thanks for the comments.

[jira] [Updated] (HDFS-12756) Ozone: Add datanodeID to heartbeat responses and container protocol

2017-11-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12756: Status: Patch Available (was: Open) > Ozone: Add datanodeID to heartbeat responses and container

[jira] [Commented] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236817#comment-16236817 ] Hadoop QA commented on HDFS-12682: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12549) Ozone: OzoneClient: Support for REST protocol

2017-11-02 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236752#comment-16236752 ] Xiaoyu Yao commented on HDFS-12549: --- Thanks [~nandakumar131] for working on this. The patch looks good

[jira] [Comment Edited] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-11-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236335#comment-16236335 ] Xiao Chen edited comment on HDFS-12682 at 11/2/17 10:41 PM: Precommit

[jira] [Updated] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-11-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12725: - Attachment: HDFS-12725.06.patch Thanks for the review Eddy! Improved the messages based on your

[jira] [Commented] (HDFS-12759) Ozone: web: integrate configuration reader page to the SCM/KSM web ui.

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236686#comment-16236686 ] Hadoop QA commented on HDFS-12759: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-02 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236680#comment-16236680 ] Kuhu Shukla commented on HDFS-12754: Adding the test as it is causes a hang since the deadlock of the

[jira] [Updated] (HDFS-12759) Ozone: web: integrate configuration reader page to the SCM/KSM web ui.

2017-11-02 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12759: Attachment: HDFS-12759-HDFS-7280.002.patch conf.png Thx, the review: * I fixed

[jira] [Commented] (HDFS-12310) [SPS]: Provide an option to track the status of in progress requests

2017-11-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236597#comment-16236597 ] Lei (Eddy) Xu commented on HDFS-12310: -- +1. The 05 patch looks great. Thank you for this effort,

[jira] [Commented] (HDFS-12681) Fold HdfsLocatedFileStatus into HdfsFileStatus

2017-11-02 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236591#comment-16236591 ] Íñigo Goiri commented on HDFS-12681: The "hides a field" checkstyle can easily fixed calling the

[jira] [Comment Edited] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-11-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236556#comment-16236556 ] Lei (Eddy) Xu edited comment on HDFS-12725 at 11/2/17 8:42 PM: --- LGTM +1

[jira] [Commented] (HDFS-12725) BlockPlacementPolicyRackFaultTolerant still fails with racks with very few nodes

2017-11-02 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236556#comment-16236556 ] Lei (Eddy) Xu commented on HDFS-12725: -- LGTM +1 pending the following comment: {preformat} "

[jira] [Created] (HDFS-12769) TestReadStripedFileWithDecodingCorruptData and TestReadStripedFileWithDecodingDeletedData timeout in trunk

2017-11-02 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-12769: Summary: TestReadStripedFileWithDecodingCorruptData and TestReadStripedFileWithDecodingDeletedData timeout in trunk Key: HDFS-12769 URL:

[jira] [Commented] (HDFS-12760) Use PoolingHttpClientConnectionManager for OzoneRestClient

2017-11-02 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236543#comment-16236543 ] Xiaoyu Yao commented on HDFS-12760: --- HDFS-12549 is the new OzoneClient that will use the http connection

[jira] [Resolved] (HDFS-12760) Use PoolingHttpClientConnectionManager for OzoneRestClient

2017-11-02 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDFS-12760. --- Resolution: Duplicate > Use PoolingHttpClientConnectionManager for OzoneRestClient >

[jira] [Assigned] (HDFS-12758) Ozone: Correcting assertEquals argument order in test cases

2017-11-02 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDFS-12758: - Assignee: Bharat Viswanadham > Ozone: Correcting assertEquals argument order in

[jira] [Commented] (HDFS-12756) Ozone: Add datanodeID to heartbeat responses and container protocol

2017-11-02 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236497#comment-16236497 ] Xiaoyu Yao commented on HDFS-12756: --- Thanks [~anu] for the patch. It looks good to me overall. I just

[jira] [Comment Edited] (HDFS-12759) Ozone: web: integrate configuration reader page to the SCM/KSM web ui.

2017-11-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236438#comment-16236438 ] Anu Engineer edited comment on HDFS-12759 at 11/2/17 7:55 PM: -- one more minor

[jira] [Assigned] (HDFS-12765) Ozone: Add proper timeout for all ozone tests

2017-11-02 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDFS-12765: - Assignee: Bharat Viswanadham > Ozone: Add proper timeout for all ozone tests >

[jira] [Assigned] (HDFS-12766) Ozone: Ensure usage of parameterized slf4j log syntax for ozone

2017-11-02 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDFS-12766: - Assignee: Bharat Viswanadham > Ozone: Ensure usage of parameterized slf4j log

[jira] [Commented] (HDFS-7240) Object store in HDFS

2017-11-02 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236483#comment-16236483 ] Mukul Kumar Singh commented on HDFS-7240: - [~ste...@apache.org] I have filed HDFS-12768,

[jira] [Created] (HDFS-12768) Ozone: Qualify OzoneFileSystem paths in Filesystem APIs

2017-11-02 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-12768: Summary: Ozone: Qualify OzoneFileSystem paths in Filesystem APIs Key: HDFS-12768 URL: https://issues.apache.org/jira/browse/HDFS-12768 Project: Hadoop HDFS

[jira] [Created] (HDFS-12767) Ozone: Handle larger file sizes for OzoneOutputStream & OzoneInputStream

2017-11-02 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-12767: Summary: Ozone: Handle larger file sizes for OzoneOutputStream & OzoneInputStream Key: HDFS-12767 URL: https://issues.apache.org/jira/browse/HDFS-12767

[jira] [Created] (HDFS-12766) Ozone: Ensure usage of parameterized slf4j log syntax for ozone

2017-11-02 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-12766: - Summary: Ozone: Ensure usage of parameterized slf4j log syntax for ozone Key: HDFS-12766 URL: https://issues.apache.org/jira/browse/HDFS-12766 Project: Hadoop HDFS

[jira] [Created] (HDFS-12765) Ozone: Add proper timeout for all ozone tests

2017-11-02 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-12765: - Summary: Ozone: Add proper timeout for all ozone tests Key: HDFS-12765 URL: https://issues.apache.org/jira/browse/HDFS-12765 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-12760) Use PoolingHttpClientConnectionManager for OzoneRestClient

2017-11-02 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12760: -- Parent Issue: HDFS-12761 (was: HDFS-7240) > Use PoolingHttpClientConnectionManager for OzoneRestClient

[jira] [Updated] (HDFS-12758) Ozone: Correcting assertEquals argument order in test cases

2017-11-02 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12758: -- Parent Issue: HDFS-12761 (was: HDFS-7240) > Ozone: Correcting assertEquals argument order in test

[jira] [Updated] (HDFS-12762) Ozone: Enhance tests for OzoneFileSystem

2017-11-02 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12762: - Parent Issue: HDFS-12761 (was: HDFS-7240) > Ozone: Enhance tests for OzoneFileSystem >

[jira] [Updated] (HDFS-12764) Ozone: Implement efficient copyFromLocalFile and copyToLocalFile using bucket operations.

2017-11-02 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12764: - Issue Type: Sub-task (was: Bug) Parent: HDFS-12761 > Ozone: Implement efficient

[jira] [Commented] (HDFS-12720) Ozone: Ratis options are not passed from KSM Client protobuf helper correctly.

2017-11-02 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236442#comment-16236442 ] Tsz Wo Nicholas Sze commented on HDFS-12720: +1 the 006 patch looks good. Thanks for all the

[jira] [Updated] (HDFS-12761) Ozone: Merge Ozone to trunk

2017-11-02 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12761: - Issue Type: Task (was: Sub-task) Parent: (was: HDFS-7240) > Ozone: Merge

[jira] [Commented] (HDFS-12759) Ozone: web: integrate configuration reader page to the SCM/KSM web ui.

2017-11-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236438#comment-16236438 ] Anu Engineer commented on HDFS-12759: - one more minor comment, in common tools->config, it looks like

[jira] [Updated] (HDFS-12763) DataStreamer should heartbeat during flush

2017-11-02 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-12763: --- Attachment: HDFS-12763.001.patch v1 patch with a test that checks if heartbeats get sent during

[jira] [Updated] (HDFS-12763) DataStreamer should heartbeat during flush

2017-11-02 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-12763: --- Status: Patch Available (was: Open) > DataStreamer should heartbeat during flush >

[jira] [Commented] (HDFS-12759) Ozone: web: integrate configuration reader page to the SCM/KSM web ui.

2017-11-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236415#comment-16236415 ] Anu Engineer commented on HDFS-12759: - Could you please take care of the ASF Licensing issues. +1

[jira] [Commented] (HDFS-12762) Ozone: Enhance tests for OzoneFileSystem

2017-11-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236412#comment-16236412 ] Steve Loughran commented on HDFS-12762: --- If you look at hadoop-aws/pom.xml you can see how we make

[jira] [Created] (HDFS-12764) Ozone: Implement efficient copyFromLocalFile and copyToLocalFile using bucket operations.

2017-11-02 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-12764: Summary: Ozone: Implement efficient copyFromLocalFile and copyToLocalFile using bucket operations. Key: HDFS-12764 URL: https://issues.apache.org/jira/browse/HDFS-12764

[jira] [Created] (HDFS-12763) DataStreamer should heartbeat during flush

2017-11-02 Thread Kuhu Shukla (JIRA)
Kuhu Shukla created HDFS-12763: -- Summary: DataStreamer should heartbeat during flush Key: HDFS-12763 URL: https://issues.apache.org/jira/browse/HDFS-12763 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-12739) Add Support for SCM --init command

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236398#comment-16236398 ] Hadoop QA commented on HDFS-12739: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-12762) Ozone: Enhance tests for OzoneFileSystem

2017-11-02 Thread Mukul Kumar Singh (JIRA)
Mukul Kumar Singh created HDFS-12762: Summary: Ozone: Enhance tests for OzoneFileSystem Key: HDFS-12762 URL: https://issues.apache.org/jira/browse/HDFS-12762 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-7240) Object store in HDFS

2017-11-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236371#comment-16236371 ] Anu Engineer commented on HDFS-7240: [~ste...@apache.org] I have filed HDFS-12761 to discuss

[jira] [Created] (HDFS-12761) Ozone: Merge Ozone to trunk

2017-11-02 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-12761: --- Summary: Ozone: Merge Ozone to trunk Key: HDFS-12761 URL: https://issues.apache.org/jira/browse/HDFS-12761 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-12719) Ozone: Fix checkstyle, javac, whitespace issues in HDFS-7240 branch

2017-11-02 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12719: - Attachment: HDFS-12719-HDFS-7240.002.patch This patch fixes style issues on HDFS-7240.

[jira] [Commented] (HDFS-12749) DN may not send block report to NN after NN restart

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236348#comment-16236348 ] Hadoop QA commented on HDFS-12749: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-12760) Use PoolingHttpClientConnectionManager for OzoneRestClient

2017-11-02 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-12760: - Summary: Use PoolingHttpClientConnectionManager for OzoneRestClient Key: HDFS-12760 URL: https://issues.apache.org/jira/browse/HDFS-12760 Project: Hadoop HDFS

[jira] [Updated] (HDFS-12760) Use PoolingHttpClientConnectionManager for OzoneRestClient

2017-11-02 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12760: -- Description: This is based on [~ste...@apache.org]'s comments on HDFS-7240. I thought our client

[jira] [Commented] (HDFS-12682) ECAdmin -listPolicies will always show SystemErasureCodingPolicies state as DISABLED

2017-11-02 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236335#comment-16236335 ] Xiao Chen commented on HDFS-12682: -- Precommit https://builds.apache.org/job/PreCommit-HDFS-Build/21923/

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-02 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236308#comment-16236308 ] Kuhu Shukla commented on HDFS-12754: bq. I would add it here. Agree. CC: [~yangjiandan], adding the UT

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-02 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236285#comment-16236285 ] Íñigo Goiri commented on HDFS-12754: The test in HDFS-12757 looks like a good repro for this. I would

[jira] [Commented] (HDFS-7240) Object store in HDFS

2017-11-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236271#comment-16236271 ] Steve Loughran commented on HDFS-7240: -- Anu, I've got some more comments. Given the size of this JIRA,

[jira] [Commented] (HDFS-12759) Ozone: web: integrate configuration reader page to the SCM/KSM web ui.

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236255#comment-16236255 ] Hadoop QA commented on HDFS-12759: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12753) Getting file not found exception while using distcp with s3a

2017-11-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-12753: -- Component/s: fs/s3 > Getting file not found exception while using distcp with s3a >

[jira] [Updated] (HDFS-12759) Ozone: web: integrate configuration reader page to the SCM/KSM web ui.

2017-11-02 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12759: Attachment: after1.png before2.png before1.png

[jira] [Commented] (HDFS-12498) Journal Syncer is not started in Federated + HA cluster

2017-11-02 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236152#comment-16236152 ] Bharat Viswanadham commented on HDFS-12498: --- Test case failures are not related to this patch.

[jira] [Commented] (HDFS-12697) Ozone services must stay disabled in secure setup for alpha

2017-11-02 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236146#comment-16236146 ] Bharat Viswanadham commented on HDFS-12697: --- Thank You [~xyao] for committing the patch. >

[jira] [Commented] (HDFS-12474) Ozone: SCM: Handling container report with key count and container usage.

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236141#comment-16236141 ] Hadoop QA commented on HDFS-12474: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12720) Ozone: Ratis options are not passed from KSM Client protobuf helper correctly.

2017-11-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16236140#comment-16236140 ] Hadoop QA commented on HDFS-12720: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12759) Ozone: web: integrate configuration reader page to the SCM/KSM web ui.

2017-11-02 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12759: Attachment: HDFS-12759-HDFS-7240.001.patch > Ozone: web: integrate configuration reader page to the

[jira] [Updated] (HDFS-12759) Ozone: web: integrate configuration reader page to the SCM/KSM web ui.

2017-11-02 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12759: Status: Patch Available (was: Open) > Ozone: web: integrate configuration reader page to the

[jira] [Updated] (HDFS-12759) Ozone: web: integrate configuration reader page to the SCM/KSM web ui.

2017-11-02 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elek, Marton updated HDFS-12759: Labels: web-ui (was: ) > Ozone: web: integrate configuration reader page to the SCM/KSM web ui. >

[jira] [Created] (HDFS-12759) Ozone: web: integrate configuration reader page to the SCM/KSM web ui.

2017-11-02 Thread Elek, Marton (JIRA)
Elek, Marton created HDFS-12759: --- Summary: Ozone: web: integrate configuration reader page to the SCM/KSM web ui. Key: HDFS-12759 URL: https://issues.apache.org/jira/browse/HDFS-12759 Project: Hadoop

[jira] [Updated] (HDFS-12739) Add Support for SCM --init command

2017-11-02 Thread Shashikant Banerjee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-12739: --- Attachment: HDFS-12739-HDFS-7240.005.patch Thanks [~nandakumar131] for the review

[jira] [Commented] (HDFS-12754) Lease renewal can hit a deadlock

2017-11-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16235844#comment-16235844 ] Kihwal Lee commented on HDFS-12754: --- Please take a look at HDFS-12757. > Lease renewal can hit a

[jira] [Comment Edited] (HDFS-12757) DeadLock Happened Between DFSOutputStream and LeaseRenewer when LeaseRenewer#renew SocketTimeException

2017-11-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16235842#comment-16235842 ] Kihwal Lee edited comment on HDFS-12757 at 11/2/17 2:50 PM: I think it is a

[jira] [Commented] (HDFS-12757) DeadLock Happened Between DFSOutputStream and LeaseRenewer when LeaseRenewer#renew SocketTimeException

2017-11-02 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16235842#comment-16235842 ] Kihwal Lee commented on HDFS-12757: --- I think it is a dupe of HDFS-12754. With the patch applied the

[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

2017-11-02 Thread TanYuxin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TanYuxin updated HDFS-12749: Affects Version/s: 2.7.1 Status: Patch Available (was: Open) > DN may not send block report

[jira] [Commented] (HDFS-12696) BlockPoolManager#startAll is called twice during DataNode startup

2017-11-02 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16235752#comment-16235752 ] Nanda kumar commented on HDFS-12696: *Code flow* {noformat} DataNode#main secureMain

[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

2017-11-02 Thread TanYuxin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TanYuxin updated HDFS-12749: Attachment: (was: HDFS-12749.001.patch) > DN may not send block report to NN after NN restart >

[jira] [Updated] (HDFS-12749) DN may not send block report to NN after NN restart

2017-11-02 Thread TanYuxin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TanYuxin updated HDFS-12749: Attachment: HDFS-12749.001.patch > DN may not send block report to NN after NN restart >

[jira] [Updated] (HDFS-12758) Ozone: Correcting assertEquals argument order in test cases

2017-11-02 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-12758: --- Labels: newbie (was: ) > Ozone: Correcting assertEquals argument order in test cases >

[jira] [Updated] (HDFS-12758) Ozone: Correcting assertEquals argument order in test cases

2017-11-02 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-12758: --- Tags: (was: newbee) > Ozone: Correcting assertEquals argument order in test cases >

[jira] [Updated] (HDFS-12758) Ozone: Correcting assertEquals argument order in test cases

2017-11-02 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-12758: --- Environment: (was: In few test cases, the arguments to {{Assert.assertEquals}} is swapped. Below

[jira] [Updated] (HDFS-12758) Ozone: Correcting assertEquals argument order in test cases

2017-11-02 Thread Nanda kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nanda kumar updated HDFS-12758: --- Description: In few test cases, the arguments to {{Assert.assertEquals}} is swapped. Below is the

  1   2   >