[jira] [Commented] (HDFS-11605) Allow user to customize new erasure code policies

2017-04-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988251#comment-15988251 ] Hudson commented on HDFS-11605: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11647 (See

[jira] [Updated] (HDFS-11605) Allow user to customize new erasure code policies

2017-04-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-11605: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-11605) Allow user to customize new erasure code policies

2017-04-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-11605: - Summary: Allow user to customize new erasure code policies (was: Allow user to customize and add new

[jira] [Updated] (HDFS-11712) Ozone: Reuse ObjectMapper instance to improve the performance

2017-04-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11712: - Attachment: (was: HDFS-11712-HDFS-7240.002.patch) > Ozone: Reuse ObjectMapper instance to improve the

[jira] [Updated] (HDFS-11712) Ozone: Reuse ObjectMapper instance to improve the performance

2017-04-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11712: - Attachment: HDFS-11712-HDFS-7240.002.patch > Ozone: Reuse ObjectMapper instance to improve the

[jira] [Comment Edited] (HDFS-11712) Ozone: Reuse ObjectMapper instance to improve the performance

2017-04-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988212#comment-15988212 ] Yiqun Lin edited comment on HDFS-11712 at 4/28/17 5:09 AM: --- Thanks [~anu] for

[jira] [Commented] (HDFS-11675) Ozone: SCM CLI: Implement delete container command

2017-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988215#comment-15988215 ] Hadoop QA commented on HDFS-11675: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11605) Allow user to customize and add new erasure code codecs and policies

2017-04-27 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988216#comment-15988216 ] Kai Zheng commented on HDFS-11605: -- The latest patch LGTM and +1. There is an unneeded import and I will

[jira] [Comment Edited] (HDFS-11712) Ozone: Reuse ObjectMapper instance to improve the performance

2017-04-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988212#comment-15988212 ] Yiqun Lin edited comment on HDFS-11712 at 4/28/17 5:07 AM: --- Thanks [~anu] for

[jira] [Updated] (HDFS-11712) Ozone: Reuse ObjectMapper instance to improve the performance

2017-04-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11712: - Attachment: HDFS-11712-HDFS-7240.002.patch Thanks [~anu] for taking a look! {quote} Do you think we can

[jira] [Commented] (HDFS-11675) Ozone: SCM CLI: Implement delete container command

2017-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988125#comment-15988125 ] Hadoop QA commented on HDFS-11675: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11675) Ozone: SCM CLI: Implement delete container command

2017-04-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988075#comment-15988075 ] Anu Engineer commented on HDFS-11675: - [~cheersyang] yes, makes sense. +1, pending jenkins. > Ozone:

[jira] [Commented] (HDFS-11675) Ozone: SCM CLI: Implement delete container command

2017-04-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988071#comment-15988071 ] Weiwei Yang commented on HDFS-11675: Hi [~anu] I prefer to keep it under {{container}} command,

[jira] [Comment Edited] (HDFS-11675) Ozone: SCM CLI: Implement delete container command

2017-04-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988071#comment-15988071 ] Weiwei Yang edited comment on HDFS-11675 at 4/28/17 2:26 AM: - Hi [~anu] I

[jira] [Commented] (HDFS-11675) Ozone: SCM CLI: Implement delete container command

2017-04-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988064#comment-15988064 ] Anu Engineer commented on HDFS-11675: - ok, so at this point this cli command is useful for us to

[jira] [Commented] (HDFS-11716) Ozone: SCM: CLI: Revisit delete container API

2017-04-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988060#comment-15988060 ] Anu Engineer commented on HDFS-11716: - no worries, you are most welcome. > Ozone: SCM: CLI: Revisit

[jira] [Commented] (HDFS-11716) Ozone: SCM: CLI: Revisit delete container API

2017-04-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988058#comment-15988058 ] Weiwei Yang commented on HDFS-11716: Oops .. forgot the add the ozone label.. thanks for fixing that

[jira] [Updated] (HDFS-11716) Ozone: SCM: CLI: Revisit delete container API

2017-04-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11716: Summary: Ozone: SCM: CLI: Revisit delete container API (was: Revisit delete container API) >

[jira] [Updated] (HDFS-11675) Ozone: SCM CLI: Implement delete container command

2017-04-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11675: --- Attachment: HDFS-11675-HDFS-7240.004.patch Forgot to fix the checkstyle issue in v3 patch :( ...

[jira] [Commented] (HDFS-11675) Ozone: SCM CLI: Implement delete container command

2017-04-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988042#comment-15988042 ] Weiwei Yang commented on HDFS-11675: Thanks [~vagarychen] and [~anu] for your quick responses. [~anu],

[jira] [Updated] (HDFS-11716) Revisit delete container API

2017-04-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11716: --- Description: Current delete container API seems can be possibly running into inconsistent state. SCM

[jira] [Created] (HDFS-11716) Revisit delete container API

2017-04-27 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-11716: -- Summary: Revisit delete container API Key: HDFS-11716 URL: https://issues.apache.org/jira/browse/HDFS-11716 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-11681) DatanodeStorageInfo#getBlockIterator() should return an iterator to an unmodifiable set.

2017-04-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15988032#comment-15988032 ] Virajith Jalaparti commented on HDFS-11681: --- Pinging [~andrew.wang], [~shv] [~umamaheswararao]

[jira] [Updated] (HDFS-11675) Ozone: SCM CLI: Implement delete container command

2017-04-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11675: --- Attachment: HDFS-11675-HDFS-7240.003.patch > Ozone: SCM CLI: Implement delete container command >

[jira] [Commented] (HDFS-8498) Blocks can be committed with wrong size

2017-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987985#comment-15987985 ] Hadoop QA commented on HDFS-8498: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11702) Remove indefinite caching of key provider uri in DFSClient

2017-04-27 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987959#comment-15987959 ] Rushabh S Shah commented on HDFS-11702: --- Thanks [~hanishakoneru] for looking into this jira. bq.

[jira] [Commented] (HDFS-11702) Remove indefinite caching of key provider uri in DFSClient

2017-04-27 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987932#comment-15987932 ] Hanisha Koneru commented on HDFS-11702: --- [~shahrs87], the patch doesn't apply cleanly for me. -

[jira] [Commented] (HDFS-11713) Use MoveFileEx to allow renaming a file when the destination exists

2017-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987930#comment-15987930 ] Hadoop QA commented on HDFS-11713: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11714) Newly added NN storage directory won't get initialized and cause space exhaustion

2017-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987919#comment-15987919 ] Hadoop QA commented on HDFS-11714: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11715) Ozone: SCM : Add priority for datanode commands

2017-04-27 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987872#comment-15987872 ] Chen Liang commented on HDFS-11715: --- Thanks [~anu] for filing this, a very interesting idea! A side

[jira] [Updated] (HDFS-11713) Use MoveFileEx to allow renaming a file when the destination exists

2017-04-27 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-11713: -- Description: The {{NativeIO.c#renameTo0}} currently uses {{MoveFile}} Windows system call,

[jira] [Commented] (HDFS-11713) Use MoveFileEx to allow renaming a file when the destination exists

2017-04-27 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987846#comment-15987846 ] Lukas Majercak commented on HDFS-11713: --- Exception in {{TestRollingUpgrade.testRollback}} : {code}

[jira] [Commented] (HDFS-8498) Blocks can be committed with wrong size

2017-04-27 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987844#comment-15987844 ] Zhe Zhang commented on HDFS-8498: - I'd like to help get this committed to branch-2.7. Just triggered

[jira] [Commented] (HDFS-9342) Erasure coding: client should update and commit block based on acknowledged size

2017-04-27 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987835#comment-15987835 ] Zhe Zhang commented on HDFS-9342: - Sorry for the late response. Yes the main logic LGTM as well. I spent

[jira] [Updated] (HDFS-11713) Use MoveFileEx to allow renaming a file when the destination exists

2017-04-27 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-11713: -- Description: The {{NativeIO.c#renameTo0}} currently uses {{MoveFile}} Windows system call,

[jira] [Updated] (HDFS-11714) Newly added NN storage directory won't get initialized and cause space exhaustion

2017-04-27 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11714: -- Status: Patch Available (was: Open) > Newly added NN storage directory won't get initialized and cause

[jira] [Commented] (HDFS-11675) Ozone: SCM CLI: Implement delete container command

2017-04-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987798#comment-15987798 ] Anu Engineer commented on HDFS-11675: - [~cheersyang] Thanks for the patch. Two minor nits: *

[jira] [Updated] (HDFS-11714) Newly added NN storage directory won't get initialized and cause space exhaustion

2017-04-27 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-11714: -- Attachment: HDFS-11714.trunk.patch The version file can be created in an empty storage diectory in

[jira] [Commented] (HDFS-2970) Contending block synchronizations can result in scary log messages

2017-04-27 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987793#comment-15987793 ] Todd Lipcon commented on HDFS-2970: --- Yep, if my memory from 5 years ago serves me correctly, we can just

[jira] [Updated] (HDFS-8873) Allow the directoryScanner to be rate-limited

2017-04-27 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8873: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.4 2.9.0

[jira] [Updated] (HDFS-11713) Use MoveFileEx to allow renaming a file when the destination exists

2017-04-27 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-11713: -- Labels: windows (was: ) > Use MoveFileEx to allow renaming a file when the destination exists

[jira] [Commented] (HDFS-11712) Ozone: Reuse ObjectMapper instance to improve the performance

2017-04-27 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987757#comment-15987757 ] Anu Engineer commented on HDFS-11712: - [~linyiqun] Thanks for sharing the link --

[jira] [Commented] (HDFS-11714) Newly added NN storage directory won't get initialized and cause space exhaustion

2017-04-27 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987756#comment-15987756 ] Kihwal Lee commented on HDFS-11714: --- The original design pre-HA was to just create directory structure

[jira] [Created] (HDFS-11715) Ozone: SCM : Add priority for datanode commands

2017-04-27 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11715: --- Summary: Ozone: SCM : Add priority for datanode commands Key: HDFS-11715 URL: https://issues.apache.org/jira/browse/HDFS-11715 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-11713) Use MoveFileEx to allow renaming a file when the destination exists

2017-04-27 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987728#comment-15987728 ] Inigo Goiri commented on HDFS-11713: The change from {{rename()}} to {{MoveFile()}} was done by

[jira] [Created] (HDFS-11714) Newly added NN storage directory won't get initialized and cause space exhaustion

2017-04-27 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-11714: - Summary: Newly added NN storage directory won't get initialized and cause space exhaustion Key: HDFS-11714 URL: https://issues.apache.org/jira/browse/HDFS-11714 Project:

[jira] [Updated] (HDFS-11713) Use MoveFileEx to allow renaming a file when the destination exists

2017-04-27 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-11713: -- Status: Patch Available (was: Open) > Use MoveFileEx to allow renaming a file when the

[jira] [Updated] (HDFS-11713) Use MoveFileEx to allow renaming a file when the destination exists

2017-04-27 Thread Lukas Majercak (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lukas Majercak updated HDFS-11713: -- Attachment: HDFS-11713.001.patch > Use MoveFileEx to allow renaming a file when the destination

[jira] [Created] (HDFS-11713) Use MoveFileEx to allow renaming a file when the destination exists

2017-04-27 Thread Lukas Majercak (JIRA)
Lukas Majercak created HDFS-11713: - Summary: Use MoveFileEx to allow renaming a file when the destination exists Key: HDFS-11713 URL: https://issues.apache.org/jira/browse/HDFS-11713 Project: Hadoop

[jira] [Commented] (HDFS-11707) TestDirectoryScanner#testThrottling fails on OSX

2017-04-27 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987645#comment-15987645 ] Erik Krogen commented on HDFS-11707: Hm... We are seeing consistent failure on OS X 10.11.4, 10.12.3,

[jira] [Commented] (HDFS-11675) Ozone: SCM CLI: Implement delete container command

2017-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987490#comment-15987490 ] Hadoop QA commented on HDFS-11675: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11709) StandbyCheckpointer should handle an non-existing legacyOivImageDir gracefully

2017-04-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987466#comment-15987466 ] Konstantin Shvachko commented on HDFS-11709: A unit test would've been appropriate for this

[jira] [Commented] (HDFS-8873) Allow the directoryScanner to be rate-limited

2017-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987383#comment-15987383 ] Hadoop QA commented on HDFS-8873: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11384) Add option for balancer to disperse getBlocks calls to avoid NameNode's rpc.CallQueueLength spike

2017-04-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-11384: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.2

[jira] [Commented] (HDFS-9807) Add an optional StorageID to writes

2017-04-27 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987356#comment-15987356 ] Virajith Jalaparti commented on HDFS-9807: -- Thanks for posting the modified patch [~ehiggs]. A few

[jira] [Commented] (HDFS-11675) Ozone: SCM CLI: Implement delete container command

2017-04-27 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987242#comment-15987242 ] Chen Liang commented on HDFS-11675: --- Thanks [~cheersyang] for the work! v002 patch looks pretty good to

[jira] [Commented] (HDFS-11709) StandbyCheckpointer should handle an non-existing legacyOivImageDir gracefully

2017-04-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987071#comment-15987071 ] Hudson commented on HDFS-11709: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11640 (See

[jira] [Commented] (HDFS-11709) StandbyCheckpointer should handle an non-existing legacyOivImageDir gracefully

2017-04-27 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987057#comment-15987057 ] Erik Krogen commented on HDFS-11709: Thanks [~kihwal] and [~zhz]! > StandbyCheckpointer should handle

[jira] [Updated] (HDFS-11709) StandbyCheckpointer should handle an non-existing legacyOivImageDir gracefully

2017-04-27 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-11709: - Resolution: Fixed Fix Version/s: 2.8.1 3.0.0-alpha3 2.7.4

[jira] [Commented] (HDFS-11675) Ozone: SCM CLI: Implement delete container command

2017-04-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987012#comment-15987012 ] Weiwei Yang commented on HDFS-11675: Oops forgot to include the new file in the patch, uploaded v2

[jira] [Updated] (HDFS-11675) Ozone: SCM CLI: Implement delete container command

2017-04-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11675: --- Attachment: HDFS-11675-HDFS-7240.002.patch > Ozone: SCM CLI: Implement delete container command >

[jira] [Updated] (HDFS-11709) StandbyCheckpointer should handle an non-existing legacyOivImageDir gracefully

2017-04-27 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-11709: - Hadoop Flags: Reviewed Target Version/s: 2.9.0, 2.7.4, 3.0.0-alpha3, 2.8.1 (was: 2.9.0,

[jira] [Commented] (HDFS-9807) Add an optional StorageID to writes

2017-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987003#comment-15987003 ] Hadoop QA commented on HDFS-9807: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11675) Ozone: SCM CLI: Implement delete container command

2017-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986997#comment-15986997 ] Hadoop QA commented on HDFS-11675: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11675) Ozone: SCM CLI: Implement delete container command

2017-04-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986994#comment-15986994 ] Weiwei Yang commented on HDFS-11675: Please kindling review [~anu], [~vagarychen], thanks. > Ozone:

[jira] [Commented] (HDFS-11675) Ozone: SCM CLI: Implement delete container command

2017-04-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986993#comment-15986993 ] Weiwei Yang commented on HDFS-11675: Some notes for review # Changes to {{ContainerCommandHandler}},

[jira] [Updated] (HDFS-8873) Allow the directoryScanner to be rate-limited

2017-04-27 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8873: Status: Patch Available (was: Reopened) Sorry for reopening the JIRA, triggering Jenkins for the branch-2.7

[jira] [Reopened] (HDFS-8873) Allow the directoryScanner to be rate-limited

2017-04-27 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reopened HDFS-8873: - > Allow the directoryScanner to be rate-limited > - > >

[jira] [Commented] (HDFS-11712) Ozone: Reuse ObjectMapper instance to improve the performance

2017-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986961#comment-15986961 ] Hadoop QA commented on HDFS-11712: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11675) Ozone: SCM CLI: Implement delete container command

2017-04-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11675: --- Status: Patch Available (was: Open) > Ozone: SCM CLI: Implement delete container command >

[jira] [Updated] (HDFS-11675) Ozone: SCM CLI: Implement delete container command

2017-04-27 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-11675: --- Attachment: HDFS-11675-HDFS-7240.001.patch > Ozone: SCM CLI: Implement delete container command >

[jira] [Commented] (HDFS-11704) OzoneFileSystem: A Hadoop file system implementation for Ozone

2017-04-27 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986915#comment-15986915 ] Steve Loughran commented on HDFS-11704: --- I'll help you set up testing this downstream via my spark

[jira] [Assigned] (HDFS-11710) hadoop-hdfs-native-client build fails in trunk after HDFS-11529

2017-04-27 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HDFS-11710: - Assignee: Sailesh Mukil > hadoop-hdfs-native-client build fails in trunk after HDFS-11529 >

[jira] [Commented] (HDFS-11709) StandbyCheckpointer should handle an non-existing legacyOivImageDir gracefully

2017-04-27 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986836#comment-15986836 ] Kihwal Lee commented on HDFS-11709: --- +1 lgtm > StandbyCheckpointer should handle an non-existing

[jira] [Commented] (HDFS-11708) positional read will fail if replicas moved to different DNs after stream is opened

2017-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986821#comment-15986821 ] Hadoop QA commented on HDFS-11708: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11709) StandbyCheckpointer should handle an non-existing legacyOivImageDir gracefully

2017-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986811#comment-15986811 ] Hadoop QA commented on HDFS-11709: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-11712) Ozone: Reuse ObjectMapper instance to improve the performance

2017-04-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986799#comment-15986799 ] Yiqun Lin edited comment on HDFS-11712 at 4/27/17 3:16 PM: --- I read some doc of

[jira] [Commented] (HDFS-11712) Ozone: Reuse ObjectMapper instance to improve the performance

2017-04-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986799#comment-15986799 ] Yiqun Lin commented on HDFS-11712: -- I read some doc of {{ObjectMapper}} again, current patch seem not

[jira] [Comment Edited] (HDFS-11712) Ozone: Reuse ObjectMapper instance to improve the performance

2017-04-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986754#comment-15986754 ] Yiqun Lin edited comment on HDFS-11712 at 4/27/17 2:51 PM: --- While working on

[jira] [Commented] (HDFS-11712) Ozone: Reuse ObjectMapper instance to improve the performance

2017-04-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986754#comment-15986754 ] Yiqun Lin commented on HDFS-11712: -- While woking on this, I found that ozone is still using the old

[jira] [Updated] (HDFS-11712) Ozone: Reuse ObjectMapper instance to improve the performance

2017-04-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11712: - Status: Patch Available (was: Open) > Ozone: Reuse ObjectMapper instance to improve the performance >

[jira] [Updated] (HDFS-11712) Ozone: Reuse ObjectMapper instance to improve the performance

2017-04-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11712: - Attachment: HDFS-11712-HDFS-7240.001.patch > Ozone: Reuse ObjectMapper instance to improve the

[jira] [Updated] (HDFS-11712) Ozone: Reuse ObjectMapper instance to improve the performance

2017-04-27 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11712: - Description: In the ozone, there are many places using {{ObjectMapper}} to do the object-json

[jira] [Commented] (HDFS-11711) DN should not delete the block On "Too many open files" Exception

2017-04-27 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986710#comment-15986710 ] Brahma Reddy Battula commented on HDFS-11711: - *FYI* . Following is the log from DN

[jira] [Created] (HDFS-11712) Ozone: Reuse ObjectMapper instance to improve the performance

2017-04-27 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-11712: Summary: Ozone: Reuse ObjectMapper instance to improve the performance Key: HDFS-11712 URL: https://issues.apache.org/jira/browse/HDFS-11712 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9807) Add an optional StorageID to writes

2017-04-27 Thread Ewan Higgs (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewan Higgs updated HDFS-9807: - Attachment: HDFS-9807.006.patch Attaching patch rebased now that HDFS-6708 has been merged. > Add an

[jira] [Created] (HDFS-11711) DN should not delete the block On "Too many open files" Exception

2017-04-27 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-11711: --- Summary: DN should not delete the block On "Too many open files" Exception Key: HDFS-11711 URL: https://issues.apache.org/jira/browse/HDFS-11711

[jira] [Updated] (HDFS-11709) StandbyCheckpointer should handle an non-existing legacyOivImageDir gracefully

2017-04-27 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-11709: --- Attachment: HDFS-11709.000.patch Attaching v000 patch that catches {{IOExceptions}} thrown by

[jira] [Updated] (HDFS-11709) StandbyCheckpointer should handle an non-existing legacyOivImageDir gracefully

2017-04-27 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-11709: --- Status: Patch Available (was: Open) > StandbyCheckpointer should handle an non-existing

[jira] [Updated] (HDFS-11708) positional read will fail if replicas moved to different DNs after stream is opened

2017-04-27 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-11708: - Attachment: (was: HDFS-11708-02.patch) > positional read will fail if replicas moved to

[jira] [Updated] (HDFS-11708) positional read will fail if replicas moved to different DNs after stream is opened

2017-04-27 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-11708: - Attachment: HDFS-11708-02.patch > positional read will fail if replicas moved to different DNs

[jira] [Updated] (HDFS-11708) positional read will fail if replicas moved to different DNs after stream is opened

2017-04-27 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-11708: - Attachment: HDFS-11708-02.patch Updated the patch with addressed comments. hedged read would

[jira] [Commented] (HDFS-11708) positional read will fail if replicas moved to different DNs after stream is opened

2017-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986381#comment-15986381 ] Hadoop QA commented on HDFS-11708: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11708) positional read will fail if replicas moved to different DNs after stream is opened

2017-04-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986316#comment-15986316 ] Hadoop QA commented on HDFS-11708: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-11284) [SPS]: fix issue of moving blocks with satisfier while changing replication factor

2017-04-27 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated HDFS-11284: -- Resolution: Invalid Status: Resolved (was: Patch Available) Currently I cannot reproduce the

[jira] [Commented] (HDFS-11695) [SPS]: Namenode failed to start while loading SPS xAttrs from the edits log.

2017-04-27 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986307#comment-15986307 ] Yuanbo Liu commented on HDFS-11695: --- [~surendrasingh] Thanks for filing this JIRA. It would be great if

[jira] [Updated] (HDFS-10843) Update space quota when a UC block is completed rather than committed.

2017-04-27 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-10843: - Fix Version/s: 2.8.0 > Update space quota when a UC block is completed rather than committed. >

[jira] [Updated] (HDFS-10921) TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode

2017-04-27 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-10921: - Fix Version/s: 2.8.0 > TestDiskspaceQuotaUpdate doesn't wait for NN to get out of safe mode >

[jira] [Commented] (HDFS-11710) hadoop-hdfs-native-client build fails in trunk after HDFS-11529

2017-04-27 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986261#comment-15986261 ] Vinayakumar B commented on HDFS-11710: -- Simple empty function in os/windows/thread_local_storage.c as

[jira] [Commented] (HDFS-11708) positional read will fail if replicas moved to different DNs after stream is opened

2017-04-27 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986254#comment-15986254 ] Vinayakumar B commented on HDFS-11708: -- Thanks for review [~brahmareddy]. I will update the patch. >

  1   2   >