[jira] [Commented] (HDFS-12303) Change default EC cell size to 1MB for better performance

2017-08-15 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128369#comment-16128369 ] Wei Zhou commented on HDFS-12303: - The junit test failures reported can not be reproduced in my local

[jira] [Updated] (HDFS-12303) Change default EC cell size to 1MB for better performance

2017-08-15 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zhou updated HDFS-12303: Status: Open (was: Patch Available) > Change default EC cell size to 1MB for better performance >

[jira] [Updated] (HDFS-12303) Change default EC cell size to 1MB for better performance

2017-08-15 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zhou updated HDFS-12303: Status: Patch Available (was: Open) > Change default EC cell size to 1MB for better performance >

[jira] [Updated] (HDFS-12258) ec -listPolicies should list all policies in system, no matter it's enabled or disabled

2017-08-15 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zhou updated HDFS-12258: Attachment: HDFS-12258.03.patch Thanks [~rakeshr] for reviewing and the comments! For the 4th issue, my

[jira] [Commented] (HDFS-12302) FSVolume's getVolumeMap actually do nothing when Instantiate a FsDatasetImpl object

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128347#comment-16128347 ] Hadoop QA commented on HDFS-12302: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12214) [SPS]: Fix review comments of StoragePolicySatisfier feature

2017-08-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128340#comment-16128340 ] Rakesh R commented on HDFS-12214: - Thanks [~surendrasingh] for the comments. bq. In

[jira] [Updated] (HDFS-11082) Erasure Coding : Provide replicated EC policy to just replicating the files

2017-08-15 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-11082: - Attachment: HDFS-11082.004.patch Hi Andrew, thanks for the quick review. 004.patch is uploaded to

[jira] [Created] (HDFS-12308) Erasure Coding: Provide DistributedFileSystem & DFSClient API to return the effective EC policy on a directory or file, including the replication policy

2017-08-15 Thread SammiChen (JIRA)
SammiChen created HDFS-12308: Summary: Erasure Coding: Provide DistributedFileSystem & DFSClient API to return the effective EC policy on a directory or file, including the replication policy Key: HDFS-12308 URL:

[jira] [Commented] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128334#comment-16128334 ] Wei-Chiu Chuang commented on HDFS-11738: Thanks, the latest patch looks really good to me. On a

[jira] [Updated] (HDFS-12269) Better to return a Map rather than HashMap in getErasureCodingCodecs

2017-08-15 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huafeng Wang updated HDFS-12269: Attachment: HDFS-12269.002.patch > Better to return a Map rather than HashMap in

[jira] [Commented] (HDFS-12307) Ozone: TestKeys#testPutAndGetKeyWithDnRestart fails

2017-08-15 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128290#comment-16128290 ] Weiwei Yang commented on HDFS-12307: I did a quick look, it looks like the root cause is the container

[jira] [Commented] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-15 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128285#comment-16128285 ] Vinayakumar B commented on HDFS-11738: -- Test failure is unrelated. checkstyle is about line length,

[jira] [Commented] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-08-15 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128282#comment-16128282 ] Akira Ajisaka commented on HDFS-11882: -- Thanks [~andrew.wang] for the update! Mostly looks good to

[jira] [Created] (HDFS-12307) Ozone: TestKeys#testPutAndGetKeyWithDnRestart fails

2017-08-15 Thread Weiwei Yang (JIRA)
Weiwei Yang created HDFS-12307: -- Summary: Ozone: TestKeys#testPutAndGetKeyWithDnRestart fails Key: HDFS-12307 URL: https://issues.apache.org/jira/browse/HDFS-12307 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-12302) FSVolume's getVolumeMap actually do nothing when Instantiate a FsDatasetImpl object

2017-08-15 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liaoyuxiangqin updated HDFS-12302: -- Attachment: HDFS-12302.002.patch > FSVolume's getVolumeMap actually do nothing when Instantiate

[jira] [Updated] (HDFS-12302) FSVolume's getVolumeMap actually do nothing when Instantiate a FsDatasetImpl object

2017-08-15 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liaoyuxiangqin updated HDFS-12302: -- Status: Patch Available (was: Open) > FSVolume's getVolumeMap actually do nothing when

[jira] [Updated] (HDFS-12302) FSVolume's getVolumeMap actually do nothing when Instantiate a FsDatasetImpl object

2017-08-15 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liaoyuxiangqin updated HDFS-12302: -- Status: Open (was: Patch Available) > FSVolume's getVolumeMap actually do nothing when

[jira] [Commented] (HDFS-12306) [branch-2]Separate class InnerNode from class NetworkTopology and make it extendable

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128220#comment-16128220 ] Hadoop QA commented on HDFS-12306: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12304) Remove unused parameter from FsDatasetImpl#addVolume

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128203#comment-16128203 ] Hadoop QA commented on HDFS-12304: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11082) Erasure Coding : Provide replicated EC policy to just replicating the files

2017-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128174#comment-16128174 ] Andrew Wang commented on HDFS-11082: Thanks for revving Sammi, only a single nit, looks good

[jira] [Comment Edited] (HDFS-11082) Erasure Coding : Provide replicated EC policy to just replicating the files

2017-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128174#comment-16128174 ] Andrew Wang edited comment on HDFS-11082 at 8/16/17 1:08 AM: - Thanks for

[jira] [Commented] (HDFS-12302) FSVolume's getVolumeMap actually do nothing when Instantiate a FsDatasetImpl object

2017-08-15 Thread liaoyuxiangqin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128170#comment-16128170 ] liaoyuxiangqin commented on HDFS-12302: --- [~vagarychen] Thanks for you watch, could you help me see

[jira] [Commented] (HDFS-12260) StreamCapabilities.StreamCapability should be public.

2017-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128172#comment-16128172 ] Andrew Wang commented on HDFS-12260: Are we changing hasCapability as part of this? Part of why it's

[jira] [Commented] (HDFS-10787) libhdfs++: hdfs_configuration and configuration_loader should be accessible from our public API

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128116#comment-16128116 ] Hadoop QA commented on HDFS-10787: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12304) Remove unused parameter from FsDatasetImpl#addVolume

2017-08-15 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12304: -- Attachment: HDFS-12304.001.patch > Remove unused parameter from FsDatasetImpl#addVolume >

[jira] [Updated] (HDFS-12304) Remove unused parameter from FsDatasetImpl#addVolume

2017-08-15 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12304: -- Status: Patch Available (was: Open) > Remove unused parameter from FsDatasetImpl#addVolume >

[jira] [Commented] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128091#comment-16128091 ] Andrew Wang commented on HDFS-11882: I can fix the checkstyles in the next patch, anyone up for a

[jira] [Updated] (HDFS-12306) [branch-2]Separate class InnerNode from class NetworkTopology and make it extendable

2017-08-15 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12306: -- Attachment: HDFS-12306-branch-2.001.patch > [branch-2]Separate class InnerNode from class

[jira] [Updated] (HDFS-12306) [branch-2]Separate class InnerNode from class NetworkTopology and make it extendable

2017-08-15 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12306: -- Status: Patch Available (was: Open) > [branch-2]Separate class InnerNode from class NetworkTopology

[jira] [Created] (HDFS-12306) [branch-2]Separate class InnerNode from class NetworkTopology and make it extendable

2017-08-15 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12306: - Summary: [branch-2]Separate class InnerNode from class NetworkTopology and make it extendable Key: HDFS-12306 URL: https://issues.apache.org/jira/browse/HDFS-12306

[jira] [Commented] (HDFS-12301) NN File Browser UI: Navigate to a path when enter is pressed

2017-08-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128043#comment-16128043 ] Hudson commented on HDFS-12301: --- ABORTED: Integrated in Jenkins build Hadoop-trunk-Commit #12192 (See

[jira] [Updated] (HDFS-12301) NN File Browser UI: Navigate to a path when enter is pressed

2017-08-15 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-12301: Resolution: Fixed Fix Version/s: 2.8.2 3.0.0-beta1 Status:

[jira] [Closed] (HDFS-12301) NN File Browser UI: Navigate to a path when enter is pressed

2017-08-15 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash closed HDFS-12301. --- > NN File Browser UI: Navigate to a path when enter is pressed >

[jira] [Commented] (HDFS-12301) NN File Browser UI: Navigate to a path when enter is pressed

2017-08-15 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128005#comment-16128005 ] Ravi Prakash commented on HDFS-12301: - Thank you for the reviews Haohui and Allen! I've committed this

[jira] [Commented] (HDFS-12182) BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127995#comment-16127995 ] Hadoop QA commented on HDFS-12182: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12290) Block Storage: Change dfs.cblock.jscsi.server.address default bind address to 0.0.0.0

2017-08-15 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127991#comment-16127991 ] Chen Liang commented on HDFS-12290: --- Thanks [~msingh] for the catch! The failed tests are unrelated.

[jira] [Updated] (HDFS-12290) Block Storage: Change dfs.cblock.jscsi.server.address default bind address to 0.0.0.0

2017-08-15 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12290: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Block Storage: Change

[jira] [Commented] (HDFS-12305) Ozone: SCM: Add StateMachine for pipeline/container

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127917#comment-16127917 ] Hadoop QA commented on HDFS-12305: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10787) libhdfs++: hdfs_configuration and configuration_loader should be accessible from our public API

2017-08-15 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10787: - Attachment: HDFS-10787.HDFS-8707.002.patch Fixed loading and validating of configs and getting

[jira] [Commented] (HDFS-12188) TestDecommissioningStatus#testDecommissionStatus fails intermittently

2017-08-15 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127858#comment-16127858 ] Ajay Kumar commented on HDFS-12188: --- Hi [~brahmareddy] , i tested this in a loop but it passed each

[jira] [Commented] (HDFS-12238) Ozone: Add valid trace ID check in sendCommandAsync

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127839#comment-16127839 ] Hadoop QA commented on HDFS-12238: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12301) NN File Browser UI: Navigate to a path when enter is pressed

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127826#comment-16127826 ] Hadoop QA commented on HDFS-12301: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-08-15 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127820#comment-16127820 ] Manoj Govindassamy commented on HDFS-11912: --- [~ghuangups], * The added test has failed again

[jira] [Updated] (HDFS-12301) NN File Browser UI: Navigate to a path when enter is pressed

2017-08-15 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-12301: Status: Patch Available (was: Open) > NN File Browser UI: Navigate to a path when enter is

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127789#comment-16127789 ] Hadoop QA commented on HDFS-11912: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12117) HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST Interface

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127779#comment-16127779 ] Hadoop QA commented on HDFS-12117: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-12182) BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks

2017-08-15 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-12182: Attachment: HDFS-12182-branch-2.001.patch Applied changes on top of branch-2 and

[jira] [Commented] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127755#comment-16127755 ] Hadoop QA commented on HDFS-11738: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12305) Ozone: SCM: Add StateMachine for pipeline/container

2017-08-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12305: -- Status: Patch Available (was: Open) > Ozone: SCM: Add StateMachine for pipeline/container >

[jira] [Updated] (HDFS-12305) Ozone: SCM: Add StateMachine for pipeline/container

2017-08-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-12305: -- Attachment: HDFS-12305-HDFS-7240.001.patch > Ozone: SCM: Add StateMachine for pipeline/container >

[jira] [Updated] (HDFS-12117) HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST Interface

2017-08-15 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-12117: Attachment: HDFS-12117-branch-2.001.patch Nevermind, I had just applied my commit

[jira] [Comment Edited] (HDFS-12238) Ozone: Add valid trace ID check in sendCommandAsync

2017-08-15 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127677#comment-16127677 ] Ajay Kumar edited comment on HDFS-12238 at 8/15/17 6:29 PM: [~anu], thanks for

[jira] [Commented] (HDFS-12238) Ozone: Add valid trace ID check in sendCommandAsync

2017-08-15 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127677#comment-16127677 ] Ajay Kumar commented on HDFS-12238: --- [~anu], thanks for review. Uploaded new patch with suggested

[jira] [Created] (HDFS-12305) Ozone: SCM: Add StateMachine for pipeline/container

2017-08-15 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-12305: - Summary: Ozone: SCM: Add StateMachine for pipeline/container Key: HDFS-12305 URL: https://issues.apache.org/jira/browse/HDFS-12305 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-12238) Ozone: Add valid trace ID check in sendCommandAsync

2017-08-15 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12238: -- Attachment: HDFS-12238-HDFS-7240.02.patch > Ozone: Add valid trace ID check in sendCommandAsync >

[jira] [Commented] (HDFS-12214) [SPS]: Fix review comments of StoragePolicySatisfier feature

2017-08-15 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127659#comment-16127659 ] Surendra Singh Lilhore commented on HDFS-12214: --- Thanks [~rakeshr] for the patch. Patch

[jira] [Created] (HDFS-12304) Remove unused parameter from FsDatasetImpl#addVolume

2017-08-15 Thread Chen Liang (JIRA)
Chen Liang created HDFS-12304: - Summary: Remove unused parameter from FsDatasetImpl#addVolume Key: HDFS-12304 URL: https://issues.apache.org/jira/browse/HDFS-12304 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-11912) Add a snapshot unit test with randomized file IO operations

2017-08-15 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127658#comment-16127658 ] Manoj Govindassamy commented on HDFS-11912: --- [~ghuangups], Thanks for working on the patch

[jira] [Updated] (HDFS-12255) Block Storage: Cblock should generated unique trace ID for the ops

2017-08-15 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12255: -- Resolution: Fixed Status: Resolved (was: Patch Available) Failed tests are unrelated.

[jira] [Commented] (HDFS-10285) Storage Policy Satisfier in Namenode

2017-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127645#comment-16127645 ] Andrew Wang commented on HDFS-10285: Hi Uma, bq. Now quick question on your example above “a user

[jira] [Commented] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-15 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127631#comment-16127631 ] Vinayakumar B commented on HDFS-11738: -- Thanks [~jojochuang] for reviewing changes. bq. IIUC, the

[jira] [Updated] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-15 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-11738: - Attachment: HDFS-11738-04.patch Updated the patch addressing above comments. > Hedged pread

[jira] [Commented] (HDFS-10787) libhdfs++: hdfs_configuration and configuration_loader should be accessible from our public API

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127607#comment-16127607 ] Hadoop QA commented on HDFS-10787: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127590#comment-16127590 ] Hadoop QA commented on HDFS-12225: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-08-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127582#comment-16127582 ] Xiaoyu Yao commented on HDFS-12159: --- Thanks [~anu] for the update. Patch looks good to me. There are few

[jira] [Comment Edited] (HDFS-12117) HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST Interface

2017-08-15 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124983#comment-16124983 ] Wellington Chevreuil edited comment on HDFS-12117 at 8/15/17 4:50 PM: --

[jira] [Commented] (HDFS-10787) libhdfs++: hdfs_configuration and configuration_loader should be accessible from our public API

2017-08-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127465#comment-16127465 ] ASF GitHub Bot commented on HDFS-10787: --- Github user jamesclampffer commented on the issue:

[jira] [Updated] (HDFS-12225) [SPS]: Optimize extended attributes for tracking SPS movements

2017-08-15 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12225: -- Attachment: HDFS-12225-HDFS-10285-02.patch Attached v2 patch. Fixed checkstyle

[jira] [Commented] (HDFS-10787) libhdfs++: hdfs_configuration and configuration_loader should be accessible from our public API

2017-08-15 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127395#comment-16127395 ] James Clampffer commented on HDFS-10787: Thanks for the initial patch [~mtracy] and the options

[jira] [Commented] (HDFS-12066) When Namenode is in safemode,may not allowed to remove an user's erasure coding policy

2017-08-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127365#comment-16127365 ] Hudson commented on HDFS-12066: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12189 (See

[jira] [Commented] (HDFS-12054) FSNamesystem#addErasureCodingPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-08-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127364#comment-16127364 ] Hudson commented on HDFS-12054: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12189 (See

[jira] [Updated] (HDFS-12054) FSNamesystem#addErasureCodingPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-08-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12054: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1

[jira] [Updated] (HDFS-12066) When Namenode is in safemode,may not allowed to remove an user's erasure coding policy

2017-08-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12066: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1

[jira] [Updated] (HDFS-10787) libhdfs++: hdfs_configuration and configuration_loader should be accessible from our public API

2017-08-15 Thread Anatoli Shein (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anatoli Shein updated HDFS-10787: - Attachment: HDFS-10787.HDFS-8707.001.patch I added a getter for hdfs::Options and a constructor

[jira] [Commented] (HDFS-11738) Hedged pread takes more time when block moved from initial locations

2017-08-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127273#comment-16127273 ] Wei-Chiu Chuang commented on HDFS-11738: Hello [~vinayrpet] thanks for the patch! I reviewed the

[jira] [Commented] (HDFS-12214) [SPS]: Fix review comments of StoragePolicySatisfier feature

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127186#comment-16127186 ] Hadoop QA commented on HDFS-12214: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12303) Change default EC cell size to 1MB for better performance

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127168#comment-16127168 ] Hadoop QA commented on HDFS-12303: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12214) [SPS]: Fix review comments of StoragePolicySatisfier feature

2017-08-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-12214: Attachment: HDFS-12214-HDFS-10285-07.patch Fixed checkstyle warning and attached new patch. cc:

[jira] [Commented] (HDFS-12066) When Namenode is in safemode,may not allowed to remove an user's erasure coding policy

2017-08-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127081#comment-16127081 ] Wei-Chiu Chuang commented on HDFS-12066: +1 > When Namenode is in safemode,may not allowed to

[jira] [Commented] (HDFS-12054) FSNamesystem#addErasureCodingPolicies should call checkNameNodeSafeMode() to ensure Namenode is not in safemode

2017-08-15 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127079#comment-16127079 ] Wei-Chiu Chuang commented on HDFS-12054: +1 > FSNamesystem#addErasureCodingPolicies should call

[jira] [Updated] (HDFS-12303) Change default EC cell size to 1MB for better performance

2017-08-15 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zhou updated HDFS-12303: Attachment: HDFS-12303.00.patch Initial patch. > Change default EC cell size to 1MB for better performance

[jira] [Updated] (HDFS-12303) Change default EC cell size to 1MB for better performance

2017-08-15 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zhou updated HDFS-12303: Status: Patch Available (was: Open) > Change default EC cell size to 1MB for better performance >

[jira] [Commented] (HDFS-12258) ec -listPolicies should list all policies in system, no matter it's enabled or disabled

2017-08-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127002#comment-16127002 ] Rakesh R commented on HDFS-12258: - Thanks [~zhouwei] for the patch. Following are few comments, please

[jira] [Updated] (HDFS-12298) Ozone: Block deletion service floods the log when deleting large number of block files

2017-08-15 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12298: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Commented] (HDFS-11696) Fix warnings from Spotbugs in hadoop-hdfs

2017-08-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126982#comment-16126982 ] Hudson commented on HDFS-11696: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12188 (See

[jira] [Commented] (HDFS-12298) Ozone: Block deletion service floods the log when deleting large number of block files

2017-08-15 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126972#comment-16126972 ] Weiwei Yang commented on HDFS-12298: Looks good to me, the v2 patch, I will commit this shortly.

[jira] [Updated] (HDFS-11696) Fix warnings from Spotbugs in hadoop-hdfs

2017-08-15 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11696: - Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-12298) Ozone: Block deletion service floods the log when deleting large number of block files

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126880#comment-16126880 ] Hadoop QA commented on HDFS-12298: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12230) Ozone: KSM: Add creation time field in bucket info

2017-08-15 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12230: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status:

[jira] [Resolved] (HDFS-11814) Benchmark and tune for prefered default cell size

2017-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-11814. Resolution: Done Thanks Wei! Let's resolve this one and continue with changing the defaults in

[jira] [Updated] (HDFS-12303) Change default EC cell size to 1MB for better performance

2017-08-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12303: --- Labels: hdfs-ec-3.0-must-do (was: ) Priority: Blocker (was: Major) Hadoop Flags:

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-08-15 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126845#comment-16126845 ] Xiao Chen commented on HDFS-10899: -- Looked at the Daryn comment about edit log buffering and

[jira] [Commented] (HDFS-12230) Ozone: KSM: Add creation time field in bucket info

2017-08-15 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126842#comment-16126842 ] Weiwei Yang commented on HDFS-12230: +1 on v3 patch, I will commit this shortly. > Ozone: KSM: Add

[jira] [Commented] (HDFS-12230) Ozone: KSM: Add creation time field in bucket info

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16126840#comment-16126840 ] Hadoop QA commented on HDFS-12230: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||