[jira] [Resolved] (HDFS-10171) Balancer should log config values

2016-03-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-10171. --- Resolution: Duplicate Fix Version/s: 2.8.0 {noformat} 2016-03-15 22:42:31,618 [Thread-0] INFO

[jira] [Updated] (HDFS-9262) Support reconfiguring dfs.datanode.lazywriter.interval.sec without DN restart

2016-03-15 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9262: Attachment: HDFS-9262-HDFS-9000.005.patch V005 is rebased on trunk. > Support reconfiguring

[jira] [Commented] (HDFS-9857) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-1]

2016-03-15 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196786#comment-15196786 ] Zhe Zhang commented on HDFS-9857: - Thanks Rakesh. +1 pending Jenkins. Nice work here! > Erasure Coding:

[jira] [Updated] (HDFS-10171) Balancer should log config values

2016-03-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10171: -- Description: To improve supportability, Balancer should log config values. (was: To improve

[jira] [Created] (HDFS-10171) Balancer should log config values and iteration termination reasons

2016-03-15 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10171: - Summary: Balancer should log config values and iteration termination reasons Key: HDFS-10171 URL: https://issues.apache.org/jira/browse/HDFS-10171 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9904) testCheckpointCancellationDuringUpload occasionally fails

2016-03-15 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196761#comment-15196761 ] Lin Yiqun commented on HDFS-9904: - Thanks [~kihwal] for commit! > testCheckpointCancellationDuringUpload

[jira] [Commented] (HDFS-9857) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-1]

2016-03-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196759#comment-15196759 ] Rakesh R commented on HDFS-9857: Thanks [~zhz] for the reviews. I've attached patch addressing the

[jira] [Updated] (HDFS-9857) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-1]

2016-03-15 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-9857: --- Attachment: HDFS-9857-02.patch > Erasure Coding: Rename replication-based names in BlockManager to more >

[jira] [Commented] (HDFS-9960) OzoneHandler : Add localstorage support for keys

2016-03-15 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196745#comment-15196745 ] Chris Nauroth commented on HDFS-9960: - Hi [~anu]. It looks like these Checkstyle and Findbugs warnings

[jira] [Updated] (HDFS-9961) Ozone: Add buckets commands to CLI

2016-03-15 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-9961: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) +1

[jira] [Updated] (HDFS-9952) Expose FSNamesystem lock wait time as metrics

2016-03-15 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9952: Attachment: HDFS-9952-01.patch Attaching the patch. > Expose FSNamesystem lock wait time as metrics

[jira] [Updated] (HDFS-9952) Expose FSNamesystem lock wait time as metrics

2016-03-15 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9952: Status: Patch Available (was: Open) > Expose FSNamesystem lock wait time as metrics >

[jira] [Commented] (HDFS-9959) add log when block removed from last live datanode

2016-03-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196729#comment-15196729 ] Hadoop QA commented on HDFS-9959: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-15 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9847: Attachment: HDFS-9847.004.patch That's a good idea. Update the latest patch for addressing comments. > HDFS

[jira] [Commented] (HDFS-9940) Rename dfs.balancer.max.concurrent.moves to avoid confusion

2016-03-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196712#comment-15196712 ] John Zhuge commented on HDFS-9940: -- I like 2) better because all rebalance configuration is done at

[jira] [Commented] (HDFS-9917) IBR accumulate more objects when SNN was down for sometime.

2016-03-15 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196709#comment-15196709 ] Brahma Reddy Battula commented on HDFS-9917: I meant to say,we can avoid RPC to namenode and

[jira] [Commented] (HDFS-9940) Rename dfs.balancer.max.concurrent.moves to avoid confusion

2016-03-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196705#comment-15196705 ] John Zhuge commented on HDFS-9940: -- [~yzhangal], great idea if we don't have to manually config each DN

[jira] [Commented] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

2016-03-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196701#comment-15196701 ] Hadoop QA commented on HDFS-9349: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-8901) Use ByteBuffer in striping positional read

2016-03-15 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8901: Attachment: HDFS-8901-v5.patch Rebased. > Use ByteBuffer in striping positional read >

[jira] [Commented] (HDFS-9917) IBR accumulate more objects when SNN was down for sometime.

2016-03-15 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196635#comment-15196635 ] Brahma Reddy Battula commented on HDFS-9917: bq. I suggest that NN could just ignore the

[jira] [Updated] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

2016-03-15 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8905: Attachment: HDFS-8905-v9.patch Rebased one more time. > Refactor DFSInputStream#ReaderStrategy >

[jira] [Commented] (HDFS-9260) Improve the performance and GC friendliness of NameNode startup and full block reports

2016-03-15 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196630#comment-15196630 ] Vinayakumar B commented on HDFS-9260: - How about bringing this into branch-2? > Improve the

[jira] [Commented] (HDFS-9940) Rename dfs.balancer.max.concurrent.moves to avoid confusion

2016-03-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196566#comment-15196566 ] Yongjun Zhang commented on HDFS-9940: - Hi Guys, I wonder if this can be a balancer config only, and we

[jira] [Updated] (HDFS-9954) Test RPC timeout fix of HADOOP-12672 against HDFS

2016-03-15 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9954: --- Resolution: Invalid Status: Resolved (was: Patch Available) It turned out that

[jira] [Commented] (HDFS-9857) Erasure Coding: Rename replication-based names in BlockManager to more generic [part-1]

2016-03-15 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196506#comment-15196506 ] Zhe Zhang commented on HDFS-9857: - Seems the patch needs a small rebase. I also found a nit and a follow-on

[jira] [Commented] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196503#comment-15196503 ] Arpit Agarwal commented on HDFS-9349: - Thank you for updating the patch [~xiaobingo]. The

[jira] [Commented] (HDFS-9940) Rename dfs.balancer.max.concurrent.moves to avoid confusion

2016-03-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196482#comment-15196482 ] John Zhuge commented on HDFS-9940: -- Balancer uses config {{dfs.datanode.balance.max.concurrent.moves}} to

[jira] [Assigned] (HDFS-8210) Ozone: Implement storage container manager

2016-03-15 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth reassigned HDFS-8210: --- Assignee: Chris Nauroth (was: Jitendra Nath Pandey) > Ozone: Implement storage container

[jira] [Commented] (HDFS-9956) LDAP PERFORMANCE ISSUE AND FAIL OVER

2016-03-15 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196443#comment-15196443 ] Allen Wittenauer commented on HDFS-9956: is a naming services caching daemon being used or is this

[jira] [Updated] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

2016-03-15 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9349: Attachment: HDFS-9349-HDFS-9000.005.patch > Support reconfiguring fs.protected.directories without

[jira] [Commented] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

2016-03-15 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196437#comment-15196437 ] Xiaobing Zhou commented on HDFS-9349: - V005 is rebased on trunk. > Support reconfiguring

[jira] [Commented] (HDFS-9940) Rename dfs.balancer.max.concurrent.moves to avoid confusion

2016-03-15 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196389#comment-15196389 ] Tsz Wo Nicholas Sze commented on HDFS-9940: --- dfs.balancer.max.concurrent.moves is also confusing

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196374#comment-15196374 ] Arpit Agarwal commented on HDFS-9668: - bq. It means one slow operation of finalizeBlock, addBlock and

[jira] [Commented] (HDFS-9940) Rename dfs.balancer.max.concurrent.moves to avoid confusion

2016-03-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196363#comment-15196363 ] John Zhuge commented on HDFS-9940: -- +1 HDFS-7466 > Rename dfs.balancer.max.concurrent.moves to avoid

[jira] [Assigned] (HDFS-7285) Erasure Coding Support inside HDFS

2016-03-15 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers reassigned HDFS-7285: Assignee: Zhe Zhang (was: Matt Hardy) > Erasure Coding Support inside HDFS >

[jira] [Assigned] (HDFS-7285) Erasure Coding Support inside HDFS

2016-03-15 Thread Matt Hardy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Hardy reassigned HDFS-7285: Assignee: Matt Hardy (was: Zhe Zhang) > Erasure Coding Support inside HDFS >

[jira] [Updated] (HDFS-9959) add log when block removed from last live datanode

2016-03-15 Thread yunjiong zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yunjiong zhao updated HDFS-9959: Attachment: HDFS-9959.1.patch Update patch: 1. log after release the write lock 2. change error to

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-03-15 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196237#comment-15196237 ] Tsz Wo Nicholas Sze commented on HDFS-9668: --- > Currently, read operations have no special

[jira] [Commented] (HDFS-9917) IBR accumulate more objects when SNN was down for sometime.

2016-03-15 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15196158#comment-15196158 ] Tsz Wo Nicholas Sze commented on HDFS-9917: --- > Before Full BR, all pending IBRs will be flushed.

[jira] [Commented] (HDFS-10170) DiskBalancer: Force rebase diskbalancer branch

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195995#comment-15195995 ] Arpit Agarwal commented on HDFS-10170: -- +1 for force rebase to make DiskBalancer testable on Mac. I

[jira] [Updated] (HDFS-8457) Ozone: Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into parent interface

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8457: Fix Version/s: (was: HDFS-7240) > Ozone: Refactor FsDatasetSpi to pull up HDFS-agnostic

[jira] [Updated] (HDFS-8661) DataNode should filter the set of NameSpaceInfos passed to Datasets

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8661: Fix Version/s: (was: HDFS-7240) > DataNode should filter the set of NameSpaceInfos passed to

[jira] [Updated] (HDFS-8679) Move DatasetSpi to new package

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8679: Fix Version/s: (was: HDFS-7240) > Move DatasetSpi to new package >

[jira] [Updated] (HDFS-8392) DataNode support for multiple datasets

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8392: Fix Version/s: (was: HDFS-7240) > DataNode support for multiple datasets >

[jira] [Resolved] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-8677. - Resolution: Fixed We'll revisit FsDataset changes later. > Ozone: Introduce

[jira] [Resolved] (HDFS-8679) Move DatasetSpi to new package

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-8679. - Resolution: Later We'll revisit FsDataset changes later. > Move DatasetSpi to new package >

[jira] [Resolved] (HDFS-8661) DataNode should filter the set of NameSpaceInfos passed to Datasets

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-8661. - Resolution: Later We'll revisit FsDataset changes later. > DataNode should filter the set of

[jira] [Reopened] (HDFS-8679) Move DatasetSpi to new package

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-8679: - > Move DatasetSpi to new package > -- > > Key: HDFS-8679 >

[jira] [Reopened] (HDFS-8677) Ozone: Introduce KeyValueContainerDatasetSpi

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-8677: - > Ozone: Introduce KeyValueContainerDatasetSpi > > >

[jira] [Resolved] (HDFS-8457) Ozone: Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into parent interface

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-8457. - Resolution: Later We'll revisit FsDataset changes later. > Ozone: Refactor FsDatasetSpi to pull

[jira] [Reopened] (HDFS-8661) DataNode should filter the set of NameSpaceInfos passed to Datasets

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-8661: - > DataNode should filter the set of NameSpaceInfos passed to Datasets >

[jira] [Resolved] (HDFS-8392) DataNode support for multiple datasets

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-8392. - Resolution: Later We'll revisit FsDataset changes later. > DataNode support for multiple datasets

[jira] [Reopened] (HDFS-8457) Ozone: Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into parent interface

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-8457: - > Ozone: Refactor FsDatasetSpi to pull up HDFS-agnostic functionality into > parent interface >

[jira] [Reopened] (HDFS-8392) DataNode support for multiple datasets

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-8392: - > DataNode support for multiple datasets > -- > >

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-15 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195976#comment-15195976 ] Andrew Wang commented on HDFS-3702: --- Since we're just adding a flag to the existing {{create}} flags

[jira] [Updated] (HDFS-8210) Ozone: Implement storage container manager

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8210: Fix Version/s: (was: HDFS-7240) > Ozone: Implement storage container manager >

[jira] [Reopened] (HDFS-8210) Ozone: Implement storage container manager

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reopened HDFS-8210: - We've rebased the branch and this change was left out. Reopening the Jira. > Ozone: Implement storage

[jira] [Resolved] (HDFS-10170) DiskBalancer: Force rebase diskbalancer branch

2016-03-15 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDFS-10170. - Resolution: Fixed > DiskBalancer: Force rebase diskbalancer branch >

[jira] [Created] (HDFS-10170) DiskBalancer: Force rebase diskbalancer branch

2016-03-15 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-10170: --- Summary: DiskBalancer: Force rebase diskbalancer branch Key: HDFS-10170 URL: https://issues.apache.org/jira/browse/HDFS-10170 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-7648) Verify the datanode directory layout

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195908#comment-15195908 ] Colin Patrick McCabe commented on HDFS-7648: Hi [~rakesh_r], can you rebase the patch on trunk?

[jira] [Updated] (HDFS-7648) Verify that HDFS blocks are in the correct datanode directories

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7648: --- Summary: Verify that HDFS blocks are in the correct datanode directories (was: Verify

[jira] [Resolved] (HDFS-9955) DataNode won't self-heal after some block dirs were manually misplaced

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-9955. Resolution: Duplicate > DataNode won't self-heal after some block dirs were manually

[jira] [Commented] (HDFS-9951) Use string constants for XML tags in OfflineImageReconstructor

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195795#comment-15195795 ] Colin Patrick McCabe commented on HDFS-9951: Thanks for working on this. Can you put the

[jira] [Commented] (HDFS-3702) Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195791#comment-15195791 ] Arpit Agarwal commented on HDFS-3702: - Thanks [~stack], [~eddyxu]. It would be great if we can avoid

[jira] [Comment Edited] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195782#comment-15195782 ] Colin Patrick McCabe edited comment on HDFS-9668 at 3/15/16 5:48 PM: -

[jira] [Commented] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195782#comment-15195782 ] Colin Patrick McCabe commented on HDFS-9668: Hi [~jingcheng...@intel.com], Thanks again for

[jira] [Comment Edited] (HDFS-9668) Optimize the locking in FsDatasetImpl

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195782#comment-15195782 ] Colin Patrick McCabe edited comment on HDFS-9668 at 3/15/16 5:47 PM: -

[jira] [Commented] (HDFS-9579) Provide bytes-read-by-network-distance metrics at FileSystem.Statistics level

2016-03-15 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195706#comment-15195706 ] Ming Ma commented on HDFS-9579: --- Thanks [~liuml07]! Any comments from others? > Provide

[jira] [Commented] (HDFS-9895) Remove DataNode#conf because there is already a copy in the base class

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195689#comment-15195689 ] Colin Patrick McCabe commented on HDFS-9895: I think this JIRA was misleadingly titled. The

[jira] [Updated] (HDFS-9895) Remove DataNode#conf because there is already a reference to it in the base class

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9895: --- Summary: Remove DataNode#conf because there is already a reference to it in the base

[jira] [Updated] (HDFS-9931) Remove NameNode#conf because there is already a reference to it in the base class

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9931: --- Summary: Remove NameNode#conf because there is already a reference to it in the base

[jira] [Comment Edited] (HDFS-9895) Remove DataNode#conf because there is already a reference to it in the base class

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195689#comment-15195689 ] Colin Patrick McCabe edited comment on HDFS-9895 at 3/15/16 5:13 PM: - I

[jira] [Updated] (HDFS-9895) Remove DataNode#conf because there is already a copy in the base class

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9895: --- Description: Since DataNode inherits ReconfigurableBase with Configured as base class

[jira] [Updated] (HDFS-9895) Remove DataNode#conf because there is already a copy in the base class

2016-03-15 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9895: --- Summary: Remove DataNode#conf because there is already a copy in the base class (was:

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195658#comment-15195658 ] Arpit Agarwal commented on HDFS-9847: - Thank you [~linyiqun]. I don't think we need getLongTimeSeconds

[jira] [Commented] (HDFS-9904) testCheckpointCancellationDuringUpload occasionally fails

2016-03-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195578#comment-15195578 ] Hudson commented on HDFS-9904: -- FAILURE: Integrated in Hadoop-trunk-Commit #9464 (See

[jira] [Resolved] (HDFS-9904) testCheckpointCancellationDuringUpload occasionally fails

2016-03-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-9904. -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3 >

[jira] [Commented] (HDFS-9904) testCheckpointCancellationDuringUpload occasionally fails

2016-03-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195554#comment-15195554 ] Kihwal Lee commented on HDFS-9904: -- I've committed this to trunk through branch-2.7. Thanks for working on

[jira] [Updated] (HDFS-9904) testCheckpointCancellationDuringUpload occasionally fails

2016-03-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-9904: - Assignee: Lin Yiqun > testCheckpointCancellationDuringUpload occasionally fails >

[jira] [Commented] (HDFS-9904) testCheckpointCancellationDuringUpload occasionally fails

2016-03-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195531#comment-15195531 ] Kihwal Lee commented on HDFS-9904: -- +1 I've verified that the config is only set for the specific test

[jira] [Commented] (HDFS-9694) Make existing DFSClient#getFileChecksum() work for striped blocks

2016-03-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195522#comment-15195522 ] Hadoop QA commented on HDFS-9694: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9847) HDFS configuration without time unit name should accept friendly time units

2016-03-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195406#comment-15195406 ] Hadoop QA commented on HDFS-9847: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9945) Datanode command for evicting writers

2016-03-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195386#comment-15195386 ] Kihwal Lee commented on HDFS-9945: -- HDFS-2043 TestHFlush HDFS-9780 TestRollingFileSystemSinkWithSecureHdfs

[jira] [Commented] (HDFS-6532) Intermittent test failure org.apache.hadoop.hdfs.TestCrcCorruption.testCorruptionDuringWrt

2016-03-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195362#comment-15195362 ] Kihwal Lee commented on HDFS-6532: -- Still happening. {noformat}

[jira] [Created] (HDFS-10169) TestEditLog.testBatchedSyncWithClosedLogs sometimes fails.

2016-03-15 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-10169: - Summary: TestEditLog.testBatchedSyncWithClosedLogs sometimes fails. Key: HDFS-10169 URL: https://issues.apache.org/jira/browse/HDFS-10169 Project: Hadoop HDFS

[jira] [Commented] (HDFS-2043) TestHFlush failing intermittently

2016-03-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195338#comment-15195338 ] Kihwal Lee commented on HDFS-2043: -- This seems to be an actual race in the code. > TestHFlush failing

[jira] [Commented] (HDFS-2043) TestHFlush failing intermittently

2016-03-15 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195335#comment-15195335 ] Kihwal Lee commented on HDFS-2043: -- This is how it fails nowadays in precommit. {noformat}

[jira] [Commented] (HDFS-9961) Ozone: Add buckets commands to CLI

2016-03-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195302#comment-15195302 ] Hadoop QA commented on HDFS-9961: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9928) Make HDFS commands guide up to date

2016-03-15 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9928: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Target

[jira] [Commented] (HDFS-9928) Make HDFS commands guide up to date

2016-03-15 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195148#comment-15195148 ] Masatake Iwasaki commented on HDFS-9928: +1 > Make HDFS commands guide up to date >

[jira] [Commented] (HDFS-9960) OzoneHandler : Add localstorage support for keys

2016-03-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195096#comment-15195096 ] Hadoop QA commented on HDFS-9960: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9951) Use string constants for XML tags in OfflineImageReconstructor

2016-03-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195069#comment-15195069 ] Hadoop QA commented on HDFS-9951: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9694) Make existing DFSClient#getFileChecksum() work for striped blocks

2016-03-15 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9694: Attachment: HDFS-9694-v6.patch Thanks [~umamaheswararao] for the review and nice suggestions. The renaming

[jira] [Commented] (HDFS-9928) Make HDFS commands guide up to date

2016-03-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195015#comment-15195015 ] Hadoop QA commented on HDFS-9928: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Deleted] (HDFS-10167) CLONE - Erasure Coding: when recovering lost blocks, logs can be too verbose and hurt performance

2016-03-15 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B deleted HDFS-10167: - > CLONE - Erasure Coding: when recovering lost blocks, logs can be too verbose > and hurt

[jira] [Deleted] (HDFS-10130) CLONE - Erasure Coding: handle missing internal block locations in DFSStripedInputStream

2016-03-15 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B deleted HDFS-10130: - > CLONE - Erasure Coding: handle missing internal block locations in > DFSStripedInputStream >

[jira] [Deleted] (HDFS-10165) CLONE - Erasure coding: update EC command "-s" flag to "-p" when specifying policy

2016-03-15 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B deleted HDFS-10165: - > CLONE - Erasure coding: update EC command "-s" flag to "-p" when specifying > policy >

[jira] [Deleted] (HDFS-10160) CLONE - Erasure coding: fix 2 failed tests of DFSStripedOutputStream

2016-03-15 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B deleted HDFS-10160: - > CLONE - Erasure coding: fix 2 failed tests of DFSStripedOutputStream >

[jira] [Deleted] (HDFS-10139) CLONE - Erasure Coding: the number of chunks in packet is not updated when writing parity data

2016-03-15 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B deleted HDFS-10139: - > CLONE - Erasure Coding: the number of chunks in packet is not updated when > writing parity data

[jira] [Deleted] (HDFS-10147) CLONE - Erasure Coding: add test for namenode process over replicated striped block

2016-03-15 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B deleted HDFS-10147: - > CLONE - Erasure Coding: add test for namenode process over replicated striped > block >

  1   2   3   4   5   6   >