[jira] [Commented] (HDFS-8902) Uses ByteBuffer on heap or direct ByteBuffer according to used erasure coder in striping read (position and stateful)

2015-12-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041262#comment-15041262 ] Kai Zheng commented on HDFS-8902: - The task will be covered in HDFS-8668 and HDFS-8901. > Uses ByteBuffer

[jira] [Resolved] (HDFS-8902) Uses ByteBuffer on heap or direct ByteBuffer according to used erasure coder in striping read (position and stateful)

2015-12-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng resolved HDFS-8902. - Resolution: Duplicate > Uses ByteBuffer on heap or direct ByteBuffer according to used erasure coder > in

[jira] [Commented] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

2015-12-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041242#comment-15041242 ] Hadoop QA commented on HDFS-8905: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

2015-12-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8668: Status: Patch Available (was: Open) > Erasure Coding: revisit buffer used for encoding and decoding. >

[jira] [Updated] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

2015-12-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8668: Attachment: HDFS-8668-v1.patch Uploaded a patch to use appropriate bytebuffer according to used erasure

[jira] [Commented] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

2015-12-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041273#comment-15041273 ] Kai Zheng commented on HDFS-8905: - Hi [~zhz], the updated patch hopefully addressed your ideas. The above

[jira] [Resolved] (HDFS-8903) Uses ByteBuffer on heap or direct ByteBuffer according to used erasure coder in striping write

2015-12-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng resolved HDFS-8903. - Resolution: Duplicate > Uses ByteBuffer on heap or direct ByteBuffer according to used erasure coder > in

[jira] [Resolved] (HDFS-8904) Uses ByteBuffer on heap or direct ByteBuffer according to used erasure coder in striping recovery on DataNode side

2015-12-04 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng resolved HDFS-8904. - Resolution: Duplicate > Uses ByteBuffer on heap or direct ByteBuffer according to used erasure coder > in

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-12-04 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041403#comment-15041403 ] Vinayakumar B commented on HDFS-8647: - bq. Hi Brahma Reddy Battula, does this mean we have a change of

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-12-04 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041510#comment-15041510 ] Brahma Reddy Battula commented on HDFS-8647: Yes, Tested on the latest code. auto replication

[jira] [Resolved] (HDFS-9127) Re-replication for files with enough replicas in single rack

2015-12-04 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B resolved HDFS-9127. - Resolution: Invalid This problem doesnt exist on latest code. Feel free to re-open if found again.

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

2015-12-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041464#comment-15041464 ] Hadoop QA commented on HDFS-8901: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9501) TestBalancer#testBalancerWithPinnedBlocks fails in branch-2.7

2015-12-04 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9501: --- Resolution: Implemented Status: Resolved (was: Patch Available) Closing as

[jira] [Commented] (HDFS-9472) concat() API does not resolve the .reserved path

2015-12-04 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041433#comment-15041433 ] Rakesh R commented on HDFS-9472: Thanks [~umamaheswararao] for the suggestions. If this is designed

[jira] [Commented] (HDFS-8668) Erasure Coding: revisit buffer used for encoding and decoding.

2015-12-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041523#comment-15041523 ] Hadoop QA commented on HDFS-8668: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9214) Reconfigure DN concurrent move on the fly

2015-12-04 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9214: Attachment: HDFS-9214.005.patch > Reconfigure DN concurrent move on the fly >

[jira] [Commented] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-12-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041850#comment-15041850 ] Zhe Zhang commented on HDFS-9314: - Thanks Xiao! +1 on the 2.7 and 2.6 patches. I just committed them. >

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-04 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041799#comment-15041799 ] Joep Rottinghuis commented on HDFS-8578: Wrt. catching InterruptedException, even though the newer

[jira] [Updated] (HDFS-9430) Remove waitForLoadingFSImage since checkNNStartup has ensured image loaded and namenode started.

2015-12-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9430: -- Summary: Remove waitForLoadingFSImage since checkNNStartup has ensured image loaded and namenode started. (was:

[jira] [Updated] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-12-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9314: Fix Version/s: 2.6.4 2.7.3 > Improve BlockPlacementPolicyDefault's picking of excess

[jira] [Commented] (HDFS-9214) Reconfigure DN concurrent move on the fly

2015-12-04 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041852#comment-15041852 ] Xiaobing Zhou commented on HDFS-9214: - V005 fixed this one. It fails because one more DataNode

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

2015-12-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041856#comment-15041856 ] Arpit Agarwal commented on HDFS-8647: - Thanks for confirming that [~vinayrpet] and [~brahmareddy]. >

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-04 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041792#comment-15041792 ] Joep Rottinghuis commented on HDFS-8578: If I read the patch correctly the parallelism will be the

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-04 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15041804#comment-15041804 ] Joep Rottinghuis commented on HDFS-8578: Or in this case perhaps yield and break out of the for

[jira] [Updated] (HDFS-9430) waitForLoadingFSImage can be removed since checkNNStartup already ensures image loaded and namenode started.

2015-12-04 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-9430: -- Summary: waitForLoadingFSImage can be removed since checkNNStartup already ensures image loaded and namenode

[jira] [Updated] (HDFS-7651) [ NN Bench ] Refactor nnbench as a Tool implementation.

2015-12-04 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-7651: --- Summary: [ NN Bench ] Refactor nnbench as a Tool implementation. (was: [ NN Bench ]

[jira] [Commented] (HDFS-9214) Reconfigure DN concurrent move on the fly

2015-12-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042201#comment-15042201 ] Hadoop QA commented on HDFS-9214: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042236#comment-15042236 ] Hadoop QA commented on HDFS-8578: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9430) Remove waitForLoadingFSImage since checkNNStartup has ensured image loaded and namenode started.

2015-12-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042288#comment-15042288 ] Hudson commented on HDFS-9430: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #665 (See

[jira] [Commented] (HDFS-9490) MiniDFSCluster should change block generation stamp via FsDatasetTestUtils

2015-12-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042289#comment-15042289 ] Hudson commented on HDFS-9490: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #665 (See

[jira] [Commented] (HDFS-9267) TestDiskError should get stored replicas through FsDatasetTestUtils.

2015-12-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042292#comment-15042292 ] Hudson commented on HDFS-9267: -- FAILURE: Integrated in Hadoop-trunk-Commit #8923 (See

[jira] [Commented] (HDFS-9469) DiskBalancer : Add Planner

2015-12-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042286#comment-15042286 ] Hadoop QA commented on HDFS-9469: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9228) libhdfs++ should respect NN retry configuration settings

2015-12-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042342#comment-15042342 ] Hadoop QA commented on HDFS-9228: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9491) Tests should get the number of pending async delets via FsDatasetTestUtils

2015-12-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042344#comment-15042344 ] Hadoop QA commented on HDFS-9491: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

2015-12-04 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042081#comment-15042081 ] Vinayakumar B commented on HDFS-8578: - bq. One big spot where I see the memory footprint potentially

[jira] [Resolved] (HDFS-4488) Confusing WebHDFS exception when host doesn't resolve

2015-12-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-4488. --- Resolution: Cannot Reproduce Target Version/s: 2.1.0-beta, 3.0.0 (was:

[jira] [Resolved] (HDFS-2593) Rename webhdfs HTTP param 'delegation' to 'delegationtoken'

2015-12-04 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-2593. --- Resolution: Not A Problem Resolving this stale issue as Not A Problem. > Rename

[jira] [Updated] (HDFS-9486) libhdfs++ Fix valgrind failures when using more than 1 io_service worker thread.

2015-12-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9486: -- Summary: libhdfs++ Fix valgrind failures when using more than 1 io_service worker thread. (was:

[jira] [Updated] (HDFS-9486) libhdfs++ Fix valgrind failures when using more than 1 io_service worker thread.

2015-12-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9486: -- Attachment: HDFS-9486.HDFS-8707.001.patch Thanks for the review [~bobthansen]. Added new patch;

[jira] [Commented] (HDFS-9448) Enable valgrind for libhdfspp unit tests

2015-12-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042279#comment-15042279 ] Allen Wittenauer commented on HDFS-9448: So yeah, looking closer at this, I think we should

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

2015-12-04 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042332#comment-15042332 ] Vinod Kumar Vavilapalli commented on HDFS-8791: --- Setting tentative target-versions 2.8.0,

[jira] [Commented] (HDFS-9486) libhdfs++ Fix valgrind failures when using more than 1 io_service worker thread.

2015-12-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042340#comment-15042340 ] Hadoop QA commented on HDFS-9486: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9228) libhdfs++ should respect NN retry configuration settings

2015-12-04 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9228: - Attachment: HDFS-9228.HDFS-8707.011.patch New patch: rebased on HDFS-8707 head > libhdfs++ should respect

[jira] [Updated] (HDFS-9508) Fix NPE in MiniKMS.start()

2015-12-04 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9508: -- Description: Sometimes, KMS resource file can not be loaded. When this happens, an InputStream

[jira] [Commented] (HDFS-9214) Support reconfiguring dfs.datanode.balance.max.concurrent.moves without DN restart

2015-12-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042413#comment-15042413 ] Chris Nauroth commented on HDFS-9214: - There is a license warning on the new

[jira] [Updated] (HDFS-9486) Valgrind failures when using more than 1 io_service worker thread.

2015-12-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9486: -- Attachment: HDFS-9486.HDFS-8707.000.patch Attached patch. The issue here was stale code meant

[jira] [Updated] (HDFS-9486) Valgrind failures when using more than 1 io_service worker thread.

2015-12-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9486: -- Status: Patch Available (was: Open) > Valgrind failures when using more than 1 io_service

[jira] [Updated] (HDFS-9417) Clean up the RAT warnings in the HDFS-8707 branch.

2015-12-04 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9417: - Attachment: HDFS-9417.HDFS-8707.004.patch New patch: cleans up refactoring of inputstream.cc > Clean up

[jira] [Commented] (HDFS-9267) TestDiskError should get stored replicas through FsDatasetTestUtils.

2015-12-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042211#comment-15042211 ] Colin Patrick McCabe commented on HDFS-9267: +1. Thanks, [~eddyxu]. > TestDiskError should

[jira] [Commented] (HDFS-9486) libhdfs++ Fix valgrind failures when using more than 1 io_service worker thread.

2015-12-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042265#comment-15042265 ] Hadoop QA commented on HDFS-9486: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

2015-12-04 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-8791: -- Target Version/s: 2.8.0, 2.7.3, 2.6.3 (was: 2.6.3) > block ID-based DN storage

[jira] [Comment Edited] (HDFS-9214) Support reconfiguring dfs.datanode.balance.max.concurrent.moves without DN restart

2015-12-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042369#comment-15042369 ] Arpit Agarwal edited comment on HDFS-9214 at 12/4/15 10:49 PM: --- I've

[jira] [Commented] (HDFS-9486) Valgrind failures when using more than 1 io_service worker thread.

2015-12-04 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042169#comment-15042169 ] Bob Hansen commented on HDFS-9486: -- Good catch, and a good place for comments. There's a typo in the

[jira] [Commented] (HDFS-8831) Trash Support for deletion in HDFS encryption zone

2015-12-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042290#comment-15042290 ] Hudson commented on HDFS-8831: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #665 (See

[jira] [Commented] (HDFS-9233) Create LICENSE.txt and NOTICES files for libhdfs++

2015-12-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042295#comment-15042295 ] Allen Wittenauer commented on HDFS-9233: The license and notice information should be added to the

[jira] [Commented] (HDFS-9474) TestPipelinesFailover should not fail when printing debug message

2015-12-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042356#comment-15042356 ] Hudson commented on HDFS-9474: -- FAILURE: Integrated in Hadoop-trunk-Commit #8924 (See

[jira] [Commented] (HDFS-8901) Use ByteBuffer in striping positional read

2015-12-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042377#comment-15042377 ] Zhe Zhang commented on HDFS-8901: - Some EC related test failures look possibly related to the change, like

[jira] [Updated] (HDFS-9448) Enable valgrind for libhdfspp unit tests

2015-12-04 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9448: - Attachment: HDFS-9448.HDFS-8707.003.patch [~aw] - Thanks for your feedback. {quote} a) by default, it

[jira] [Commented] (HDFS-9414) Refactor reconfiguration of ClientDatanodeProtocol for reusability

2015-12-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042393#comment-15042393 ] Hadoop QA commented on HDFS-9414: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9508) Fix NPE in MiniKMS.start()

2015-12-04 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9508: -- Component/s: test > Fix NPE in MiniKMS.start() > -- > >

[jira] [Created] (HDFS-9508) Fix NPE in MiniKMS.start()

2015-12-04 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-9508: - Summary: Fix NPE in MiniKMS.start() Key: HDFS-9508 URL: https://issues.apache.org/jira/browse/HDFS-9508 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-9267) TestDiskError should get stored replicas through FsDatasetTestUtils.

2015-12-04 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9267: --- Resolution: Fixed Fix Version/s: 2.9.0 Target Version/s: 3.0.0, 2.9.0

[jira] [Commented] (HDFS-9465) No header files in mvn package

2015-12-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042261#comment-15042261 ] Allen Wittenauer commented on HDFS-9465: IIRC, I built on OS X after hacking the hell out of the

[jira] [Updated] (HDFS-9474) TestPipelinesFailover should not fail when printing debug message

2015-12-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9474: Summary: TestPipelinesFailover should not fail when printing debug message (was:

[jira] [Resolved] (HDFS-9508) Fix NPE in MiniKMS.start()

2015-12-04 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-9508. --- Resolution: Invalid This should be filed under Hadoop Commons > Fix NPE in MiniKMS.start() >

[jira] [Comment Edited] (HDFS-9262) Reconfigure DN lazy writer interval on the fly

2015-12-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042347#comment-15042347 ] Arpit Agarwal edited comment on HDFS-9262 at 12/4/15 10:35 PM: --- Hi

[jira] [Commented] (HDFS-9483) Documentation does not cover use of "swebhdfs" as URL scheme for SSL-secured WebHDFS.

2015-12-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042164#comment-15042164 ] Hadoop QA commented on HDFS-9483: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9504) libhdfs++ Initialize BadNodeTracker in FileSystemImpl constructor

2015-12-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9504: -- Resolution: Fixed Status: Resolved (was: Patch Available) > libhdfs++ Initialize

[jira] [Commented] (HDFS-9504) libhdfs++ Initialize BadNodeTracker in FileSystemImpl constructor

2015-12-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042199#comment-15042199 ] James Clampffer commented on HDFS-9504: --- Thanks for the review Bob, I've committed this to HDFS-8707.

[jira] [Commented] (HDFS-9464) Documentation needs to be exposed

2015-12-04 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042253#comment-15042253 ] Allen Wittenauer commented on HDFS-9464: hadoop-project/src/site/site.xml generates the index.html

[jira] [Updated] (HDFS-9474) TestPipelinesFailover should not fail when printing debug message

2015-12-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9474: Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-9262) Reconfigure DN lazy writer interval on the fly

2015-12-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042347#comment-15042347 ] Arpit Agarwal commented on HDFS-9262: - Hi [~xiaobingo], we already have a cross-cast to Reconfigurable.

[jira] [Commented] (HDFS-9417) Clean up the RAT warnings in the HDFS-8707 branch.

2015-12-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042345#comment-15042345 ] Hadoop QA commented on HDFS-9417: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9486) libhdfs++ Fix valgrind failures when using more than 1 io_service worker thread.

2015-12-04 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042348#comment-15042348 ] Bob Hansen commented on HDFS-9486: -- Hm. Still failing the unit test on Apache's servers. Do they pass on

[jira] [Updated] (HDFS-9214) Support reconfiguring dfs.datanode.balance.max.concurrent.moves without DN restart

2015-12-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9214: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Updated] (HDFS-9214) Support reconfiguring dfs.datanode.balance.max.concurrent.moves without DN restart

2015-12-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-9214: Summary: Support reconfiguring dfs.datanode.balance.max.concurrent.moves without DN restart (was:

[jira] [Commented] (HDFS-9214) Support reconfiguring dfs.datanode.balance.max.concurrent.moves without DN restart

2015-12-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042415#comment-15042415 ] Hudson commented on HDFS-9214: -- FAILURE: Integrated in Hadoop-trunk-Commit #8925 (See

[jira] [Commented] (HDFS-9214) Support reconfiguring dfs.datanode.balance.max.concurrent.moves without DN restart

2015-12-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042421#comment-15042421 ] Arpit Agarwal commented on HDFS-9214: - Thanks for the catch Chris. Pushed commits to add the missing

[jira] [Commented] (HDFS-9262) Reconfigure DN lazy writer interval on the fly

2015-12-04 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042471#comment-15042471 ] Xiaobing Zhou commented on HDFS-9262: - Thanks [~arpitagarwal] for review. 1. It's not possible cast

[jira] [Commented] (HDFS-9414) Refactor reconfiguration of ClientDatanodeProtocol for reusability

2015-12-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042473#comment-15042473 ] Arpit Agarwal commented on HDFS-9414: - +1 for the v002 patch pending Jenkins. > Refactor

[jira] [Commented] (HDFS-9267) TestDiskError should get stored replicas through FsDatasetTestUtils.

2015-12-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042479#comment-15042479 ] Hudson commented on HDFS-9267: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #666 (See

[jira] [Commented] (HDFS-9474) TestPipelinesFailover should not fail when printing debug message

2015-12-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042478#comment-15042478 ] Hudson commented on HDFS-9474: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #666 (See

[jira] [Commented] (HDFS-9373) Show friendly information to user when client succeeds the writing with some failed streamers

2015-12-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042483#comment-15042483 ] Zhe Zhang commented on HDFS-9373: - Thanks Bo for the work. Patch LGTM overall. Submitting patch to trigger

[jira] [Commented] (HDFS-9262) Reconfigure DN lazy writer interval on the fly

2015-12-04 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042484#comment-15042484 ] Xiaobing Zhou commented on HDFS-9262: - Sorry, copy-paste error, I mean ExternalDatasetImpl and

[jira] [Commented] (HDFS-9262) Reconfigure DN lazy writer interval on the fly

2015-12-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042485#comment-15042485 ] Arpit Agarwal commented on HDFS-9262: - Thanks for checking. Then let's go with the second option to

[jira] [Comment Edited] (HDFS-9262) Reconfigure DN lazy writer interval on the fly

2015-12-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042485#comment-15042485 ] Arpit Agarwal edited comment on HDFS-9262 at 12/5/15 12:38 AM: --- Thanks for

[jira] [Commented] (HDFS-9214) Support reconfiguring dfs.datanode.balance.max.concurrent.moves without DN restart

2015-12-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042424#comment-15042424 ] Chris Nauroth commented on HDFS-9214: - Thank you, Arpit. > Support reconfiguring

[jira] [Commented] (HDFS-9491) Tests should get the number of pending async delets via FsDatasetTestUtils

2015-12-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042432#comment-15042432 ] Lei (Eddy) Xu commented on HDFS-9491: - Hi, Tony {{TestDecommission}} failed on JDK 8, could you help

[jira] [Commented] (HDFS-9414) Refactor reconfiguration of ClientDatanodeProtocol for reusability

2015-12-04 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042444#comment-15042444 ] Arpit Agarwal commented on HDFS-9414: - [~xiaobingo] thanks for the v002 patch. I believe this will not

[jira] [Commented] (HDFS-9448) Enable valgrind for libhdfspp unit tests

2015-12-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042491#comment-15042491 ] Hadoop QA commented on HDFS-9448: - (!) A patch to the testing environment has been detected. Re-executing

[jira] [Assigned] (HDFS-9450) Fix failing HDFS tests on HDFS-7240 Ozone branch.

2015-12-04 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reassigned HDFS-9450: --- Assignee: Xiaobing Zhou > Fix failing HDFS tests on HDFS-7240 Ozone branch. >

[jira] [Commented] (HDFS-9491) Tests should get the number of pending async delets via FsDatasetTestUtils

2015-12-04 Thread Tony Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042448#comment-15042448 ] Tony Wu commented on HDFS-9491: --- Hi [~eddyxu], I just ran {{TestDecommission}} with the patch with JDK 8 on

[jira] [Updated] (HDFS-9414) Refactor reconfiguration of ClientDatanodeProtocol for reusability

2015-12-04 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9414: Attachment: HDFS-9414.003.patch V003 fixed a couple of check-style issues. > Refactor

[jira] [Created] (HDFS-9509) Add new metrics for measuring datanode storage statistics

2015-12-04 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-9509: - Summary: Add new metrics for measuring datanode storage statistics Key: HDFS-9509 URL: https://issues.apache.org/jira/browse/HDFS-9509 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9281) Change TestDeleteBlockPool to not explicitly use File to check block pool existence.

2015-12-04 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9281: Attachment: HDFS-9281.02.patch Update the patch after HDFS-9267 being checked in. > Change

[jira] [Commented] (HDFS-9173) Erasure Coding: Lease recovery for striped file

2015-12-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042477#comment-15042477 ] Zhe Zhang commented on HDFS-9173: - The patch looks pretty good. More detailed review will follow after a

[jira] [Updated] (HDFS-9373) Show friendly information to user when client succeeds the writing with some failed streamers

2015-12-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9373: Affects Version/s: 3.0.0 > Show friendly information to user when client succeeds the writing with some >

[jira] [Updated] (HDFS-9373) Show friendly information to user when client succeeds the writing with some failed streamers

2015-12-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9373: Target Version/s: 3.0.0 > Show friendly information to user when client succeeds the writing with some >

[jira] [Updated] (HDFS-9373) Show friendly information to user when client succeeds the writing with some failed streamers

2015-12-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9373: Component/s: erasure-coding > Show friendly information to user when client succeeds the writing with some

[jira] [Updated] (HDFS-9373) Show friendly information to user when client succeeds the writing with some failed streamers

2015-12-04 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9373: Status: Patch Available (was: Open) > Show friendly information to user when client succeeds the writing

  1   2   >