[jira] [Commented] (HDFS-10893) Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test

2016-10-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15544431#comment-15544431 ] Hadoop QA commented on HDFS-10893: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (HDFS-10884) [SPS]: Add block movement tracker to track the completion of block movement future tasks at DN

2016-10-03 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10884: Status: Patch Available (was: Open) > [SPS]: Add block movement tracker to track the completion of block

[jira] [Updated] (HDFS-10884) [SPS]: Add block movement tracker to track the completion of block movement future tasks at DN

2016-10-03 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10884: Status: Open (was: Patch Available) > [SPS]: Add block movement tracker to track the completion of block

[jira] [Updated] (HDFS-10925) Cache symlinkString in INodeSymlink

2016-10-03 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10925: - Attachment: HDFS-10925.002.patch > Cache symlinkString in INodeSymlink >

[jira] [Commented] (HDFS-10925) Cache symlinkString in INodeSymlink

2016-10-03 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15544367#comment-15544367 ] Yiqun Lin commented on HDFS-10925: -- Thanks [~daryn] for the comments. I also think the {{symlinkString}}

[jira] [Commented] (HDFS-10893) Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test

2016-10-03 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15544307#comment-15544307 ] Jitendra Nath Pandey commented on HDFS-10893: - [~liuml07], sorry for not responding earlier.

[jira] [Updated] (HDFS-10884) [SPS]: Add block movement tracker to track the completion of block movement future tasks at DN

2016-10-03 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10884: Attachment: HDFS-10884-HDFS-10285-01.patch Attaching another patch fixing findbugs and checkstyle warnings.

[jira] [Commented] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-10-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15544243#comment-15544243 ] Hadoop QA commented on HDFS-10896: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10934) TestDFSShell.testStat fails intermittently

2016-10-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15544239#comment-15544239 ] Hudson commented on HDFS-10934: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10537 (See

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

2016-10-03 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15544187#comment-15544187 ] Brahma Reddy Battula commented on HDFS-10810: - thanks for commit and review. >

[jira] [Updated] (HDFS-10893) Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test

2016-10-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10893: - Attachment: HDFS-10893-branch-2.002.patch Rebased from {{trunk}} and {{branch-2}} branches for

[jira] [Updated] (HDFS-10893) Refactor TestDFSShell by setting up MiniDFSCluser once for all commands test

2016-10-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10893: - Attachment: HDFS-10893.002.patch > Refactor TestDFSShell by setting up MiniDFSCluser once for all

[jira] [Updated] (HDFS-10934) TestDFSShell.testStat fails intermittently

2016-10-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10934: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

2016-10-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15544131#comment-15544131 ] Hudson commented on HDFS-10810: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10536 (See

[jira] [Updated] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

2016-10-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10810: - Fix Version/s: 3.0.0-alpha2 2.8.0 > Setreplication removing block from

[jira] [Updated] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

2016-10-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10810: - Component/s: namenode > Setreplication removing block from underconstrcution temporarily when

[jira] [Updated] (HDFS-10810) Setreplication removing block from underconstrcution temporarily when batch IBR is enabled.

2016-10-03 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10810: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Resolved] (HDFS-8236) Merge HDFS-8227 into EC branch

2016-10-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-8236. --- Resolution: Incomplete Since HDFS-7285 has been merged, I don't think we need this one anymore. Thanks

[jira] [Updated] (HDFS-8227) BlockCollection should return Block instead of BlockInfoContiguous in the interfaces

2016-10-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8227: -- Resolution: Incomplete Status: Resolved (was: Patch Available) Since HDFS-7285 was merged to

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-10-03 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15544058#comment-15544058 ] Yongjun Zhang commented on HDFS-9820: - Thanks a lot for your review and comments [~andrew.wang]! Good

[jira] [Commented] (HDFS-10945) Fix the Findbugwaring FSNamesystem#renameTo(String, String, boolean) in branch-2

2016-10-03 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15544001#comment-15544001 ] Brahma Reddy Battula commented on HDFS-10945: - Thanks [~kihwal] for review and commit. > Fix

[jira] [Commented] (HDFS-10629) Federation Router

2016-10-03 Thread Jason Kace (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543962#comment-15543962 ] Jason Kace commented on HDFS-10629: --- ??Should rename method do some validation to make sure src ns !=

[jira] [Commented] (HDFS-10745) Directly resolve paths into INodesInPath

2016-10-03 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543886#comment-15543886 ] Konstantin Shvachko commented on HDFS-10745: The port to 2.7 looks good. There are two more

[jira] [Commented] (HDFS-10480) Add an admin command to list currently open files

2016-10-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543881#comment-15543881 ] Andrew Wang commented on HDFS-10480: Hi Rushabh, thanks for working on this, I took a brief look at

[jira] [Updated] (HDFS-10896) Move lock logging logic from FSNamesystem into FSNamesystemLock

2016-10-03 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10896: --- Attachment: HDFS-10896-branch-2.7.004.patch Attaching branch-2.7 patch. Backport wasn't as messy as

[jira] [Updated] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-10-03 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10872: --- Status: Patch Available (was: Open) > Add MutableRate metrics for FSNamesystemLock operations >

[jira] [Updated] (HDFS-10872) Add MutableRate metrics for FSNamesystemLock operations

2016-10-03 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10872: --- Attachment: FSLockPerf.java Some comments on performance considerations... I am attaching code

[jira] [Commented] (HDFS-10939) Reduce performance penalty of encryption zones

2016-10-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543856#comment-15543856 ] Hadoop QA commented on HDFS-10939: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

2016-10-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543850#comment-15543850 ] Hudson commented on HDFS-10918: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10535 (See

[jira] [Commented] (HDFS-10627) Volume Scanner marks a block as "suspect" even if the block sender encounters 'Broken pipe' or 'Connection reset by peer' exception

2016-10-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543849#comment-15543849 ] Hadoop QA commented on HDFS-10627: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10878) TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException

2016-10-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543832#comment-15543832 ] Hadoop QA commented on HDFS-10878: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10745) Directly resolve paths into INodesInPath

2016-10-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543824#comment-15543824 ] Hadoop QA commented on HDFS-10745: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-10950) Add unit tests to verify ACLs in safemode

2016-10-03 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543723#comment-15543723 ] Chris Nauroth commented on HDFS-10950: -- Hello [~xiaobingo]. Do you think this is already covered

[jira] [Updated] (HDFS-10930) Refactor Datanode IO operations into a single class

2016-10-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10930: -- Description: Datanode IO (Disk/Network) related operations and instrumentations are currently spilled

[jira] [Commented] (HDFS-10930) Refactor Datanode IO operations into a single class

2016-10-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543709#comment-15543709 ] Xiaoyu Yao commented on HDFS-10930: --- No, the goal is not to merge all these classes above into one

[jira] [Updated] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

2016-10-03 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10918: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 2.8.0

[jira] [Updated] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-10-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9820: -- Affects Version/s: 2.6.4 Target Version/s: 2.8.0, 3.0.0-alpha2 > Improve distcp to support

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-10-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543686#comment-15543686 ] Andrew Wang commented on HDFS-9820: --- Hi Yongjun, thanks for sticking with this one. I had a few meta

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-10-03 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543660#comment-15543660 ] Konstantin Shvachko commented on HDFS-10301: Just created HDFS-10953 for removing 1-rpc BRs.

[jira] [Created] (HDFS-10953) Remove single-rpc block reports.

2016-10-03 Thread Konstantin Shvachko (JIRA)
Konstantin Shvachko created HDFS-10953: -- Summary: Remove single-rpc block reports. Key: HDFS-10953 URL: https://issues.apache.org/jira/browse/HDFS-10953 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-10931) libhdfs++: Fix object lifecycle issues in the BlockReader

2016-10-03 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543583#comment-15543583 ] James Clampffer commented on HDFS-10931: Thanks for the review Bob. bq. Code is a definite

[jira] [Commented] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-10-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543575#comment-15543575 ] Hadoop QA commented on HDFS-10558: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-10952) libhdfs++: Fix test_libhdfs_threaded_hdfspp_test_shim_static non-deterministic failures

2016-10-03 Thread James Clampffer (JIRA)
James Clampffer created HDFS-10952: -- Summary: libhdfs++: Fix test_libhdfs_threaded_hdfspp_test_shim_static non-deterministic failures Key: HDFS-10952 URL: https://issues.apache.org/jira/browse/HDFS-10952

[jira] [Commented] (HDFS-10930) Refactor Datanode IO operations into a single class

2016-10-03 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543564#comment-15543564 ] Daryn Sharp commented on HDFS-10930: I hope I'm misunderstanding this jira. Are you actually

[jira] [Commented] (HDFS-10887) Provide admin/debug tool to dump block map

2016-10-03 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543547#comment-15543547 ] Daryn Sharp commented on HDFS-10887: I think the existing datanode map +

[jira] [Commented] (HDFS-10878) TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException

2016-10-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543545#comment-15543545 ] Hadoop QA commented on HDFS-10878: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-10951) libhdfs++: FileHandle should handle DN failure internally

2016-10-03 Thread James Clampffer (JIRA)
James Clampffer created HDFS-10951: -- Summary: libhdfs++: FileHandle should handle DN failure internally Key: HDFS-10951 URL: https://issues.apache.org/jira/browse/HDFS-10951 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10627) Volume Scanner mark a block as "suspect" even if the block sender encounters 'Broken pipe' or 'Connection reset by peer' exception

2016-10-03 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543532#comment-15543532 ] Daryn Sharp commented on HDFS-10627: +1 Will check in tomorrow afternoon unless there are further

[jira] [Updated] (HDFS-10627) Volume Scanner marks a block as "suspect" even if the block sender encounters 'Broken pipe' or 'Connection reset by peer' exception

2016-10-03 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10627: -- Summary: Volume Scanner marks a block as "suspect" even if the block sender encounters 'Broken

[jira] [Commented] (HDFS-10714) Issue in handling checksum errors in write pipeline when fault DN is LAST_IN_PIPELINE

2016-10-03 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543529#comment-15543529 ] Yongjun Zhang commented on HDFS-10714: -- Hi [~vinayrpet], Thanks for your work here and sorry for the

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-10-03 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543509#comment-15543509 ] Daryn Sharp commented on HDFS-10301: Regarding removing single-rpcs, I'm ok with doing it on another

[jira] [Commented] (HDFS-10946) basic hadoop commands should not hang irrespective of any cluster issue

2016-10-03 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543495#comment-15543495 ] Kihwal Lee commented on HDFS-10946: --- It should. I think the default rpc timeout is 60 seconds. > basic

[jira] [Comment Edited] (HDFS-10629) Federation Router

2016-10-03 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543484#comment-15543484 ] Ming Ma edited comment on HDFS-10629 at 10/3/16 9:33 PM: - Thanks [~jakace] for the

[jira] [Comment Edited] (HDFS-10629) Federation Router

2016-10-03 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543484#comment-15543484 ] Ming Ma edited comment on HDFS-10629 at 10/3/16 9:31 PM: - Thanks [~jakace] for the

[jira] [Commented] (HDFS-10629) Federation Router

2016-10-03 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543484#comment-15543484 ] Ming Ma commented on HDFS-10629: Thanks [~jakace] for the explanation and new patch. bq. The status

[jira] [Comment Edited] (HDFS-10629) Federation Router

2016-10-03 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543484#comment-15543484 ] Ming Ma edited comment on HDFS-10629 at 10/3/16 9:29 PM: - Thanks [~jakace] for the

[jira] [Updated] (HDFS-10939) Reduce performance penalty of encryption zones

2016-10-03 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-10939: --- Attachment: HDFS-10939.1.patch Updated due to conflict with getfileinfo changes. Updated tests to

[jira] [Updated] (HDFS-10948) HDFS setOwner no-op should not generate an edit log transaction

2016-10-03 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10948: -- Attachment: testNullUserNullGroup.patch Thanks for reporting the issue, [~Karthik Palaniappan]. Did you

[jira] [Assigned] (HDFS-10948) HDFS setOwner no-op should not generate an edit log transaction

2016-10-03 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HDFS-10948: - Assignee: John Zhuge > HDFS setOwner no-op should not generate an edit log transaction >

[jira] [Commented] (HDFS-10898) libhdfs++: Make logs more informative and consistent

2016-10-03 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543417#comment-15543417 ] Bob Hansen commented on HDFS-10898: --- What would you think of keeping SEEK and READ at the TRACE level

[jira] [Updated] (HDFS-10950) Add unit tests to verify ACLs in safemode

2016-10-03 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10950: - Description: This proposes adding unit tests to validate that getting Acls works when namende is

[jira] [Commented] (HDFS-7642) NameNode should periodically log DataNode decommissioning progress

2016-10-03 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543411#comment-15543411 ] Andrew Wang commented on HDFS-7642: --- Thanks for working on this Sean, one meta comment and then some

[jira] [Updated] (HDFS-10950) Add unit tests to verify ACLs in safemode

2016-10-03 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10950: - Component/s: fs > Add unit tests to verify ACLs in safemode >

[jira] [Created] (HDFS-10950) Add unit tests to verify ACLs in safemode

2016-10-03 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-10950: Summary: Add unit tests to verify ACLs in safemode Key: HDFS-10950 URL: https://issues.apache.org/jira/browse/HDFS-10950 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-10931) libhdfs++: Fix object lifecycle issues in the BlockReader

2016-10-03 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543401#comment-15543401 ] Bob Hansen commented on HDFS-10931: --- Code is a definite improvement. I am very uncomfortable with

[jira] [Updated] (HDFS-10745) Directly resolve paths into INodesInPath

2016-10-03 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10745: - Attachment: HDFS-10745-branch-2.7.04.patch Verified that all reported test failures in v3 branch-2.7

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-10-03 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543394#comment-15543394 ] Yongjun Zhang commented on HDFS-9820: - Copied from

[jira] [Commented] (HDFS-9820) Improve distcp to support efficient restore to an earlier snapshot

2016-10-03 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543389#comment-15543389 ] Yongjun Zhang commented on HDFS-9820: - Copied from

[jira] [Commented] (HDFS-10884) [SPS]: Add block movement tracker to track the completion of block movement future tasks at DN

2016-10-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543388#comment-15543388 ] Hadoop QA commented on HDFS-10884: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-10314) A new tool to sync current HDFS view to specified snapshot

2016-10-03 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248778#comment-15248778 ] Yongjun Zhang edited comment on HDFS-10314 at 10/3/16 8:43 PM: --- The idea is

[jira] [Commented] (HDFS-10789) Route webhdfs through the RPC call queue

2016-10-03 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543312#comment-15543312 ] Kihwal Lee commented on HDFS-10789: --- The RPC ACL controls at protocol level, bit it looks like what you

[jira] [Commented] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-10-03 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543309#comment-15543309 ] Xiaobing Zhou commented on HDFS-10558: -- Thanks [~anu]. I re-submitted v001 patch with shortened name.

[jira] [Updated] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-10-03 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10558: - Attachment: (was: HDFS-10558-HDFS-10576.001.patch) > DiskBalancer: Print the full path to

[jira] [Updated] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-10-03 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10558: - Attachment: HDFS-10558.001.patch > DiskBalancer: Print the full path to plan file >

[jira] [Updated] (HDFS-10949) DiskBalancer: deprecate TestDiskBalancer#setVolumeCapacity

2016-10-03 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10949: - Description: HDFS-10824 fixed amnesia of capacity setting of MiniDFSCluster, there's no reason

[jira] [Updated] (HDFS-10878) TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException

2016-10-03 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10878: -- Status: Patch Available (was: Open) > TestDFSClientRetries#testIdempotentAllocateBlockAndClose

[jira] [Updated] (HDFS-10878) TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException

2016-10-03 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10878: -- Attachment: HDFS-10878-1.patch > TestDFSClientRetries#testIdempotentAllocateBlockAndClose

[jira] [Updated] (HDFS-10878) TestDFSClientRetries#testIdempotentAllocateBlockAndClose throws ConcurrentModificationException

2016-10-03 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10878: -- Status: Open (was: Patch Available) Need to address checkstyle warning. >

[jira] [Updated] (HDFS-10949) DiskBalancer: deprecate TestDiskBalancer#setVolumeCapacity

2016-10-03 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10949: - Description: HDFS-10824 fixed amnesia of capacity setting of MiniDFSCluster, it's easy to create

[jira] [Updated] (HDFS-10949) DiskBalancer: deprecate TestDiskBalancer#setVolumeCapacity

2016-10-03 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10949: - Priority: Minor (was: Major) > DiskBalancer: deprecate TestDiskBalancer#setVolumeCapacity >

[jira] [Updated] (HDFS-10949) DiskBalancer: deprecate TestDiskBalancer#setVolumeCapacity

2016-10-03 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10949: - Fix Version/s: (was: 2.9.0) > DiskBalancer: deprecate TestDiskBalancer#setVolumeCapacity >

[jira] [Created] (HDFS-10949) DiskBalancer: deprecate TestDiskBalancer#setVolumeCapacity

2016-10-03 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-10949: Summary: DiskBalancer: deprecate TestDiskBalancer#setVolumeCapacity Key: HDFS-10949 URL: https://issues.apache.org/jira/browse/HDFS-10949 Project: Hadoop HDFS

[jira] [Commented] (HDFS-10789) Route webhdfs through the RPC call queue

2016-10-03 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543295#comment-15543295 ] Daryn Sharp commented on HDFS-10789: The ACL authorization is currently only checked when processing

[jira] [Commented] (HDFS-10943) rollEditLog expects empty EditsDoubleBuffer.bufCurrent which is not guaranteed

2016-10-03 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543293#comment-15543293 ] Yongjun Zhang commented on HDFS-10943: -- Thanks a lot [~kihwal]! About {quote} That's why it

[jira] [Commented] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-10-03 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543284#comment-15543284 ] Anu Engineer commented on HDFS-10558: - [~xiaobingo] Thanks for updating the patch. I will take a look

[jira] [Updated] (HDFS-7642) NameNode should periodically log DataNode decommissioning progress

2016-10-03 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HDFS-7642: Attachment: HDFS-7642.001.patch Attaching an initial implementation. I'm wondering if hostname is

[jira] [Commented] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-10-03 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543277#comment-15543277 ] Xiaobing Zhou commented on HDFS-10558: -- The patch v001 is posted. With support of HDFS-10824, it's

[jira] [Updated] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-10-03 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10558: - Attachment: HDFS-10558-HDFS-10576.001.patch > DiskBalancer: Print the full path to plan file >

[jira] [Updated] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-10-03 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10558: - Attachment: (was: HDFS-10558-HDFS-10576.001.patch) > DiskBalancer: Print the full path to

[jira] [Commented] (HDFS-10789) Route webhdfs through the RPC call queue

2016-10-03 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543257#comment-15543257 ] Zhe Zhang commented on HDFS-10789: -- Thanks much for working on this [~daryn] [~kihwal] and [~shahrs87].

[jira] [Updated] (HDFS-10558) DiskBalancer: Print the full path to plan file

2016-10-03 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10558: - Attachment: HDFS-10558-HDFS-10576.001.patch > DiskBalancer: Print the full path to plan file >

[jira] [Updated] (HDFS-10789) Route webhdfs through the RPC call queue

2016-10-03 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10789: -- Attachment: HDFS-10789-1.patch Attaching rebased patch. > Route webhdfs through the RPC call

[jira] [Updated] (HDFS-10789) Route webhdfs through the RPC call queue

2016-10-03 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-10789: -- Status: Patch Available (was: Open) > Route webhdfs through the RPC call queue >

[jira] [Commented] (HDFS-10944) Change javadoc "Allow Snapshot " to " DisAllow Snapshot" for disallowSnapshot function

2016-10-03 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543182#comment-15543182 ] Jagadesh Kiran N commented on HDFS-10944: - Failures are not related to Patch, please review >

[jira] [Comment Edited] (HDFS-10944) Change javadoc "Allow Snapshot " to " DisAllow Snapshot" for disallowSnapshot function

2016-10-03 Thread Jagadesh Kiran N (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543182#comment-15543182 ] Jagadesh Kiran N edited comment on HDFS-10944 at 10/3/16 7:25 PM: -- Unit

[jira] [Commented] (HDFS-9337) Should check required params in WebHDFS to avoid NPE

2016-10-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543172#comment-15543172 ] Hadoop QA commented on HDFS-9337: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-10884) [SPS]: Add block movement tracker to track the completion of block movement future tasks at DN

2016-10-03 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10884: Affects Version/s: HDFS-10285 Status: Patch Available (was: Open) > [SPS]: Add block

[jira] [Updated] (HDFS-10884) [SPS]: Add block movement tracker to track the completion of block movement future tasks at DN

2016-10-03 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-10884: Attachment: HDFS-10884-HDFS-10285-00.patch Attached patch to track the block movements asynchronously via

[jira] [Commented] (HDFS-10429) DataStreamer interrupted warning always appears when using CLI upload file

2016-10-03 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543091#comment-15543091 ] Zhiyuan Yang commented on HDFS-10429: - Sorry for holding this too long...Will do it later today.

[jira] [Commented] (HDFS-10690) Optimize insertion/removal of replica in ShortCircuitCache

2016-10-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543081#comment-15543081 ] Hudson commented on HDFS-10690: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10533 (See

  1   2   >