[jira] [Commented] (HDFS-10370) Allow DataNode to be started with numactl

2016-05-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15297215#comment-15297215 ] John Zhuge commented on HDFS-10370: --- Could you elaborate a bit more the use cases? If w

[jira] [Commented] (HDFS-10370) Allow DataNode to be started with numactl

2016-05-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15297074#comment-15297074 ] John Zhuge commented on HDFS-10370: --- Thanks [~dlmarion] for working on the issue. Could

[jira] [Commented] (HDFS-7374) Allow decommissioning of dead DataNodes

2016-05-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15296755#comment-15296755 ] John Zhuge commented on HDFS-7374: -- {color:red}WARNING{color}: as already pointed out by [

[jira] [Commented] (HDFS-7373) Clean up temporary files after fsimage transfer failures

2016-05-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15296750#comment-15296750 ] John Zhuge commented on HDFS-7373: -- {color:red}WARNING{color}: due to a typo in HDFS-7374

[jira] [Commented] (HDFS-10439) Update setOwner doc in HdfsPermissionsGuide

2016-05-22 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15295919#comment-15295919 ] John Zhuge commented on HDFS-10439: --- Thanks [~iwasakims]. > Update setOwner doc in Hdfs

[jira] [Updated] (HDFS-10378) FSDirAttrOp#setOwner throws AccessControlException with wrong message

2016-05-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10378: -- Attachment: HDFS-10378.002.patch Patch 002: * Fix {{setOwner}} permission checking code * Enhance unit t

[jira] [Comment Edited] (HDFS-10439) Update setOwner doc in HdfsPermissionsGuide

2016-05-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15293484#comment-15293484 ] John Zhuge edited comment on HDFS-10439 at 5/20/16 2:58 PM: Pa

[jira] [Updated] (HDFS-10439) Update setOwner doc in HdfsPermissionsGuide

2016-05-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10439: -- Attachment: HDFS-10439.001.patch Patch 001: * Update setOwner documentation regarding changing the group

[jira] [Commented] (HDFS-10378) FSDirAttrOp#setOwner throws AccessControlException with wrong message

2016-05-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15292746#comment-15292746 ] John Zhuge commented on HDFS-10378: --- [~yzhangal] According to {{HdfsPermissionsGuide}}:

[jira] [Created] (HDFS-10439) Update setOwner doc in HdfsPermissionsGuide

2016-05-19 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10439: - Summary: Update setOwner doc in HdfsPermissionsGuide Key: HDFS-10439 URL: https://issues.apache.org/jira/browse/HDFS-10439 Project: Hadoop HDFS Issue Type: Bug

[jira] [Work stopped] (HDFS-9913) DispCp doesn't use Trash with -delete option

2016-05-19 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-9913 stopped by John Zhuge. > DispCp doesn't use Trash with -delete option > -

[jira] [Updated] (HDFS-10381) DataStreamer DataNode exclusion log message should be warning

2016-05-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10381: -- Labels: supportability (was: ) > DataStreamer DataNode exclusion log message should be warning > --

[jira] [Commented] (HDFS-10381) DataStreamer DataNode exclusion log message should be warning

2016-05-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15287910#comment-15287910 ] John Zhuge commented on HDFS-10381: --- Thanks [~liuml07], [~jojochuang], [~jingzhao], and

[jira] [Commented] (HDFS-10410) RedundantEditLogInputStream#LOG is set to wrong class

2016-05-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15286820#comment-15286820 ] John Zhuge commented on HDFS-10410: --- Thanks [~eddyxu]! > RedundantEditLogInputStream#LO

[jira] [Updated] (HDFS-10410) RedundantEditLogInputStream#LOG is set to wrong class

2016-05-16 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10410: -- Attachment: HDFS-10410.001.patch Upload the correct patch file name. > RedundantEditLogInputStream#LOG

[jira] [Updated] (HDFS-10410) RedundantEditLogInputStream#LOG is set to wrong class

2016-05-16 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10410: -- Attachment: (was: HADOOP-10410.001.patch) > RedundantEditLogInputStream#LOG is set to wrong class >

[jira] [Updated] (HDFS-10410) RedundantEditLogInputStream#LOG is set to wrong class

2016-05-16 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10410: -- Labels: supportability (was: ) Affects Version/s: 2.6.0 Target Version/s: 2.8.0

[jira] [Updated] (HDFS-10410) RedundantEditLogInputStream#LOG is set to wrong class

2016-05-16 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10410: -- Attachment: HADOOP-10410.001.patch Patch 001: * Set {{RedundantEditLogInputStream#LOG}} to its own class

[jira] [Work started] (HDFS-10410) RedundantEditLogInputStream#LOG is set to wrong class

2016-05-16 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10410 started by John Zhuge. - > RedundantEditLogInputStream#LOG is set to wrong class > -

[jira] [Created] (HDFS-10410) RedundantEditLogInputStream#LOG is set to wrong class

2016-05-16 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10410: - Summary: RedundantEditLogInputStream#LOG is set to wrong class Key: HDFS-10410 URL: https://issues.apache.org/jira/browse/HDFS-10410 Project: Hadoop HDFS Issue Typ

[jira] [Commented] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-05-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15279254#comment-15279254 ] John Zhuge commented on HDFS-10287: --- [~ozawa] Could you also review and commit this jira

[jira] [Updated] (HDFS-10378) FSDirAttrOp#setOwner throws AccessControlException with wrong message

2016-05-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10378: -- Summary: FSDirAttrOp#setOwner throws AccessControlException with wrong message (was: setOwner throws Ac

[jira] [Commented] (HDFS-10387) DataTransferProtocol#writeBlock missing some javadocs

2016-05-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15278955#comment-15278955 ] John Zhuge commented on HDFS-10387: --- [~liuml07] The DN is free to ignore it. Copy from p

[jira] [Updated] (HDFS-10387) DataTransferProtocol#writeBlock missing some javadocs

2016-05-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10387: -- Status: Patch Available (was: In Progress) > DataTransferProtocol#writeBlock missing some javadocs > --

[jira] [Updated] (HDFS-10387) DataTransferProtocol#writeBlock missing some javadocs

2016-05-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10387: -- Attachment: HDFS-10387.001.patch Please review patch 001: * Add javadoc for parameter requestedChecksum,

[jira] [Commented] (HDFS-10387) DataTransferProtocol#writeBlock missing some javadocs

2016-05-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15278688#comment-15278688 ] John Zhuge commented on HDFS-10387: --- {{allowLazyPersist}} also misses javadoc. > DataTr

[jira] [Work started] (HDFS-10387) DataTransferProtocol#writeBlock missing some javadocs

2016-05-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10387 started by John Zhuge. - > DataTransferProtocol#writeBlock missing some javadocs > -

[jira] [Commented] (HDFS-10381) DataStreamer DataNode exclusion log message should be warning

2016-05-10 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15278452#comment-15278452 ] John Zhuge commented on HDFS-10381: --- [~jingzhao] Could you please review since you worke

[jira] [Updated] (HDFS-10381) DataStreamer DataNode exclusion log message should be warning

2016-05-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10381: -- Attachment: HDFS-10381.001.patch Please review patch 001: * Change 2 logs from info to warn in {{DataStr

[jira] [Updated] (HDFS-10381) DataStreamer DataNode exclusion log message should be warning

2016-05-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10381: -- Status: Patch Available (was: In Progress) > DataStreamer DataNode exclusion log message should be warn

[jira] [Commented] (HDFS-10381) DataStreamer DataNode exclusion log message should be warning

2016-05-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277626#comment-15277626 ] John Zhuge commented on HDFS-10381: --- Thanks [~liuml07]. Fixed. > DataStreamer DataNode

[jira] [Updated] (HDFS-10381) DataStreamer DataNode exclusion log message should be warning

2016-05-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10381: -- Component/s: (was: datanode) hdfs-client > DataStreamer DataNode exclusion log mess

[jira] [Updated] (HDFS-10381) DataStreamer DataNode exclusion log message should be warning

2016-05-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10381: -- Summary: DataStreamer DataNode exclusion log message should be warning (was: DataNode exclusion log mes

[jira] [Commented] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-05-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277597#comment-15277597 ] John Zhuge commented on HDFS-10287: --- Thanks [~boky01]. Leave the unit test alone to mini

[jira] [Commented] (HDFS-10378) setOwner throws AccessControlException with wrong message

2016-05-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15277080#comment-15277080 ] John Zhuge commented on HDFS-10378: --- Thanks [~yzhangal]. HDFS-10378.001.patch does inclu

[jira] [Work started] (HDFS-10381) DataNode exclusion log message should be a warning

2016-05-09 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10381 started by John Zhuge. - > DataNode exclusion log message should be a warning >

[jira] [Created] (HDFS-10381) DataNode exclusion log message should be a warning

2016-05-09 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10381: - Summary: DataNode exclusion log message should be a warning Key: HDFS-10381 URL: https://issues.apache.org/jira/browse/HDFS-10381 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-10378) setOwner throws AccessControlException with wrong message

2016-05-06 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10378: -- Status: Patch Available (was: In Progress) Please review patch 001: * FSDirAttrOp.setOwner performs sup

[jira] [Updated] (HDFS-10378) setOwner throws AccessControlException with wrong message

2016-05-06 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10378: -- Attachment: HDFS-10378.001.patch > setOwner throws AccessControlException with wrong message > -

[jira] [Updated] (HDFS-10378) setOwner throws AccessControlException with wrong message

2016-05-06 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10378: -- Description: Calling {{setOwner}} as a non-super user does trigger {{AccessControlException}}, however,

[jira] [Commented] (HDFS-9939) Increase DecompressorStream skip buffer size

2016-05-06 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15274975#comment-15274975 ] John Zhuge commented on HDFS-9939: -- Thanks [~andrew.wang] and [~yzhangal]! > Increase Dec

[jira] [Work started] (HDFS-10378) setOwner throws AccessControlException with wrong message

2016-05-06 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10378 started by John Zhuge. - > setOwner throws AccessControlException with wrong message > -

[jira] [Updated] (HDFS-10378) setOwner throws AccessControlException with wrong message

2016-05-06 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10378: -- Attachment: HDFS-10378-unit.patch > setOwner throws AccessControlException with wrong message >

[jira] [Created] (HDFS-10378) setOwner throws AccessControlException with wrong message

2016-05-06 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10378: - Summary: setOwner throws AccessControlException with wrong message Key: HDFS-10378 URL: https://issues.apache.org/jira/browse/HDFS-10378 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-10376) setOwner call is not run as the specified user in TestPermission

2016-05-06 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15274808#comment-15274808 ] John Zhuge commented on HDFS-10376: --- After some debugging, the bogus user is passed to N

[jira] [Commented] (HDFS-10376) setOwner call is not run as the specified user in TestPermission

2016-05-06 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15274698#comment-15274698 ] John Zhuge commented on HDFS-10376: --- Ignore my previous comment about IllegalStateExcept

[jira] [Commented] (HDFS-10376) setOwner call is not run as the specified user in TestPermission

2016-05-06 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15274679#comment-15274679 ] John Zhuge commented on HDFS-10376: --- Got this unexpected exception when debugging TestPe

[jira] [Created] (HDFS-10375) Remove redundent TestMiniDFSCluster.testDualClusters

2016-05-06 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10375: - Summary: Remove redundent TestMiniDFSCluster.testDualClusters Key: HDFS-10375 URL: https://issues.apache.org/jira/browse/HDFS-10375 Project: Hadoop HDFS Issue Type

[jira] [Updated] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-05-06 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10287: -- Hadoop Flags: Reviewed > MiniDFSCluster should implement AutoCloseable > ---

[jira] [Commented] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-05-06 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15274213#comment-15274213 ] John Zhuge commented on HDFS-10287: --- +1 LGTM. Thanks [~boky01] for submitting the patch.

[jira] [Work started] (HDFS-9913) DispCp doesn't use Trash with -delete option

2016-05-06 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-9913 started by John Zhuge. > DispCp doesn't use Trash with -delete option > -

[jira] [Work started] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-05-06 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6962 started by John Zhuge. > ACLs inheritance conflict with umaskmode > > >

[jira] [Commented] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-05-06 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15274120#comment-15274120 ] John Zhuge commented on HDFS-6962: -- [~supputuri] and [~andrew.wang] I am picking it up. >

[jira] [Assigned] (HDFS-6962) ACLs inheritance conflict with umaskmode

2016-05-06 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HDFS-6962: Assignee: John Zhuge (was: Srikanth Upputuri) > ACLs inheritance conflict with umaskmode >

[jira] [Updated] (HDFS-2043) TestHFlush failing intermittently

2016-05-05 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-2043: - Hadoop Flags: Reviewed > TestHFlush failing intermittently > - > >

[jira] [Updated] (HDFS-2043) TestHFlush failing intermittently

2016-05-05 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-2043: - Attachment: HDFS-2043.006.patch My bad [~linyiqun], this file uses System.out instead of log. I uploaded a

[jira] [Updated] (HDFS-9939) Increase DecompressorStream skip buffer size

2016-05-05 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9939: - Status: Patch Available (was: In Progress) > Increase DecompressorStream skip buffer size > --

[jira] [Updated] (HDFS-9939) Increase DecompressorStream skip buffer size

2016-05-05 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9939: - Attachment: HDFS-9939.002.patch Patch 002: * Remove unused variable buf in testSkip [~andrew.wang], could

[jira] [Updated] (HDFS-9939) Increase DecompressorStream skip buffer size

2016-05-05 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9939: - Status: In Progress (was: Patch Available) > Increase DecompressorStream skip buffer size > --

[jira] [Commented] (HDFS-10300) TestDistCpSystem should share MiniDFSCluster

2016-05-05 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273245#comment-15273245 ] John Zhuge commented on HDFS-10300: --- Could anyone kindly code review? Thanks. > TestDis

[jira] [Commented] (HDFS-2043) TestHFlush failing intermittently

2016-05-05 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15273155#comment-15273155 ] John Zhuge commented on HDFS-2043: -- [~linyiqun], could you please add a INFO log message w

[jira] [Assigned] (HDFS-240) Should HDFS restrict the names used for files?

2016-05-05 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reassigned HDFS-240: --- Assignee: John Zhuge > Should HDFS restrict the names used for files? > ---

[jira] [Commented] (HDFS-2043) TestHFlush failing intermittently

2016-05-05 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15272057#comment-15272057 ] John Zhuge commented on HDFS-2043: -- [~linyiqun] and [~iwasakims], great work on patch 004.

[jira] [Commented] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-05-03 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15268378#comment-15268378 ] John Zhuge commented on HDFS-10287: --- [~boky01], do you think {{MiniDFSCluster}} should e

[jira] [Commented] (HDFS-10216) distcp -diff relative path exception

2016-04-26 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259444#comment-15259444 ] John Zhuge commented on HDFS-10216: --- Thanks [~yzhangal]. > distcp -diff relative path e

[jira] [Commented] (HDFS-9885) In distcp cmd ouput, Display name should be given for org.apache.hadoop.tools.mapred.CopyMapper$Counter.

2016-04-26 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259417#comment-15259417 ] John Zhuge commented on HDFS-9885: -- Can anyone commit this reviewed jira? Thanks. > In di

[jira] [Commented] (HDFS-10297) Increase default balance bandwidth and concurrent moves

2016-04-26 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259368#comment-15259368 ] John Zhuge commented on HDFS-10297: --- [~andrew.wang], I uploaded a patch for branch-2.8,

[jira] [Updated] (HDFS-10297) Increase default balance bandwidth and concurrent moves

2016-04-26 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10297: -- Attachment: HDFS-10297.003.branch-2.8.patch Upload HDFS-10297.003.branch-2.8.patch for branch 2.8. > In

[jira] [Commented] (HDFS-10297) Increase default balance bandwidth and concurrent moves

2016-04-26 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15259009#comment-15259009 ] John Zhuge commented on HDFS-10297: --- Thanks [~rchiang]. > Increase default balance band

[jira] [Commented] (HDFS-10297) Increase default balance bandwidth and concurrent moves

2016-04-26 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15258988#comment-15258988 ] John Zhuge commented on HDFS-10297: --- [~rchiang]'s HDFS-8356 added the missing properties

[jira] [Commented] (HDFS-10297) Increase default balance bandwidth and concurrent moves

2016-04-26 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15258978#comment-15258978 ] John Zhuge commented on HDFS-10297: --- Wow, so many properties of file {{hdfs-default.xml}

[jira] [Commented] (HDFS-10297) Increase default balance bandwidth and concurrent moves

2016-04-26 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15258924#comment-15258924 ] John Zhuge commented on HDFS-10297: --- Thank you [~andrew.wang]. I will create a patch for

[jira] [Commented] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-04-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256596#comment-15256596 ] John Zhuge commented on HDFS-10287: --- Thanks [~boky01] for creating the patch, however, y

[jira] [Commented] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-04-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15256550#comment-15256550 ] John Zhuge commented on HDFS-10287: --- This jira is not a clone of YARN-4959. > MiniDFSCl

[jira] [Updated] (HDFS-10300) TestDistCpSystem should share MiniDFSCluster

2016-04-21 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10300: -- Attachment: HDFS-10300.001.patch Patch 001: * Share a MiniDFSCluster in test cases * Switch to JUnit 4 a

[jira] [Updated] (HDFS-10300) TestDistCpSystem should share MiniDFSCluster

2016-04-21 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10300: -- Labels: quality test (was: ) Status: Patch Available (was: In Progress) > TestDistCpSystem should

[jira] [Commented] (HDFS-9670) DistCp throws NPE when source is root

2016-04-21 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15252527#comment-15252527 ] John Zhuge commented on HDFS-9670: -- Thanks [~yzhangal] for reporting, reviewing, and commi

[jira] [Commented] (HDFS-10297) Increase default balance bandwidth and concurrent moves

2016-04-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15251006#comment-15251006 ] John Zhuge commented on HDFS-10297: --- Could someone kindly review this simple patch? > I

[jira] [Updated] (HDFS-10297) Increase default balance bandwidth and concurrent moves

2016-04-16 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10297: -- Attachment: HDFS-10297.003.patch Patch 003: * Fix checkstyle > Increase default balance bandwidth and c

[jira] [Commented] (HDFS-10300) TestDistCpSystem should share MiniDFSCluster

2016-04-16 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244327#comment-15244327 ] John Zhuge commented on HDFS-10300: --- Depend on HDFS-9670 to be fixed first. > TestDistC

[jira] [Commented] (HDFS-10297) Increase default balance bandwidth and concurrent moves

2016-04-16 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15244108#comment-15244108 ] John Zhuge commented on HDFS-10297: --- Unit test failures look unrelated. > Increase defa

[jira] [Updated] (HDFS-10297) Increase default balance bandwidth and concurrent moves

2016-04-16 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10297: -- Attachment: HDFS-10297.002.patch Patch 002: * Fix checkstyle errors > Increase default balance bandwidt

[jira] [Work started] (HDFS-10300) TestDistCpSystem should share MiniDFSCluster

2016-04-16 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10300 started by John Zhuge. - > TestDistCpSystem should share MiniDFSCluster > --

[jira] [Commented] (HDFS-10300) TestDistCpSystem should share MiniDFSCluster

2016-04-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15243650#comment-15243650 ] John Zhuge commented on HDFS-10300: --- It is the old style of JUnit 3. Switch to JUnit 4 a

[jira] [Commented] (HDFS-10300) TestDistCpSystem should share MiniDFSCluster

2016-04-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15243647#comment-15243647 ] John Zhuge commented on HDFS-10300: --- Do not understand why {{TestDistCpSystem}} extends

[jira] [Commented] (HDFS-9670) DistCp throws NPE when source is root

2016-04-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15243556#comment-15243556 ] John Zhuge commented on HDFS-9670: -- Created HDFS-10300 "TestDistCpSystem should share Mini

[jira] [Created] (HDFS-10300) TestDistCpSystem should share MiniDFSCluster

2016-04-15 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10300: - Summary: TestDistCpSystem should share MiniDFSCluster Key: HDFS-10300 URL: https://issues.apache.org/jira/browse/HDFS-10300 Project: Hadoop HDFS Issue Type: Improv

[jira] [Updated] (HDFS-9670) DistCp throws NPE when source is root

2016-04-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9670: - Attachment: HDFS-9670.002.patch Patch 002: * Use 1 mini cluster in unit test because the issue is reproduci

[jira] [Commented] (HDFS-9670) DistCp throws NPE when source is root

2016-04-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15243547#comment-15243547 ] John Zhuge commented on HDFS-9670: -- Thanks, will fix it. > DistCp throws NPE when source

[jira] [Commented] (HDFS-10297) Increase default balance bandwidth and concurrent moves

2016-04-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15243522#comment-15243522 ] John Zhuge commented on HDFS-10297: --- Thanks [~jingzhao]. > Increase default balance ban

[jira] [Commented] (HDFS-9670) DistCp throws NPE when source is root

2016-04-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15243416#comment-15243416 ] John Zhuge commented on HDFS-9670: -- Very good point! * File a separate jira to consolidate

[jira] [Updated] (HDFS-10297) Increase default balance bandwidth and concurrent moves

2016-04-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10297: -- Fix Version/s: 2.8.0 Status: Patch Available (was: Open) > Increase default balance bandwidt

[jira] [Updated] (HDFS-10297) Increase default balance bandwidth and concurrent moves

2016-04-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10297: -- Attachment: HDFS-10297.001.patch Patch 001: * Change values in {{hdfs-default.xml}} * Change values of {

[jira] [Updated] (HDFS-9940) Balancer should not use property dfs.datanode.balance.max.concurrent.moves

2016-04-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9940: - Summary: Balancer should not use property dfs.datanode.balance.max.concurrent.moves (was: Balancer should

[jira] [Created] (HDFS-10297) Increase default balance bandwidth and concurrent moves

2016-04-14 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10297: - Summary: Increase default balance bandwidth and concurrent moves Key: HDFS-10297 URL: https://issues.apache.org/jira/browse/HDFS-10297 Project: Hadoop HDFS Issue T

[jira] [Updated] (HDFS-9940) Balancer should not use property name dfs.datanode.balance.max.concurrent.moves

2016-04-14 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9940: - Summary: Balancer should not use property name dfs.datanode.balance.max.concurrent.moves (was: Balancer sh

[jira] [Updated] (HDFS-9940) Balancer should not use property name

2016-04-14 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9940: - Summary: Balancer should not use property name (was: Rename dfs.balancer.max.concurrent.moves to avoid co

[jira] [Commented] (HDFS-10289) Balancer configures DNs directly

2016-04-14 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15242183#comment-15242183 ] John Zhuge commented on HDFS-10289: --- Split into 2 tasks: * HDFS-10294: Balancer configur

[jira] [Created] (HDFS-10295) Balancer configures DN properties directly on-demand

2016-04-14 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10295: - Summary: Balancer configures DN properties directly on-demand Key: HDFS-10295 URL: https://issues.apache.org/jira/browse/HDFS-10295 Project: Hadoop HDFS Issue Type

[jira] [Updated] (HDFS-10294) Balancer configures DN properties

2016-04-14 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10294: -- Priority: Major (was: Critical) > Balancer configures DN properties > -

<    3   4   5   6   7   8   9   10   >