[jira] [Updated] (HDFS-8696) Reduce the variances of latency of WebHDFS

2015-07-02 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8696: Attachment: HDFS-8696.2.patch patch V2. boss threads setting is unnecessary. Just use default value

[jira] [Updated] (HDFS-8696) Reduce the variances of latency of WebHDFS

2015-07-06 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8696: Attachment: HDFS-8696.3.patch Patch V3, removed dfs.webhdfs.server.worker.threads, keep to use

[jira] [Commented] (HDFS-8696) Reduce the variances of latency of WebHDFS

2015-07-06 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14615751#comment-14615751 ] Xiaobing Zhou commented on HDFS-8696: - [~bobhansen] hadoop.http.max.threads only

[jira] [Updated] (HDFS-8696) Reduce the variances of latency of WebHDFS

2015-07-01 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8696: Status: Patch Available (was: Open) Reduce the variances of latency of WebHDFS

[jira] [Updated] (HDFS-8696) Reduce the variances of latency of WebHDFS

2015-07-01 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8696: Attachment: HDFS-8696.1.patch Made a patch. Reduced the latency to sub second in my test evn. Can

[jira] [Updated] (HDFS-8861) Remove unnecessary log from method FSNamesystem.getCorruptFiles

2015-08-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8861: Description: The log in FSNamesystem.getCorruptFiles will print out whole stack trace, which makes

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-08-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694104#comment-14694104 ] Xiaobing Zhou commented on HDFS-8855: - [~bobhansen] I was using the sequential work

[jira] [Commented] (HDFS-8861) Remove unnecessary log from method FSNamesystem.getCorruptFiles

2015-08-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694192#comment-14694192 ] Xiaobing Zhou commented on HDFS-8861: - Removed inaccurate description. Remove

[jira] [Commented] (HDFS-8861) Remove unnecessary log from method FSNamesystem.getCorruptFiles

2015-08-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14694247#comment-14694247 ] Xiaobing Zhou commented on HDFS-8861: - No, HDFS-8522 didn't handle getCorruptFiles.

[jira] [Updated] (HDFS-8861) Remove unnecessary log from method FSNamesystem.getCorruptFiles

2015-08-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8861: Description: The log in FSNamesystem.getCorruptFiles will print out too many messages mixed with

[jira] [Updated] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-08-18 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8855: Status: Patch Available (was: Open) Webhdfs client leaks active NameNode connections

[jira] [Updated] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-08-18 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8855: Attachment: HDFS-8855.1.patch Made a patch for review. Idea's been to avoid creating brand new

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-08-19 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14704102#comment-14704102 ] Xiaobing Zhou commented on HDFS-8855: - Thanks [~wheat9] and [~bobhansen] for review.

[jira] [Created] (HDFS-8910) Downgrade log Operation category READ is not supported in state... to DEBUG level.

2015-08-17 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-8910: --- Summary: Downgrade log Operation category READ is not supported in state... to DEBUG level. Key: HDFS-8910 URL: https://issues.apache.org/jira/browse/HDFS-8910

[jira] [Updated] (HDFS-8910) Downgrade log Operation category READ is not supported in state... to DEBUG level.

2015-08-17 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8910: Attachment: HDFS-8910.1.patch Made a tentative patch for review. Downgrade log Operation category

[jira] [Created] (HDFS-8696) Small reads are blocked by large long running reads

2015-06-29 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-8696: --- Summary: Small reads are blocked by large long running reads Key: HDFS-8696 URL: https://issues.apache.org/jira/browse/HDFS-8696 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-8696) Small reads are blocked by large long running reads

2015-06-30 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608878#comment-14608878 ] Xiaobing Zhou commented on HDFS-8696: - I investigated many aspects of issue, including

[jira] [Assigned] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-08-05 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reassigned HDFS-8855: --- Assignee: Xiaobing Zhou Webhdfs client leaks active NameNode connections

[jira] [Updated] (HDFS-8861) Remove unnecessary log from method FSNamesystem.getCorruptFiles

2015-08-13 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8861: Resolution: Won't Fix Status: Resolved (was: Patch Available) Close it and leave

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-08-10 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680988#comment-14680988 ] Xiaobing Zhou commented on HDFS-8855: - [~bobhansen] This looks good to me. Let's work

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-08-11 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14692650#comment-14692650 ] Xiaobing Zhou commented on HDFS-8855: - Tested HDFS-7597 patch, it’s working well for

[jira] [Created] (HDFS-8861) Remove unnecessary log from method FSNamesystem.getCorruptFiles

2015-08-05 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-8861: --- Summary: Remove unnecessary log from method FSNamesystem.getCorruptFiles Key: HDFS-8861 URL: https://issues.apache.org/jira/browse/HDFS-8861 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8861) Remove unnecessary log from method FSNamesystem.getCorruptFiles

2015-08-05 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8861: Attachment: HDFS-8861.1.patch Made a patch V1, simply removing the log print. Remove unnecessary

[jira] [Updated] (HDFS-8861) Remove unnecessary log from method FSNamesystem.getCorruptFiles

2015-08-05 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8861: Status: Patch Available (was: Open) Remove unnecessary log from method

[jira] [Updated] (HDFS-9330) Reconfigure deleting duplicate replica on the fly

2015-10-29 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9330: Attachment: HDFS-9330.001.patch Posted patch 001. > Reconfigure deleting duplicate replica on the

[jira] [Updated] (HDFS-9330) Reconfigure deleting duplicate replica on the fly

2015-10-29 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9330: Status: Patch Available (was: Open) > Reconfigure deleting duplicate replica on the fly >

[jira] [Updated] (HDFS-9262) Reconfigure lazy writer interval on the fly

2015-10-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9262: Attachment: HDFS-9262.001.patch Posted patch 001. > Reconfigure lazy writer interval on the fly >

[jira] [Created] (HDFS-9330) Reconfigure deleting duplicate replica on the fly

2015-10-28 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-9330: --- Summary: Reconfigure deleting duplicate replica on the fly Key: HDFS-9330 URL: https://issues.apache.org/jira/browse/HDFS-9330 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-9330) Reconfigure deleting duplicate replica on the fly

2015-10-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9330: Description: This is to reconfigure {code} dfs.datanode.duplicate.replica.deletion {code} without

[jira] [Updated] (HDFS-9262) Reconfigure lazy writer interval on the fly

2015-10-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9262: Status: Patch Available (was: Open) > Reconfigure lazy writer interval on the fly >

[jira] [Commented] (HDFS-9094) Add command line option to ask NameNode reload configuration.

2015-11-10 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14999111#comment-14999111 ] Xiaobing Zhou commented on HDFS-9094: - Thanks [~arpitagarwal] for review! The high level change is to

[jira] [Updated] (HDFS-9349) Reconfigure NN protected directories on the fly

2015-11-10 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9349: Attachment: HDFS-9349.001.patch Patch v001. Kindly review. > Reconfigure NN protected directories

[jira] [Updated] (HDFS-9349) Reconfigure NN protected directories on the fly

2015-11-10 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9349: Status: Patch Available (was: Open) > Reconfigure NN protected directories on the fly >

[jira] [Commented] (HDFS-9094) Add command line option to ask NameNode reload configuration.

2015-11-10 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14999466#comment-14999466 ] Xiaobing Zhou commented on HDFS-9094: - Quite good comments, thanks [~arpitagarwal]. I was thinking of

[jira] [Updated] (HDFS-9349) Reconfigure NN protected directories on the fly

2015-11-10 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9349: Attachment: HDFS-9349.002.patch Good comments, thanks [~liuml07] for review. Posted v002. >

[jira] [Updated] (HDFS-9349) Reconfigure NN protected directories on the fly

2015-11-10 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9349: Status: Patch Available (was: In Progress) > Reconfigure NN protected directories on the fly >

[jira] [Updated] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-11-10 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8855: Attachment: HDFS-8855.008.patch Patch v008 to merge follow-up work, kindly review. Thanks. >

[jira] [Updated] (HDFS-9349) Reconfigure NN protected directories on the fly

2015-11-10 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9349: Status: In Progress (was: Patch Available) > Reconfigure NN protected directories on the fly >

[jira] [Assigned] (HDFS-9427) HDFS should not default to ephemeral ports

2015-11-13 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reassigned HDFS-9427: --- Assignee: Xiaobing Zhou > HDFS should not default to ephemeral ports >

[jira] [Assigned] (HDFS-9432) WebHDFS: Some GET operations are wrongly documented as PUT operations

2015-11-16 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reassigned HDFS-9432: --- Assignee: Xiaobing Zhou > WebHDFS: Some GET operations are wrongly documented as PUT

[jira] [Commented] (HDFS-9432) WebHDFS: Some GET operations are wrongly documented as PUT operations

2015-11-16 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006946#comment-15006946 ] Xiaobing Zhou commented on HDFS-9432: - I was thinking it still needs some fixes when I picked it up,

[jira] [Updated] (HDFS-9414) Moving reconfiguration protocol out of ClientDatanodeProtocol for reusability

2015-11-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9414: Attachment: HDFS-9414.001.patch Posted patch v001, kindly review. > Moving reconfiguration protocol

[jira] [Updated] (HDFS-9414) Moving reconfiguration protocol out of ClientDatanodeProtocol for reusability

2015-11-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9414: Status: Patch Available (was: Open) > Moving reconfiguration protocol out of ClientDatanodeProtocol

[jira] [Created] (HDFS-9414) Moving reconfiguration protocol out of ClientDatanodeProtocol for reusability

2015-11-11 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-9414: --- Summary: Moving reconfiguration protocol out of ClientDatanodeProtocol for reusability Key: HDFS-9414 URL: https://issues.apache.org/jira/browse/HDFS-9414 Project:

[jira] [Commented] (HDFS-9094) Add command line option to ask NameNode reload configuration.

2015-11-11 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15000906#comment-15000906 ] Xiaobing Zhou commented on HDFS-9094: - I created HDFS-9414 to do ReconfigurationProtocol so as to

[jira] [Updated] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-11-10 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8855: Status: Patch Available (was: Reopened) > Webhdfs client leaks active NameNode connections >

[jira] [Commented] (HDFS-9242) Fix Findbugs warning from webhdfs.DataNodeUGIProvider.ugiCache

2015-11-02 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985879#comment-14985879 ] Xiaobing Zhou commented on HDFS-9242: - Patch 003 LGTM. Thanks everyone to do this makeup fix for

[jira] [Created] (HDFS-9349) Reconfigure NN protected directories on the fly

2015-10-30 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-9349: --- Summary: Reconfigure NN protected directories on the fly Key: HDFS-9349 URL: https://issues.apache.org/jira/browse/HDFS-9349 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-9262) Reconfigure DN lazy writer interval on the fly

2015-10-30 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9262: Summary: Reconfigure DN lazy writer interval on the fly (was: Reconfigure lazy writer interval on

[jira] [Updated] (HDFS-9330) Reconfigure DN deleting duplicate replica on the fly

2015-10-30 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9330: Summary: Reconfigure DN deleting duplicate replica on the fly (was: Reconfigure deleting duplicate

[jira] [Assigned] (HDFS-9349) Reconfigure NN protected directories on the fly

2015-10-30 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reassigned HDFS-9349: --- Assignee: Xiaobing Zhou > Reconfigure NN protected directories on the fly >

[jira] [Commented] (HDFS-9370) TestDataNodeUGIProvider fails intermittently due to non-deterministic cache expiry.

2015-11-03 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988511#comment-14988511 ] Xiaobing Zhou commented on HDFS-9370: - +1. Thanks [~cnauroth] for fix. Could you put your comment with

[jira] [Commented] (HDFS-9370) TestDataNodeUGIProvider fails intermittently due to non-deterministic cache expiry.

2015-11-03 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988528#comment-14988528 ] Xiaobing Zhou commented on HDFS-9370: - +1 002 Thanks. > TestDataNodeUGIProvider fails intermittently

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-11-04 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990124#comment-14990124 ] Xiaobing Zhou commented on HDFS-8855: - Thanks [~wheat9]. Waiting for HDFS-9242 and HDFS-9370 to get

[jira] [Commented] (HDFS-9242) Fix Findbugs warning from webhdfs.DataNodeUGIProvider.ugiCache

2015-11-04 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990139#comment-14990139 ] Xiaobing Zhou commented on HDFS-9242: - Is v003 good to go? I am going to consolidate it into

[jira] [Commented] (HDFS-9242) Fix Findbugs warning from webhdfs.DataNodeUGIProvider.ugiCache

2015-11-04 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990142#comment-14990142 ] Xiaobing Zhou commented on HDFS-9242: - +1 v003, LGTM. > Fix Findbugs warning from

[jira] [Commented] (HDFS-1477) Make NameNode Reconfigurable.

2015-10-30 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14983266#comment-14983266 ] Xiaobing Zhou commented on HDFS-1477: - Thanks [~arpitagarwal] for review! The next patch will address

[jira] [Work started] (HDFS-9140) Discover conf parameters that need no DataNode restart to make changes effective

2015-10-30 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-9140 started by Xiaobing Zhou. --- > Discover conf parameters that need no DataNode restart to make changes >

[jira] [Updated] (HDFS-9094) Add command line option to ask NameNode reload configuration.

2015-11-05 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9094: Attachment: HDFS-9094.001.patch Posted patch v001. Kindly review, thanks! > Add command line option

[jira] [Updated] (HDFS-9094) Add command line option to ask NameNode reload configuration.

2015-11-05 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9094: Status: Patch Available (was: Open) > Add command line option to ask NameNode reload configuration.

[jira] [Updated] (HDFS-9349) Reconfigure NN protected directories on the fly

2015-10-30 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9349: Description: This is to reconfigure {code} fs.protected.directories {code} without restarting NN. >

[jira] [Updated] (HDFS-9349) Reconfigure NN protected directories on the fly

2015-10-30 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9349: Component/s: namenode > Reconfigure NN protected directories on the fly >

[jira] [Updated] (HDFS-1477) Reconfigure NN heartbeat and recheck interval on the fly

2015-10-30 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-1477: Summary: Reconfigure NN heartbeat and recheck interval on the fly (was: Make NameNode

[jira] [Updated] (HDFS-9262) Reconfigure lazy writer interval on the fly

2015-10-16 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9262: Description: This is to reconfigure {code} dfs.datanode.lazywriter.interval.sec {code} without

[jira] [Updated] (HDFS-9262) Reconfigure lazy writer interval on the fly

2015-10-16 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9262: Description: This is to reconfigure dfs.datanode.lazywriter.interval.sec without restarting DN. >

[jira] [Updated] (HDFS-9262) Reconfigure lazy writer interval on the fly

2015-10-16 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9262: Affects Version/s: 2.7.0 > Reconfigure lazy writer interval on the fly >

[jira] [Created] (HDFS-9262) Reconfigure lazy writer interval on the fly

2015-10-16 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-9262: --- Summary: Reconfigure lazy writer interval on the fly Key: HDFS-9262 URL: https://issues.apache.org/jira/browse/HDFS-9262 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-9140) Discover conf parameters that need no DataNode restart to make changes effective

2015-10-08 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9140: Summary: Discover conf parameters that need no DataNode restart to make changes effective (was:

[jira] [Commented] (HDFS-9140) Discover conf parameters that need no DataNode restart to make changes effective

2015-10-08 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14949042#comment-14949042 ] Xiaobing Zhou commented on HDFS-9140: - By an evaluation, these DN parameters can be reconfigured on the

[jira] [Updated] (HDFS-9214) Reconfigure DN concurrent move on the fly

2015-10-15 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9214: Attachment: HDFS-9214.002.patch Patch 002 with more tests added. > Reconfigure DN concurrent move

[jira] [Updated] (HDFS-9214) Reconfigure DN concurrent move on the fly

2015-10-08 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9214: Affects Version/s: 2.7.0 > Reconfigure DN concurrent move on the fly >

[jira] [Created] (HDFS-9214) Reconfigure DN concurrent move on the fly

2015-10-08 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-9214: --- Summary: Reconfigure DN concurrent move on the fly Key: HDFS-9214 URL: https://issues.apache.org/jira/browse/HDFS-9214 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-9214) Reconfigure DN concurrent move on the fly

2015-10-08 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9214: Component/s: datanode > Reconfigure DN concurrent move on the fly >

[jira] [Updated] (HDFS-9094) Add command line option to ask NameNode reload configuration.

2015-10-08 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9094: Component/s: namenode > Add command line option to ask NameNode reload configuration. >

[jira] [Updated] (HDFS-1477) Make NameNode Reconfigurable.

2015-10-08 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-1477: Component/s: namenode > Make NameNode Reconfigurable. > - > >

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-10-05 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14943802#comment-14943802 ] Xiaobing Zhou commented on HDFS-8855: - This issue is from DataNodeUGIProvider#tokenUGI {code} Token

[jira] [Updated] (HDFS-9140) Discover conf parameters that need no NN/DN restart to make changes effective

2015-10-06 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9140: Summary: Discover conf parameters that need no NN/DN restart to make changes effective (was:

[jira] [Updated] (HDFS-9214) Reconfigure DN concurrent move on the fly

2015-10-09 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9214: Status: Patch Available (was: Open) > Reconfigure DN concurrent move on the fly >

[jira] [Updated] (HDFS-9214) Reconfigure DN concurrent move on the fly

2015-10-09 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9214: Attachment: HDFS-9214.001.patch I posted the 001 patch with a hope someone can review it. Thanks. >

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-10-09 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951276#comment-14951276 ] Xiaobing Zhou commented on HDFS-8855: - Benchmarked the two approaches based on real token at 1 million

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-10-09 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14950832#comment-14950832 ] Xiaobing Zhou commented on HDFS-8855: - There's patch 007 that uses UUID as cache key. {code} 345

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-10-09 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951113#comment-14951113 ] Xiaobing Zhou commented on HDFS-8855: - We need unique cache key to ensure semantics of one token

[jira] [Updated] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-08-27 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8855: Attachment: HDFS-8855.2.patch Made patch V2. The proposed fix is to cache UGI in webhdfs to avoid

[jira] [Updated] (HDFS-9000) Allow reconfiguration without restart for parameters where applicable.

2015-09-01 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9000: Description: Many parameters can be re-configured without requiring a restart. > Allow

[jira] [Updated] (HDFS-9000) Allow reconfiguration without restart for parameters where applicable.

2015-09-01 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9000: Affects Version/s: 2.7.0 > Allow reconfiguration without restart for parameters where applicable. >

[jira] [Created] (HDFS-9000) Allow reconfiguration without restart for parameters where applicable.

2015-09-01 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-9000: --- Summary: Allow reconfiguration without restart for parameters where applicable. Key: HDFS-9000 URL: https://issues.apache.org/jira/browse/HDFS-9000 Project: Hadoop

[jira] [Created] (HDFS-9094) Add command line option to ask NameNode reload configuration.

2015-09-16 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-9094: --- Summary: Add command line option to ask NameNode reload configuration. Key: HDFS-9094 URL: https://issues.apache.org/jira/browse/HDFS-9094 Project: Hadoop HDFS

[jira] [Updated] (HDFS-1477) Make NameNode Reconfigurable.

2015-09-16 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-1477: Issue Type: Sub-task (was: Improvement) Parent: HDFS-9000 > Make NameNode Reconfigurable. >

[jira] [Reopened] (HDFS-9000) Allow reconfiguration without restart for parameters where applicable.

2015-09-16 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou reopened HDFS-9000: - Reopen it as umbrella. There are much work to do. > Allow reconfiguration without restart for

[jira] [Updated] (HDFS-1477) Make NameNode Reconfigurable.

2015-09-16 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-1477: Target Version/s: (was: ) Status: Patch Available (was: Open) > Make NameNode

[jira] [Commented] (HDFS-1477) Make NameNode Reconfigurable.

2015-09-16 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14791336#comment-14791336 ] Xiaobing Zhou commented on HDFS-1477: - I took this over since there's no progress in last years. >

[jira] [Commented] (HDFS-1477) Make NameNode Reconfigurable.

2015-09-16 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14791343#comment-14791343 ] Xiaobing Zhou commented on HDFS-1477: - Changed this as a sub task of HDFS-9000. > Make NameNode

[jira] [Updated] (HDFS-1477) Make NameNode Reconfigurable.

2015-09-16 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-1477: Assignee: Xiaobing Zhou (was: Patrick Kling) > Make NameNode Reconfigurable. >

[jira] [Updated] (HDFS-1477) Make NameNode Reconfigurable.

2015-09-16 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-1477: Attachment: HDFS-1477.4.patch I made patch V4 with minor changes based on previous work. Could

[jira] [Updated] (HDFS-1477) Make NameNode Reconfigurable.

2015-09-16 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-1477: Affects Version/s: (was: 0.23.0) 2.7.0 > Make NameNode Reconfigurable. >

[jira] [Updated] (HDFS-9094) Add command line option to ask NameNode reload configuration.

2015-09-16 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9094: Affects Version/s: 2.7.0 > Add command line option to ask NameNode reload configuration. >

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-09-17 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14804721#comment-14804721 ] Xiaobing Zhou commented on HDFS-8855: - Thanks [~owen.omalley] for the review! I made patch V5 to

[jira] [Updated] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-09-17 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8855: Attachment: HDFS-8855.005.patch > Webhdfs client leaks active NameNode connections >

[jira] [Updated] (HDFS-8696) Reduce the variances of latency of WebHDFS

2015-09-28 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-8696: Attachment: HDFS-8696.009.patch > Reduce the variances of latency of WebHDFS >

[jira] [Commented] (HDFS-8696) Reduce the variances of latency of WebHDFS

2015-09-29 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935932#comment-14935932 ] Xiaobing Zhou commented on HDFS-8696: - Checked the test failures are not related. > Reduce the

  1   2   3   4   5   6   7   8   9   10   >