[jira] [Commented] (HDFS-9501) TestBalancer#testBalancerWithPinnedBlocks fails in branch-2.7

[ https://issues.apache.org/jira/browse/HDFS-9501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15037997#comment-15037997 ] Xiaoyu Yao commented on HDFS-9501: -- Thanks [~brahmareddy] for working on this. Patch LGTM and I've tested

[jira] [Updated] (HDFS-8831) Trash Support for deletion in HDFS encryption zone

[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8831: - Attachment: HDFS-8831.05.patch Thanks [~arpitagarwal] for the review. Patch v05 addresses the latest

[jira] [Updated] (HDFS-8831) Trash Support for deletion in HDFS encryption zone

[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8831: - Release Note: Trash is now supported for deletion of files within encryption zone after HDFS-8831. The

[jira] [Updated] (HDFS-8831) Trash Support for deletion in HDFS encryption zone

[ https://issues.apache.org/jira/browse/HDFS-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8831: - Attachment: HDFS-8831.03.patch Update patch v03 based on [~arpit99]'s feedback. Please review, thanks!

[jira] [Commented] (HDFS-9528) Cleanup namenode audit/log/exception messages

[ https://issues.apache.org/jira/browse/HDFS-9528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15051723#comment-15051723 ] Xiaoyu Yao commented on HDFS-9528: -- +1 for h9528_20151210.patch > Cleanup namenode audit/log/exception

[jira] [Commented] (HDFS-8326) Documentation about when checkpoints are run is out of date

[ https://issues.apache.org/jira/browse/HDFS-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15052978#comment-15052978 ] Xiaoyu Yao commented on HDFS-8326: -- Good catch, [~iwasakims]. I will cherry-pick the fix to branch-2. >

[jira] [Commented] (HDFS-8785) TestDistributedFileSystem is failing in trunk

[ https://issues.apache.org/jira/browse/HDFS-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056249#comment-15056249 ] Xiaoyu Yao commented on HDFS-8785: -- [~yzhangal], Thanks for committing this to branch-2/branch-2.8! >

[jira] [Commented] (HDFS-9530) huge Non-DFS Used in hadoop 2.6.2 & 2.7.1

[ https://issues.apache.org/jira/browse/HDFS-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049010#comment-15049010 ] Xiaoyu Yao commented on HDFS-9530: -- This looks like the symptom of HDFS-8072, where RBW reserved space is

[jira] [Commented] (HDFS-9625) set replication for empty file failed when set storage policy

[ https://issues.apache.org/jira/browse/HDFS-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087946#comment-15087946 ] Xiaoyu Yao commented on HDFS-9625: -- [~Deng FEI], thanks for reporting the issue and attach the fix. Can

[jira] [Commented] (HDFS-9584) NPE in distcp when ssl configuration file does not exist in class path.

[ https://issues.apache.org/jira/browse/HDFS-9584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066913#comment-15066913 ] Xiaoyu Yao commented on HDFS-9584: -- Thanks [~surendrasingh] for working on this. Patch LGTM. +1 pending

[jira] [Updated] (HDFS-8855) Webhdfs client leaks active NameNode connections

[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8855: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Thanks

[jira] [Updated] (HDFS-8512) storage type inside LocatedBlock object is not fully exposed for GETFILESTATUS

[ https://issues.apache.org/jira/browse/HDFS-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8512: - Attachment: HDFS-8512.01.patch Thanks [~szetszwo] for the review. Rebase the patch to trunk. > storage

[jira] [Commented] (HDFS-9210) Fix some misuse of %n in VolumeScanner#printStats

[ https://issues.apache.org/jira/browse/HDFS-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027437#comment-15027437 ] Xiaoyu Yao commented on HDFS-9210: -- [~andrew.wang], [~templedf], can you help reviewing the patch v02 that

[jira] [Commented] (HDFS-8485) Transparent Encryption Fails to work with Yarn/MapReduce

[ https://issues.apache.org/jira/browse/HDFS-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027466#comment-15027466 ] Xiaoyu Yao commented on HDFS-8485: -- [~PrasadAlle], Do you have *dfs.encryption.key.provider.uri*

[jira] [Updated] (HDFS-8512) storage type inside LocatedBlock object is not fully exposed for GETFILESTATUS

[ https://issues.apache.org/jira/browse/HDFS-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8512: - Issue Type: Improvement (was: Bug) > storage type inside LocatedBlock object is not fully exposed for

[jira] [Updated] (HDFS-8512) WebHDFS : GETFILESTATUS should include storage type in LocatedBlock

[ https://issues.apache.org/jira/browse/HDFS-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8512: - Summary: WebHDFS : GETFILESTATUS should include storage type in LocatedBlock (was: storage type inside

[jira] [Updated] (HDFS-8512) WebHDFS : GETFILESTATUS should return LocatedBlock with storage type info

[ https://issues.apache.org/jira/browse/HDFS-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8512: - Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Thanks

[jira] [Updated] (HDFS-9210) Fix some misuse of %n in VolumeScanner#printStats

[ https://issues.apache.org/jira/browse/HDFS-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9210: - Attachment: HDFS-9210.02.patch Thanks [~templedf] for the review! Attached a patch using

[jira] [Updated] (HDFS-8512) WebHDFS : GETFILESTATUS should return LocatedBlock with storage type info

[ https://issues.apache.org/jira/browse/HDFS-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8512: - Summary: WebHDFS : GETFILESTATUS should return LocatedBlock with storage type info (was: WebHDFS :

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15023292#comment-15023292 ] Xiaoyu Yao commented on HDFS-8855: -- Thanks [~xiaobingo] for updating the patch. +1 for the latest patch.

[jira] [Updated] (HDFS-9584) NPE in distcp when ssl configuration file does not exist in class path.

[ https://issues.apache.org/jira/browse/HDFS-9584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9584: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9244) Support nested encryption zones

[ https://issues.apache.org/jira/browse/HDFS-9244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15093013#comment-15093013 ] Xiaoyu Yao commented on HDFS-9244: -- Thanks [~zhz] for working on this. Can we clarify the use cases (in

[jira] [Commented] (HDFS-9584) NPE in distcp when ssl configuration file does not exist in class path.

[ https://issues.apache.org/jira/browse/HDFS-9584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15093202#comment-15093202 ] Xiaoyu Yao commented on HDFS-9584: -- Thanks [~jojochuang]! I've corrected the commit message. > NPE in

[jira] [Commented] (HDFS-8548) Minicluster throws NPE on shutdown

[ https://issues.apache.org/jira/browse/HDFS-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15314688#comment-15314688 ] Xiaoyu Yao commented on HDFS-8548: -- Sounds good to me. I just cherry-picked it to branch-2.7. >

[jira] [Commented] (HDFS-10512) VolumeScanner may terminate to due NPE in DataNode.reportBadBlocks

[ https://issues.apache.org/jira/browse/HDFS-10512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15325503#comment-15325503 ] Xiaoyu Yao commented on HDFS-10512: --- Thanks [~jojochuang] for reporting the issue and [~linyiqun] for

[jira] [Assigned] (HDFS-9650) Problem is logging of "Redundant addStoredBlock request received"

[ https://issues.apache.org/jira/browse/HDFS-9650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-9650: Assignee: Xiaoyu Yao > Problem is logging of "Redundant addStoredBlock request received" >

[jira] [Commented] (HDFS-9650) Problem is logging of "Redundant addStoredBlock request received"

[ https://issues.apache.org/jira/browse/HDFS-9650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331182#comment-15331182 ] Xiaoyu Yao commented on HDFS-9650: -- Thanks [~brahma] for the heads up. Yes, we do need to backport

[jira] [Commented] (HDFS-9906) Remove spammy log spew when a datanode is restarted

[ https://issues.apache.org/jira/browse/HDFS-9906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15331228#comment-15331228 ] Xiaoyu Yao commented on HDFS-9906: -- Cherrypicked to branch-2.7. > Remove spammy log spew when a datanode

[jira] [Updated] (HDFS-10528) Add logging to successful standby checkpointing

[ https://issues.apache.org/jira/browse/HDFS-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10528: -- Status: Patch Available (was: Open) > Add logging to successful standby checkpointing >

[jira] [Updated] (HDFS-10528) Add logging to successful standby checkpointing

[ https://issues.apache.org/jira/browse/HDFS-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10528: -- Attachment: HDFS-10528.00.patch > Add logging to successful standby checkpointing >

[jira] [Commented] (HDFS-9906) Remove spammy log spew when a datanode is restarted

[ https://issues.apache.org/jira/browse/HDFS-9906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332102#comment-15332102 ] Xiaoyu Yao commented on HDFS-9906: -- Thanks [~ajisakaa], cherry-pick to 2.7.3 and update fix version to

[jira] [Updated] (HDFS-9906) Remove spammy log spew when a datanode is restarted

[ https://issues.apache.org/jira/browse/HDFS-9906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9906: - Fix Version/s: (was: 2.7.4) 2.7.3 > Remove spammy log spew when a datanode is

[jira] [Commented] (HDFS-9924) [umbrella] Asynchronous HDFS Access

[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15310837#comment-15310837 ] Xiaoyu Yao commented on HDFS-9924: -- [~daryn], thanks for the valuable feedback. @Kihwal Lee also mentioned

[jira] [Comment Edited] (HDFS-9924) [umbrella] Asynchronous HDFS Access

[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15310837#comment-15310837 ] Xiaoyu Yao edited comment on HDFS-9924 at 6/1/16 6:31 PM: -- [~daryn], thanks for

[jira] [Created] (HDFS-10475) Adding metrics and warn/debug logs for long FSD lock

Xiaoyu Yao created HDFS-10475: - Summary: Adding metrics and warn/debug logs for long FSD lock Key: HDFS-10475 URL: https://issues.apache.org/jira/browse/HDFS-10475 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-10528) Add logging to successful standby checkpointing

Xiaoyu Yao created HDFS-10528: - Summary: Add logging to successful standby checkpointing Key: HDFS-10528 URL: https://issues.apache.org/jira/browse/HDFS-10528 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-10528) Add logging to successful standby checkpointing

[ https://issues.apache.org/jira/browse/HDFS-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330846#comment-15330846 ] Xiaoyu Yao commented on HDFS-10528: --- Plan to add a log entry after {{ lastCheckpointTime = now;}}. >

[jira] [Updated] (HDFS-10528) Add logging to successful standby checkpointing

[ https://issues.apache.org/jira/browse/HDFS-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10528: -- Status: Open (was: Patch Available) > Add logging to successful standby checkpointing >

[jira] [Updated] (HDFS-10528) Add logging to successful standby checkpointing

[ https://issues.apache.org/jira/browse/HDFS-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10528: -- Status: Patch Available (was: Open) > Add logging to successful standby checkpointing >

[jira] [Created] (HDFS-10539) DecayRpcScheduler MXBean should only report decayed CallVolumeSummary

Xiaoyu Yao created HDFS-10539: - Summary: DecayRpcScheduler MXBean should only report decayed CallVolumeSummary Key: HDFS-10539 URL: https://issues.apache.org/jira/browse/HDFS-10539 Project: Hadoop HDFS

[jira] [Comment Edited] (HDFS-10469) Add number of active xceivers to datanode metrics

[ https://issues.apache.org/jira/browse/HDFS-10469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342988#comment-15342988 ] Xiaoyu Yao edited comment on HDFS-10469 at 6/21/16 11:02 PM: - Thanks

[jira] [Commented] (HDFS-10469) Add number of active xceivers to datanode metrics

[ https://issues.apache.org/jira/browse/HDFS-10469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15342988#comment-15342988 ] Xiaoyu Yao commented on HDFS-10469: --- Thanks [~hanishakoneru] for updating the patch. The V4 patch looks

[jira] [Commented] (HDFS-10535) Rename AsyncDistributedFileSystem

[ https://issues.apache.org/jira/browse/HDFS-10535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334156#comment-15334156 ] Xiaoyu Yao commented on HDFS-10535: --- Thanks [~szetszwo] for working on this. The patch looks good to me

[jira] [Commented] (HDFS-10469) Add number of active xceivers to datanode metrics

[ https://issues.apache.org/jira/browse/HDFS-10469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347197#comment-15347197 ] Xiaoyu Yao commented on HDFS-10469: --- I finished testing this patch against the failed tests. Only

[jira] [Updated] (HDFS-10469) Add number of active xceivers to datanode metrics

[ https://issues.apache.org/jira/browse/HDFS-10469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10469: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-10469) Add number of active xceivers to datanode metrics

[ https://issues.apache.org/jira/browse/HDFS-10469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10469: -- Labels: datanode metrics (was: ) > Add number of active xceivers to datanode metrics >

[jira] [Created] (HDFS-10572) Fix TestOfflineEditsViewer#testGenerated

Xiaoyu Yao created HDFS-10572: - Summary: Fix TestOfflineEditsViewer#testGenerated Key: HDFS-10572 URL: https://issues.apache.org/jira/browse/HDFS-10572 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9759) Fix the typo in JvmPauseMonitor#getNumGcWarnThreadholdExceeded

[ https://issues.apache.org/jira/browse/HDFS-9759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134633#comment-15134633 ] Xiaoyu Yao commented on HDFS-9759: -- +1, I will commit it shortly. > Fix the typo in

[jira] [Commented] (HDFS-8660) Slow write to packet mirror should log which mirror and which block

[ https://issues.apache.org/jira/browse/HDFS-8660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133369#comment-15133369 ] Xiaoyu Yao commented on HDFS-8660: -- [~hazem], thanks for working on this. Can you rebase the patch to

[jira] [Commented] (HDFS-9688) Test the effect of nested encryption zones in HDFS downgrade

[ https://issues.apache.org/jira/browse/HDFS-9688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123865#comment-15123865 ] Xiaoyu Yao commented on HDFS-9688: -- bq. Also, renaming the root dir of a nested EZ won't be allowed,

[jira] [Updated] (HDFS-9210) Fix some misuse of %n in VolumeScanner#printStats

[ https://issues.apache.org/jira/browse/HDFS-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9210: - Resolution: Fixed Status: Resolved (was: Patch Available) Thanks all for the reviews. I've commit

[jira] [Resolved] (HDFS-9750) Document -source option for balancer

[ https://issues.apache.org/jira/browse/HDFS-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDFS-9750. -- Resolution: Duplicate > Document -source option for balancer > > >

[jira] [Commented] (HDFS-8923) Add -source flag to balancer usage message

[ https://issues.apache.org/jira/browse/HDFS-8923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15130969#comment-15130969 ] Xiaoyu Yao commented on HDFS-8923: -- [~ctrezzo], the patch v2 looks good to me. Can you rebase the patch to

[jira] [Created] (HDFS-9750) Document -source option for balancer

Xiaoyu Yao created HDFS-9750: Summary: Document -source option for balancer Key: HDFS-9750 URL: https://issues.apache.org/jira/browse/HDFS-9750 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-9723) Improve Namenode Throttling Against Bad Jobs with FCQ and CallerContext

Xiaoyu Yao created HDFS-9723: Summary: Improve Namenode Throttling Against Bad Jobs with FCQ and CallerContext Key: HDFS-9723 URL: https://issues.apache.org/jira/browse/HDFS-9723 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9843) Document distcp options required for copying between encrypted locations

[ https://issues.apache.org/jira/browse/HDFS-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9843: - Attachment: HDFS-9843.02.patch Thanks [~cnauroth]! Update the patch with the fixed the link. > Document

[jira] [Updated] (HDFS-9843) Document distcp options required for copying between encrypted locations

[ https://issues.apache.org/jira/browse/HDFS-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9843: - Attachment: HDFS-9843.01.patch Thanks [~cnauroth] for the review. Patch 01 fix the anchor to distcp

[jira] [Updated] (HDFS-9843) Document distcp options required for copying between encrypted locations

[ https://issues.apache.org/jira/browse/HDFS-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9843: - Affects Version/s: 2.6.0 > Document distcp options required for copying between encrypted locations >

[jira] [Updated] (HDFS-9843) Document distcp options required for copying between encrypted locations

[ https://issues.apache.org/jira/browse/HDFS-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9843: - Component/s: encryption documentation distcp > Document distcp options

[jira] [Created] (HDFS-9843) Document distcp options required for copying between encrypted locations

Xiaoyu Yao created HDFS-9843: Summary: Document distcp options required for copying between encrypted locations Key: HDFS-9843 URL: https://issues.apache.org/jira/browse/HDFS-9843 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9831) Document webhdfs retry configuration keys introduced by HDFS-5219/HDFS-5122

[ https://issues.apache.org/jira/browse/HDFS-9831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9831: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Tags: webhdfs

[jira] [Updated] (HDFS-9831) Document webhdfs retry configuration keys introduced by HDFS-5219/HDFS-5122

[ https://issues.apache.org/jira/browse/HDFS-9831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9831: - Thanks [~xiaobingo] for the contribution. I've committed the patch to trunk, branch-2, and branch-2.8. >

[jira] [Commented] (HDFS-9831) Document webhdfs retry configuration keys introduced by HDFS-5219/HDFS-5122

[ https://issues.apache.org/jira/browse/HDFS-9831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15167566#comment-15167566 ] Xiaoyu Yao commented on HDFS-9831: -- Thanks [~xiaobingo] for the update. One more issue found on the

[jira] [Updated] (HDFS-9843) Document distcp options required for copying between encrypted locations

[ https://issues.apache.org/jira/browse/HDFS-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9843: - Attachment: HDFS-9843.00.patch Attach a initial patch. > Document distcp options required for copying

[jira] [Updated] (HDFS-9843) Document distcp options required for copying between encrypted locations

[ https://issues.apache.org/jira/browse/HDFS-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9843: - Status: Patch Available (was: Open) > Document distcp options required for copying between encrypted

[jira] [Commented] (HDFS-9831) Document webhdfs retry configuration keys introduced by HDFS-5219/HDFS-5122

[ https://issues.apache.org/jira/browse/HDFS-9831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15168107#comment-15168107 ] Xiaoyu Yao commented on HDFS-9831: -- [~xiaobingo], thanks for the update. We need to add an anchor for the

[jira] [Commented] (HDFS-9831) Document webhdfs retry configuration keys introduced by HDFS-5219/HDFS-5122

[ https://issues.apache.org/jira/browse/HDFS-9831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166336#comment-15166336 ] Xiaoyu Yao commented on HDFS-9831: -- Thanks [~xiaobingo] for working on this. The patch looks good to me.

[jira] [Commented] (HDFS-9843) Document distcp options required for copying between encrypted locations

[ https://issues.apache.org/jira/browse/HDFS-9843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15166339#comment-15166339 ] Xiaoyu Yao commented on HDFS-9843: -- Thank you, [~cnauroth] for reviewing and committing the patch! >

[jira] [Commented] (HDFS-9667) StorageType: SSD precede over DISK

[ https://issues.apache.org/jira/browse/HDFS-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15109184#comment-15109184 ] Xiaoyu Yao commented on HDFS-9667: -- Thanks [~aderen] for reporting this, this seems to be a dup of

[jira] [Resolved] (HDFS-9667) StorageType: SSD precede over DISK

[ https://issues.apache.org/jira/browse/HDFS-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDFS-9667. -- Resolution: Fixed > StorageType: SSD precede over DISK > -- > >

[jira] [Commented] (HDFS-9799) Reimplement getCurrentTrashDir to remove incompatibility

[ https://issues.apache.org/jira/browse/HDFS-9799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148193#comment-15148193 ] Xiaoyu Yao commented on HDFS-9799: -- Thanks [~zhz] for reporting the issue and working on the fix. bq.

[jira] [Commented] (HDFS-9799) Reimplement getCurrentTrashDir to remove incompatibility

[ https://issues.apache.org/jira/browse/HDFS-9799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150698#comment-15150698 ] Xiaoyu Yao commented on HDFS-9799: -- Thanks [~zhz] for the explanation. Agree with your changes on

[jira] [Commented] (HDFS-9711) Integrate CSRF prevention filter in WebHDFS.

[ https://issues.apache.org/jira/browse/HDFS-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151128#comment-15151128 ] Xiaoyu Yao commented on HDFS-9711: -- Thanks [~cnauroth] for working on this. The patch looks good to me +1.

[jira] [Commented] (HDFS-9711) Integrate CSRF prevention filter in WebHDFS.

[ https://issues.apache.org/jira/browse/HDFS-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151258#comment-15151258 ] Xiaoyu Yao commented on HDFS-9711: -- LGTM, Thanks [~cnauroth] for the clarification! > Integrate CSRF

[jira] [Created] (HDFS-9831) Document webhdfs retry configuration keys introduced by HDFS-5219/HDFS-5122

Xiaoyu Yao created HDFS-9831: Summary: Document webhdfs retry configuration keys introduced by HDFS-5219/HDFS-5122 Key: HDFS-9831 URL: https://issues.apache.org/jira/browse/HDFS-9831 Project: Hadoop

[jira] [Commented] (HDFS-9839) Reduce verbosity of processReport logging

[ https://issues.apache.org/jira/browse/HDFS-9839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155858#comment-15155858 ] Xiaoyu Yao commented on HDFS-9839: -- Patch LGTM. +1. > Reduce verbosity of processReport logging >

[jira] [Commented] (HDFS-9881) DistributedFileSystem#getTrashRoot returns incorrect path for encryption zones

[ https://issues.apache.org/jira/browse/HDFS-9881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15174487#comment-15174487 ] Xiaoyu Yao commented on HDFS-9881: -- Thanks [~andrew.wang]. Patch LGTM, +1. >

[jira] [Created] (HDFS-10207) Support enable Hadoop IPC backoff without namenode restart

Xiaoyu Yao created HDFS-10207: - Summary: Support enable Hadoop IPC backoff without namenode restart Key: HDFS-10207 URL: https://issues.apache.org/jira/browse/HDFS-10207 Project: Hadoop HDFS

[jira] [Created] (HDFS-10209) Support enable caller context in HDFS namenode audit log without restart namenode

Xiaoyu Yao created HDFS-10209: - Summary: Support enable caller context in HDFS namenode audit log without restart namenode Key: HDFS-10209 URL: https://issues.apache.org/jira/browse/HDFS-10209 Project:

[jira] [Updated] (HDFS-10207) Support enable Hadoop IPC backoff without namenode restart

[ https://issues.apache.org/jira/browse/HDFS-10207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10207: -- Description: It will be useful to allow changing {{ipc.#port#.backoff.enable}} without a namenode

[jira] [Commented] (HDFS-10209) Support enable caller context in HDFS namenode audit log without restart namenode

[ https://issues.apache.org/jira/browse/HDFS-10209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15210805#comment-15210805 ] Xiaoyu Yao commented on HDFS-10209: --- The configuration key is {{hadoop.caller.context.enabled}} that is

[jira] [Updated] (HDFS-9887) WebHdfs socket timeouts should be configurable

[ https://issues.apache.org/jira/browse/HDFS-9887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9887: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Moved] (HDFS-9887) WebHdfs socket timeouts should be configurable

[ https://issues.apache.org/jira/browse/HDFS-9887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao moved HADOOP-12827 to HDFS-9887: --- Target Version/s: 2.8.0 (was: 2.9.0) Component/s: (was: fs)

[jira] [Commented] (HDFS-9887) WebHdfs socket timeouts should be configurable

[ https://issues.apache.org/jira/browse/HDFS-9887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183301#comment-15183301 ] Xiaoyu Yao commented on HDFS-9887: -- Thanks [~jojochuang] for reporting this. Further reading found that

[jira] [Assigned] (HDFS-9914) Fix configurable WebhDFS connect/read timeout

[ https://issues.apache.org/jira/browse/HDFS-9914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-9914: Assignee: Xiaoyu Yao > Fix configurable WebhDFS connect/read timeout >

[jira] [Updated] (HDFS-9914) Fix configurable WebhDFS connect/read timeout

[ https://issues.apache.org/jira/browse/HDFS-9914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9914: - Description: Webhdfs specific read/connect timeout as added HDFS-9887. This ticket is opened to fix the

[jira] [Updated] (HDFS-9914) Fix configurable WebhDFS connect/read timeout

[ https://issues.apache.org/jira/browse/HDFS-9914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9914: - Status: Patch Available (was: Open) > Fix configurable WebhDFS connect/read timeout >

[jira] [Updated] (HDFS-9914) Fix configurable WebhDFS connect/read timeout

[ https://issues.apache.org/jira/browse/HDFS-9914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9914: - Attachment: HDFS-9914.001.patch > Fix configurable WebhDFS connect/read timeout >

[jira] [Created] (HDFS-9914) Fix configurable WebhDFS connect/read timeout

Xiaoyu Yao created HDFS-9914: Summary: Fix configurable WebhDFS connect/read timeout Key: HDFS-9914 URL: https://issues.apache.org/jira/browse/HDFS-9914 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9887) WebHdfs socket timeouts should be configurable

[ https://issues.apache.org/jira/browse/HDFS-9887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183322#comment-15183322 ] Xiaoyu Yao commented on HDFS-9887: -- Filed HDFS-9914 for the fix. > WebHdfs socket timeouts should be

[jira] [Commented] (HDFS-9887) WebHdfs socket timeouts should be configurable

[ https://issues.apache.org/jira/browse/HDFS-9887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15183241#comment-15183241 ] Xiaoyu Yao commented on HDFS-9887: -- Agree, this is a bug. Webhdfs with ssl configuration exception will

[jira] [Updated] (HDFS-9723) Improve Namenode Throttling Against Bad Jobs with FCQ and CallerContext

[ https://issues.apache.org/jira/browse/HDFS-9723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-9723: - Description: HDFS namenode handles RPC requests from DFS clients and internal processing from datanodes.

[jira] [Updated] (HDFS-10253) Fix TestRefreshCallQueue failure.

[ https://issues.apache.org/jira/browse/HDFS-10253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10253: -- Attachment: HDFS-10253.00.patch Thanks [~brahmareddy] for catching this. Attach a simple fix for

[jira] [Updated] (HDFS-10253) Fix TestRefreshCallQueue failure.

[ https://issues.apache.org/jira/browse/HDFS-10253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-10253: -- Status: Patch Available (was: Open) > Fix TestRefreshCallQueue failure. >

[jira] [Commented] (HDFS-10209) Support enable caller context in HDFS namenode audit log without restart namenode

[ https://issues.apache.org/jira/browse/HDFS-10209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15217025#comment-15217025 ] Xiaoyu Yao commented on HDFS-10209: --- Thanks [~xiaobingo] for working on this. Patch looks good to me. +1

[jira] [Commented] (HDFS-10286) Fix TestDFSAdmin#testNameNodeGetReconfigurableProperties

[ https://issues.apache.org/jira/browse/HDFS-10286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240631#comment-15240631 ] Xiaoyu Yao commented on HDFS-10286: --- Patch looks good to me. +1 pending Jenkins. > Fix

[jira] [Commented] (HDFS-10209) Support enable caller context in HDFS namenode audit log without restart namenode

[ https://issues.apache.org/jira/browse/HDFS-10209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240592#comment-15240592 ] Xiaoyu Yao commented on HDFS-10209: --- I opened HDFS-10286 and attached your patch to it. > Support

[jira] [Commented] (HDFS-10209) Support enable caller context in HDFS namenode audit log without restart namenode

[ https://issues.apache.org/jira/browse/HDFS-10209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240588#comment-15240588 ] Xiaoyu Yao commented on HDFS-10209: --- [~xiaobingo], please open a separate ticket for the unit test fix

[jira] [Created] (HDFS-10286) Fix TestDFSAdmin#testNameNodeGetReconfigurableProperties

Xiaoyu Yao created HDFS-10286: - Summary: Fix TestDFSAdmin#testNameNodeGetReconfigurableProperties Key: HDFS-10286 URL: https://issues.apache.org/jira/browse/HDFS-10286 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-10324) Trash directory in an encryption zone should be pre-created with sticky bit

[ https://issues.apache.org/jira/browse/HDFS-10324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15256633#comment-15256633 ] Xiaoyu Yao commented on HDFS-10324: --- [~jojochuang], I mentioned #2 because Trash is client feature that

<    4   5   6   7   8   9   10   11   12   13   >