[jira] [Created] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-24 Thread Daniel Templeton (JIRA)
Daniel Templeton created HDFS-8950: -- Summary: NameNode refresh doesn't remove DataNodes Key: HDFS-8950 URL: https://issues.apache.org/jira/browse/HDFS-8950 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-9295) Add a thorough test of the full KMS code path

2015-10-23 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9295: --- Attachment: HDFS-9295.001.patch > Add a thorough test of the full KMS code path >

[jira] [Created] (HDFS-9295) Add a thorough test of the full KMS code path

2015-10-23 Thread Daniel Templeton (JIRA)
Daniel Templeton created HDFS-9295: -- Summary: Add a thorough test of the full KMS code path Key: HDFS-9295 URL: https://issues.apache.org/jira/browse/HDFS-9295 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-9295) Add a thorough test of the full KMS code path

2015-10-23 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9295: --- Affects Version/s: (was: 2.6.1) 2.7.1 Status: Patch

[jira] [Updated] (HDFS-9295) Add a thorough test of the full KMS code path

2015-10-23 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9295: --- Attachment: HDFS-9295.002.patch Fixed complier warnings > Add a thorough test of the full KMS

[jira] [Commented] (HDFS-9278) Typo in OIV

2015-10-21 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967454#comment-14967454 ] Daniel Templeton commented on HDFS-9278: Looks good to me. +1 (non-binding) > Typo in OIV >

[jira] [Updated] (HDFS-9339) Extend full test of KMS ACLs

2015-10-29 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9339: --- Status: Patch Available (was: Open) [~zhz], can you take a look when you get a chance? >

[jira] [Updated] (HDFS-9339) Extend full test of KMS ACLs

2015-10-29 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9339: --- Attachment: HDFS-9339.001.patch > Extend full test of KMS ACLs >

[jira] [Created] (HDFS-9339) Extend full test of KMS ACLs

2015-10-29 Thread Daniel Templeton (JIRA)
Daniel Templeton created HDFS-9339: -- Summary: Extend full test of KMS ACLs Key: HDFS-9339 URL: https://issues.apache.org/jira/browse/HDFS-9339 Project: Hadoop HDFS Issue Type: Test

[jira] [Commented] (HDFS-9339) Extend full test of KMS ACLs

2015-10-29 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981239#comment-14981239 ] Daniel Templeton commented on HDFS-9339: 1. The createKey method is a local method that wraps the

[jira] [Commented] (HDFS-9339) Extend full test of KMS ACLs

2015-10-29 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981299#comment-14981299 ] Daniel Templeton commented on HDFS-9339: bq. Maybe remove the try-finally and let the entire test

[jira] [Updated] (HDFS-9295) Add a thorough test of the full KMS code path

2015-10-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9295: --- Attachment: HDFS-9295.003.patch [~zhz], I think this patch addresses all of your concerns. >

[jira] [Created] (HDFS-9300) DirectoryScanner.testThrottle() is still a little flakey

2015-10-23 Thread Daniel Templeton (JIRA)
Daniel Templeton created HDFS-9300: -- Summary: DirectoryScanner.testThrottle() is still a little flakey Key: HDFS-9300 URL: https://issues.apache.org/jira/browse/HDFS-9300 Project: Hadoop HDFS

[jira] [Updated] (HDFS-9300) DirectoryScanner.testThrottle() is still a little flakey

2015-10-23 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9300: --- Attachment: HDFS-9300.001.patch Trivial patch > DirectoryScanner.testThrottle() is still a

[jira] [Updated] (HDFS-9300) DirectoryScanner.testThrottle() is still a little flakey

2015-10-23 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9300: --- Status: Patch Available (was: Open) > DirectoryScanner.testThrottle() is still a little

[jira] [Updated] (HDFS-9397) Fix typo for readChecksum() LOG.warn in BlockSender.java

2015-11-16 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9397: --- Assignee: Enrique Flores (was: Nicole Pazmany) > Fix typo for readChecksum() LOG.warn in

[jira] [Updated] (HDFS-9353) Code and comment mismatch in JavaKeyStoreProvider

2015-11-02 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9353: --- Assignee: Nicole Pazmany > Code and comment mismatch in JavaKeyStoreProvider >

[jira] [Updated] (HDFS-9397) Fix typo for readChecksum() LOG.warn in BlockSender.java

2015-11-06 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9397: --- Assignee: Nicole Pazmany > Fix typo for readChecksum() LOG.warn in BlockSender.java >

[jira] [Updated] (HDFS-9339) Extend full test of KMS ACLs

2015-11-02 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9339: --- Attachment: HDFS-9339.002.patch [~zhz], I tried making the tests use one big try-finally

[jira] [Commented] (HDFS-9210) Fix some misuse of %n in VolumeScanner#printStats

2015-10-14 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14957805#comment-14957805 ] Daniel Templeton commented on HDFS-9210: I'm confused. Looking at the patch, this: {code}

[jira] [Commented] (HDFS-9274) Default value of dfs.datanode.directoryscan.throttle.limit.ms.per.sec should be consistent

2015-10-20 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14966262#comment-14966262 ] Daniel Templeton commented on HDFS-9274: Thanks, [~hitliuyi]. Not sure how that slipped past me.

[jira] [Resolved] (HDFS-9176) TestDirectoryScanner#testThrottling often fails.

2015-10-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton resolved HDFS-9176. Resolution: Not A Problem The test failed twice is an odd way and hasn't failed since in the

[jira] [Commented] (HDFS-9176) TestDirectoryScanner#testThrottling often fails.

2015-10-06 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945468#comment-14945468 ] Daniel Templeton commented on HDFS-9176: Once the block scanner has run, there's no point in

[jira] [Commented] (HDFS-9176) TestDirectoryScanner#testThrottling often fails.

2015-10-06 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945841#comment-14945841 ] Daniel Templeton commented on HDFS-9176: I poked at it a bit, and it's not possible to reduce the

[jira] [Commented] (HDFS-9181) Better handling of exceptions thrown during upgrade shutdown

2015-10-06 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14945928#comment-14945928 ] Daniel Templeton commented on HDFS-9181: Since the logging message doesn't actually provide anyone

[jira] [Updated] (HDFS-9176) TestDirectoryScanner#testThrottling often fails.

2015-10-06 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9176: --- Attachment: HDFS-9176.002.patch I made one small change to (slightly) reduce the likelihood

[jira] [Commented] (HDFS-9220) ChecksumException after writing less than 512 bytes

2015-10-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951303#comment-14951303 ] Daniel Templeton commented on HDFS-9220: I saw a similar issue, and it went away when I backed out

[jira] [Commented] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

2015-10-13 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14955512#comment-14955512 ] Daniel Templeton commented on HDFS-9220: My testing shows that change fixes the issue I see. >

[jira] [Commented] (HDFS-9220) Reading small file (< 512 bytes) that is open for append fails due to incorrect checksum

2015-10-13 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956016#comment-14956016 ] Daniel Templeton commented on HDFS-9220: Thanks, [~jingzhao]. Could you add some comments to the

[jira] [Commented] (HDFS-2896) The 2NN incorrectly daemonizes

2015-08-26 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715439#comment-14715439 ] Daniel Templeton commented on HDFS-2896: The comment in the 2NN that the checkpoint

[jira] [Updated] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-26 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8950: --- Attachment: HDFS-8950.003.patch New patch that includes changes to

[jira] [Assigned] (HDFS-328) fs -setrep should have better error message

2015-08-27 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned HDFS-328: - Assignee: Daniel Templeton (was: Ravi Phulari) No recent activity, reassigning. fs

[jira] [Updated] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-27 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8950: --- Attachment: HDFS-8950.004.patch Here's another pass that replaces most of the Whitebox stuff

[jira] [Work started] (HDFS-2070) A lack of auto-test for FsShell getmerge in hdfs

2015-08-26 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-2070 started by Daniel Templeton. -- A lack of auto-test for FsShell getmerge in hdfs

[jira] [Commented] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-26 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14715642#comment-14715642 ] Daniel Templeton commented on HDFS-8950: Thanks! On the last point, I was erring

[jira] [Assigned] (HDFS-2070) A lack of auto-test for FsShell getmerge in hdfs

2015-08-26 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned HDFS-2070: -- Assignee: Daniel Templeton A lack of auto-test for FsShell getmerge in hdfs

[jira] [Updated] (HDFS-328) fs -setrep should have better error message

2015-08-27 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-328: -- Attachment: HDFS-328.001.patch Adding patch that includes a change to the

[jira] [Updated] (HDFS-328) fs -setrep should have better error message

2015-08-27 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-328: -- Attachment: (was: HDFS-328.001.patch) fs -setrep should have better error message

[jira] [Updated] (HDFS-328) fs -setrep should have better error message

2015-08-27 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-328: -- Status: Patch Available (was: Open) fs -setrep should have better error message

[jira] [Updated] (HDFS-328) fs -setrep should have better error message

2015-08-27 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-328: -- Attachment: HDFS-328.001.patch Oops. Missed some whitespace. Reposting patch. fs -setrep

[jira] [Updated] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8950: --- Attachment: HDFS-8950.005.patch Tests are all passing. Again. NameNode refresh doesn't

[jira] [Updated] (HDFS-2070) A lack of auto-test for FsShell getmerge in hdfs

2015-08-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-2070: --- Status: Patch Available (was: In Progress) Ready for review. This should be a quick and easy

[jira] [Updated] (HDFS-2070) A lack of auto-test for FsShell getmerge in hdfs

2015-08-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-2070: --- Attachment: HDFS-2070.001.patch Turns out there was already one getmerge test in the

[jira] [Updated] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8950: --- Attachment: 28531.patch Here's a patch for a unit test and fix. The HostFileManager now

[jira] [Commented] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-26 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14713414#comment-14713414 ] Daniel Templeton commented on HDFS-8950: No idea why TestAuditLogs and

[jira] [Commented] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-26 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14714163#comment-14714163 ] Daniel Templeton commented on HDFS-8950: Looking more closely at TestDecommission,

[jira] [Created] (HDFS-9001) DFSUtil.getNsServiceRpcUris() can return too many entries in a non-HA, non-federated cluster

2015-09-01 Thread Daniel Templeton (JIRA)
Daniel Templeton created HDFS-9001: -- Summary: DFSUtil.getNsServiceRpcUris() can return too many entries in a non-HA, non-federated cluster Key: HDFS-9001 URL: https://issues.apache.org/jira/browse/HDFS-9001

[jira] [Updated] (HDFS-8873) throttle directoryScanner

2015-09-02 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8873: --- Issue Type: Improvement (was: Bug) > throttle directoryScanner > - >

[jira] [Updated] (HDFS-8873) throttle directoryScanner

2015-09-02 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8873: --- Target Version/s: 2.8.0 > throttle directoryScanner > - > >

[jira] [Assigned] (HDFS-8873) throttle directoryScanner

2015-09-02 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned HDFS-8873: -- Assignee: Daniel Templeton > throttle directoryScanner > - > >

[jira] [Resolved] (HDFS-8989) Allow rate-limiting the DirectoryScanner via time-slicing

2015-09-02 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton resolved HDFS-8989. Resolution: Duplicate This is the same issue as HDFS-8873 as far as I can see. I'll add the

[jira] [Commented] (HDFS-8873) throttle directoryScanner

2015-09-02 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14727627#comment-14727627 ] Daniel Templeton commented on HDFS-8873: Suggestion from HDFS-8989: We should allow rate-limiting

[jira] [Commented] (HDFS-9001) DFSUtil.getNsServiceRpcUris() can return too many entries in a non-HA, non-federated cluster

2015-09-02 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14727442#comment-14727442 ] Daniel Templeton commented on HDFS-9001: I've stared at this thing for quite a while now, and I

[jira] [Updated] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8950: --- Fix Version/s: 2.8.0 Status: Patch Available (was: In Progress) Ready for review

[jira] [Updated] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8950: --- Attachment: HDFS-8950.002.patch Just noticed an extraneous import in the patch. (Swing?!?

[jira] [Updated] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8950: --- Attachment: (was: 28531.patch) NameNode refresh doesn't remove DataNodes

[jira] [Commented] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712123#comment-14712123 ] Daniel Templeton commented on HDFS-8950: Pulled the patch temporarily while

[jira] [Updated] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8950: --- Attachment: HDFS-8950.001.patch Once more with feeling. NameNode refresh doesn't remove

[jira] [Work started] (HDFS-8950) NameNode refresh doesn't remove DataNodes

2015-08-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-8950 started by Daniel Templeton. -- NameNode refresh doesn't remove DataNodes

[jira] [Commented] (HDFS-9024) Deprecate TotalFiles metric

2015-09-10 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739345#comment-14739345 ] Daniel Templeton commented on HDFS-9024: I don't see any UI files that use TotalFiles. Did you

[jira] [Commented] (HDFS-9024) Deprecate TotalFiles metric

2015-09-10 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739747#comment-14739747 ] Daniel Templeton commented on HDFS-9024: Not sure why the build failed for the tests in Jenkins.

[jira] [Updated] (HDFS-9065) Include commas on # of files, blocks, total filesystem objects in NN Web UI

2015-09-13 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9065: --- Attachment: HDFS-9065.003.patch Holy cow, that was an adventure. It's just 1 line of code,

[jira] [Updated] (HDFS-8873) throttle directoryScanner

2015-09-14 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8873: --- Attachment: HDFS-8873.002.patch [~cmccabe], I implemented all of your suggestions except the

[jira] [Updated] (HDFS-8873) throttle directoryScanner

2015-09-14 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8873: --- Attachment: HDFS-8873.002.patch Cleaned up a couple checkstyle and whitespace issues >

[jira] [Updated] (HDFS-8873) throttle directoryScanner

2015-09-14 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8873: --- Attachment: (was: HDFS-8873.002.patch) > throttle directoryScanner >

[jira] [Updated] (HDFS-8873) throttle directoryScanner

2015-09-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8873: --- Status: Patch Available (was: Open) > throttle directoryScanner > - >

[jira] [Updated] (HDFS-8873) throttle directoryScanner

2015-09-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8873: --- Attachment: HDFS-8873.001.patch Here's a patch to add a time-based throttle. The changes are

[jira] [Created] (HDFS-9065) Include commas on # of files, blocks, total filesystem objects in NN Web UI

2015-09-11 Thread Daniel Templeton (JIRA)
Daniel Templeton created HDFS-9065: -- Summary: Include commas on # of files, blocks, total filesystem objects in NN Web UI Key: HDFS-9065 URL: https://issues.apache.org/jira/browse/HDFS-9065 Project:

[jira] [Updated] (HDFS-9065) Include commas on # of files, blocks, total filesystem objects in NN Web UI

2015-09-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9065: --- Attachment: HDFS-9065.001.patch > Include commas on # of files, blocks, total filesystem

[jira] [Updated] (HDFS-9065) Include commas on # of files, blocks, total filesystem objects in NN Web UI

2015-09-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9065: --- Status: Patch Available (was: Open) > Include commas on # of files, blocks, total filesystem

[jira] [Updated] (HDFS-8873) throttle directoryScanner

2015-09-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8873: --- Attachment: HDFS-8873.001.patch Resolved some of the checkstyle issues. On the line too long

[jira] [Updated] (HDFS-8873) throttle directoryScanner

2015-09-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8873: --- Attachment: (was: HDFS-8873.001.patch) > throttle directoryScanner >

[jira] [Commented] (HDFS-9042) Update document for the Storage policy name

2015-09-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14740820#comment-14740820 ] Daniel Templeton commented on HDFS-9042: I don't see anywhere else where that typo pops up. Looks

[jira] [Updated] (HDFS-9065) Include commas on # of files, blocks, total filesystem objects in NN Web UI

2015-09-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9065: --- Attachment: HDFS-9065.002.patch Good suggestion. Here's a new patch. > Include commas on #

[jira] [Updated] (HDFS-9065) Include commas on # of files, blocks, total filesystem objects in NN Web UI

2015-09-12 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9065: --- Attachment: HDFS-9065.002.patch Simplified the patch a bit. > Include commas on # of files,

[jira] [Updated] (HDFS-9065) Include commas on # of files, blocks, total filesystem objects in NN Web UI

2015-09-12 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9065: --- Attachment: (was: HDFS-9065.002.patch) > Include commas on # of files, blocks, total

[jira] [Commented] (HDFS-7466) Allow different values for dfs.datanode.balance.max.concurrent.moves per datanode

2015-09-15 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14745720#comment-14745720 ] Daniel Templeton commented on HDFS-7466: (Subtext: if you're busy with other stuff, I'd be happy to

[jira] [Updated] (HDFS-9065) Include commas on # of files, blocks, total filesystem objects in NN Web UI

2015-09-14 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9065: --- Attachment: HDFS-9065.003.patch Making me work for it. :) Resolved. > Include commas on # of

[jira] [Updated] (HDFS-9001) DFSUtil.getNsServiceRpcUris() can return too many entries in a non-HA, non-federated cluster

2015-09-15 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9001: --- Status: Patch Available (was: Open) > DFSUtil.getNsServiceRpcUris() can return too many

[jira] [Updated] (HDFS-9001) DFSUtil.getNsServiceRpcUris() can return too many entries in a non-HA, non-federated cluster

2015-09-15 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9001: --- Attachment: HDFS-9001.001.patch Cool. Here's a patch. > DFSUtil.getNsServiceRpcUris() can

[jira] [Updated] (HDFS-8873) throttle directoryScanner

2015-09-16 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8873: --- Attachment: HDFS-8873.003.patch New patch. [~cmccabe], I addressed your concerns about key

[jira] [Updated] (HDFS-8873) throttle directoryScanner

2015-09-17 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8873: --- Attachment: HDFS-8873.003.patch Reposting patch. > throttle directoryScanner >

[jira] [Updated] (HDFS-8873) throttle directoryScanner

2015-09-17 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-8873: --- Attachment: (was: HDFS-8873.003.patch) > throttle directoryScanner >

[jira] [Commented] (HDFS-8873) throttle directoryScanner

2015-09-17 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14804279#comment-14804279 ] Daniel Templeton commented on HDFS-8873: [sigh] Those tests pass for me locally, so can't say why

[jira] [Commented] (HDFS-7466) Allow different values for dfs.datanode.balance.max.concurrent.moves per datanode

2015-09-14 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14744012#comment-14744012 ] Daniel Templeton commented on HDFS-7466: [~benoy], are you still working on this? Here's a wacky

[jira] [Commented] (HDFS-9151) Mover should print the exit status/reason on console like balancer tool.

2015-09-29 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935117#comment-14935117 ] Daniel Templeton commented on HDFS-9151: +1 (non-binding) > Mover should print the exit

[jira] [Assigned] (HDFS-9176) TestDirectoryScanner#testThrottling often fails.

2015-09-29 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned HDFS-9176: -- Assignee: Daniel Templeton > TestDirectoryScanner#testThrottling often fails. >

[jira] [Commented] (HDFS-9176) TestDirectoryScanner#testThrottling often fails.

2015-09-29 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935305#comment-14935305 ] Daniel Templeton commented on HDFS-9176: It's probably the timing-based nature of the test. I'll

[jira] [Commented] (HDFS-9158) [OEV-Doc] : Document does not mention about "-f" and "-r" options

2015-09-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14933546#comment-14933546 ] Daniel Templeton commented on HDFS-9158: Works for me. +1 (non-binding) > [OEV-Doc] : Document

[jira] [Commented] (HDFS-9174) Fix the latest findbugs of FSOutputSummer.tracer and DirectoryScanner$ReportCompiler.currentThread

2015-09-29 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935843#comment-14935843 ] Daniel Templeton commented on HDFS-9174: The changes look good to me. +1 (non-binding) > Fix the

[jira] [Commented] (HDFS-8873) Allow the directoryScanner to be rate-limited

2015-09-29 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14935941#comment-14935941 ] Daniel Templeton commented on HDFS-8873: Already patched in HDFS-9174 > Allow the directoryScanner

[jira] [Created] (HDFS-9179) fs.defaultFS should not be used on the server side

2015-09-30 Thread Daniel Templeton (JIRA)
Daniel Templeton created HDFS-9179: -- Summary: fs.defaultFS should not be used on the server side Key: HDFS-9179 URL: https://issues.apache.org/jira/browse/HDFS-9179 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9181) Better handling of exceptions thrown during upgrade shutdown

2015-09-30 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14938899#comment-14938899 ] Daniel Templeton commented on HDFS-9181: My concern is mostly that swallowing a Throwable can have

[jira] [Commented] (HDFS-9158) [OEV-Doc] : Document does not mention about "-f" and "-r" options

2015-09-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14933437#comment-14933437 ] Daniel Templeton commented on HDFS-9158: Looks like you're missing the spaces in "input,so" and

[jira] [Commented] (HDFS-9151) Mover should print the exit status/reason on console like balancer tool.

2015-09-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14933430#comment-14933430 ] Daniel Templeton commented on HDFS-9151: Thanks, [~surendrasingh]. I have a couple of language

[jira] [Commented] (HDFS-9024) Deprecate TotalFiles metric

2015-09-09 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14737295#comment-14737295 ] Daniel Templeton commented on HDFS-9024: In general the patch looks fine to me. Note that there is

[jira] [Commented] (HDFS-1312) Re-balance disks within a Datanode

2015-10-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14944172#comment-14944172 ] Daniel Templeton commented on HDFS-1312: The reporting aspect should perhaps be handled under

[jira] [Reopened] (HDFS-9176) TestDirectoryScanner#testThrottling often fails.

2015-10-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reopened HDFS-9176: The latest build hit the same issue again, so it wasn't just a temporary environmental effect.

[jira] [Updated] (HDFS-9176) TestDirectoryScanner#testThrottling often fails.

2015-10-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9176: --- Attachment: HDFS-9176.001.patch Doh. If you look carefully at these log lines, you'll see the

[jira] [Updated] (HDFS-9176) TestDirectoryScanner#testThrottling often fails.

2015-10-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated HDFS-9176: --- Status: Patch Available (was: Reopened) > TestDirectoryScanner#testThrottling often fails. >

  1   2   3   4   5   >