[jira] [Commented] (HDFS-6092) DistributedFileSystem#getCanonicalServiceName() and DistributedFileSystem#getUri() may return inconsistent results w.r.t. port

2018-09-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16629503#comment-16629503 ] Ted Yu commented on HDFS-6092: -- Test failure was not related. >

[jira] [Commented] (HDFS-6092) DistributedFileSystem#getCanonicalServiceName() and DistributedFileSystem#getUri() may return inconsistent results w.r.t. port

2018-09-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16618259#comment-16618259 ] Ted Yu commented on HDFS-6092: -- Test failure was not related. >

[jira] [Comment Edited] (HDFS-13515) NetUtils#connect should log remote address for NoRouteToHostException

2018-09-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471170#comment-16471170 ] Ted Yu edited comment on HDFS-13515 at 9/17/18 11:01 PM: - Can you log the remote

[jira] [Comment Edited] (HDFS-13515) NetUtils#connect should log remote address for NoRouteToHostException

2018-08-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471170#comment-16471170 ] Ted Yu edited comment on HDFS-13515 at 8/2/18 8:27 PM: --- Can you log the remote

[jira] [Commented] (HDFS-13511) Provide specialized exception when block length cannot be obtained

2018-06-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509677#comment-16509677 ] Ted Yu commented on HDFS-13511: --- Can this be merged into 3.1 branch ? thanks > Provide specialized

[jira] [Commented] (HDFS-6092) DistributedFileSystem#getCanonicalServiceName() and DistributedFileSystem#getUri() may return inconsistent results w.r.t. port

2018-05-20 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16482132#comment-16482132 ] Ted Yu commented on HDFS-6092: -- Test failure was not related. >

[jira] [Comment Edited] (HDFS-13515) NetUtils#connect should log remote address for NoRouteToHostException

2018-05-20 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471170#comment-16471170 ] Ted Yu edited comment on HDFS-13515 at 5/21/18 2:42 AM: Can you log the remote

[jira] [Commented] (HDFS-13515) NetUtils#connect should log remote address for NoRouteToHostException

2018-05-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471170#comment-16471170 ] Ted Yu commented on HDFS-13515: --- Can you log the remote address in case of exception ? > NetUtils#connect

[jira] [Created] (HDFS-13515) NetUtils#connect should log remote address for NoRouteToHostException

2018-04-28 Thread Ted Yu (JIRA)
Ted Yu created HDFS-13515: - Summary: NetUtils#connect should log remote address for NoRouteToHostException Key: HDFS-13515 URL: https://issues.apache.org/jira/browse/HDFS-13515 Project: Hadoop HDFS

[jira] [Created] (HDFS-13511) Provide specialized exception when block length cannot be obtained

2018-04-27 Thread Ted Yu (JIRA)
Ted Yu created HDFS-13511: - Summary: Provide specialized exception when block length cannot be obtained Key: HDFS-13511 URL: https://issues.apache.org/jira/browse/HDFS-13511 Project: Hadoop HDFS

[jira] [Comment Edited] (HDFS-7101) Potential null dereference in DFSck#doWork()

2018-04-09 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368441#comment-16368441 ] Ted Yu edited comment on HDFS-7101 at 4/10/18 1:03 AM: --- More review, please . was

[jira] [Commented] (HDFS-12574) Add CryptoInputStream to WebHdfsFileSystem read call.

2018-03-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16408652#comment-16408652 ] Ted Yu commented on HDFS-12574: --- See if you have recommendation on how the following code can be formulated

[jira] [Commented] (HDFS-12574) Add CryptoInputStream to WebHdfsFileSystem read call.

2018-03-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16408628#comment-16408628 ] Ted Yu commented on HDFS-12574: --- Is it possible to expose decryptEncryptedDataEncryptionKey in a

[jira] [Commented] (HDFS-12574) Add CryptoInputStream to WebHdfsFileSystem read call.

2018-03-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16408590#comment-16408590 ] Ted Yu commented on HDFS-12574: --- hbase 2.0 needs to call HdfsKMSUtil#decryptEncryptedDataEncryptionKey

[jira] [Commented] (HDFS-13206) IllegalStateException: Unable to finalize edits file

2018-02-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380902#comment-16380902 ] Ted Yu commented on HDFS-13206: --- {code} devtmpfs 65906460 0 65906460 0% /dev tmpfs

[jira] [Commented] (HDFS-13206) IllegalStateException: Unable to finalize edits file

2018-02-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380829#comment-16380829 ] Ted Yu commented on HDFS-13206: --- I don't think that was the case. I used {{df}} command on the Linux where

[jira] [Updated] (HDFS-13206) IllegalStateException: Unable to finalize edits file

2018-02-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-13206: -- Attachment: testFavoredNodeTableImport-output.txt > IllegalStateException: Unable to finalize edits file >

[jira] [Created] (HDFS-13206) IllegalStateException: Unable to finalize edits file

2018-02-28 Thread Ted Yu (JIRA)
Ted Yu created HDFS-13206: - Summary: IllegalStateException: Unable to finalize edits file Key: HDFS-13206 URL: https://issues.apache.org/jira/browse/HDFS-13206 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-6092) DistributedFileSystem#getCanonicalServiceName() and DistributedFileSystem#getUri() may return inconsistent results w.r.t. port

2018-02-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6092: - Attachment: HDFS-6092-v5.patch > DistributedFileSystem#getCanonicalServiceName() and >

[jira] [Updated] (HDFS-6092) DistributedFileSystem#getCanonicalServiceName() and DistributedFileSystem#getUri() may return inconsistent results w.r.t. port

2018-02-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6092: - Assignee: Ted Yu Status: Patch Available (was: Open) > DistributedFileSystem#getCanonicalServiceName() and

[jira] [Commented] (HDFS-7101) Potential null dereference in DFSck#doWork()

2018-02-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368441#comment-16368441 ] Ted Yu commented on HDFS-7101: -- More review, please. > Potential null dereference in DFSck#doWork() >

[jira] [Updated] (HDFS-5750) JHLogAnalyzer#parseLogFile() should close stm upon return

2017-12-24 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-5750: - Description: stm is assigned to in. But stm may point to another InputStream : {code} if(compressionClass

[jira] [Commented] (HDFS-7101) Potential null dereference in DFSck#doWork()

2017-12-24 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302861#comment-16302861 ] Ted Yu commented on HDFS-7101: -- TestFailureToReadEdits failure was not related to patch. > Potential null

[jira] [Updated] (HDFS-6092) DistributedFileSystem#getCanonicalServiceName() and DistributedFileSystem#getUri() may return inconsistent results w.r.t. port

2017-12-24 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6092: - Status: Open (was: Patch Available) > DistributedFileSystem#getCanonicalServiceName() and >

[jira] [Comment Edited] (HDFS-7101) Potential null dereference in DFSck#doWork()

2017-12-13 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124972#comment-15124972 ] Ted Yu edited comment on HDFS-7101 at 12/14/17 1:53 AM: Agreed. was (Author:

[jira] [Resolved] (HDFS-5012) replica.getGenerationStamp() may be >= recoveryId

2017-11-04 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HDFS-5012. -- Resolution: Cannot Reproduce > replica.getGenerationStamp() may be >= recoveryId >

[jira] [Updated] (HDFS-5750) JHLogAnalyzer#parseLogFile() should close stm upon return

2017-11-04 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-5750: - Description: stm is assigned to in But stm may point to another InputStream : {code} if(compressionClass

[jira] [Updated] (HDFS-5750) JHLogAnalyzer#parseLogFile() should close stm upon return

2017-10-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-5750: - Description: stm is assigned to in But stm may point to another InputStream : {code} if(compressionClass

[jira] [Commented] (HDFS-5012) replica.getGenerationStamp() may be >= recoveryId

2017-10-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16214331#comment-16214331 ] Ted Yu commented on HDFS-5012: -- Planning to resolve this since there has been no repro. >

[jira] [Resolved] (HDFS-4796) Port HDFS-4721 'Speed up lease/block recovery when DN fails and a block goes into recovery' to branch 1

2017-10-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HDFS-4796. -- Resolution: Won't Fix > Port HDFS-4721 'Speed up lease/block recovery when DN fails and a block goes > into

[jira] [Resolved] (HDFS-5834) TestCheckpoint#testCheckpoint may fail due to Bad value assertion

2017-10-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HDFS-5834. -- Resolution: Cannot Reproduce > TestCheckpoint#testCheckpoint may fail due to Bad value assertion >

[jira] [Resolved] (HDFS-5831) TestAuditLogs#testAuditAllowedStat sometimes fails in trunk

2017-10-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HDFS-5831. -- Resolution: Cannot Reproduce > TestAuditLogs#testAuditAllowedStat sometimes fails in trunk >

[jira] [Resolved] (HDFS-5718) TestHttpsFileSystem intermittently fails with Port in use error

2017-10-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HDFS-5718. -- Resolution: Cannot Reproduce > TestHttpsFileSystem intermittently fails with Port in use error >

[jira] [Updated] (HDFS-12599) Move DataNodeTestUtils.mockDatanodeBlkPinning into mock test util class

2017-10-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-12599: -- Attachment: HDFS-12599.v1.patch > Move DataNodeTestUtils.mockDatanodeBlkPinning into mock test util class >

[jira] [Updated] (HDFS-12599) Move DataNodeTestUtils.mockDatanodeBlkPinning into mock test util class

2017-10-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-12599: -- Attachment: HDFS-12599.v1.patch Rerun QA. > Move DataNodeTestUtils.mockDatanodeBlkPinning into mock test util

[jira] [Commented] (HDFS-12599) Move DataNodeTestUtils.mockDatanodeBlkPinning into mock test util class

2017-10-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193960#comment-16193960 ] Ted Yu commented on HDFS-12599: --- Don't think the failed tests were related to the patch. Ran

[jira] [Updated] (HDFS-12599) Move DataNodeTestUtils.mockDatanodeBlkPinning into mock test util class

2017-10-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-12599: -- Assignee: Ted Yu Status: Patch Available (was: Open) > Move DataNodeTestUtils.mockDatanodeBlkPinning

[jira] [Updated] (HDFS-12599) Move DataNodeTestUtils.mockDatanodeBlkPinning into mock test util class

2017-10-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-12599: -- Attachment: HDFS-12599.v1.patch > Move DataNodeTestUtils.mockDatanodeBlkPinning into mock test util class >

[jira] [Created] (HDFS-12599) Move DataNodeTestUtils.mockDatanodeBlkPinning into mock test util class

2017-10-05 Thread Ted Yu (JIRA)
Ted Yu created HDFS-12599: - Summary: Move DataNodeTestUtils.mockDatanodeBlkPinning into mock test util class Key: HDFS-12599 URL: https://issues.apache.org/jira/browse/HDFS-12599 Project: Hadoop HDFS

[jira] [Commented] (HDFS-12599) Move DataNodeTestUtils.mockDatanodeBlkPinning into mock test util class

2017-10-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193492#comment-16193492 ] Ted Yu commented on HDFS-12599: --- How about moving the method to

[jira] [Updated] (HDFS-11214) Upgrade netty-all to 4.1.1.Final

2017-01-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-11214: -- Attachment: HDFS-11214.v7.patch > Upgrade netty-all to 4.1.1.Final > > >

[jira] [Commented] (HDFS-6092) DistributedFileSystem#getCanonicalServiceName() and DistributedFileSystem#getUri() may return inconsistent results w.r.t. port

2016-10-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15617127#comment-15617127 ] Ted Yu commented on HDFS-6092: -- Patch v4 has gone stale. > DistributedFileSystem#getCanonicalServiceName()

[jira] [Commented] (HDFS-7567) Potential null dereference in FSEditLogLoader#applyEditLogOp()

2016-08-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15424817#comment-15424817 ] Ted Yu commented on HDFS-7567: -- Thanks for the link, [~jojochuang] > Potential null dereference in

[jira] [Commented] (HDFS-8548) Minicluster throws NPE on shutdown

2016-06-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15314619#comment-15314619 ] Ted Yu commented on HDFS-8548: -- Can this be backported to 2.7 branch ? Thanks > Minicluster throws NPE on

[jira] [Commented] (HDFS-7101) Potential null dereference in DFSck#doWork()

2016-01-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124972#comment-15124972 ] Ted Yu commented on HDFS-7101: -- Agree. > Potential null dereference in DFSck#doWork() >

[jira] [Commented] (HDFS-7694) FSDataInputStream should support "unbuffer"

2016-01-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114065#comment-15114065 ] Ted Yu commented on HDFS-7694: -- [~cmccabe] [~djp]: Patch applies on branch-2.6 cleanly. Can you commit to

[jira] [Commented] (HDFS-7694) FSDataInputStream should support "unbuffer"

2016-01-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15114069#comment-15114069 ] Ted Yu commented on HDFS-7694: -- [~cmccabe] [~djp]: Patch applies on branch-2.6 cleanly. Can you commit to

[jira] [Updated] (HDFS-7101) Potential null dereference in DFSck#doWork()

2016-01-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-7101: - Attachment: HDFS-7101.v1.patch > Potential null dereference in DFSck#doWork() >

[jira] [Commented] (HDFS-7694) FSDataInputStream should support "unbuffer"

2016-01-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15113588#comment-15113588 ] Ted Yu commented on HDFS-7694: -- Is there compatibility concern for backporting this to 2.6 branch ? Thanks >

[jira] [Commented] (HDFS-7101) Potential null dereference in DFSck#doWork()

2016-01-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090348#comment-15090348 ] Ted Yu commented on HDFS-7101: -- Looks like the patch needs to be updated. > Potential null dereference in

[jira] [Updated] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2015-10-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6481: - Description: Ian Brooks reported the following stack trace: {code} 2014-06-03 13:05:03,915 WARN [DataStreamer for

[jira] [Commented] (HDFS-6264) Provide FileSystem#create() variant which throws exception if parent directory doesn't exist

2015-09-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14933894#comment-14933894 ] Ted Yu commented on HDFS-6264: -- I don't think removing deprecation would result in the following test failure:

[jira] [Commented] (HDFS-6264) Provide FileSystem#create() variant which throws exception if parent directory doesn't exist

2015-09-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14933904#comment-14933904 ] Ted Yu commented on HDFS-6264: -- I ran TestIPC, TestHDFSContractCreate and TestStorageRestore locally with

[jira] [Created] (HDFS-9169) TestNativeAzureFileSystemOperationsMocked fails in trunk

2015-09-28 Thread Ted Yu (JIRA)
Ted Yu created HDFS-9169: Summary: TestNativeAzureFileSystemOperationsMocked fails in trunk Key: HDFS-9169 URL: https://issues.apache.org/jira/browse/HDFS-9169 Project: Hadoop HDFS Issue Type: Test

[jira] [Updated] (HDFS-6264) Provide FileSystem#create() variant which throws exception if parent directory doesn't exist

2015-09-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6264: - Attachment: hdfs-6264-v3.txt > Provide FileSystem#create() variant which throws exception if parent > directory

[jira] [Commented] (HDFS-6264) Provide FileSystem#create() variant which throws exception if parent directory doesn't exist

2015-09-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14909349#comment-14909349 ] Ted Yu commented on HDFS-6264: -- w.r.t. the two checkstyle warnings, the count didn't change with vs. without

[jira] [Updated] (HDFS-6264) Provide FileSystem#create() variant which throws exception if parent directory doesn't exist

2015-09-25 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6264: - Attachment: hdfs-6264-v2.txt > Provide FileSystem#create() variant which throws exception if parent > directory

[jira] [Commented] (HDFS-6264) Provide FileSystem#create() variant which throws exception if parent directory doesn't exist

2015-09-24 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907397#comment-14907397 ] Ted Yu commented on HDFS-6264: -- [~kihwal]: Is there anything I can do ? > Provide FileSystem#create() variant

[jira] [Resolved] (HDFS-5897) TestNNWithQJM#testNewNamenodeTakesOverWriter occasionally fails in trunk

2015-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HDFS-5897. -- Resolution: Cannot Reproduce > TestNNWithQJM#testNewNamenodeTakesOverWriter occasionally fails in trunk >

[jira] [Assigned] (HDFS-6264) Provide FileSystem#create() variant which throws exception if parent directory doesn't exist

2015-09-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reassigned HDFS-6264: Assignee: Ted Yu > Provide FileSystem#create() variant which throws exception if parent > directory

[jira] [Updated] (HDFS-6264) Provide FileSystem#create() variant which throws exception if parent directory doesn't exist

2015-09-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6264: - Status: Patch Available (was: Open) > Provide FileSystem#create() variant which throws exception if parent >

[jira] [Commented] (HDFS-6264) Provide FileSystem#create() variant which throws exception if parent directory doesn't exist

2015-09-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14791096#comment-14791096 ] Ted Yu commented on HDFS-6264: -- bq. The applied patch generated 1 new checkstyle issues (total was 229, now

[jira] [Updated] (HDFS-6264) Provide FileSystem#create() variant which throws exception if parent directory doesn't exist

2015-09-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6264: - Description: FileSystem#createNonRecursive() is deprecated. However, there is no DistributedFileSystem#create()

[jira] [Updated] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2015-08-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6481: - Description: Ian Brooks reported the following stack trace: {code} 2014-06-03 13:05:03,915 WARN [DataStreamer

[jira] [Updated] (HDFS-6290) File is not closed in OfflineImageViewerPB#run()

2015-08-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6290: - Description: {code} } else if (processor.equals(XML)) { new PBImageXmlWriter(conf, out).visit(new

[jira] [Updated] (HDFS-6264) Provide FileSystem#create() variant which throws exception if parent directory doesn't exist

2015-08-19 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6264: - Description: FileSystem#createNonRecursive() is deprecated. However, there is no DistributedFileSystem#create()

[jira] [Updated] (HDFS-6290) File is not closed in OfflineImageViewerPB#run()

2015-07-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6290: - Description: {code} } else if (processor.equals(XML)) { new PBImageXmlWriter(conf, out).visit(new

[jira] [Updated] (HDFS-6092) DistributedFileSystem#getCanonicalServiceName() and DistributedFileSystem#getUri() may return inconsistent results w.r.t. port

2015-07-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6092: - Description: I discovered this when working on HBASE-10717 Here is sample code to reproduce the problem: {code}

[jira] [Updated] (HDFS-7101) Potential null dereference in DFSck#doWork()

2015-07-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-7101: - Description: {code} String lastLine = null; int errCode = -1; try { while ((line =

[jira] [Updated] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2015-06-09 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6481: - Description: Ian Brooks reported the following stack trace: {code} 2014-06-03 13:05:03,915 WARN [DataStreamer for

[jira] [Updated] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2015-05-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6481: - Description: Ian Brooks reported the following stack trace: {code} 2014-06-03 13:05:03,915 WARN [DataStreamer

[jira] [Updated] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2015-05-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6481: - Description: Ian Brooks reported the following stack trace: {code} 2014-06-03 13:05:03,915 WARN [DataStreamer for

[jira] [Updated] (HDFS-7101) Potential null dereference in DFSck#doWork()

2015-05-17 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-7101: - Description: {code} String lastLine = null; int errCode = -1; try { while ((line =

[jira] [Updated] (HDFS-7471) TestDatanodeManager#testNumVersionsReportedCorrect occasionally fails

2015-05-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-7471: - Resolution: Cannot Reproduce Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-7471) TestDatanodeManager#testNumVersionsReportedCorrect occasionally fails

2015-05-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-7471: - Description: From https://builds.apache.org/job/Hadoop-Hdfs-trunk/1957/ : {code} FAILED:

[jira] [Commented] (HDFS-7471) TestDatanodeManager#testNumVersionsReportedCorrect occasionally fails

2015-04-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14501572#comment-14501572 ] Ted Yu commented on HDFS-7471: -- Looks like the test failure is gone. Planning to resolve this

[jira] [Commented] (HDFS-7471) TestDatanodeManager#testNumVersionsReportedCorrect occasionally fails

2015-04-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14501572#comment-14501572 ] Ted Yu commented on HDFS-7471: -- Looks like the test failure is gone. Planning to resolve this

[jira] [Updated] (HDFS-6946) TestBalancerWithSaslDataTransfer fails in trunk

2015-03-13 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6946: - Resolution: Cannot Reproduce Status: Resolved (was: Patch Available) TestBalancerWithSaslDataTransfer

[jira] [Resolved] (HDFS-6037) TestIncrementalBlockReports#testReplaceReceivedBlock fails occasionally in trunk

2015-03-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HDFS-6037. -- Resolution: Cannot Reproduce TestIncrementalBlockReports#testReplaceReceivedBlock fails occasionally in trunk

[jira] [Updated] (HDFS-7261) storageMap is accessed without synchronization in DatanodeDescriptor#updateHeartbeatState()

2015-02-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-7261: - Description: Here is the code: {code} failedStorageInfos = new HashSetDatanodeStorageInfo(

[jira] [Commented] (HDFS-7471) TestDatanodeManager#testNumVersionsReportedCorrect occasionally fails

2015-02-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14338741#comment-14338741 ] Ted Yu commented on HDFS-7471: -- [~kihwal]: What's your opinion ?

[jira] [Updated] (HDFS-7538) removedDst should be checked against null in the finally block of FSDirRenameOp#unprotectedRenameTo()

2015-02-24 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-7538: - Resolution: Not a Problem Status: Resolved (was: Patch Available) removedDst should be checked against

[jira] [Commented] (HDFS-7495) Remove updatePosition argument from DFSInputStream#getBlockAt()

2015-02-23 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14334302#comment-14334302 ] Ted Yu commented on HDFS-7495: -- Thanks Colin for picking this up. bq. this code isn't

[jira] [Commented] (HDFS-7008) xlator should be closed upon exit from DFSAdmin#genericRefresh()

2015-02-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14333026#comment-14333026 ] Ted Yu commented on HDFS-7008: -- +1 xlator should be closed upon exit from

[jira] [Commented] (HDFS-7008) xlator should be closed upon exit from DFSAdmin#genericRefresh()

2015-02-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14332496#comment-14332496 ] Ted Yu commented on HDFS-7008: -- +1 xlator should be closed upon exit from

[jira] [Updated] (HDFS-7495) Lock inversion in DFSInputStream#getBlockAt()

2015-02-20 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-7495: - Resolution: Later Status: Resolved (was: Patch Available) Lock inversion in DFSInputStream#getBlockAt()

[jira] [Resolved] (HDFS-6081) TestRetryCacheWithHA#testCreateSymlink occasionally fails in trunk

2015-02-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HDFS-6081. -- Resolution: Cannot Reproduce TestRetryCacheWithHA#testCreateSymlink occasionally fails in trunk

[jira] [Resolved] (HDFS-6177) TestHttpFSServer fails occasionally in trunk

2015-02-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HDFS-6177. -- Resolution: Cannot Reproduce TestHttpFSServer fails occasionally in trunk

[jira] [Resolved] (HDFS-6501) TestCrcCorruption#testCorruptionDuringWrt sometimes fails in trunk

2015-02-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HDFS-6501. -- Resolution: Cannot Reproduce TestCrcCorruption#testCorruptionDuringWrt sometimes fails in trunk

[jira] [Resolved] (HDFS-6726) TestNamenodeCapacityReport fails intermittently

2015-02-15 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HDFS-6726. -- Resolution: Cannot Reproduce TestNamenodeCapacityReport fails intermittently

[jira] [Resolved] (HDFS-7102) Null dereference in PacketReceiver#receiveNextPacket()

2015-02-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HDFS-7102. -- Resolution: Later Null dereference in PacketReceiver#receiveNextPacket()

[jira] [Commented] (HDFS-6946) TestBalancerWithSaslDataTransfer fails in trunk

2015-02-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317070#comment-14317070 ] Ted Yu commented on HDFS-6946: -- This test hasn't failed in recent builds.

[jira] [Resolved] (HDFS-7083) TestDecommission#testIncludeByRegistrationName sometimes fails

2015-02-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HDFS-7083. -- Resolution: Cannot Reproduce TestDecommission#testIncludeByRegistrationName sometimes fails

[jira] [Commented] (HDFS-6133) Make Balancer support exclude specified path

2015-02-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317251#comment-14317251 ] Ted Yu commented on HDFS-6133: -- In DFSOutputStream.java: {code} 1452

[jira] [Updated] (HDFS-7756) DatanodeInfoWithStorage should be tagged Private

2015-02-09 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-7756: - Attachment: hdfs-7756-002.patch Alternative patch which restores method signature for LocatedBlock#getLocations()

[jira] [Created] (HDFS-7756) DatanodeInfoWithStorage should be tagged Private

2015-02-09 Thread Ted Yu (JIRA)
Ted Yu created HDFS-7756: Summary: DatanodeInfoWithStorage should be tagged Private Key: HDFS-7756 URL: https://issues.apache.org/jira/browse/HDFS-7756 Project: Hadoop HDFS Issue Type: Task

[jira] [Updated] (HDFS-7756) DatanodeInfoWithStorage should be tagged Private

2015-02-09 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-7756: - Status: Patch Available (was: Open) DatanodeInfoWithStorage should be tagged Private

[jira] [Commented] (HDFS-7647) DatanodeManager.sortLocatedBlocks sorts DatanodeInfos but not StorageIDs

2015-02-09 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312969#comment-14312969 ] Ted Yu commented on HDFS-7647: -- DatanodeInfoWithStorage doesn't have audience annotation. Is

[jira] [Commented] (HDFS-7647) DatanodeManager.sortLocatedBlocks sorts DatanodeInfos but not StorageIDs

2015-02-09 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14312984#comment-14312984 ] Ted Yu commented on HDFS-7647: -- Sure. I am testing a patch - will log JIRA momentarily.

[jira] [Updated] (HDFS-7756) DatanodeInfoWithStorage should be tagged Private

2015-02-09 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-7756: - Attachment: hdfs-7756-001.patch Proposed patch. In order not to break downstream projects which reorder

  1   2   3   4   5   >