[jira] [Created] (HDFS-6582) Missing null check in RpcProgramNfs3#read(XDR, SecurityHandler)

2014-06-20 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6582: Summary: Missing null check in RpcProgramNfs3#read(XDR, SecurityHandler) Key: HDFS-6582 URL: https://issues.apache.org/jira/browse/HDFS-6582 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-6586) TestBalancer#testExitZeroOnSuccess sometimes fails in trunk

2014-06-22 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6586: Summary: TestBalancer#testExitZeroOnSuccess sometimes fails in trunk Key: HDFS-6586 URL: https://issues.apache.org/jira/browse/HDFS-6586 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-6726) TestNamenodeCapacityReport fails intermittently

2014-07-22 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6726: Summary: TestNamenodeCapacityReport fails intermittently Key: HDFS-6726 URL: https://issues.apache.org/jira/browse/HDFS-6726 Project: Hadoop HDFS Issue Type: Test

[jira] [Created] (HDFS-6810) storageMap is accessed without proper synchronization in DatanodeDescriptor#getStorageReports

2014-08-02 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6810: Summary: storageMap is accessed without proper synchronization in DatanodeDescriptor#getStorageReports Key: HDFS-6810 URL: https://issues.apache.org/jira/browse/HDFS-6810 Project:

[jira] [Updated] (HDFS-6810) StorageReport array is initialized with wrong size in DatanodeDescriptor#getStorageReports

2014-08-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6810: - Summary: StorageReport array is initialized with wrong size in DatanodeDescriptor#getStorageReports (was:

[jira] [Updated] (HDFS-6810) StorageReport is initialized with wrong size in DatanodeDescriptor#getStorageReports

2014-08-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6810: - Summary: StorageReport is initialized with wrong size in DatanodeDescriptor#getStorageReports (was: storageMap

[jira] [Commented] (HDFS-6810) StorageReport array is initialized with wrong size in DatanodeDescriptor#getStorageReports

2014-08-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14083766#comment-14083766 ] Ted Yu commented on HDFS-6810: -- Thanks for taking care of this, Nicolas. StorageReport array

[jira] [Created] (HDFS-6842) TestHttpFSFWithWebhdfsFileSystem fails in trunk

2014-08-12 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6842: Summary: TestHttpFSFWithWebhdfsFileSystem fails in trunk Key: HDFS-6842 URL: https://issues.apache.org/jira/browse/HDFS-6842 Project: Hadoop HDFS Issue Type: Test

[jira] [Resolved] (HDFS-6842) TestHttpFSFWithWebhdfsFileSystem fails in trunk

2014-08-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HDFS-6842. -- Resolution: Duplicate Covered by HADOOP-10836 TestHttpFSFWithWebhdfsFileSystem fails in trunk

[jira] [Created] (HDFS-6848) Lack of synchronization on access to datanodeUuid in DataStorage#format()

2014-08-13 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6848: Summary: Lack of synchronization on access to datanodeUuid in DataStorage#format() Key: HDFS-6848 URL: https://issues.apache.org/jira/browse/HDFS-6848 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6848) Lack of synchronization on access to datanodeUuid in DataStorage#format()

2014-08-13 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096431#comment-14096431 ] Ted Yu commented on HDFS-6848: -- bq. it is better to call the synchronized method

[jira] [Created] (HDFS-6852) TestBalancerWithEncryptedTransfer sometimes fails in trunk

2014-08-14 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6852: Summary: TestBalancerWithEncryptedTransfer sometimes fails in trunk Key: HDFS-6852 URL: https://issues.apache.org/jira/browse/HDFS-6852 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-6902) FileWriter should be closed in finally block in BlockReceiver#receiveBlock()

2014-08-20 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6902: Summary: FileWriter should be closed in finally block in BlockReceiver#receiveBlock() Key: HDFS-6902 URL: https://issues.apache.org/jira/browse/HDFS-6902 Project: Hadoop HDFS

[jira] [Moved] (HDFS-6946) TestBalancerWithSaslDataTransfer fails in trunk

2014-08-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu moved HBASE-11824 to HDFS-6946: -- Key: HDFS-6946 (was: HBASE-11824) Project: Hadoop HDFS (was: HBase)

[jira] [Commented] (HDFS-6852) TestBalancerWithEncryptedTransfer sometimes fails in trunk

2014-09-04 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121559#comment-14121559 ] Ted Yu commented on HDFS-6852: -- Looks like HDFS-6506 is ready to be checked in.

[jira] [Created] (HDFS-7008) xlator should be closed upon exit from DFSAdmin#genericRefresh()

2014-09-05 Thread Ted Yu (JIRA)
Ted Yu created HDFS-7008: Summary: xlator should be closed upon exit from DFSAdmin#genericRefresh() Key: HDFS-7008 URL: https://issues.apache.org/jira/browse/HDFS-7008 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-06-12 Thread Zhihong Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13294094#comment-13294094 ] Zhihong Ted Yu commented on HDFS-1783: -- {code} public FSDataOutputStream create(Path

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-06-20 Thread Zhihong Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13397927#comment-13397927 ] Zhihong Ted Yu commented on HDFS-1783: -- {code} +for (curNode = 0; curNode

[jira] [Commented] (HDFS-1783) Ability for HDFS client to write replicas in parallel

2012-06-20 Thread Zhihong Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13397930#comment-13397930 ] Zhihong Ted Yu commented on HDFS-1783: -- I was looking at an old version of the patch.

[jira] [Updated] (HDFS-3655) Datanode recoverRbw could hang sometime

2012-07-16 Thread Zhihong Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhihong Ted Yu updated HDFS-3655: - Summary: Datanode recoverRbw could hang sometime (was: datenode recoverRbw could hang sometime)

[jira] [Commented] (HDFS-3814) Make the replication monitor multipliers configurable in 1.x

2012-08-18 Thread Zhihong Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13437365#comment-13437365 ] Zhihong Ted Yu commented on HDFS-3814: -- The two parameters cited seem to be the same.

[jira] [Commented] (HDFS-3791) Backport HDFS-173 to Branch-1 : Recursively deleting a directory with millions of files makes NameNode unresponsive for other commands until the deletion completes

2012-08-28 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13443245#comment-13443245 ] Ted Yu commented on HDFS-3791: -- Currently small deletion is determined by the constant

[jira] [Updated] (HDFS-6057) DomainSocketWatcher.watcherThread should be marked as daemon thread

2014-03-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6057: - Status: Patch Available (was: Open) DomainSocketWatcher.watcherThread should be marked as daemon thread

[jira] [Assigned] (HDFS-6057) DomainSocketWatcher.watcherThread should be marked as daemon thread

2014-03-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reassigned HDFS-6057: Assignee: Ted Yu DomainSocketWatcher.watcherThread should be marked as daemon thread

[jira] [Updated] (HDFS-6057) DomainSocketWatcher.watcherThread should be marked as daemon thread

2014-03-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6057: - Attachment: hdfs-6057-v1.txt ShortCircuitRegistry closes DomainSocketWatcher in shutdown(). Patch v1 closes

[jira] [Assigned] (HDFS-6057) DomainSocketWatcher.watcherThread should be marked as daemon thread

2014-03-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reassigned HDFS-6057: Assignee: (was: Ted Yu) DomainSocketWatcher.watcherThread should be marked as daemon thread

[jira] [Created] (HDFS-6081) TestRetryCacheWithHA#testCreateSymlink occasionally fails in trunk

2014-03-09 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6081: Summary: TestRetryCacheWithHA#testCreateSymlink occasionally fails in trunk Key: HDFS-6081 URL: https://issues.apache.org/jira/browse/HDFS-6081 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-6083) TestQuorumJournalManager#testChangeWritersLogsOutOfSync2 occasionally fails

2014-03-09 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6083: Summary: TestQuorumJournalManager#testChangeWritersLogsOutOfSync2 occasionally fails Key: HDFS-6083 URL: https://issues.apache.org/jira/browse/HDFS-6083 Project: Hadoop HDFS

[jira] [Created] (HDFS-6092) DistributedFileSystem#getCanonicalServiceName() and DistributedFileSystem#getUri() may return inconsistent results w.r.t. port

2014-03-11 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6092: Summary: DistributedFileSystem#getCanonicalServiceName() and DistributedFileSystem#getUri() may return inconsistent results w.r.t. port Key: HDFS-6092 URL:

[jira] [Updated] (HDFS-6092) DistributedFileSystem#getCanonicalServiceName() and DistributedFileSystem#getUri() may return inconsistent results w.r.t. port

2014-03-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6092: - Description: I discovered this when working on HBASE-10717 Here is sample code to reproduce the problem: {code}

[jira] [Updated] (HDFS-6092) DistributedFileSystem#getCanonicalServiceName() and DistributedFileSystem#getUri() may return inconsistent results w.r.t. port

2014-03-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6092: - Attachment: hdfs-6092-v1.txt Tentative patch. DistributedFileSystem#getCanonicalServiceName() and

[jira] [Updated] (HDFS-6092) DistributedFileSystem#getCanonicalServiceName() and DistributedFileSystem#getUri() may return inconsistent results w.r.t. port

2014-03-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6092: - Status: Patch Available (was: Open) DistributedFileSystem#getCanonicalServiceName() and

[jira] [Updated] (HDFS-6092) DistributedFileSystem#getCanonicalServiceName() and DistributedFileSystem#getUri() may return inconsistent results w.r.t. port

2014-03-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6092: - Attachment: hdfs-6092-v2.txt Patch v2 passed the following tests: {code} 636 mvn test -Dtest=TestFileStatus

[jira] [Commented] (HDFS-6092) DistributedFileSystem#getCanonicalServiceName() and DistributedFileSystem#getUri() may return inconsistent results w.r.t. port

2014-03-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13931766#comment-13931766 ] Ted Yu commented on HDFS-6092: -- [~haosd...@gmail.com]: With your patch, desFs's URI still

[jira] [Updated] (HDFS-6092) DistributedFileSystem#getCanonicalServiceName() and DistributedFileSystem#getUri() may return inconsistent results w.r.t. port

2014-03-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6092: - Attachment: hdfs-6092-v3.txt DistributedFileSystem#getCanonicalServiceName() and

[jira] [Commented] (HDFS-6092) DistributedFileSystem#getCanonicalServiceName() and DistributedFileSystem#getUri() may return inconsistent results w.r.t. port

2014-03-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13931930#comment-13931930 ] Ted Yu commented on HDFS-6092: -- How about patch v3 ? I try to be a little generic by detecting

[jira] [Commented] (HDFS-5672) TestHASafeMode#testSafeBlockTracking fails in trunk

2014-03-25 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13946713#comment-13946713 ] Ted Yu commented on HDFS-5672: -- The test failed again in build #1712:

[jira] [Reopened] (HDFS-5672) TestHASafeMode#testSafeBlockTracking fails in trunk

2014-03-25 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reopened HDFS-5672: -- TestHASafeMode#testSafeBlockTracking fails in trunk ---

[jira] [Commented] (HDFS-5672) TestHASafeMode#testSafeBlockTracking fails in trunk

2014-03-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13948198#comment-13948198 ] Ted Yu commented on HDFS-5672: -- Was the failure,

[jira] [Created] (HDFS-6160) TestSafeMode occasionally fails

2014-03-26 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6160: Summary: TestSafeMode occasionally fails Key: HDFS-6160 URL: https://issues.apache.org/jira/browse/HDFS-6160 Project: Hadoop HDFS Issue Type: Test Reporter: Ted

[jira] [Commented] (HDFS-5672) TestHASafeMode#testSafeBlockTracking fails in trunk

2014-03-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13948281#comment-13948281 ] Ted Yu commented on HDFS-5672: -- Jing, I created HDFS-6160 to track TestSafeMode failure.

[jira] [Created] (HDFS-6177) TestHttpFSServer fails occasionally in trunk

2014-03-30 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6177: Summary: TestHttpFSServer fails occasionally in trunk Key: HDFS-6177 URL: https://issues.apache.org/jira/browse/HDFS-6177 Project: Hadoop HDFS Issue Type: Test

[jira] [Created] (HDFS-6257) TestCacheDirectives#testExceedsCapacity fails occasionally in trunk

2014-04-18 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6257: Summary: TestCacheDirectives#testExceedsCapacity fails occasionally in trunk Key: HDFS-6257 URL: https://issues.apache.org/jira/browse/HDFS-6257 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-6264) Provide FileSystem#create() variant which throws exception if parent directory doesn't exist

2014-04-21 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6264: Summary: Provide FileSystem#create() variant which throws exception if parent directory doesn't exist Key: HDFS-6264 URL: https://issues.apache.org/jira/browse/HDFS-6264 Project:

[jira] [Updated] (HDFS-6264) Provide FileSystem#create() variant which throws exception if parent directory doesn't exist

2014-04-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6264: - Description: FileSystem#createNonRecursive() is deprecated. However, there is no DistributedFileSystem#create()

[jira] [Commented] (HDFS-6264) Provide FileSystem#create() variant which throws exception if parent directory doesn't exist

2014-04-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13975999#comment-13975999 ] Ted Yu commented on HDFS-6264: -- Another option is to un-deprecate

[jira] [Updated] (HDFS-6264) Provide FileSystem#create() variant which throws exception if parent directory doesn't exist

2014-04-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6264: - Priority: Major (was: Minor) Raising priority to Major due to client unable to migrate off deprecated API.

[jira] [Updated] (HDFS-6264) Provide FileSystem#create() variant which throws exception if parent directory doesn't exist

2014-04-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6264: - Attachment: hdfs-6264-v1.txt Patch v1 un-deprecates createNonRecursive(). Provide FileSystem#create() variant

[jira] [Created] (HDFS-6290) File is not closed in OfflineImageViewerPB#run()

2014-04-26 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6290: Summary: File is not closed in OfflineImageViewerPB#run() Key: HDFS-6290 URL: https://issues.apache.org/jira/browse/HDFS-6290 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-6291) FSImage may be left unclosed in BootstrapStandby#doRun()

2014-04-26 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6291: Summary: FSImage may be left unclosed in BootstrapStandby#doRun() Key: HDFS-6291 URL: https://issues.apache.org/jira/browse/HDFS-6291 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-6264) Provide FileSystem#create() variant which throws exception if parent directory doesn't exist

2014-04-29 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6264: - Description: FileSystem#createNonRecursive() is deprecated. However, there is no DistributedFileSystem#create()

[jira] [Commented] (HDFS-6290) File is not closed in OfflineImageViewerPB#run()

2014-05-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13987886#comment-13987886 ] Ted Yu commented on HDFS-6290: -- This was observed in trunk code. File is not closed in

[jira] [Commented] (HDFS-6338) Add a RPC method to allow administrator to delete the file lease.

2014-05-04 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13988965#comment-13988965 ] Ted Yu commented on HDFS-6338: -- Did you try recoverLease() ? Add a RPC method to allow

[jira] [Updated] (HDFS-6291) FSImage may be left unclosed in BootstrapStandby#doRun()

2014-05-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6291: - Component/s: ha FSImage may be left unclosed in BootstrapStandby#doRun()

[jira] [Updated] (HDFS-6264) Provide FileSystem#create() variant which throws exception if parent directory doesn't exist

2014-05-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6264: - Labels: hbase (was: ) Provide FileSystem#create() variant which throws exception if parent directory doesn't

[jira] [Resolved] (HDFS-6083) TestQuorumJournalManager#testChangeWritersLogsOutOfSync2 occasionally fails

2014-05-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved HDFS-6083. -- Resolution: Cannot Reproduce TestQuorumJournalManager#testChangeWritersLogsOutOfSync2 occasionally fails

[jira] [Updated] (HDFS-6290) File is not closed in OfflineImageViewerPB#run()

2014-05-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6290: - Component/s: tools File is not closed in OfflineImageViewerPB#run()

[jira] [Updated] (HDFS-6257) TestCacheDirectives#testExceedsCapacity fails occasionally in trunk

2014-05-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6257: - Component/s: caching TestCacheDirectives#testExceedsCapacity fails occasionally in trunk

[jira] [Created] (HDFS-6369) RemoteBlockReader#available() should call FSInputChecker.available()

2014-05-11 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6369: Summary: RemoteBlockReader#available() should call FSInputChecker.available() Key: HDFS-6369 URL: https://issues.apache.org/jira/browse/HDFS-6369 Project: Hadoop HDFS

[jira] [Created] (HDFS-6368) TransferFsImage#receiveFile() should perform validation on fsImageName parameter

2014-05-16 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6368: Summary: TransferFsImage#receiveFile() should perform validation on fsImageName parameter Key: HDFS-6368 URL: https://issues.apache.org/jira/browse/HDFS-6368 Project: Hadoop HDFS

[jira] [Created] (HDFS-6415) Missing null check in FSImageSerialization#writePermissionStatus()

2014-05-16 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6415: Summary: Missing null check in FSImageSerialization#writePermissionStatus() Key: HDFS-6415 URL: https://issues.apache.org/jira/browse/HDFS-6415 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-6437) TestBookKeeperHACheckpoints#TestStandbyCheckpoints fails in trunk

2014-05-20 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6437: Summary: TestBookKeeperHACheckpoints#TestStandbyCheckpoints fails in trunk Key: HDFS-6437 URL: https://issues.apache.org/jira/browse/HDFS-6437 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2014-06-03 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6481: Summary: DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs Key: HDFS-6481 URL: https://issues.apache.org/jira/browse/HDFS-6481 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2014-06-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6481: - Attachment: hdfs-6481-v1.txt Patch v1 adds check for i against the length of storageIDs

[jira] [Updated] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2014-06-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6481: - Status: Patch Available (was: Open) DatanodeManager#getDatanodeStorageInfos() should check the length of

[jira] [Updated] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2014-06-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6481: - Attachment: hdfs-6481-v1.txt DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

[jira] [Updated] (HDFS-6481) DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs

2014-06-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6481: - Attachment: (was: hdfs-6481-v1.txt) DatanodeManager#getDatanodeStorageInfos() should check the length of

[jira] [Updated] (HDFS-6369) RemoteBlockReader#available() should call FSInputChecker.available()

2014-06-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6369: - Attachment: hdfs-6369-v2.txt RemoteBlockReader#available() should call FSInputChecker.available()

[jira] [Updated] (HDFS-6369) RemoteBlockReader#available() should call FSInputChecker.available()

2014-06-05 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6369: - Attachment: hdfs-6369-v3.txt RemoteBlockReader#available() should call FSInputChecker.available()

[jira] [Created] (HDFS-6501) TestCrcCorruption#testCorruptionDuringWrt sometimes fails in trunk

2014-06-07 Thread Ted Yu (JIRA)
Ted Yu created HDFS-6501: Summary: TestCrcCorruption#testCorruptionDuringWrt sometimes fails in trunk Key: HDFS-6501 URL: https://issues.apache.org/jira/browse/HDFS-6501 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-3703) Decrease the datanode failure detection time

2012-09-07 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13451123#comment-13451123 ] Ted Yu commented on HDFS-3703: -- {code} + public static final String

[jira] [Commented] (HDFS-3703) Decrease the datanode failure detection time

2012-09-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13452277#comment-13452277 ] Ted Yu commented on HDFS-3703: -- {code} ++ , which is smaller than the minimal

[jira] [Commented] (HDFS-3703) Decrease the datanode failure detection time

2012-09-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13452324#comment-13452324 ] Ted Yu commented on HDFS-3703: -- The retrieval of value for staleInterval is in DatanodeManager

[jira] [Commented] (HDFS-3703) Decrease the datanode failure detection time

2012-09-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13452408#comment-13452408 ] Ted Yu commented on HDFS-3703: -- bq. based on the number of nodes marked stale in the cluster

[jira] [Commented] (HDFS-3703) Decrease the datanode failure detection time

2012-09-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13453069#comment-13453069 ] Ted Yu commented on HDFS-3703: -- {code} Arrays.sort(b.getLocations(), new

[jira] [Updated] (HDFS-3703) Decrease the datanode failure detection time

2012-09-11 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-3703: - Status: Patch Available (was: Open) Decrease the datanode failure detection time

[jira] [Commented] (HDFS-3703) Decrease the datanode failure detection time

2012-09-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13454073#comment-13454073 ] Ted Yu commented on HDFS-3703: -- @Jing: If backport to 1.0 is needed and you're busy, I can

[jira] [Updated] (HDFS-3703) Decrease the datanode failure detection time

2012-09-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-3703: - Fix Version/s: 1.0.4 Decrease the datanode failure detection time

[jira] [Commented] (HDFS-3703) Decrease the datanode failure detection time

2012-09-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13454210#comment-13454210 ] Ted Yu commented on HDFS-3703: -- In hadoop 1.0, I don't see the following code in

[jira] [Commented] (HDFS-3703) Decrease the datanode failure detection time

2012-09-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13454339#comment-13454339 ] Ted Yu commented on HDFS-3703: -- @Suresh: If I understand your comment correctly, I should

[jira] [Updated] (HDFS-3703) Decrease the datanode failure detection time

2012-09-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-3703: - Status: Open (was: Patch Available) Decrease the datanode failure detection time

[jira] [Updated] (HDFS-3703) Decrease the datanode failure detection time

2012-09-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-3703: - Attachment: 3703-hadoop-1.0.txt Attaching first patch for hadoop 1.0 I don't see how heart beat can be

[jira] [Commented] (HDFS-3703) Decrease the datanode failure detection time

2012-09-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13454463#comment-13454463 ] Ted Yu commented on HDFS-3703: -- Should 1.0.4 be put back as Fix Version ?

[jira] [Commented] (HDFS-3703) Decrease the datanode failure detection time

2012-09-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13454466#comment-13454466 ] Ted Yu commented on HDFS-3703: -- I noticed the following in FSNamesystem of hadoop 1.0: {code}

[jira] [Commented] (HDFS-3703) Decrease the datanode failure detection time

2012-09-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13454473#comment-13454473 ] Ted Yu commented on HDFS-3703: -- What about disabling DataNode heart beat ? I guess that should

[jira] [Commented] (HDFS-3703) Decrease the datanode failure detection time

2012-09-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13454630#comment-13454630 ] Ted Yu commented on HDFS-3703: -- Looking at how DataNode heart beat is disabled in trunk, I

[jira] [Commented] (HDFS-3703) Decrease the datanode failure detection time

2012-09-13 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13454722#comment-13454722 ] Ted Yu commented on HDFS-3703: -- I think disabling the data node heart beat simulates GC pause,

[jira] [Commented] (HDFS-3703) Decrease the datanode failure detection time

2012-09-13 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13455176#comment-13455176 ] Ted Yu commented on HDFS-3703: -- @N: My patch needs some more work in the unit test. I think

[jira] [Commented] (HDFS-3429) DataNode reads checksums even if client does not need them

2012-10-01 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13467176#comment-13467176 ] Ted Yu commented on HDFS-3429: -- Pardon my limited knowledge of hdfs. {code} + boolean

[jira] [Commented] (HDFS-3077) Quorum-based protocol for reading and writing edit logs

2012-10-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13471836#comment-13471836 ] Ted Yu commented on HDFS-3077: -- bq. JN2: highestSegmentTxId = 101, since it never got any

[jira] [Commented] (HDFS-4031) Update findbugsExcludeFile.xml to include findbugs 2 exclusions

2012-10-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13473695#comment-13473695 ] Ted Yu commented on HDFS-4031: -- There seem to be 3 exclusions in the patch :-)

[jira] [Commented] (HDFS-4031) Update findbugsExcludeFile.xml to include findbugs 2 exclusions

2012-10-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13473734#comment-13473734 ] Ted Yu commented on HDFS-4031: -- From HDFS-3077: {code} -1 findbugs. The patch appears to

[jira] [Updated] (HDFS-4222) NN is unresponsive and lose heartbeats of DNs when Hadoop is configured to use LDAP and LDAP has issues

2012-11-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-4222: - Summary: NN is unresponsive and lose heartbeats of DNs when Hadoop is configured to use LDAP and LDAP has issues

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13549833#comment-13549833 ] Ted Yu commented on HDFS-4261: -- Minor: {code} + if (notChangedIterations =

[jira] [Created] (HDFS-4382) Fix typo MAX_NOT_CHANGED_INTERATIONS when HDFS-4261 was fixed

2013-01-10 Thread Ted Yu (JIRA)
Ted Yu created HDFS-4382: Summary: Fix typo MAX_NOT_CHANGED_INTERATIONS when HDFS-4261 was fixed Key: HDFS-4382 URL: https://issues.apache.org/jira/browse/HDFS-4382 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-4261) TestBalancerWithNodeGroup times out

2013-01-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13550501#comment-13550501 ] Ted Yu commented on HDFS-4261: -- Created HDFS-4382. Will upload a patch soon. Is there plan

[jira] [Updated] (HDFS-4382) Fix typo MAX_NOT_CHANGED_INTERATIONS when HDFS-4261 was fixed

2013-01-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-4382: - Attachment: hdfs-4382-v1.txt Patch that fixes the typo. Also changed the constant in Balancer to private - it is

[jira] [Updated] (HDFS-4382) Fix typo MAX_NOT_CHANGED_INTERATIONS when HDFS-4261 was fixed

2013-01-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-4382: - Fix Version/s: 3.0.0 Status: Patch Available (was: Open) Fix typo MAX_NOT_CHANGED_INTERATIONS

[jira] [Assigned] (HDFS-4382) Fix typo MAX_NOT_CHANGED_INTERATIONS when HDFS-4261 was fixed

2013-01-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu reassigned HDFS-4382: Assignee: Ted Yu Fix typo MAX_NOT_CHANGED_INTERATIONS when HDFS-4261 was fixed

[jira] [Updated] (HDFS-4382) Fix typo MAX_NOT_CHANGED_INTERATIONS when TestBalancerWithNodeGroup was fixed by HDFS-4261

2013-01-10 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-4382: - Summary: Fix typo MAX_NOT_CHANGED_INTERATIONS when TestBalancerWithNodeGroup was fixed by HDFS-4261 (was: Fix

  1   2   3   4   5   >