[jira] [Created] (HDFS-6836) HDFS INFO logging is verbose uses file appenders

2014-08-08 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-6836: Summary: HDFS INFO logging is verbose uses file appenders Key: HDFS-6836 URL: https://issues.apache.org/jira/browse/HDFS-6836 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-6836) HDFS INFO logging is verbose uses file appenders

2014-08-08 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6836: - Affects Version/s: 2.4.1 Status: Patch Available (was: Open) Check if

[jira] [Updated] (HDFS-6836) HDFS INFO logging is verbose uses file appenders

2014-08-08 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6836: - Attachment: HDFS-6836.0.patch HDFS INFO logging is verbose uses file appenders

[jira] [Commented] (HDFS-6836) HDFS INFO logging is verbose uses file appenders

2014-08-08 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091444#comment-14091444 ] Xiaoyu Yao commented on HDFS-6836: -- No test added as the change suppresses the log output

[jira] [Updated] (HDFS-6836) HDFS INFO logging is verbose uses file appenders

2014-08-12 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6836: - Attachment: HDFS-6836.1.patch Update to use debug log instead of default info log inside

[jira] [Commented] (HDFS-6836) HDFS INFO logging is verbose uses file appenders

2014-08-12 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094466#comment-14094466 ] Xiaoyu Yao commented on HDFS-6836: -- Thanks! I've updated the patch with the feedback.

[jira] [Updated] (HDFS-6836) HDFS INFO logging is verbose uses file appenders

2014-08-12 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6836: - Attachment: HDFS-6836.2.patch Updated based on the feedback. HDFS INFO logging is verbose uses file

[jira] [Commented] (HDFS-6848) Lack of synchronization on access to datanodeUuid in DataStorage#format()

2014-08-13 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096254#comment-14096254 ] Xiaoyu Yao commented on HDFS-6848: -- Note: the only caller of DataStorage#format() is the

[jira] [Commented] (HDFS-6762) hadoop-hdfs build fails at module-javadocs

2014-08-14 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097041#comment-14097041 ] Xiaoyu Yao commented on HDFS-6762: -- +1 Will take a look. hadoop-hdfs build fails at

[jira] [Updated] (HDFS-6848) Lack of synchronization on access to datanodeUuid in DataStorage#format()

2014-08-18 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6848: - Attachment: HDFS-6848.0.patch Lack of synchronization on access to datanodeUuid in DataStorage#format()

[jira] [Updated] (HDFS-6848) Lack of synchronization on access to datanodeUuid in DataStorage#format()

2014-08-18 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6848: - Status: Patch Available (was: Open) Lack of synchronization on access to datanodeUuid in

[jira] [Commented] (HDFS-6912) HDFS Short-circuit read implementation throws SIGBUS from misc.Unsafe usage

2014-08-21 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106508#comment-14106508 ] Xiaoyu Yao commented on HDFS-6912: -- The mmap() function is used to map between the address

[jira] [Created] (HDFS-6950) Add Additional unit tests for HDFS-6581

2014-08-26 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-6950: Summary: Add Additional unit tests for HDFS-6581 Key: HDFS-6950 URL: https://issues.apache.org/jira/browse/HDFS-6950 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-6950) Add Additional unit tests for HDFS-6581

2014-08-27 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6950: - Attachment: HDFS-6950.0.patch Initial patch for additional unit test around eviction, delete,

[jira] [Commented] (HDFS-6832) Fix the usage of 'hdfs namenode' command

2014-08-27 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113379#comment-14113379 ] Xiaoyu Yao commented on HDFS-6832: -- Could you remove the extra space before -force below?

[jira] [Updated] (HDFS-6831) Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help'

2014-08-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6831: - Attachment: HDFS-6831.0.patch Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help'

[jira] [Commented] (HDFS-6831) Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help'

2014-08-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113475#comment-14113475 ] Xiaoyu Yao commented on HDFS-6831: -- Attach a patch that fixed the issue with a

[jira] [Updated] (HDFS-6831) Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help'

2014-08-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6831: - Status: Patch Available (was: Open) Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help'

[jira] [Updated] (HDFS-6831) Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help'

2014-08-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6831: - Attachment: HDFS-6831.1.patch Update hdfs DFSAdmin to hdfs dfsadmin Inconsistency between 'hdfs

[jira] [Commented] (HDFS-6928) 'hdfs put' command should accept lazyPersist flag for testing

2014-08-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14114176#comment-14114176 ] Xiaoyu Yao commented on HDFS-6928: -- Looks good. Can you update the comment of with

[jira] [Commented] (HDFS-6960) Bugfix in LazyWriter, fix test case and some refactoring

2014-08-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14114451#comment-14114451 ] Xiaoyu Yao commented on HDFS-6960: -- In FsDataSetImpl.java Can you put the following into

[jira] [Commented] (HDFS-6960) Bugfix in LazyWriter, fix test case and some refactoring

2014-08-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14114476#comment-14114476 ] Xiaoyu Yao commented on HDFS-6960: -- The change of return value from void to boolean for

[jira] [Commented] (HDFS-6960) Bugfix in LazyWriter, fix test case and some refactoring

2014-08-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14114481#comment-14114481 ] Xiaoyu Yao commented on HDFS-6960: -- +1 Bugfix in LazyWriter, fix test case and some

[jira] [Commented] (HDFS-6931) Move lazily persisted replicas to finalized directory on DN startup

2014-08-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14114531#comment-14114531 ] Xiaoyu Yao commented on HDFS-6931: -- +1 Move lazily persisted replicas to finalized

[jira] [Commented] (HDFS-6832) Fix the usage of 'hdfs namenode' command

2014-08-31 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14117033#comment-14117033 ] Xiaoyu Yao commented on HDFS-6832: -- +1 Fix the usage of 'hdfs namenode' command

[jira] [Updated] (HDFS-6950) Add Additional unit tests for HDFS-6581

2014-09-01 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6950: - Attachment: HDFS-6950.1.patch Update the patch. Add Additional unit tests for HDFS-6581

[jira] [Commented] (HDFS-6930) Improve replica eviction from RAM disk

2014-09-02 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14118932#comment-14118932 ] Xiaoyu Yao commented on HDFS-6930: -- +1 Can you check if capacity 0? It can be 0 when the

[jira] [Assigned] (HDFS-6950) Add Additional unit tests for HDFS-6581

2014-09-02 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-6950: Assignee: Xiaoyu Yao (was: Xiaoyu Yao) Add Additional unit tests for HDFS-6581

[jira] [Work started] (HDFS-6950) Add Additional unit tests for HDFS-6581

2014-09-02 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6950 started by Xiaoyu Yao. Add Additional unit tests for HDFS-6581 ---

[jira] [Created] (HDFS-6989) Add multi-node test support for unit test

2014-09-02 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-6989: Summary: Add multi-node test support for unit test Key: HDFS-6989 URL: https://issues.apache.org/jira/browse/HDFS-6989 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-6990) Add unit test for evict/delete RAM_DISK block with open handle

2014-09-02 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-6990: Summary: Add unit test for evict/delete RAM_DISK block with open handle Key: HDFS-6990 URL: https://issues.apache.org/jira/browse/HDFS-6990 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6950) Add Additional unit tests for HDFS-6581

2014-09-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6950: - Attachment: HDFS-6950.2.patch Thanks [~arpitagarwal] for reviewing these tests. Updated patches based on

[jira] [Work started] (HDFS-6990) Add unit test for evict/delete RAM_DISK block with open handle

2014-09-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6990 started by Xiaoyu Yao. Add unit test for evict/delete RAM_DISK block with open handle

[jira] [Updated] (HDFS-6990) Add unit test for evict/delete RAM_DISK block with open handle

2014-09-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6990: - Attachment: HDFS-6990.0.patch Attache the initial patch to test eviction/deletion of RAM_DISK block with

[jira] [Work started] (HDFS-6862) Add missing timeout annotations to tests

2014-09-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6862 started by Xiaoyu Yao. Add missing timeout annotations to tests

[jira] [Assigned] (HDFS-6862) Add missing timeout annotations to tests

2014-09-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-6862: Assignee: Xiaoyu Yao Add missing timeout annotations to tests

[jira] [Updated] (HDFS-6862) Add missing timeout annotations to tests

2014-09-03 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6862: - Attachment: HDFS-6862.0.patch Add timeout=3 (300s) to those tests missing timeout annotations. Add

[jira] [Assigned] (HDFS-6932) Balancer and Mover tools should ignore replicas on RAM_DISK

2014-09-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-6932: Assignee: Xiaoyu Yao Balancer and Mover tools should ignore replicas on RAM_DISK

[jira] [Updated] (HDFS-6932) Balancer and Mover tools should ignore replicas on RAM_DISK

2014-09-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6932: - Attachment: HDFS-6932.0.patch Skip balancing for StorageType RAM_DISK. We could also add command line

[jira] [Work started] (HDFS-6932) Balancer and Mover tools should ignore replicas on RAM_DISK

2014-09-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6932 started by Xiaoyu Yao. Balancer and Mover tools should ignore replicas on RAM_DISK

[jira] [Commented] (HDFS-6977) Delete all copies when a block is deleted from the block space

2014-09-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121889#comment-14121889 ] Xiaoyu Yao commented on HDFS-6977: -- +1 Looks good. Delete all copies when a block is

[jira] [Commented] (HDFS-6991) Notify NN of evicted block before deleting it from RAM disk

2014-09-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14121933#comment-14121933 ] Xiaoyu Yao commented on HDFS-6991: -- +1 with some minor issues in FsDataSetImpl.java line

[jira] [Updated] (HDFS-6998) warning message 'ssl.client.truststore.location has not been set' gets printed for hftp command

2014-09-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6998: - Attachment: HDFS-6998.0.patch warning message 'ssl.client.truststore.location has not been set' gets

[jira] [Work started] (HDFS-6998) warning message 'ssl.client.truststore.location has not been set' gets printed for hftp command

2014-09-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6998 started by Xiaoyu Yao. warning message 'ssl.client.truststore.location has not been set' gets printed for

[jira] [Updated] (HDFS-6998) warning message 'ssl.client.truststore.location has not been set' gets printed for hftp command

2014-09-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6998: - Status: In Progress (was: Patch Available) warning message 'ssl.client.truststore.location has not been

[jira] [Updated] (HDFS-6998) warning message 'ssl.client.truststore.location has not been set' gets printed for hftp command

2014-09-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6998: - Status: Patch Available (was: In Progress) warning message 'ssl.client.truststore.location has not been

[jira] [Updated] (HDFS-6831) Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help'

2014-09-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6831: - Attachment: HDFS-6831.2.patch Update patch based on [~ajisakaa] and [~arpitagarwal]' feedback.

[jira] [Commented] (HDFS-6831) Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help'

2014-09-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122367#comment-14122367 ] Xiaoyu Yao commented on HDFS-6831: -- Thanks! The IntelliJ Optimize import on the fly and

[jira] [Updated] (HDFS-6831) Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help'

2014-09-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6831: - Attachment: HDFS-6831.3.patch Figure out how to disable the import optimize on the fly option from

[jira] [Commented] (HDFS-6862) Add missing timeout annotations to tests

2014-09-04 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14122471#comment-14122471 ] Xiaoyu Yao commented on HDFS-6862: -- Thanks! I will remember to submit after attaching

[jira] [Updated] (HDFS-6831) Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help'

2014-09-05 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6831: - Attachment: HDFS-6831.4.patch Thanks [~ajisakaa], patch updated. Inconsistency between 'hdfs dfsadmin'

[jira] [Commented] (HDFS-6831) Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help'

2014-09-05 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14123223#comment-14123223 ] Xiaoyu Yao commented on HDFS-6831: -- I tired both tests on my machine twice and passed.

[jira] [Created] (HDFS-7025) HDFS Credential Provider related Unit Test Failure

2014-09-06 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-7025: Summary: HDFS Credential Provider related Unit Test Failure Key: HDFS-7025 URL: https://issues.apache.org/jira/browse/HDFS-7025 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-7025) HDFS Credential Provider related Unit Test Failure

2014-09-06 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7025: - Attachment: HDFS-7025.0.patch HDFS Credential Provider related Unit Test Failure

[jira] [Updated] (HDFS-7025) HDFS Credential Provider related Unit Test Failure

2014-09-06 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7025: - Attachment: HDFS-7025.1.patch Update patch with additional fix from [~cnauroth] that solves HDFS test root

[jira] [Updated] (HDFS-316) Balancer should run for a configurable # of iterations

2014-09-08 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-316: Attachment: HDFS-316.0.patch Add a parameter {code} -maxIdleIteration {code} to allow specifying # of idle

[jira] [Assigned] (HDFS-316) Balancer should run for a configurable # of iterations

2014-09-08 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-316: --- Assignee: Xiaoyu Yao Balancer should run for a configurable # of iterations

[jira] [Updated] (HDFS-316) Balancer should run for a configurable # of iterations

2014-09-08 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-316: Affects Version/s: 2.4.1 Status: Patch Available (was: Open) Balancer should run for a

[jira] [Created] (HDFS-7066) LazyWriter#evictBlocks misses a null check for replicaState

2014-09-15 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-7066: Summary: LazyWriter#evictBlocks misses a null check for replicaState Key: HDFS-7066 URL: https://issues.apache.org/jira/browse/HDFS-7066 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-7066) LazyWriter#evictBlocks misses a null check for replicaState

2014-09-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7066: - Description: LazyWriter#evictBlocks (added for HDFS-6581) misses a null check for replicaState. As a

[jira] [Updated] (HDFS-7066) LazyWriter#evictBlocks misses a null check for replicaState

2014-09-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7066: - Attachment: HDFS-7066.0.patch LazyWriter#evictBlocks misses a null check for replicaState

[jira] [Updated] (HDFS-7066) LazyWriter#evictBlocks misses a null check for replicaState

2014-09-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7066: - Description: LazyWriter#evictBlocks (added for HDFS-6581) misses a null check for replicaState. As a

[jira] [Updated] (HDFS-7064) Fix test failures

2014-09-15 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7064: - Attachment: HDFS-7064.0.patch Fix the following test issues: org.apache.hadoop.hdfs.TestDFSShell.testGet

[jira] [Created] (HDFS-7071) Adding Lazy_Persist to editsStored/editsStored.xml to fix TestOfflineEditsViewer#testStored test

2014-09-16 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-7071: Summary: Adding Lazy_Persist to editsStored/editsStored.xml to fix TestOfflineEditsViewer#testStored test Key: HDFS-7071 URL: https://issues.apache.org/jira/browse/HDFS-7071

[jira] [Commented] (HDFS-7064) Fix test failures

2014-09-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14135815#comment-14135815 ] Xiaoyu Yao commented on HDFS-7064: --  

[jira] [Updated] (HDFS-7071) Adding Lazy_Persist to editsStored/editsStored.xml to fix TestOfflineEditsViewer#testStored test

2014-09-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7071: - Attachment: editsStored HDFS-7071.0.patch Attach the raw binary file (editsStored) and the

[jira] [Updated] (HDFS-7064) Fix test failures

2014-09-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7064: - Attachment: HDFS-7064.1.patch Thanks [~arpitagarwal] for the feedback. I've updated the patch. Fix test

[jira] [Commented] (HDFS-7064) Fix test failures

2014-09-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136392#comment-14136392 ] Xiaoyu Yao commented on HDFS-7064: -- Got it, I miss the first part and will update the

[jira] [Updated] (HDFS-7064) Fix test failures

2014-09-16 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7064: - Attachment: HDFS-7064.2.patch Patch updated. Fix test failures - Key:

[jira] [Updated] (HDFS-6990) Add unit test for evict/delete RAM_DISK block with open handle

2014-09-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6990: - Attachment: HDFS-6990.1.patch Update patch based on the feedback. Add unit test for evict/delete

[jira] [Work started] (HDFS-7071) Adding Lazy_Persist to editsStored/editsStored.xml to fix TestOfflineEditsViewer#testStored test

2014-09-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-7071 started by Xiaoyu Yao. Adding Lazy_Persist to editsStored/editsStored.xml to fix

[jira] [Updated] (HDFS-6581) Write to single replica in memory

2014-09-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6581: - Attachment: Test-Plan-for-HDFS-6581-Memory-Storage.pdf Write to single replica in memory

[jira] [Updated] (HDFS-7084) FsDatasetImpl#copyBlockFiles debug log can be improved

2014-09-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7084: - Affects Version/s: (was: 2.6.0) HDFS-6581 FsDatasetImpl#copyBlockFiles debug

[jira] [Created] (HDFS-7084) FsDatasetImpl#copyBlockFiles debug log can be improved

2014-09-17 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-7084: Summary: FsDatasetImpl#copyBlockFiles debug log can be improved Key: HDFS-7084 URL: https://issues.apache.org/jira/browse/HDFS-7084 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-7084) FsDatasetImpl#copyBlockFiles debug log can be improved

2014-09-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7084: - Issue Type: Sub-task (was: Improvement) Parent: HDFS-6581 FsDatasetImpl#copyBlockFiles debug log

[jira] [Assigned] (HDFS-7084) FsDatasetImpl#copyBlockFiles debug log can be improved

2014-09-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao reassigned HDFS-7084: Assignee: Xiaoyu Yao FsDatasetImpl#copyBlockFiles debug log can be improved

[jira] [Updated] (HDFS-7084) FsDatasetImpl#copyBlockFiles debug log can be improved

2014-09-17 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7084: - Attachment: HDFS-7084.0.patch FsDatasetImpl#copyBlockFiles debug log can be improved

[jira] [Created] (HDFS-7115) TestEncryptionZones assume Unix path separator for KMS key store path

2014-09-21 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-7115: Summary: TestEncryptionZones assume Unix path separator for KMS key store path Key: HDFS-7115 URL: https://issues.apache.org/jira/browse/HDFS-7115 Project: Hadoop HDFS

[jira] [Updated] (HDFS-7115) TestEncryptionZones assumes Unix path separator for KMS key store path

2014-09-21 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7115: - Summary: TestEncryptionZones assumes Unix path separator for KMS key store path (was: TestEncryptionZones

[jira] [Updated] (HDFS-7115) TestEncryptionZones assumes Unix path separator for KMS key store path

2014-09-21 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7115: - Attachment: HDFS-7115.0.patch Attach the patch that fixed the original KMS store path issue on Windows. It

[jira] [Updated] (HDFS-7115) TestEncryptionZones assumes Unix path separator for KMS key store path

2014-09-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7115: - Fix Version/s: 2.6.0 Status: Patch Available (was: Open) TestEncryptionZones assumes Unix

[jira] [Created] (HDFS-7126) TestEncryptionZonesWithHA assumes Unix path separator for KMS key store path

2014-09-22 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDFS-7126: Summary: TestEncryptionZonesWithHA assumes Unix path separator for KMS key store path Key: HDFS-7126 URL: https://issues.apache.org/jira/browse/HDFS-7126 Project: Hadoop

[jira] [Updated] (HDFS-7126) TestEncryptionZonesWithHA assumes Unix path separator for KMS key store path

2014-09-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7126: - Attachment: HDFS-7126.0.patch TestEncryptionZonesWithHA assumes Unix path separator for KMS key store

[jira] [Updated] (HDFS-7126) TestEncryptionZonesWithHA assumes Unix path separator for KMS key store path

2014-09-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7126: - Status: Patch Available (was: Open) TestEncryptionZonesWithHA assumes Unix path separator for KMS key

[jira] [Updated] (HDFS-6990) Add unit test for evict/delete RAM_DISK block with open handle

2014-09-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6990: - Attachment: HDFS-6990.2.patch Update the patch with SCR reader counter check and the eviction validation.

[jira] [Updated] (HDFS-6990) Add unit test for evict/delete RAM_DISK block with open handle

2014-09-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6990: - Attachment: HDFS-6990.3.patch Thanks [~arpitagarwal] for reviewing the test. I've udpated patch to skip

[jira] [Commented] (HDFS-6988) Add configurable limit for percentage-based eviction threshold

2014-09-22 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14144252#comment-14144252 ] Xiaoyu Yao commented on HDFS-6988: -- Looks good to me. +1 (Non-binding) Add configurable

[jira] [Updated] (HDFS-6932) Balancer and Mover tools should ignore replicas on RAM_DISK

2014-09-23 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6932: - Attachment: HDFS-6932.1.patch Attach a patch to skip move/balance to/from transient storage and add unit

[jira] [Commented] (HDFS-316) Balancer should run for a configurable # of iterations

2014-09-23 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145706#comment-14145706 ] Xiaoyu Yao commented on HDFS-316: - Will update the patch with all lowercase option.

[jira] [Updated] (HDFS-6932) Balancer and Mover tools should ignore replicas on RAM_DISK

2014-09-24 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6932: - Attachment: HDFS-6932.2.patch Add Balancer test with RAM_DISK configuration and fix an array OOB issue in

[jira] [Updated] (HDFS-6932) Balancer and Mover tools should ignore replicas on RAM_DISK

2014-09-24 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-6932: - Attachment: HDFS-6932.3.patch Minor update to correct the timeout value for testBalancerWithRamDisk

[jira] [Work started] (HDFS-7129) Metrics to track usage of memory for writes

2014-09-24 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-7129 started by Xiaoyu Yao. Metrics to track usage of memory for writes ---

[jira] [Updated] (HDFS-7129) Metrics to track usage of memory for writes

2014-09-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7129: - Attachment: HDFS-7129.0.patch Adding memory storage related metrics to DataNodeMetrics. Metrics to track

[jira] [Updated] (HDFS-7129) Metrics to track usage of memory for writes

2014-09-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7129: - Attachment: HDFS-7129.1.patch Update the patch with additional unit tests for metrics. Metrics to track

[jira] [Updated] (HDFS-316) Balancer should run for a configurable # of iterations

2014-09-27 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-316: Attachment: HDFS-316.1.patch Thanks [~aw] for the feedback. Update command option to -maxidleiteration and

[jira] [Commented] (HDFS-7129) Metrics to track usage of memory for writes

2014-09-29 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14152230#comment-14152230 ] Xiaoyu Yao commented on HDFS-7129: -- Thanks [~arpitagarwal] for the review. We should not

[jira] [Commented] (HDFS-7129) Metrics to track usage of memory for writes

2014-09-29 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14152239#comment-14152239 ] Xiaoyu Yao commented on HDFS-7129: -- Thanks [~cnauroth] for the review. Good catch on 1!

[jira] [Updated] (HDFS-7129) Metrics to track usage of memory for writes

2014-09-29 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7129: - Attachment: HDFS-7129.2.patch Update the patch based on the feedback. Metrics to track usage of memory

[jira] [Updated] (HDFS-7129) Metrics to track usage of memory for writes

2014-09-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7129: - Attachment: HDFS-7129.3.patch Update patch to match the latest feature branch and remove some unnecessary

[jira] [Updated] (HDFS-316) Balancer should run for a configurable # of iterations

2014-09-30 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-316: Attachment: HDFS-316.2.patch Fix the patch. Balancer should run for a configurable # of iterations

  1   2   3   4   5   6   7   8   9   10   >