[jira] [Commented] (HDFS-7068) Support multiple block placement policies

2015-03-05 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14348676#comment-14348676 ] Zesheng Wu commented on HDFS-7068: -- Just go ahead, thanks for your work. Support

[jira] [Commented] (HDFS-7068) Support multiple block placement policies

2014-09-17 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14136853#comment-14136853 ] Zesheng Wu commented on HDFS-7068: -- bq. Indeed, right now the storage policies in

[jira] [Created] (HDFS-7068) Support multiple block placement policies

2014-09-16 Thread Zesheng Wu (JIRA)
Zesheng Wu created HDFS-7068: Summary: Support multiple block placement policies Key: HDFS-7068 URL: https://issues.apache.org/jira/browse/HDFS-7068 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-7044) Support retention policy based on access time and modify time, use XAttr to store policy

2014-09-16 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14135425#comment-14135425 ] Zesheng Wu commented on HDFS-7044: -- bq. HDFS-6382 is standalone daemon outside NameNode,

[jira] [Commented] (HDFS-7044) Support retention policy based on access time and modify time, use XAttr to store policy

2014-09-16 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14135548#comment-14135548 ] Zesheng Wu commented on HDFS-7044: -- bq. The same arguments that said that HDFS-6382 should

[jira] [Commented] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

2014-08-28 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14114824#comment-14114824 ] Zesheng Wu commented on HDFS-6898: -- [~arpitagarwal], what about append data to existing

[jira] [Commented] (HDFS-6898) DN must reserve space for a full block when an RBW block is created

2014-08-28 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14114847#comment-14114847 ] Zesheng Wu commented on HDFS-6898: -- Oh, sorry, I missed that detail in the patch. One

[jira] [Commented] (HDFS-6827) Both NameNodes stuck in STANDBY state due to HealthMonitor not aware of the target's status changing sometimes

2014-08-26 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14110645#comment-14110645 ] Zesheng Wu commented on HDFS-6827: -- [~vinayrpet], I verified your patch of HADOOP-10251 on

[jira] [Updated] (HDFS-6827) Both NameNodes stuck in STANDBY state due to HealthMonitor not aware of the target's status changing sometimes

2014-08-26 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6827: - Resolution: Duplicate Status: Resolved (was: Patch Available) Duplicate of HADOOP-10251. Both

[jira] [Commented] (HDFS-6827) Both NameNodes stuck in STANDBY state due to HealthMonitor not aware of the target's status changing sometimes

2014-08-21 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105261#comment-14105261 ] Zesheng Wu commented on HDFS-6827: -- Ping [~vinayrpet].. Both NameNodes stuck in STANDBY

[jira] [Commented] (HDFS-6827) Both NameNodes stuck in STANDBY state due to HealthMonitor not aware of the target's status changing sometimes

2014-08-21 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106364#comment-14106364 ] Zesheng Wu commented on HDFS-6827: -- Thanks [~vinayrpet], I will try the scenario in the

[jira] [Commented] (HDFS-6827) Both NameNodes stuck in STANDBY state due to HealthMonitor not aware of the target's status changing sometimes

2014-08-20 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14103500#comment-14103500 ] Zesheng Wu commented on HDFS-6827: -- I've looked into HADOOP-10251, it's quite different

[jira] [Commented] (HDFS-6827) Both NameNodes stuck in STANDBY state due to HealthMonitor not aware of the target's status changing sometimes

2014-08-20 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14103505#comment-14103505 ] Zesheng Wu commented on HDFS-6827: -- [~vinayrpet], Can you verify according to the

[jira] [Commented] (HDFS-6827) Both NameNodes stuck in STANDBY state due to HealthMonitor not aware of the target's status changing sometimes

2014-08-20 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14103557#comment-14103557 ] Zesheng Wu commented on HDFS-6827: -- I gone through your patch of HADOOP-10251. {code}

[jira] [Commented] (HDFS-6827) Both NameNodes could be in STANDBY State due to HealthMonitor not aware of the target's status changing sometimes

2014-08-19 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14103261#comment-14103261 ] Zesheng Wu commented on HDFS-6827: -- Thanks [~stack]:) bq. Yes. Is there anything more

[jira] [Updated] (HDFS-6827) Both NameNodes stuck in STANDBY state due to HealthMonitor not aware of the target's status changing sometimes

2014-08-19 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6827: - Summary: Both NameNodes stuck in STANDBY state due to HealthMonitor not aware of the target's status

[jira] [Commented] (HDFS-6827) Both NameNodes stuck in STANDBY state due to HealthMonitor not aware of the target's status changing sometimes

2014-08-19 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14103278#comment-14103278 ] Zesheng Wu commented on HDFS-6827: -- bq. As I described in the issue description, our NN

[jira] [Commented] (HDFS-6827) Both NameNodes could be in STANDBY State due to HealthMonitor not aware of the target's status changing sometimes

2014-08-18 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101725#comment-14101725 ] Zesheng Wu commented on HDFS-6827: -- Thanks [~stack]. bq. This issue looks a little ugly.

[jira] [Commented] (HDFS-6827) Both NameNodes could be in STANDBY State due to HealthMonitor not aware of the target's status changing sometimes

2014-08-18 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101775#comment-14101775 ] Zesheng Wu commented on HDFS-6827: -- bq. BTW: The healthCheckLock is used to distinguish

[jira] [Commented] (HDFS-6827) Both NameNodes could be in STANDBY State due to HealthMonitor not aware of the target's status changing sometimes

2014-08-18 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101781#comment-14101781 ] Zesheng Wu commented on HDFS-6827: -- bq. In the below test, is it possible the state gets

[jira] [Commented] (HDFS-6827) NameNode double standby

2014-08-08 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090541#comment-14090541 ] Zesheng Wu commented on HDFS-6827: -- Hi [~arpitagarwal], can you help review this patch?

[jira] [Updated] (HDFS-6827) NameNode double standby

2014-08-06 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6827: - Attachment: HDFS-6827.1.patch NameNode double standby --- Key:

[jira] [Updated] (HDFS-6827) NameNode double standby

2014-08-06 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6827: - Status: Patch Available (was: Open) NameNode double standby ---

[jira] [Commented] (HDFS-6827) NameNode double standby

2014-08-06 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14087395#comment-14087395 ] Zesheng Wu commented on HDFS-6827: -- Submit a patch to fix this bug. BTW: The

[jira] [Updated] (HDFS-6827) NameNode double standby

2014-08-06 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6827: - Priority: Critical (was: Major) NameNode double standby --- Key:

[jira] [Created] (HDFS-6827) NameNode double standby

2014-08-05 Thread Zesheng Wu (JIRA)
Zesheng Wu created HDFS-6827: Summary: NameNode double standby Key: HDFS-6827 URL: https://issues.apache.org/jira/browse/HDFS-6827 Project: Hadoop HDFS Issue Type: Bug Components: ha

[jira] [Commented] (HDFS-6526) Implement HDFS TtlManager

2014-07-25 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075238#comment-14075238 ] Zesheng Wu commented on HDFS-6526: -- Thanks for feedback, [~daryn]. # About scalability and

[jira] [Commented] (HDFS-6382) HDFS File/Directory TTL

2014-07-18 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067254#comment-14067254 ] Zesheng Wu commented on HDFS-6382: -- Thanks [~cutting] I will move the trash emptier into

[jira] [Updated] (HDFS-6596) Improve InputStream when read spans two blocks

2014-06-30 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6596: - Attachment: HDFS-6596.3.patch Fixed javadoc warnings. Improve InputStream when read spans two blocks

[jira] [Updated] (HDFS-6596) Improve InputStream when read spans two blocks

2014-06-30 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6596: - Attachment: HDFS-6596.3.patch Improve InputStream when read spans two blocks

[jira] [Updated] (HDFS-6596) Improve InputStream when read spans two blocks

2014-06-29 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6596: - Attachment: HDFS-6596.2.patch Failed test is unrelated, just resubmit the patch to trigger Jenkins.

[jira] [Updated] (HDFS-6596) Improve InputStream when read spans two blocks

2014-06-29 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6596: - Attachment: HDFS-6596.2.patch Mmm, Unrelated test failure, just resubmit... Improve InputStream when

[jira] [Updated] (HDFS-6596) Improve InputStream when read spans two blocks

2014-06-27 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6596: - Attachment: HDFS-6596.2.patch Uploaded a polished version. Improve InputStream when read spans two

[jira] [Updated] (HDFS-6596) Improve InputStream when read spans two blocks

2014-06-25 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6596: - Attachment: HDFS-6596.1.patch An initial patch. Since {{DataInputStream#readfully(byte[], int, int)}} is

[jira] [Updated] (HDFS-6596) Improve InputStream when read spans two blocks

2014-06-25 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6596: - Status: Patch Available (was: Open) Improve InputStream when read spans two blocks

[jira] [Created] (HDFS-6596) Improve InputStream when read spans two blocks

2014-06-24 Thread Zesheng Wu (JIRA)
Zesheng Wu created HDFS-6596: Summary: Improve InputStream when read spans two blocks Key: HDFS-6596 URL: https://issues.apache.org/jira/browse/HDFS-6596 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-6596) Improve InputStream when read spans two blocks

2014-06-24 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042986#comment-14042986 ] Zesheng Wu commented on HDFS-6596: -- Thanks Colin. bq. What you are proposing is basically

[jira] [Updated] (HDFS-6382) HDFS File/Directory TTL

2014-06-23 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6382: - Attachment: HDFS-TTL-Design-3.pdf Update the document according to the implementation. HDFS

[jira] [Updated] (HDFS-6525) FsShell supports HDFS TTL

2014-06-23 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6525: - Attachment: HDFS-6525.1.patch Initial implementation. FsShell supports HDFS TTL

[jira] [Updated] (HDFS-6525) FsShell supports HDFS TTL

2014-06-23 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6525: - Target Version/s: 2.5.0 Status: Patch Available (was: Open) FsShell supports HDFS TTL

[jira] [Updated] (HDFS-6526) Implement HDFS TtlManager

2014-06-23 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6526: - Attachment: HDFS-6526.1.patch Initial implementation, the unit test depends on HDFS-6525, so we should

[jira] [Updated] (HDFS-6526) Implement HDFS TtlManager

2014-06-23 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6526: - Target Version/s: 2.5.0 Status: Patch Available (was: Open) Implement HDFS TtlManager

[jira] [Commented] (HDFS-6382) HDFS File/Directory TTL

2014-06-23 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040683#comment-14040683 ] Zesheng Wu commented on HDFS-6382: -- Hi guys, I've uploaded an initial implementation on

[jira] [Commented] (HDFS-6525) FsShell supports HDFS TTL

2014-06-23 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041572#comment-14041572 ] Zesheng Wu commented on HDFS-6525: -- Thanks [~daryn], I will update the patch to address

[jira] [Updated] (HDFS-6525) FsShell supports HDFS TTL

2014-06-23 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6525: - Attachment: HDFS-6525.2.patch Updated to address [~daryn]'s comments. BTW: Daryn, the path is only

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-22 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14040435#comment-14040435 ] Zesheng Wu commented on HDFS-6507: -- Thanks [~vinayrpet] for reviewing the patch. Thanks

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-19 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14037044#comment-14037044 ] Zesheng Wu commented on HDFS-6507: -- You mean that we should revert the change to

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-19 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14037058#comment-14037058 ] Zesheng Wu commented on HDFS-6507: -- If we remove this, the log message will like this

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-19 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14037069#comment-14037069 ] Zesheng Wu commented on HDFS-6507: -- I eventually catch your point:) But I think

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-19 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14037078#comment-14037078 ] Zesheng Wu commented on HDFS-6507: -- Since it still has some potential value when used in

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-19 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14038235#comment-14038235 ] Zesheng Wu commented on HDFS-6507: -- Hi [~vinayrpet], it seems that folks do not have other

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-18 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034856#comment-14034856 ] Zesheng Wu commented on HDFS-6507: -- Yes, I will figure it out immediately Improve

[jira] [Updated] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-18 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6507: - Attachment: HDFS-6507.8.patch Improve DFSAdmin to support HA cluster better

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-18 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034891#comment-14034891 ] Zesheng Wu commented on HDFS-6507: -- The failed test doesn't relate to this issue.

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-18 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14036720#comment-14036720 ] Zesheng Wu commented on HDFS-6507: -- Thanks for feedback [~jingzhao] I still think that we

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033480#comment-14033480 ] Zesheng Wu commented on HDFS-6507: -- Thanks [~vinayrpet] for reviewing the patch, all

[jira] [Updated] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6507: - Attachment: HDFS-6507.3.patch New patch addressed Vinay's review comments. Improve DFSAdmin to support

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033688#comment-14033688 ] Zesheng Wu commented on HDFS-6507: -- I checked the related code, ProxyAndInfo is used in 3

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033693#comment-14033693 ] Zesheng Wu commented on HDFS-6507: -- Oh, It seems that NameNode also has a {{

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033737#comment-14033737 ] Zesheng Wu commented on HDFS-6507: -- OK, let me figure these too out:) Improve DFSAdmin

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033738#comment-14033738 ] Zesheng Wu commented on HDFS-6507: -- bq. One more query I have. using this implementation

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033754#comment-14033754 ] Zesheng Wu commented on HDFS-6507: -- Mmm, maybe in this case, user can use {{-fs}} generic

[jira] [Updated] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6507: - Attachment: HDFS-6507.5.patch Some minor polishes. Improve DFSAdmin to support HA cluster better

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14033725#comment-14033725 ] Zesheng Wu commented on HDFS-6507: -- It seems that finalizeUpgrade() doesn't output any

[jira] [Updated] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6507: - Attachment: HDFS-6507.6.patch The failed test {{TestCrcCorruption}} doesn't relate to this issue I run it

[jira] [Updated] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6507: - Attachment: HDFS-6507.7.patch Fix breaked test. Improve DFSAdmin to support HA cluster better

[jira] [Updated] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-17 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6507: - Attachment: HDFS-6507.7.patch Failed tests don't relate to this issue, just resubmit the #7 patch to

[jira] [Commented] (HDFS-6382) HDFS File/Directory TTL

2014-06-15 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14032082#comment-14032082 ] Zesheng Wu commented on HDFS-6382: -- [~ste...@apache.org] Thanks for your feedback. We have

[jira] [Updated] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-13 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6507: - Tags: dfsadmin Target Version/s: 3.0.0, 2.5.0 (was: 3.0.0) Status: Patch

[jira] [Updated] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-13 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6507: - Attachment: HDFS-6507.1.patch Attached initial version of the implementation. Improve DFSAdmin to

[jira] [Created] (HDFS-6525) FsShell supports HDFS TTL

2014-06-13 Thread Zesheng Wu (JIRA)
Zesheng Wu created HDFS-6525: Summary: FsShell supports HDFS TTL Key: HDFS-6525 URL: https://issues.apache.org/jira/browse/HDFS-6525 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-6526) Implement HDFS TtlManager

2014-06-13 Thread Zesheng Wu (JIRA)
Zesheng Wu created HDFS-6526: Summary: Implement HDFS TtlManager Key: HDFS-6526 URL: https://issues.apache.org/jira/browse/HDFS-6526 Project: Hadoop HDFS Issue Type: Sub-task Affects

[jira] [Commented] (HDFS-6382) HDFS File/Directory TTL

2014-06-13 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030366#comment-14030366 ] Zesheng Wu commented on HDFS-6382: -- I filed two sub-tasks to track the development of this

[jira] [Updated] (HDFS-6526) Implement HDFS TtlManager

2014-06-13 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6526: - Description: This issue is used to track development of HDFS TtlManager, for details see HDFS-6382.

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-13 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14030507#comment-14030507 ] Zesheng Wu commented on HDFS-6507: -- Mmm, seems that some test failed, I will figure it out

[jira] [Updated] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-13 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6507: - Attachment: HDFS-6507.2.patch Fix breaked tests. Improve DFSAdmin to support HA cluster better

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-12 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14028870#comment-14028870 ] Zesheng Wu commented on HDFS-6507: -- Fix one mistake: bq. The existing refresh commands do

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-12 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14028986#comment-14028986 ] Zesheng Wu commented on HDFS-6507: -- [~vinayrpet], Thanks for your feedback. bq. Only worry

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-12 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14029025#comment-14029025 ] Zesheng Wu commented on HDFS-6507: -- OK, I'll go ahead for implementation. Improve

[jira] [Commented] (HDFS-6503) Fix typo of DFSAdmin restoreFailedStorage

2014-06-11 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14028646#comment-14028646 ] Zesheng Wu commented on HDFS-6503: -- [~wheat9] Thank you for reviewing the patch:) Fix

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-11 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14028732#comment-14028732 ] Zesheng Wu commented on HDFS-6507: -- HADOOP-10376 implements a refresh command like this

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-11 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14028748#comment-14028748 ] Zesheng Wu commented on HDFS-6507: -- Since [~arpitagarwal] and [~chrili] are leading the

[jira] [Commented] (HDFS-6382) HDFS File/Directory TTL

2014-06-11 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14028768#comment-14028768 ] Zesheng Wu commented on HDFS-6382: -- [~szetszwo], Thanks for your valuable suggestions. bq.

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-11 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14028777#comment-14028777 ] Zesheng Wu commented on HDFS-6507: -- [~chrili], Thanks for your feedback. Waiting for

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-11 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14028814#comment-14028814 ] Zesheng Wu commented on HDFS-6507: -- bq. I don't see a significant advantage of having a

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-11 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14028843#comment-14028843 ] Zesheng Wu commented on HDFS-6507: -- [~jingzhao], Thanks for feedback. I've checked

[jira] [Created] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-10 Thread Zesheng Wu (JIRA)
Zesheng Wu created HDFS-6507: Summary: Improve DFSAdmin to support HA cluster better Key: HDFS-6507 URL: https://issues.apache.org/jira/browse/HDFS-6507 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-10 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6507: - Description: Currently, the commands supported in DFSAdmin can be classified into three categories

[jira] [Updated] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-10 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6507: - Description: Currently, the commands supported in DFSAdmin can be classified into three categories

[jira] [Commented] (HDFS-6382) HDFS File/Directory TTL

2014-06-10 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14027325#comment-14027325 ] Zesheng Wu commented on HDFS-6382: -- bq. Even if it's not implemented at first, we should

[jira] [Updated] (HDFS-6382) HDFS File/Directory TTL

2014-06-10 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6382: - Attachment: HDFS-TTL-Design -2.pdf Updated the documents to address Colin's suggestions. Thanks Colin for

[jira] [Updated] (HDFS-6382) HDFS File/Directory TTL

2014-06-09 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6382: - Attachment: HDFS-TTL-Design.pdf An initial version of design doc. HDFS File/Directory TTL

[jira] [Created] (HDFS-6503) Fix typo of DFSAdmin restoreFailedStorage

2014-06-09 Thread Zesheng Wu (JIRA)
Zesheng Wu created HDFS-6503: Summary: Fix typo of DFSAdmin restoreFailedStorage Key: HDFS-6503 URL: https://issues.apache.org/jira/browse/HDFS-6503 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Updated] (HDFS-6503) Fix typo of DFSAdmin restoreFailedStorage

2014-06-09 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6503: - Status: Patch Available (was: Open) Fix typo of DFSAdmin restoreFailedStorage

[jira] [Updated] (HDFS-6503) Fix typo of DFSAdmin restoreFailedStorage

2014-06-09 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zesheng Wu updated HDFS-6503: - Attachment: HDFS-6503.patch Fix typo of DFSAdmin restoreFailedStorage

[jira] [Commented] (HDFS-6503) Fix typo of DFSAdmin restoreFailedStorage

2014-06-09 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025285#comment-14025285 ] Zesheng Wu commented on HDFS-6503: -- Just fix typo, no need to add new tests. Fix typo of

[jira] [Commented] (HDFS-6382) HDFS File/Directory TTL

2014-06-09 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14026047#comment-14026047 ] Zesheng Wu commented on HDFS-6382: -- Thanks [~cmccabe] for your feedback. bq. For the MR

[jira] [Commented] (HDFS-6442) Fix TestEditLogAutoroll and TestStandbyCheckpoints failure caused by port conficts

2014-05-28 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14011937#comment-14011937 ] Zesheng Wu commented on HDFS-6442: -- Thanks [~arpitagarwal]. Fix TestEditLogAutoroll and

[jira] [Commented] (HDFS-6442) Fix TestEditLogAutoroll failure caused by port conficts

2014-05-27 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14010488#comment-14010488 ] Zesheng Wu commented on HDFS-6442: -- Thanks [~arpitagarwal], OK, I will make it more

[jira] [Commented] (HDFS-5682) Heterogeneous Storage phase 2 - APIs to expose Storage Types

2014-05-27 Thread Zesheng Wu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14010512#comment-14010512 ] Zesheng Wu commented on HDFS-5682: -- Thanks for the responses [~arpitagarwal] bq.The

  1   2   >