[jira] [Updated] (HDFS-3860) HeartbeatManager#Monitor may wrongly hold the writelock of namesystem

2012-08-27 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3860: Attachment: HDFS-heartbeat-testcase.patch HeartbeatManager#Monitor may wrongly hold the writelock of

[jira] [Updated] (HDFS-3860) HeartbeatManager#Monitor may wrongly hold the writelock of namesystem

2012-08-27 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3860: Attachment: HDFS-3860.patch HeartbeatManager#Monitor may wrongly hold the writelock of namesystem

[jira] [Updated] (HDFS-3703) Decrease the datanode failure detection time

2012-08-27 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3703: Attachment: HDFS-3703.patch This patch handles the stale nodes for reading in a straight way. It adds two

[jira] [Commented] (HDFS-3860) HeartbeatManager#Monitor may wrongly hold the writelock of namesystem

2012-08-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13443292#comment-13443292 ] Jing Zhao commented on HDFS-3860: - I just checked all the invocation of

[jira] [Created] (HDFS-3887) Remove redundant chooseTarget methods in BlockPlacementPolicy.java

2012-09-03 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-3887: --- Summary: Remove redundant chooseTarget methods in BlockPlacementPolicy.java Key: HDFS-3887 URL: https://issues.apache.org/jira/browse/HDFS-3887 Project: Hadoop HDFS

[jira] [Updated] (HDFS-3887) Remove redundant chooseTarget methods in BlockPlacementPolicy.java

2012-09-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3887: Attachment: HDFS-3887.patch Remove redundant chooseTarget methods in BlockPlacementPolicy.java

[jira] [Commented] (HDFS-3887) Remove redundant chooseTarget methods in BlockPlacementPolicy.java

2012-09-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13447521#comment-13447521 ] Jing Zhao commented on HDFS-3887: - Have rerun the two failed tests in my local machine and

[jira] [Created] (HDFS-3888) BlockPlacementPolicyDefault#LOG should be removed

2012-09-04 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-3888: --- Summary: BlockPlacementPolicyDefault#LOG should be removed Key: HDFS-3888 URL: https://issues.apache.org/jira/browse/HDFS-3888 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-3888) BlockPlacementPolicyDefault#LOG should be removed

2012-09-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3888: Attachment: HDFS-3888.patch BlockPlacementPolicyDefault#LOG should be removed

[jira] [Updated] (HDFS-3888) BlockPlacementPolicyDefault#LOG should be removed

2012-09-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3888: Status: Patch Available (was: Open) BlockPlacementPolicyDefault#LOG should be removed

[jira] [Updated] (HDFS-3888) BlockPlacementPolicyDefault code cleanup

2012-09-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3888: Status: Open (was: Patch Available) BlockPlacementPolicyDefault code cleanup

[jira] [Updated] (HDFS-3888) BlockPlacementPolicyDefault code cleanup

2012-09-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3888: Attachment: HDFS-3888.patch The code for computing the maxNodePerRack in chooseTarget() method is putting

[jira] [Assigned] (HDFS-2656) Implement a pure c client based on webhdfs

2012-09-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao reassigned HDFS-2656: --- Assignee: Jing Zhao Implement a pure c client based on webhdfs

[jira] [Updated] (HDFS-2656) Implement a pure c client based on webhdfs

2012-09-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-2656: Affects Version/s: 3.0.0 Status: Patch Available (was: Open) Implement a pure c client

[jira] [Updated] (HDFS-6041) Downgrade/Finalize should rename the rollback image instead of purging it

2014-03-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6041: Attachment: HDFS-6041.000.patch Downgrade/Finalize should rename the rollback image instead of purging it

[jira] [Updated] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6038: Attachment: HDFS-6038.001.patch Update bkjournal to fix compilation errors. JournalNode hardcodes

[jira] [Commented] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13918912#comment-13918912 ] Jing Zhao commented on HDFS-6038: - One issue with the current patch is that the JN will

[jira] [Updated] (HDFS-6041) Downgrade/Finalize should rename the rollback image instead of purging it

2014-03-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6041: Attachment: HDFS-6041.001.patch Thanks for the review, Nicholas! Update the patch to address your comments.

[jira] [Resolved] (HDFS-6041) Downgrade/Finalize should rename the rollback image instead of purging it

2014-03-03 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6041. - Resolution: Fixed Thanks Nicholas! I've committed this. Downgrade/Finalize should rename the rollback

[jira] [Created] (HDFS-6053) Fix TestDecommissioningStatus and TestDecommission in branch-2

2014-03-04 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6053: --- Summary: Fix TestDecommissioningStatus and TestDecommission in branch-2 Key: HDFS-6053 URL: https://issues.apache.org/jira/browse/HDFS-6053 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6053) Fix TestDecommissioningStatus and TestDecommission in branch-2

2014-03-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6053: Attachment: HDFS-6053.000.patch A simple patch to fix. Fix TestDecommissioningStatus and TestDecommission

[jira] [Commented] (HDFS-6053) Fix TestDecommissioningStatus and TestDecommission in branch-2

2014-03-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13919809#comment-13919809 ] Jing Zhao commented on HDFS-6053: - In my local test the patch can fix the two failed unit

[jira] [Resolved] (HDFS-6053) Fix TestDecommissioningStatus and TestDecommission in branch-2

2014-03-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6053. - Resolution: Fixed Fix Version/s: 2.4.0 Thanks for the review, Nicholas! I've committed this to

[jira] [Commented] (HDFS-6043) Give HDFS daemons NFS3 and Portmap their own OPTS

2014-03-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13920148#comment-13920148 ] Jing Zhao commented on HDFS-6043: - nit: export HADOOP_NFS3_OPTS= $HADOOP_NFS3_OPTS there is

[jira] [Commented] (HDFS-6044) Add property for setting the NFS look up time for users

2014-03-04 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13920163#comment-13920163 ] Jing Zhao commented on HDFS-6044: - The patch looks good to me. Some minor comments: # We

[jira] [Commented] (HDFS-5167) Add metrics about the NameNode retry cache

2014-03-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13921142#comment-13921142 ] Jing Zhao commented on HDFS-5167: - +1 for the latest patch. I will commit it soon. Add

[jira] [Updated] (HDFS-5167) Add metrics about the NameNode retry cache

2014-03-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5167: Resolution: Fixed Fix Version/s: 2.4.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Updated] (HDFS-6058) Fix TestHDFSCLI failures after HADOOP-8691 change

2014-03-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6058: Affects Version/s: 2.4.0 Fix TestHDFSCLI failures after HADOOP-8691 change

[jira] [Updated] (HDFS-6058) Fix TestHDFSCLI failures after HADOOP-8691 change

2014-03-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6058: Status: Patch Available (was: Open) Fix TestHDFSCLI failures after HADOOP-8691 change

[jira] [Commented] (HDFS-5653) Log namenode hostname in various exceptions being thrown in a HA setup

2014-03-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13921565#comment-13921565 ] Jing Zhao commented on HDFS-5653: - +1 the new Patch looks good to me. Log namenode

[jira] [Updated] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6038: Attachment: HDFS-6038.002.patch JournalNode hardcodes NameNodeLayoutVersion in the edit log file

[jira] [Commented] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13921602#comment-13921602 ] Jing Zhao commented on HDFS-6038: - After offline discussion with [~szetszwo], the 002 patch

[jira] [Updated] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6038: Status: Patch Available (was: Open) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

[jira] [Updated] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6038: Status: Open (was: Patch Available) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

[jira] [Updated] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6038: Status: Patch Available (was: Open) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

[jira] [Updated] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6038: Attachment: HDFS-6038.003.patch editsStored Fix some unit tests. JournalNode hardcodes

[jira] [Updated] (HDFS-6062) TestRetryCacheWithHA#testConcat is flaky

2014-03-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6062: Attachment: HDFS-6062.000.patch The patch checks the length of the target file to make sure concat has been

[jira] [Updated] (HDFS-6062) TestRetryCacheWithHA#testConcat is flaky

2014-03-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6062: Affects Version/s: 2.4.0 Status: Patch Available (was: Open)

[jira] [Created] (HDFS-6062) TestRetryCacheWithHA#testConcat is flaky

2014-03-05 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6062: --- Summary: TestRetryCacheWithHA#testConcat is flaky Key: HDFS-6062 URL: https://issues.apache.org/jira/browse/HDFS-6062 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6038: Attachment: HDFS-6038.004.patch Thanks for the review, Nicholas! Update the patch to address your comments.

[jira] [Commented] (HDFS-6058) Fix TestHDFSCLI failures after HADOOP-8691 change

2014-03-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13922122#comment-13922122 ] Jing Zhao commented on HDFS-6058: - The failed test should be unrelated. +1 for the 000

[jira] [Updated] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-06 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6038: Attachment: HDFS-6038.005.patch Update the patch to fix some unit tests and address Nicholas's comments.

[jira] [Updated] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-06 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6038: Attachment: (was: editsStored) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

[jira] [Commented] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-06 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13923479#comment-13923479 ] Jing Zhao commented on HDFS-6038: - the editsStored binary file needs to be updated again.

[jira] [Commented] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13923725#comment-13923725 ] Jing Zhao commented on HDFS-6038: - bq. DataOutputBuffer.writeInt can be simplified as

[jira] [Updated] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6038: Attachment: HDFS-6038.006.patch Update the patch to fix the javadoc warning and unit test failure.

[jira] [Updated] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6038: Attachment: HDFS-6038.007.patch Added an extra check for writing length. JournalNode hardcodes

[jira] [Commented] (HDFS-6077) running slive with webhdfs on secure HA cluster fails with un kown host exception

2014-03-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13924442#comment-13924442 ] Jing Zhao commented on HDFS-6077: - This is actually a similar issue with HDFS-5339:

[jira] [Updated] (HDFS-6077) running slive with webhdfs on secure HA cluster fails with un kown host exception

2014-03-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6077: Status: Patch Available (was: Open) running slive with webhdfs on secure HA cluster fails with un kown

[jira] [Updated] (HDFS-6077) running slive with webhdfs on secure HA cluster fails with un kown host exception

2014-03-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6077: Attachment: HDFS-6077.000.patch A simple patch to fix. running slive with webhdfs on secure HA cluster

[jira] [Commented] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13924578#comment-13924578 ] Jing Zhao commented on HDFS-6038: - [~tlipcon], do you also want to take a look at the

[jira] [Updated] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6038: Status: Open (was: Patch Available) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

[jira] [Updated] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6038: Attachment: editsStored Upload the editStored binary file. JournalNode hardcodes NameNodeLayoutVersion in

[jira] [Commented] (HDFS-6072) Clean up dead code of FSImage

2014-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13926059#comment-13926059 ] Jing Zhao commented on HDFS-6072: - The patch looks good to me. Besides the comments from

[jira] [Updated] (HDFS-6077) running slive with webhdfs on secure HA cluster fails with unkown host exception

2014-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6077: Summary: running slive with webhdfs on secure HA cluster fails with unkown host exception (was: running

[jira] [Updated] (HDFS-6077) running slive with webhdfs on secure HA cluster fails with unkown host exception

2014-03-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6077: Resolution: Fixed Fix Version/s: 2.4.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Commented] (HDFS-6072) Clean up dead code of FSImage

2014-03-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13930973#comment-13930973 ] Jing Zhao commented on HDFS-6072: - +1 for the new patch. Thanks for the cleaning, Haohui!

[jira] [Commented] (HDFS-6089) Standby NN while transitioning to active throws a connection refused error when the prior active NN process is suspended

2014-03-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13931045#comment-13931045 ] Jing Zhao commented on HDFS-6089: - Checked the log with Arpit. Looks like the issue is like

[jira] [Commented] (HDFS-6089) Standby NN while transitioning to active throws a connection refused error when the prior active NN process is suspended

2014-03-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13931048#comment-13931048 ] Jing Zhao commented on HDFS-6089: - Since in active NN we already have a

[jira] [Updated] (HDFS-6089) Standby NN while transitioning to active throws a connection refused error when the prior active NN process is suspended

2014-03-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6089: Attachment: HDFS-6089.000.patch Simple patch to remove the editlog roll from SBN. Standby NN while

[jira] [Updated] (HDFS-6089) Standby NN while transitioning to active throws a connection refused error when the prior active NN process is suspended

2014-03-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6089: Status: Patch Available (was: Open) Standby NN while transitioning to active throws a connection refused

[jira] [Updated] (HDFS-6089) Standby NN while transitioning to active throws a connection refused error when the prior active NN process is suspended

2014-03-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6089: Attachment: HDFS-6089.001.patch Fix unit tests. Standby NN while transitioning to active throws a

[jira] [Commented] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13933577#comment-13933577 ] Jing Zhao commented on HDFS-6038: - Thanks for the review, Todd! bq. just worried that

[jira] [Updated] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6038: Description: In HA setup, the JNs receive edit logs (blob) from the NN and write into edit log files. In

[jira] [Updated] (HDFS-6038) Allow JournalNode to handle editlog produced by new release with future layoutversion

2014-03-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6038: Summary: Allow JournalNode to handle editlog produced by new release with future layoutversion (was:

[jira] [Updated] (HDFS-6038) Allow JournalNode to handle editlog produced by new release with future layoutversion

2014-03-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6038: Attachment: HDFS-6038.008.patch Update the patch to address Todd's comments. The main change is to add a

[jira] [Updated] (HDFS-6038) Allow JournalNode to handle editlog produced by new release with future layoutversion

2014-03-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6038: Status: Patch Available (was: Open) Allow JournalNode to handle editlog produced by new release with

[jira] [Commented] (HDFS-6094) The same block can be counted twice towards safe mode threshold

2014-03-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13934384#comment-13934384 ] Jing Zhao commented on HDFS-6094: - I can also reproduce the issue on my local machine.

[jira] [Commented] (HDFS-6094) The same block can be counted twice towards safe mode threshold

2014-03-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13934407#comment-13934407 ] Jing Zhao commented on HDFS-6094: - Another option is to add new storage id even for

[jira] [Updated] (HDFS-6094) The same block can be counted twice towards safe mode threshold

2014-03-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6094: Attachment: TestHASafeMode-output.txt Attach the log of the test that reproduced the failure. I injected an

[jira] [Commented] (HDFS-6094) The same block can be counted twice towards safe mode threshold

2014-03-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13934472#comment-13934472 ] Jing Zhao commented on HDFS-6094: - Maybe another issue with the current code is that when

[jira] [Commented] (HDFS-6094) The same block can be counted twice towards safe mode threshold

2014-03-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13935296#comment-13935296 ] Jing Zhao commented on HDFS-6094: - The patch looks good to me. One question is, currently

[jira] [Commented] (HDFS-6100) DataNodeWebHdfsMethods does not failover in HA mode

2014-03-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13935411#comment-13935411 ] Jing Zhao commented on HDFS-6100: - The patch looks pretty good to me. Some minor comments:

[jira] [Commented] (HDFS-6094) The same block can be counted twice towards safe mode threshold

2014-03-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13938081#comment-13938081 ] Jing Zhao commented on HDFS-6094: - The latest patch looks good to me. +1. The same block

[jira] [Commented] (HDFS-6090) Use MiniDFSCluster.Builder instead of deprecated constructors

2014-03-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13938182#comment-13938182 ] Jing Zhao commented on HDFS-6090: - Thanks for the cleanup, Akira! The patch looks good to

[jira] [Updated] (HDFS-6090) Use MiniDFSCluster.Builder instead of deprecated constructors

2014-03-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6090: Resolution: Fixed Fix Version/s: 2.4.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Commented] (HDFS-6113) Rolling upgrae exception

2014-03-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13938811#comment-13938811 ] Jing Zhao commented on HDFS-6113: - Hi Fengdong, thanks for testing. But hadoop 2.3 does not

[jira] [Comment Edited] (HDFS-6113) Rolling upgrae exception

2014-03-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13938811#comment-13938811 ] Jing Zhao edited comment on HDFS-6113 at 3/18/14 4:49 AM: -- Hi

[jira] [Commented] (HDFS-6089) Standby NN while transitioning to active throws a connection refused error when the prior active NN process is suspended

2014-03-18 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13938931#comment-13938931 ] Jing Zhao commented on HDFS-6089: - Thanks for the comments, Andrew and Todd! bq. In

[jira] [Resolved] (HDFS-6113) Rolling upgrae exception

2014-03-18 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6113. - Resolution: Invalid Based on Kihwal and Nicholas's comments, let's close this jira first. Fengdong,

[jira] [Commented] (HDFS-6089) Standby NN while transitioning to active throws a connection refused error when the prior active NN process is suspended

2014-03-18 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13939848#comment-13939848 ] Jing Zhao commented on HDFS-6089: - Thanks for the response, Andrew. bq. If we add a time

[jira] [Commented] (HDFS-6089) Standby NN while transitioning to active throws a connection refused error when the prior active NN process is suspended

2014-03-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13940229#comment-13940229 ] Jing Zhao commented on HDFS-6089: - Hi Andrew, thanks for the explanation. I guess I

[jira] [Updated] (HDFS-6100) DataNodeWebHdfsMethods does not failover in HA mode

2014-03-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6100: Resolution: Fixed Fix Version/s: 2.4.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Commented] (HDFS-6100) DataNodeWebHdfsMethods does not failover in HA mode

2014-03-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13940716#comment-13940716 ] Jing Zhao commented on HDFS-6100: - +1 for the latest patch. DataNodeWebHdfsMethods does

[jira] [Commented] (HDFS-6105) NN web UI for DN list loads the same jmx page multiple times.

2014-03-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13941088#comment-13941088 ] Jing Zhao commented on HDFS-6105: - +1 NN web UI for DN list loads the same jmx page

[jira] [Commented] (HDFS-6089) Standby NN while transitioning to active throws a connection refused error when the prior active NN process is suspended

2014-03-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13941117#comment-13941117 ] Jing Zhao commented on HDFS-6089: - bq. This is because if we don't have further operations

[jira] [Commented] (HDFS-6127) WebHDFS tokens cannot be renewed in HA setup

2014-03-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13941149#comment-13941149 ] Jing Zhao commented on HDFS-6127: - The patch looks good to me. Some comments: # Nit:

[jira] [Commented] (HDFS-6127) WebHDFS tokens cannot be renewed in HA setup

2014-03-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13941171#comment-13941171 ] Jing Zhao commented on HDFS-6127: - bq. The change in TestWebhdfsForHA actually weakens our

[jira] [Updated] (HDFS-6089) Standby NN while transitioning to active throws a connection refused error when the prior active NN process is suspended

2014-03-19 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6089: Attachment: HDFS-6089.002.patch Patch that adds rpc timeout for the rollEditLog call. I set the default

[jira] [Commented] (HDFS-6120) Cleanup safe mode error messages

2014-03-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13942052#comment-13942052 ] Jing Zhao commented on HDFS-6120: - Thanks for the cleanup, Arpit! The patch looks good to

[jira] [Moved] (HDFS-6131) Move HDFSHighAvailabilityWithNFS.apt.vm and HDFSHighAvailabilityWithQJM.apt.vm from Yarn to HDFS

2014-03-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao moved HADOOP-10415 to HDFS-6131: -- Component/s: (was: documentation) documentation

[jira] [Updated] (HDFS-6131) Move HDFSHighAvailabilityWithNFS.apt.vm and HDFSHighAvailabilityWithQJM.apt.vm from Yarn to HDFS

2014-03-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6131: Attachment: HDFS-6131.000.patch Move HDFSHighAvailabilityWithNFS.apt.vm and

[jira] [Updated] (HDFS-6131) Move HDFSHighAvailabilityWithNFS.apt.vm and HDFSHighAvailabilityWithQJM.apt.vm from Yarn to HDFS

2014-03-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6131: Status: Open (was: Patch Available) Move HDFSHighAvailabilityWithNFS.apt.vm and

[jira] [Commented] (HDFS-6131) Move HDFSHighAvailabilityWithNFS.apt.vm and HDFSHighAvailabilityWithQJM.apt.vm from Yarn to HDFS

2014-03-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13942128#comment-13942128 ] Jing Zhao commented on HDFS-6131: - Upload the patch for branch-2. Move

[jira] [Updated] (HDFS-6131) Move HDFSHighAvailabilityWithNFS.apt.vm and HDFSHighAvailabilityWithQJM.apt.vm from Yarn to HDFS

2014-03-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6131: Status: Patch Available (was: Open) Move HDFSHighAvailabilityWithNFS.apt.vm and

[jira] [Commented] (HDFS-6131) Move HDFSHighAvailabilityWithNFS.apt.vm and HDFSHighAvailabilityWithQJM.apt.vm from Yarn to HDFS

2014-03-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13942212#comment-13942212 ] Jing Zhao commented on HDFS-6131: - Ahh, yes. Thanks Arpit! Let me update the patch. Move

[jira] [Updated] (HDFS-6131) Move HDFSHighAvailabilityWithNFS.apt.vm and HDFSHighAvailabilityWithQJM.apt.vm from Yarn to HDFS

2014-03-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6131: Attachment: HDFS-6131.001.patch Move HDFSHighAvailabilityWithNFS.apt.vm and

[jira] [Resolved] (HDFS-6131) Move HDFSHighAvailabilityWithNFS.apt.vm and HDFSHighAvailabilityWithQJM.apt.vm from Yarn to HDFS

2014-03-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6131. - Resolution: Fixed Fix Version/s: 2.4.0 Hadoop Flags: Reviewed Thanks very much to Arpit for

[jira] [Commented] (HDFS-6038) Allow JournalNode to handle editlog produced by new release with future layoutversion

2014-03-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13942461#comment-13942461 ] Jing Zhao commented on HDFS-6038: - Thanks for the review, Nicholas! I will commit the patch

[jira] [Updated] (HDFS-6038) Allow JournalNode to handle editlog produced by new release with future layoutversion

2014-03-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6038: Resolution: Fixed Fix Version/s: 2.4.0 Status: Resolved (was: Patch Available) I've

<    1   2   3   4   5   6   7   8   9   10   >