[jira] [Comment Edited] (HDFS-6562) Refactor rename() in FSDirectory

2014-06-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039444#comment-14039444 ] Jing Zhao edited comment on HDFS-6562 at 6/20/14 10:11 PM: ---

[jira] [Commented] (HDFS-6562) Refactor rename() in FSDirectory

2014-06-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039444#comment-14039444 ] Jing Zhao commented on HDFS-6562: - Thanks for the refactoring, Haohui! Just finished

[jira] [Commented] (HDFS-6562) Refactor rename() in FSDirectory

2014-06-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039474#comment-14039474 ] Jing Zhao commented on HDFS-6562: - Comments for the remaining changes: # I guess we can

[jira] [Commented] (HDFS-4667) Capture renamed files/directories in snapshot diff report

2014-06-20 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14039491#comment-14039491 ] Jing Zhao commented on HDFS-4667: - Thanks for the review, Nicholas! [~decster], do you have

[jira] [Updated] (HDFS-4667) Capture renamed files/directories in snapshot diff report

2014-06-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-4667: Resolution: Fixed Fix Version/s: 2.5.0 Status: Resolved (was: Patch Available) Thanks

[jira] [Commented] (HDFS-6588) Investigating removing getTrueCause method in Server.java

2014-06-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041062#comment-14041062 ] Jing Zhao commented on HDFS-6588: - HDFS-5322 should not be related to the failed test. In

[jira] [Commented] (HDFS-6562) Refactor rename() in FSDirectory

2014-06-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041065#comment-14041065 ] Jing Zhao commented on HDFS-6562: - The new patch looks pretty good to me. +1 [~szetszwo],

[jira] [Commented] (HDFS-6588) Investigating removing getTrueCause method in Server.java

2014-06-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041119#comment-14041119 ] Jing Zhao commented on HDFS-6588: - Yeah, also the failed tests were not introduced by

[jira] [Created] (HDFS-6593) Move SnapshotDiffInfo out of INodeDirectorySnapshottable

2014-06-23 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6593: --- Summary: Move SnapshotDiffInfo out of INodeDirectorySnapshottable Key: HDFS-6593 URL: https://issues.apache.org/jira/browse/HDFS-6593 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-6593) Move SnapshotDiffInfo out of INodeDirectorySnapshottable

2014-06-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6593: Status: Patch Available (was: Open) Move SnapshotDiffInfo out of INodeDirectorySnapshottable

[jira] [Updated] (HDFS-6593) Move SnapshotDiffInfo out of INodeDirectorySnapshottable

2014-06-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6593: Attachment: HDFS-6593.000.patch Move SnapshotDiffInfo out of INodeDirectorySnapshottable

[jira] [Updated] (HDFS-6593) Move SnapshotDiffInfo out of INodeDirectorySnapshottable

2014-06-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6593: Attachment: HDFS-6593.001.patch Thanks for the review, Haohui! Update the patch to address your comments.

[jira] [Updated] (HDFS-6593) Move SnapshotDiffInfo out of INodeDirectorySnapshottable

2014-06-23 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6593: Attachment: HDFS-6593.002.patch Fix the failed unit test and javadoc. Move SnapshotDiffInfo out of

[jira] [Commented] (HDFS-6597) Add a new option to NN upgrade to terminate the process after upgrade on NN is completed

2014-06-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042602#comment-14042602 ] Jing Zhao commented on HDFS-6597: - bq. and later when all services were started, upgrade of

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14042720#comment-14042720 ] Jing Zhao commented on HDFS-6527: - Thanks for the report, [~l201514]! Actually the unit

[jira] [Reopened] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao reopened HDFS-6527: - Reopen the jira and wait for [~kihwal] to comment. Edit log corruption due to defered INode removal

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-27 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14046173#comment-14046173 ] Jing Zhao commented on HDFS-6527: - Thanks [~atm]! The analysis makes sense to me. Let's

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-27 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14046198#comment-14046198 ] Jing Zhao commented on HDFS-6527: - Yeah, let's merge the fix back to 2.4.1 with unit test

[jira] [Commented] (HDFS-6601) Issues in finalizing rolling upgrade when there is a layout version change

2014-06-27 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14046205#comment-14046205 ] Jing Zhao commented on HDFS-6601: - The patch looks good to me. +1. Thanks [~kihwal]!

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-27 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14046441#comment-14046441 ] Jing Zhao commented on HDFS-6527: - [~atm], do you already have a updated patch for 2.4.1?

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047893#comment-14047893 ] Jing Zhao commented on HDFS-6527: - Copied from release vote mailing thread: {code} That's

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047907#comment-14047907 ] Jing Zhao commented on HDFS-6527: - Thanks for the quick reply, [~atm]. I will merge it to

[jira] [Created] (HDFS-6609) Use DirectorySnapshottableFeature to represent a snapshottable directory

2014-06-30 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6609: --- Summary: Use DirectorySnapshottableFeature to represent a snapshottable directory Key: HDFS-6609 URL: https://issues.apache.org/jira/browse/HDFS-6609 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6609) Use DirectorySnapshottableFeature to represent a snapshottable directory

2014-06-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6609: Attachment: HDFS-6609.000.patch Initial patch. The patch adds a new DirectorySnapshottableFeature which

[jira] [Updated] (HDFS-6609) Use DirectorySnapshottableFeature to represent a snapshottable directory

2014-06-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6609: Status: Patch Available (was: Open) Use DirectorySnapshottableFeature to represent a snapshottable

[jira] [Commented] (HDFS-6527) Edit log corruption due to defered INode removal

2014-06-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048258#comment-14048258 ] Jing Zhao commented on HDFS-6527: - Actually the patch has already been merged into 2.4. I

[jira] [Commented] (HDFS-6609) Use DirectorySnapshottableFeature to represent a snapshottable directory

2014-07-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049098#comment-14049098 ] Jing Zhao commented on HDFS-6609: - Thanks for the review, [~wheat9]. Will update the patch

[jira] [Commented] (HDFS-6618) Edit log corruption may still happen even after HDFS-6527

2014-07-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14049122#comment-14049122 ] Jing Zhao commented on HDFS-6618: - If the corruption is caused by the same issue, can we

[jira] [Updated] (HDFS-6609) Use DirectorySnapshottableFeature to represent a snapshottable directory

2014-07-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6609: Attachment: HDFS-6609.002.patch Update the patch to address Haohui's comments. Use

[jira] [Commented] (HDFS-6618) Remove deleted INodes from INodeMap right away

2014-07-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14053932#comment-14053932 ] Jing Zhao commented on HDFS-6618: - bq. If we're just trying to make a minimal change to put

[jira] [Commented] (HDFS-6645) Add test for successive Snapshots between XAttr modifications

2014-07-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055882#comment-14055882 ] Jing Zhao commented on HDFS-6645: - +1. Thanks [~schu]! I will commit it tomorrow morning.

[jira] [Commented] (HDFS-6618) Remove deleted INodes from INodeMap right away

2014-07-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14056481#comment-14056481 ] Jing Zhao commented on HDFS-6618: - Thanks [~kihwal]. The patch looks good to me. +1 pending

[jira] [Commented] (HDFS-6647) Edit log corruption when pipeline recovery occurs for deleted file present in snapshot

2014-07-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14056523#comment-14056523 ] Jing Zhao commented on HDFS-6647: - In HDFS-6527 we do not allow users to get an additional

[jira] [Commented] (HDFS-6643) Refactor INodeFile.HeaderFormat and INodeWithAdditionalFields.PermissionStatusFormat

2014-07-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14056991#comment-14056991 ] Jing Zhao commented on HDFS-6643: - The patch looks pretty good to me. But it looks like the

[jira] [Commented] (HDFS-6643) Refactor INodeFile.HeaderFormat and INodeWithAdditionalFields.PermissionStatusFormat

2014-07-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057128#comment-14057128 ] Jing Zhao commented on HDFS-6643: - +1 for the latest patch. Refactor

[jira] [Updated] (HDFS-6645) Add test for successive Snapshots between XAttr modifications

2014-07-09 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6645: Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Commented] (HDFS-6651) Deletion failure can leak inodes permanently.

2014-07-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057771#comment-14057771 ] Jing Zhao commented on HDFS-6651: - I think one solution is that we do not count snapshot

[jira] [Updated] (HDFS-6651) Deletion failure can leak inodes permanently.

2014-07-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6651: Attachment: HDFS-6651.000.patch A preliminary patch demonstrating not counting snapshot diffs into

[jira] [Updated] (HDFS-6640) [ Web HDFS ] Syntax for MKDIRS, CREATESYMLINK, and SETXATTR are given wrongly(missed webhdfs/v1).).

2014-07-10 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6640: Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Moved] (HDFS-6667) In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails with Client cannot authenticate via:[TOKEN, KERBEROS] error

2014-07-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao moved HADOOP-10519 to HDFS-6667: -- Component/s: (was: security) security Key:

[jira] [Assigned] (HDFS-6667) In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails with Client cannot authenticate via:[TOKEN, KERBEROS] error

2014-07-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao reassigned HDFS-6667: --- Assignee: Jing Zhao In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails with Client

[jira] [Updated] (HDFS-6667) In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails with Client cannot authenticate via:[TOKEN, KERBEROS] error

2014-07-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6667: Attachment: HDFS-6667.000.patch Upload a simple patch based on [~daryn]'s suggestion. I've tested it in a

[jira] [Updated] (HDFS-6667) In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails with Client cannot authenticate via:[TOKEN, KERBEROS] error

2014-07-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6667: Status: Patch Available (was: Open) In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails

[jira] [Commented] (HDFS-6667) In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails with Client cannot authenticate via:[TOKEN, KERBEROS] error

2014-07-15 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14061783#comment-14061783 ] Jing Zhao commented on HDFS-6667: - The unit test failures should be unrelated.

[jira] [Commented] (HDFS-6478) RemoteException can't be retried properly for non-HA scenario

2014-07-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063820#comment-14063820 ] Jing Zhao commented on HDFS-6478: - The patch looks pretty good to me. One comment is that

[jira] [Commented] (HDFS-6689) NFS: can't access file under directory with 711 access right as other user

2014-07-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063843#comment-14063843 ] Jing Zhao commented on HDFS-6689: - +1. Thanks for the fix [~brandonli]! NFS: can't access

[jira] [Commented] (HDFS-6478) RemoteException can't be retried properly for non-HA scenario

2014-07-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064587#comment-14064587 ] Jing Zhao commented on HDFS-6478: - +1 for the new patch. I will commit it tomorrow if no

[jira] [Updated] (HDFS-6478) RemoteException can't be retried properly for non-HA scenario

2014-07-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6478: Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Commented] (HDFS-6616) bestNode shouldn't always return the first DataNode

2014-07-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14065382#comment-14065382 ] Jing Zhao commented on HDFS-6616: - bq. We should also change WebHdfsFileSystem to use the

[jira] [Commented] (HDFS-6667) In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails with Client cannot authenticate via:[TOKEN, KERBEROS] error

2014-07-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14065736#comment-14065736 ] Jing Zhao commented on HDFS-6667: - I will commit the patch based on [~wheat9]'s +1. We can

[jira] [Updated] (HDFS-6667) In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails with Client cannot authenticate via:[TOKEN, KERBEROS] error

2014-07-17 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6667: Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Commented] (HDFS-6667) In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails with Client cannot authenticate via:[TOKEN, KERBEROS] error

2014-07-18 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066631#comment-14066631 ] Jing Zhao commented on HDFS-6667: - Sure. I just followed your suggestion and change the

[jira] [Commented] (HDFS-6704) Fix the command to launch JournalNode in HDFS-HA document

2014-07-18 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066644#comment-14066644 ] Jing Zhao commented on HDFS-6704: - We should also add start into the command? Fix the

[jira] [Assigned] (HDFS-6715) webhdfs wont fail over when it gets java.io.IOException: Namenode is in startup mode

2014-07-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao reassigned HDFS-6715: --- Assignee: Jing Zhao webhdfs wont fail over when it gets java.io.IOException: Namenode is in

[jira] [Updated] (HDFS-6715) webhdfs wont fail over when it gets java.io.IOException: Namenode is in startup mode

2014-07-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6715: Attachment: HDFS-6715.000.patch We may throw a RetriableException here to allow WebHdfsFileSystem to retry

[jira] [Updated] (HDFS-6715) webhdfs wont fail over when it gets java.io.IOException: Namenode is in startup mode

2014-07-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6715: Status: Patch Available (was: Open) webhdfs wont fail over when it gets java.io.IOException: Namenode is

[jira] [Updated] (HDFS-6715) webhdfs wont fail over when it gets java.io.IOException: Namenode is in startup mode

2014-07-21 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6715: Attachment: HDFS-6715.001.patch Update the patch to fix the failed unit test. webhdfs wont fail over when

[jira] [Commented] (HDFS-6704) Fix the command to launch JournalNode in HDFS-HA document

2014-07-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070527#comment-14070527 ] Jing Zhao commented on HDFS-6704: - +1. I will commit it shortly. Fix the command to

[jira] [Updated] (HDFS-6704) Fix the command to launch JournalNode in HDFS-HA document

2014-07-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6704: Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Commented] (HDFS-5919) FileJournalManager doesn't purge empty and corrupt inprogress edits files

2014-07-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073446#comment-14073446 ] Jing Zhao commented on HDFS-5919: - The patch looks good to me. +1. Maybe we can also use

[jira] [Updated] (HDFS-6715) webhdfs wont fail over when it gets java.io.IOException: Namenode is in startup mode

2014-07-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6715: Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Commented] (HDFS-6696) Name node cannot start if the path of a file under construction contains .snapshot

2014-07-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073603#comment-14073603 ] Jing Zhao commented on HDFS-6696: - The patch looks good to me. The new unit tests also pass

[jira] [Commented] (HDFS-5919) FileJournalManager doesn't purge empty and corrupt inprogress edits files

2014-07-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074090#comment-14074090 ] Jing Zhao commented on HDFS-5919: - +1. Thanks Vinay! FileJournalManager doesn't purge

[jira] [Updated] (HDFS-6739) Add getDatanodeStorageReport to ClientProtocol

2014-07-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6739: Hadoop Flags: Reviewed Add getDatanodeStorageReport to ClientProtocol

[jira] [Commented] (HDFS-6739) Add getDatanodeStorageReport to ClientProtocol

2014-07-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14076506#comment-14076506 ] Jing Zhao commented on HDFS-6739: - The patch looks good to me. Only nits: # Looks like the

[jira] [Commented] (HDFS-6717) Jira HDFS-5804 breaks default nfs-gateway behavior for unsecured config

2014-07-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14076524#comment-14076524 ] Jing Zhao commented on HDFS-6717: - +1. Thanks for the fix [~brandonli]! Jira HDFS-5804

[jira] [Commented] (HDFS-6757) Simplify lease manager with INodeID

2014-07-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077006#comment-14077006 ] Jing Zhao commented on HDFS-6757: - The patch looks good to me. One issue is that the

[jira] [Commented] (HDFS-6763) Standby NN stalls after processing edits

2014-07-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077055#comment-14077055 ] Jing Zhao commented on HDFS-6763: - Looks like the SBN does not need to call

[jira] [Updated] (HDFS-6651) Deletion failure can leak inodes permanently.

2014-07-28 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6651: Assignee: Jing Zhao Status: Patch Available (was: Open) Deletion failure can leak inodes

[jira] [Commented] (HDFS-6757) Simplify lease manager with INodeID

2014-07-30 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079987#comment-14079987 ] Jing Zhao commented on HDFS-6757: - bq. It might not be sufficient as previous

[jira] [Commented] (HDFS-6791) A block could remain under replicated if all of its replicas are on decommissioned nodes

2014-08-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086591#comment-14086591 ] Jing Zhao commented on HDFS-6791: - Thanks for working on this, [~mingma]! I also think the

[jira] [Commented] (HDFS-6791) A block could remain under replicated if all of its replicas are on decommissioned nodes

2014-08-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086650#comment-14086650 ] Jing Zhao commented on HDFS-6791: - Yeah, looks good to me. +1 pending Jenkins. A block

[jira] [Created] (HDFS-6822) In branch-1, Namenode and datanode fails to replace _HOST to hostname for hadoop.http.authentication.kerberos.principal

2014-08-05 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6822: --- Summary: In branch-1, Namenode and datanode fails to replace _HOST to hostname for hadoop.http.authentication.kerberos.principal Key: HDFS-6822 URL:

[jira] [Commented] (HDFS-6822) In branch-1, Namenode and datanode fails to replace _HOST to hostname for hadoop.http.authentication.kerberos.principal

2014-08-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086732#comment-14086732 ] Jing Zhao commented on HDFS-6822: - The exception: {code} 2013-11-11 18:44:21,841 INFO

[jira] [Updated] (HDFS-6822) In branch-1, Namenode and datanode fails to replace _HOST to hostname for hadoop.http.authentication.kerberos.principal

2014-08-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6822: Attachment: HDFS-6822.000.patch Initial patch. Just follow the trunk/branch-2 pattern, make sure

[jira] [Commented] (HDFS-6822) In branch-1, Namenode and datanode fails to replace _HOST to hostname for hadoop.http.authentication.kerberos.principal

2014-08-05 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086956#comment-14086956 ] Jing Zhao commented on HDFS-6822: - I tested the patch in a secured cluster and the patch

[jira] [Resolved] (HDFS-6822) In branch-1, Namenode and datanode fails to replace _HOST to hostname for hadoop.http.authentication.kerberos.principal

2014-08-06 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6822. - Resolution: Fixed Fix Version/s: 1.3.0 Target Version/s: (was: 1.2.1) Hadoop

[jira] [Updated] (HDFS-6791) A block could remain under replicated if all of its replicas are on decommissioned nodes

2014-08-06 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6791: Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Commented] (HDFS-6831) Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help'

2014-08-07 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089505#comment-14089505 ] Jing Zhao commented on HDFS-6831: - Also in dfsadmin -help there are only a couple of

[jira] [Commented] (HDFS-6828) Separate block replica dispatching from Balancer

2014-08-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091321#comment-14091321 ] Jing Zhao commented on HDFS-6828: - The patch looks good to me too. +1. I will commit the

[jira] [Updated] (HDFS-6828) Separate block replica dispatching from Balancer

2014-08-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6828: Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Commented] (HDFS-3689) Add support for variable length block

2014-08-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091390#comment-14091390 ] Jing Zhao commented on HDFS-3689: - Looks like we do not have a lot of dependency on the

[jira] [Updated] (HDFS-3689) Add support for variable length block

2014-08-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-3689: Attachment: HDFS-3689.000.patch Upload a preliminary patch that addresses the above #3 and #4. Specifically

[jira] [Commented] (HDFS-6837) Code cleanup for Balancer and Dispatcher

2014-08-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093060#comment-14093060 ] Jing Zhao commented on HDFS-6837: - +1. I will commit the patch shortly. Code cleanup for

[jira] [Updated] (HDFS-6837) Code cleanup for Balancer and Dispatcher

2014-08-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6837: Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Created] (HDFS-6838) Code cleanup for unnecessary INode replacement

2014-08-11 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6838: --- Summary: Code cleanup for unnecessary INode replacement Key: HDFS-6838 URL: https://issues.apache.org/jira/browse/HDFS-6838 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-6838) Code cleanup for unnecessary INode replacement

2014-08-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6838: Attachment: HDFS-6838.000.patch Main changes: # INode#recordModification on longer needs to return an

[jira] [Updated] (HDFS-6838) Code cleanup for unnecessary INode replacement

2014-08-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6838: Status: Patch Available (was: Open) Code cleanup for unnecessary INode replacement

[jira] [Updated] (HDFS-6838) Code cleanup for unnecessary INode replacement

2014-08-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6838: Priority: Minor (was: Major) Code cleanup for unnecessary INode replacement

[jira] [Updated] (HDFS-6835) Archival Storage: Add a new API to set storage policy

2014-08-11 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6835: Attachment: HDFS-6835.000.patch Initial patch. Add a new API setStoragePolicy(String src, String

[jira] [Updated] (HDFS-6835) Archival Storage: Add a new API to set storage policy

2014-08-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6835: Attachment: HDFS-6835.001.patch Thanks for the review, Nicholas and Vinay! Update the patch to address the

[jira] [Created] (HDFS-6844) Archival Storage: Extend HdfsFileStatus to get storage policy

2014-08-12 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6844: --- Summary: Archival Storage: Extend HdfsFileStatus to get storage policy Key: HDFS-6844 URL: https://issues.apache.org/jira/browse/HDFS-6844 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-6844) Archival Storage: Extend HdfsFileStatus to get storage policy

2014-08-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6844: Attachment: HDFS-6844.000.patch Initial patch for review. The changes of the unit test depends on

[jira] [Resolved] (HDFS-6835) Archival Storage: Add a new API to set storage policy

2014-08-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6835. - Resolution: Fixed I've committed this. Archival Storage: Add a new API to set storage policy

[jira] [Created] (HDFS-6847) Archival Storage: Support storage policy on a directory

2014-08-13 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-6847: --- Summary: Archival Storage: Support storage policy on a directory Key: HDFS-6847 URL: https://issues.apache.org/jira/browse/HDFS-6847 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-6847) Archival Storage: Support storage policy on directories

2014-08-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6847: Summary: Archival Storage: Support storage policy on directories (was: Archival Storage: Support storage

[jira] [Updated] (HDFS-6847) Archival Storage: Support storage policy on a directory

2014-08-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6847: Description: This jira plans to add storage policy support on directory, i.e., users can set/get storage

[jira] [Resolved] (HDFS-6844) Archival Storage: Extend HdfsFileStatus to get storage policy

2014-08-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao resolved HDFS-6844. - Resolution: Duplicate HDFS-6847 will cover the same functionality. Close this as duplicate. Archival

[jira] [Updated] (HDFS-6847) Archival Storage: Support storage policy on directories

2014-08-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6847: Attachment: HDFS-6847.000.patch Initial patch. Use XAttr to set storage policy id for directories.

[jira] [Commented] (HDFS-6247) Avoid timeouts for replaceBlock() call by sending intermediate responses to Balancer

2014-08-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095877#comment-14095877 ] Jing Zhao commented on HDFS-6247: - Hi Vinay, looks like when you commit the patch you write

  1   2   3   4   5   6   7   8   9   10   >