[jira] [Commented] (HDFS-5207) In BlockPlacementPolicy, update 2 parameters of chooseTarget()

2013-09-16 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13768113#comment-13768113 ] Tsz Wo (Nicholas), SZE commented on HDFS-5207: -- {code} private

[jira] [Commented] (HDFS-5207) In BlockPlacementPolicy, update 2 parameters of chooseTarget()

2013-09-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13768203#comment-13768203 ] Junping Du commented on HDFS-5207: -- Thanks for great comments, Nicholas! I addressed them

[jira] [Updated] (HDFS-5207) In BlockPlacementPolicy, update 2 parameters of chooseTarget()

2013-09-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5207: - Attachment: HDFS-5207-v3.patch In BlockPlacementPolicy, update 2 parameters of chooseTarget()

[jira] [Commented] (HDFS-5207) In BlockPlacementPolicy, update 2 parameters of chooseTarget()

2013-09-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13768269#comment-13768269 ] Hadoop QA commented on HDFS-5207: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5207) In BlockPlacementPolicy, update 2 parameters of chooseTarget()

2013-09-16 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13768314#comment-13768314 ] Tsz Wo (Nicholas), SZE commented on HDFS-5207: -- Patch looks good except that

[jira] [Commented] (HDFS-3983) Hftp should support both SPNEGO and KSSL

2013-09-16 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13768351#comment-13768351 ] Arun C Murthy commented on HDFS-3983: - Any update on this? Is this ready to go? Thanks.

[jira] [Commented] (HDFS-3983) Hftp should support both SPNEGO and KSSL

2013-09-16 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13768432#comment-13768432 ] Suresh Srinivas commented on HDFS-3983: --- I will not be able to fix this in 2.1.1-beta

[jira] [Commented] (HDFS-5208) Only clear network location cache on specific nodes if invalid NetworkTopology happens

2013-09-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13768510#comment-13768510 ] Colin Patrick McCabe commented on HDFS-5208: It's a little more complicated

[jira] [Updated] (HDFS-5211) Race condition between DistributedFileSystem#close and FileSystem#close can cause return of a closed DistributedFileSystem instance from the FileSystem cache.

2013-09-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5211: Attachment: HDFS-5211.1.patch Here is a patch that switches the order of operations in

[jira] [Updated] (HDFS-5206) Some unreferred constants in DFSConfigKeys should be cleanuped

2013-09-16 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated HDFS-5206: - Assignee: Kousuke Saruta Some unreferred constants in DFSConfigKeys should be cleanuped

[jira] [Assigned] (HDFS-5119) Persist CacheManager state in the edit log

2013-09-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe reassigned HDFS-5119: -- Assignee: Andrew Wang (was: Colin Patrick McCabe) Persist CacheManager

[jira] [Assigned] (HDFS-5096) Automatically cache new data added to a cached path

2013-09-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe reassigned HDFS-5096: -- Assignee: Colin Patrick McCabe (was: Andrew Wang) Automatically cache new

[jira] [Commented] (HDFS-5206) Some unreferred constants in DFSConfigKeys should be cleanuped

2013-09-16 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13768567#comment-13768567 ] Kousuke Saruta commented on HDFS-5206: -- * DFS_STREAM_BUFFER_SIZE_KEY /

[jira] [Commented] (HDFS-5210) Fix some failing unit tests on HDFS-4949 branch

2013-09-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13768572#comment-13768572 ] Colin Patrick McCabe commented on HDFS-5210: * RandomDataImpl can be a static

[jira] [Commented] (HDFS-5205) Include NFS jars in the maven assembly

2013-09-16 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13768584#comment-13768584 ] Brandon Li commented on HDFS-5205: -- Thanks for fixing the diverged dependencies.

[jira] [Updated] (HDFS-5210) Fix some failing unit tests on HDFS-4949 branch

2013-09-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-5210: -- Attachment: hdfs-5210-4.patch Thanks Colin, new patch attached. Will commit shortly.

[jira] [Resolved] (HDFS-5210) Fix some failing unit tests on HDFS-4949 branch

2013-09-16 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-5210. --- Resolution: Fixed Fix Version/s: HDFS-4949 Committed to branch. Fix some

[jira] [Commented] (HDFS-5203) Concurrent clients that add a cache directive on the same path may prematurely uncache from each other.

2013-09-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13768513#comment-13768513 ] Colin Patrick McCabe commented on HDFS-5203: In HDFS-5213, I switched it to

[jira] [Commented] (HDFS-5211) Race condition between DistributedFileSystem#close and FileSystem#close can cause return of a closed DistributedFileSystem instance from the FileSystem cache.

2013-09-16 Thread Xi Fang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13768524#comment-13768524 ] Xi Fang commented on HDFS-5211: --- Thanks Chris for addressing this. Sounds good to me. +1

[jira] [Commented] (HDFS-5138) Support HDFS upgrade in HA

2013-09-16 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13768431#comment-13768431 ] Suresh Srinivas commented on HDFS-5138: --- Given the options enumerated by Kihwal, I

[jira] [Commented] (HDFS-5206) Some unreferred constants in DFSConfigKeys should be cleanuped

2013-09-16 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13768660#comment-13768660 ] Kousuke Saruta commented on HDFS-5206: -- I suggest as follows. *

[jira] [Updated] (HDFS-5139) Remove redundant -R option from setrep

2013-09-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5139: Attachment: HDFS-5139.04.patch Continue to accept -R for backwards compatibility but have it be the

[jira] [Updated] (HDFS-5207) In BlockPlacementPolicy, update 2 parameters of chooseTarget()

2013-09-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-5207: - Attachment: HDFS-5207-v4.patch Sorry. The cast issue should be addressed in v3 patch. Now update in v4

[jira] [Commented] (HDFS-5139) Remove redundant -R option from setrep

2013-09-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13768918#comment-13768918 ] Arpit Agarwal commented on HDFS-5139: - The failure looks unrelated to the patch.

[jira] [Resolved] (HDFS-5205) Include NFS jars in the maven assembly

2013-09-16 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Grover resolved HDFS-5205. --- Resolution: Duplicate Duplicate of HDFS-5069 Include NFS jars in the maven assembly

[jira] [Commented] (HDFS-5139) Remove redundant -R option from setrep

2013-09-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13768913#comment-13768913 ] Hadoop QA commented on HDFS-5139: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5211) Race condition between DistributedFileSystem#close and FileSystem#close can cause return of a closed DistributedFileSystem instance from the FileSystem cache.

2013-09-16 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13768939#comment-13768939 ] Tsz Wo (Nicholas), SZE commented on HDFS-5211: -- Should we remove

[jira] [Updated] (HDFS-4990) Block placement for storage types

2013-09-16 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4990: - Attachment: h4990_20130917.patch h4990_20130917.patch: reverts the changes

[jira] [Commented] (HDFS-5207) In BlockPlacementPolicy, update 2 parameters of chooseTarget()

2013-09-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13768965#comment-13768965 ] Hadoop QA commented on HDFS-5207: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (HDFS-5214) ProxyUsers does not work with NetGroups

2013-09-16 Thread Benoy Antony (JIRA)
Benoy Antony created HDFS-5214: -- Summary: ProxyUsers does not work with NetGroups Key: HDFS-5214 URL: https://issues.apache.org/jira/browse/HDFS-5214 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-5208) Only clear network location cache on specific nodes if invalid NetworkTopology happens

2013-09-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13769013#comment-13769013 ] Junping Du commented on HDFS-5208: -- Thanks for comments, Colin! I checked again on all

[jira] [Updated] (HDFS-3983) Hftp should support both SPNEGO and KSSL

2013-09-16 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-3983: -- Target Version/s: 2.2.0 (was: 2.1.1-beta) Hftp should support both SPNEGO and KSSL

[jira] [Updated] (HDFS-5138) Support HDFS upgrade in HA

2013-09-16 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HDFS-5138: Target Version/s: (was: 2.1.1-beta) Support HDFS upgrade in HA --

[jira] [Created] (HDFS-5215) dfs.datanode.du.reserved is not taking effect as it's not considered while getting the available space

2013-09-16 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-5215: -- Summary: dfs.datanode.du.reserved is not taking effect as it's not considered while getting the available space Key: HDFS-5215 URL:

[jira] [Updated] (HDFS-5191) revisit zero-copy API in FSDataInputStream to make it more intuitive

2013-09-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-5191: --- Attachment: HDFS-5191-caching.001.patch I implemented the API we've been discussing.

[jira] [Work started] (HDFS-5191) revisit zero-copy API in FSDataInputStream to make it more intuitive

2013-09-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-5191 started by Colin Patrick McCabe. revisit zero-copy API in FSDataInputStream to make it more intuitive

[jira] [Updated] (HDFS-5215) dfs.datanode.du.reserved is not taking effect as it's not considered while getting the available space

2013-09-16 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-5215: --- Description: {code}public long getAvailable() throws IOException { long remaining

[jira] [Commented] (HDFS-5215) dfs.datanode.du.reserved is not taking effect as it's not considered while getting the available space

2013-09-16 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13769093#comment-13769093 ] Brahma Reddy Battula commented on HDFS-5215: Fix can be long available =

[jira] [Updated] (HDFS-5207) In BlockPlacementPolicy, update 2 parameters of chooseTarget()

2013-09-16 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-5207: - Hadoop Flags: Reviewed +1 patch looks good. In

[jira] [Commented] (HDFS-5207) In BlockPlacementPolicy, update 2 parameters of chooseTarget()

2013-09-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13769119#comment-13769119 ] Hudson commented on HDFS-5207: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4427 (See

[jira] [Updated] (HDFS-5207) In BlockPlacementPolicy, update 2 parameters of chooseTarget()

2013-09-16 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-5207: - Resolution: Fixed Fix Version/s: 2.3.0 Status: Resolved (was:

[jira] [Commented] (HDFS-5207) In BlockPlacementPolicy, update 2 parameters of chooseTarget()

2013-09-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13769129#comment-13769129 ] Junping Du commented on HDFS-5207: -- Thanks Nicholas for review! :) In

[jira] [Updated] (HDFS-5211) Race condition between DistributedFileSystem#close and FileSystem#close can cause return of a closed DistributedFileSystem instance from the FileSystem cache.

2013-09-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5211: Attachment: HDFS-5211.2.patch [~szetszwo], good idea. Here is version 2 of the patch, with

[jira] [Updated] (HDFS-4990) Block placement for storage types

2013-09-16 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4990: - Attachment: h4990_20130917b.patch h4990_20130917b.patch: updated with HDFS-5207.

[jira] [Commented] (HDFS-5211) Race condition between DistributedFileSystem#close and FileSystem#close can cause return of a closed DistributedFileSystem instance from the FileSystem cache.

2013-09-16 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13769139#comment-13769139 ] Tsz Wo (Nicholas), SZE commented on HDFS-5211: -- +1 patch looks good. Thanks

[jira] [Assigned] (HDFS-4924) Show NameNode state on dfsclusterhealth page

2013-09-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth reassigned HDFS-4924: --- Assignee: Lohit Vijayarenu Hi, Lohit. It looks like this patch will need to be rebased.