[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-10-13 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13475657#comment-13475657 ] Harsh J commented on HADOOP-7973: - Hi Daryn, bq. Found issue in mapreduce v2 api, will

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-24 Thread Daryn Sharp (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13192278#comment-13192278 ] Daryn Sharp commented on HADOOP-7973: - Found issue in mapreduce v2 api, will post a

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-20 Thread Daryn Sharp (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13189830#comment-13189830 ] Daryn Sharp commented on HADOOP-7973: - With unbalanced closes, the filesystem will

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-20 Thread Daryn Sharp (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190080#comment-13190080 ] Daryn Sharp commented on HADOOP-7973: - bq. I guess you would need minidfs cluster

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-20 Thread Koji Noguchi (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190107#comment-13190107 ] Koji Noguchi commented on HADOOP-7973: -- bq. The beauty is if I've missed something,

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-20 Thread Daryn Sharp (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13190125#comment-13190125 ] Daryn Sharp commented on HADOOP-7973: - Yes, I'm reworking the test.

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-19 Thread Devaraj Das (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13189388#comment-13189388 ] Devaraj Das commented on HADOOP-7973: - bq. #3 is a more comprehensive solution since

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-19 Thread Kihwal Lee (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13189502#comment-13189502 ] Kihwal Lee commented on HADOOP-7973: It's probably HADOOP-4655.

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-19 Thread Jitendra Nath Pandey (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13189648#comment-13189648 ] Jitendra Nath Pandey commented on HADOOP-7973: -- bq. Unbalanced opens closes

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-19 Thread Tsz Wo (Nicholas), SZE (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13189657#comment-13189657 ] Tsz Wo (Nicholas), SZE commented on HADOOP-7973: I [opposed ref counts

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-18 Thread Daryn Sharp (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13188546#comment-13188546 ] Daryn Sharp commented on HADOOP-7973: - I thought about that myself. If close removes

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-18 Thread Daryn Sharp (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13188725#comment-13188725 ] Daryn Sharp commented on HADOOP-7973: - I'm going to try another approach of making MR

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-17 Thread Nathan Roberts (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13187756#comment-13187756 ] Nathan Roberts commented on HADOOP-7973: {quote} We'll experiment on a

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-17 Thread Robert Joseph Evans (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1318#comment-1318 ] Robert Joseph Evans commented on HADOOP-7973: - {quote}Is FsShell a publicly

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-17 Thread Alejandro Abdelnur (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13187969#comment-13187969 ] Alejandro Abdelnur commented on HADOOP-7973: To complicate things a bit more,

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-17 Thread Daryn Sharp (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13188025#comment-13188025 ] Daryn Sharp commented on HADOOP-7973: - bq. It is correct that connections are re-used

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-17 Thread Alejandro Abdelnur (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13188187#comment-13188187 ] Alejandro Abdelnur commented on HADOOP-7973: Daryn, in your proposal, if the

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-14 Thread Harsh J (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13186424#comment-13186424 ] Harsh J commented on HADOOP-7973: - (Coming in late, but just to add my thoughts…) I've

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-13 Thread Robert Joseph Evans (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13185671#comment-13185671 ] Robert Joseph Evans commented on HADOOP-7973: - I think it is important to

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-13 Thread Daryn Sharp (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13185683#comment-13185683 ] Daryn Sharp commented on HADOOP-7973: - It's unclear what all changes transpired, but

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-13 Thread Suresh Srinivas (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13185706#comment-13185706 ] Suresh Srinivas commented on HADOOP-7973: - Daryn this happens only if use_ip is

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-13 Thread Suresh Srinivas (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13185733#comment-13185733 ] Suresh Srinivas commented on HADOOP-7973: - Some comments: bq. a decision was made

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-13 Thread Suresh Srinivas (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13185744#comment-13185744 ] Suresh Srinivas commented on HADOOP-7973: - bq. What is the finalizer - java

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-13 Thread Daryn Sharp (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13185769#comment-13185769 ] Daryn Sharp commented on HADOOP-7973: - I don't think it's related to use_ip, but I'll

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-13 Thread Suresh Srinivas (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13185779#comment-13185779 ] Suresh Srinivas commented on HADOOP-7973: - bq. I don't think it's related to

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-13 Thread Suresh Srinivas (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13185784#comment-13185784 ] Suresh Srinivas commented on HADOOP-7973: - bq. Let's say I'm using DFS. I use

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-13 Thread Suresh Srinivas (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13185802#comment-13185802 ] Suresh Srinivas commented on HADOOP-7973: - distributed cache Sorry I am

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-13 Thread Daryn Sharp (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13185825#comment-13185825 ] Daryn Sharp commented on HADOOP-7973: - The problem appears to be a case of two wrongs

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-13 Thread Suresh Srinivas (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13185837#comment-13185837 ] Suresh Srinivas commented on HADOOP-7973: - bq. Unlike other filesystems, DFS used

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-13 Thread Suresh Srinivas (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13185849#comment-13185849 ] Suresh Srinivas commented on HADOOP-7973: - bq. Isn't this going to cause multiple

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-13 Thread Daryn Sharp (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13185866#comment-13185866 ] Daryn Sharp commented on HADOOP-7973: - If we tell users don't call {{close()}} then I

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-13 Thread Jitendra Nath Pandey (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13185875#comment-13185875 ] Jitendra Nath Pandey commented on HADOOP-7973: -- {quote} Connections are

[jira] [Commented] (HADOOP-7973) DistributedFileSystem close has severe consequences

2012-01-13 Thread Daryn Sharp (Commented) (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13185953#comment-13185953 ] Daryn Sharp commented on HADOOP-7973: - We'll experiment on a performance grid and see