[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-11-04 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195981#comment-14195981 ] Steve Loughran commented on HDFS-6698: -- bq. it's just so easy to write incorrect code

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-11-03 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194902#comment-14194902 ] Colin Patrick McCabe commented on HDFS-6698: Thanks, Lars. Sorry for the

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-11-03 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195409#comment-14195409 ] Lars Hofhansl commented on HDFS-6698: - Yeah, let's combine these. We can close this one

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-11-01 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192993#comment-14192993 ] Lars Hofhansl commented on HDFS-6698: - Now... I am not saying that we do not have work

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191588#comment-14191588 ] Hadoop QA commented on HDFS-6698: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-10-31 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191959#comment-14191959 ] stack commented on HDFS-6698: - LGTM. try to optimize DFSInputStream.getFileLength()

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-10-31 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192209#comment-14192209 ] Lars Hofhansl commented on HDFS-6698: - Need to make sure now that we do not kick the

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-10-31 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192290#comment-14192290 ] stack commented on HDFS-6698: - [~larsh] HDFS-6735 try to optimize

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-10-31 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192550#comment-14192550 ] Lars Hofhansl commented on HDFS-6698: - Indeed I now find that the time is spent in

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-10-31 Thread Lars Hofhansl (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192684#comment-14192684 ] Lars Hofhansl commented on HDFS-6698: - Pulling in selected changes from HDFS-6735

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-08-09 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091683#comment-14091683 ] Hadoop QA commented on HDFS-6698: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-08-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091523#comment-14091523 ] Hadoop QA commented on HDFS-6698: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071472#comment-14071472 ] Hadoop QA commented on HDFS-6698: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-23 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071475#comment-14071475 ] Liang Xie commented on HDFS-6698: - TestPipelinesFailover probably is due to ulimit setting,

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14072229#comment-14072229 ] Colin Patrick McCabe commented on HDFS-6698: Changing the locking model for the

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-23 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14072305#comment-14072305 ] stack commented on HDFS-6698: - bq. Changing the locking model for the DFSInputStream seems like

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-23 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14072489#comment-14072489 ] Colin Patrick McCabe commented on HDFS-6698: {code} + public long

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-23 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14072637#comment-14072637 ] stack commented on HDFS-6698: - bq. What happens if locatedBlocks is set to null in between the

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-22 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071316#comment-14071316 ] Liang Xie commented on HDFS-6698: - Any thoughts, [~stack]? try to optimize

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-22 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071368#comment-14071368 ] stack commented on HDFS-6698: - Patch looks great. You are being very conservative. That is

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-21 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068361#comment-14068361 ] Liang Xie commented on HDFS-6698: - In normal situation, The HFiles which all of HBase

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068461#comment-14068461 ] Hadoop QA commented on HDFS-6698: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-21 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068467#comment-14068467 ] Liang Xie commented on HDFS-6698: - Those three failure cases are not related with current

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-17 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14065300#comment-14065300 ] stack commented on HDFS-6698: - Makes sense [~xieliang007] You see this as prob in prod?

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-17 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14065990#comment-14065990 ] Liang Xie commented on HDFS-6698: - bq. Makes sense Liang Xie You see this as prob in prod?