[jira] [Commented] (HDFS-6450) Support non-positional hedged reads in HDFS

2015-03-05 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14349867#comment-14349867 ] Liang Xie commented on HDFS-6450: - Thanks [~zhz] for the comments, i am not active in this

[jira] [Created] (HDFS-7802) Reach xceiver limit once the watcherThread die

2015-02-16 Thread Liang Xie (JIRA)
Liang Xie created HDFS-7802: --- Summary: Reach xceiver limit once the watcherThread die Key: HDFS-7802 URL: https://issues.apache.org/jira/browse/HDFS-7802 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-7802) Reach xceiver limit once the watcherThread die

2015-02-16 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie resolved HDFS-7802. - Resolution: Duplicate sorry, close this jira, seems it should be in HADOOP catalogy not HDFS... Reach

[jira] [Updated] (HDFS-7763) fix zkfc hung issue due to not catching exception in a corner case

2015-02-11 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7763: Attachment: HDFS-7763-002.txt How about v2, Colin? fix zkfc hung issue due to not catching exception in a

[jira] [Updated] (HDFS-7763) fix zkfc hung issue due to not catching exception in a corner case

2015-02-10 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7763: Attachment: (was: HDFS-7763.txt) fix zkfc hung issue due to not catching exception in a corner case

[jira] [Updated] (HDFS-7763) fix zkfc hung issue due to not catching exception in a corner case

2015-02-10 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7763: Attachment: HDFS-7763-001.txt fix zkfc hung issue due to not catching exception in a corner case

[jira] [Commented] (HDFS-7763) fix zkfc hung issue due to not catching exception in a corner case

2015-02-10 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315692#comment-14315692 ] Liang Xie commented on HDFS-7763: - The findbugs warning is not related with current fix:

[jira] [Created] (HDFS-7763) fix zkfc hung issue due to not catching exception in a corner case

2015-02-09 Thread Liang Xie (JIRA)
Liang Xie created HDFS-7763: --- Summary: fix zkfc hung issue due to not catching exception in a corner case Key: HDFS-7763 URL: https://issues.apache.org/jira/browse/HDFS-7763 Project: Hadoop HDFS

[jira] [Updated] (HDFS-7763) fix zkfc hung issue due to not catching exception in a corner case

2015-02-09 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7763: Attachment: jstack.4936 HDFS-7763.txt fix zkfc hung issue due to not catching exception in

[jira] [Commented] (HDFS-7523) Setting a socket receive buffer size in DFSClient

2015-01-04 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14263788#comment-14263788 ] Liang Xie commented on HDFS-7523: - Hi [~saint@gmail.com], yes, let's just hold on right

[jira] [Commented] (HDFS-7523) Setting a socket receive buffer size in DFSClient

2014-12-30 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14260901#comment-14260901 ] Liang Xie commented on HDFS-7523: - let me report number once get change, and i think we

[jira] [Updated] (HDFS-7561) TestFetchImage should write fetched-image-dir under target.

2014-12-22 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7561: Attachment: HDFS-7561-002.txt TestFetchImage should write fetched-image-dir under target.

[jira] [Assigned] (HDFS-7561) TestFetchImage should write fetched-image-dir under target.

2014-12-22 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie reassigned HDFS-7561: --- Assignee: Liang Xie TestFetchImage should write fetched-image-dir under target.

[jira] [Updated] (HDFS-7561) TestFetchImage should write fetched-image-dir under target.

2014-12-21 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7561: Attachment: HDFS-7561-001.txt yes, the property should be test.build.dir instead of build.test.dir:) How

[jira] [Updated] (HDFS-7561) TestFetchImage should write fetched-image-dir under target.

2014-12-21 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7561: Status: Patch Available (was: Open) TestFetchImage should write fetched-image-dir under target.

[jira] [Created] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

2014-12-19 Thread Liang Xie (JIRA)
Liang Xie created HDFS-7553: --- Summary: fix the TestDFSUpgradeWithHA due to BindException Key: HDFS-7553 URL: https://issues.apache.org/jira/browse/HDFS-7553 Project: Hadoop HDFS Issue Type: Test

[jira] [Updated] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

2014-12-19 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7553: Attachment: HDFS-7553-001.txt After this change, we can ensure HttpServer2.Builder call setFindPort(true),

[jira] [Updated] (HDFS-7553) fix the TestDFSUpgradeWithHA due to BindException

2014-12-19 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7553: Status: Patch Available (was: Open) fix the TestDFSUpgradeWithHA due to BindException

[jira] [Created] (HDFS-7551) Fix the new findbugs warning from TransferFsImage

2014-12-18 Thread Liang Xie (JIRA)
Liang Xie created HDFS-7551: --- Summary: Fix the new findbugs warning from TransferFsImage Key: HDFS-7551 URL: https://issues.apache.org/jira/browse/HDFS-7551 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-7551) Fix the new findbugs warning from TransferFsImage

2014-12-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7551: Attachment: HDFS-7551-001.txt I just noticed it while working at HDFS-7523 Fix the new findbugs warning

[jira] [Updated] (HDFS-7551) Fix the new findbugs warning from TransferFsImage

2014-12-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7551: Status: Patch Available (was: Open) Fix the new findbugs warning from TransferFsImage

[jira] [Commented] (HDFS-7373) Clean up temporary files after fsimage transfer failures

2014-12-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14252821#comment-14252821 ] Liang Xie commented on HDFS-7373: - [~kihwal], if i am not wrong, there really is a new

[jira] [Commented] (HDFS-7523) Setting a socket receive buffer size in DFSClient

2014-12-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14252865#comment-14252865 ] Liang Xie commented on HDFS-7523: - for the findbugs warning and failed case, it's not

[jira] [Commented] (HDFS-7551) Fix the new findbugs warning from TransferFsImage

2014-12-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14252872#comment-14252872 ] Liang Xie commented on HDFS-7551: - Oops, seems i used another project's style, will fix it

[jira] [Updated] (HDFS-7551) Fix the new findbugs warning from TransferFsImage

2014-12-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7551: Attachment: HDFS-7551-002.txt manually edit the patch, hopefully it's ok now:) Fix the new findbugs

[jira] [Commented] (HDFS-7523) Setting a socket receive buffer size in DFSClient

2014-12-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14252877#comment-14252877 ] Liang Xie commented on HDFS-7523: - oops, missing say: TestDFSClientRetries was still not

[jira] [Created] (HDFS-7552) change FsVolumeList toString() to fix TestDataNodeVolumeFailureToleration

2014-12-18 Thread Liang Xie (JIRA)
Liang Xie created HDFS-7552: --- Summary: change FsVolumeList toString() to fix TestDataNodeVolumeFailureToleration Key: HDFS-7552 URL: https://issues.apache.org/jira/browse/HDFS-7552 Project: Hadoop HDFS

[jira] [Updated] (HDFS-7552) change FsVolumeList toString() to fix TestDataNodeVolumeFailureToleration

2014-12-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7552: Attachment: HDFS-7552-001.txt change FsVolumeList toString() to fix TestDataNodeVolumeFailureToleration

[jira] [Updated] (HDFS-7552) change FsVolumeList toString() to fix TestDataNodeVolumeFailureToleration

2014-12-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7552: Status: Patch Available (was: Open) [~eddyxu] [~cmccabe] [~wheat9] mind taking a look at it? thanks

[jira] [Commented] (HDFS-7443) Datanode upgrade to BLOCKID_BASED_LAYOUT fails if duplicate block files are present in the same volume

2014-12-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14253104#comment-14253104 ] Liang Xie commented on HDFS-7443: - HDFS-6931 introduced a resolveDuplicateReplicas to

[jira] [Created] (HDFS-7523) Setting a socket receive buffer size in DFSClient

2014-12-15 Thread Liang Xie (JIRA)
Liang Xie created HDFS-7523: --- Summary: Setting a socket receive buffer size in DFSClient Key: HDFS-7523 URL: https://issues.apache.org/jira/browse/HDFS-7523 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-7523) Setting a socket receive buffer size in DFSClient

2014-12-15 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7523: Status: Patch Available (was: Open) Setting a socket receive buffer size in DFSClient

[jira] [Updated] (HDFS-7523) Setting a socket receive buffer size in DFSClient

2014-12-15 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-7523: Attachment: HDFS-7523-001.txt Attached a small patch. similiar with the writing stuff in DFSOutputStream:

[jira] [Updated] (HDFS-6827) Both NameNodes could be in STANDBY State due to HealthMonitor not aware of the target's status changing sometimes

2014-08-12 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6827: Summary: Both NameNodes could be in STANDBY State due to HealthMonitor not aware of the target's status

[jira] [Updated] (HDFS-6800) Determine how Datanode layout changes should interact with rolling upgrade

2014-08-01 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6800: Summary: Determine how Datanode layout changes should interact with rolling upgrade (was: Detemine how

[jira] [Commented] (HDFS-289) HDFS should blacklist datanodes that are not performing well

2014-07-30 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14079048#comment-14079048 ] Liang Xie commented on HDFS-289: We just hit a HBase write performance degradation several

[jira] [Created] (HDFS-6766) optimize ack notify mechanism to avoid thundering herd issue

2014-07-29 Thread Liang Xie (JIRA)
Liang Xie created HDFS-6766: --- Summary: optimize ack notify mechanism to avoid thundering herd issue Key: HDFS-6766 URL: https://issues.apache.org/jira/browse/HDFS-6766 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-6766) optimize ack notify mechanism to avoid thundering herd issue

2014-07-29 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6766: Attachment: HDFS-6766.txt optimize ack notify mechanism to avoid thundering herd issue

[jira] [Updated] (HDFS-6766) optimize ack notify mechanism to avoid thundering herd issue

2014-07-29 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6766: Status: Patch Available (was: Open) optimize ack notify mechanism to avoid thundering herd issue

[jira] [Commented] (HDFS-6766) optimize ack notify mechanism to avoid thundering herd issue

2014-07-29 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078790#comment-14078790 ] Liang Xie commented on HDFS-6766: - The failed TestBalancer was not related with current

[jira] [Commented] (HDFS-6766) optimize ack notify mechanism to avoid thundering herd issue

2014-07-29 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078791#comment-14078791 ] Liang Xie commented on HDFS-6766: - bq. should be the condition timeout configurable Per my

[jira] [Commented] (HDFS-6735) A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream

2014-07-23 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071409#comment-14071409 ] Liang Xie commented on HDFS-6735: - bq. We'd not check in the test since it does not assert

[jira] [Commented] (HDFS-6735) A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream

2014-07-23 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071440#comment-14071440 ] Liang Xie commented on HDFS-6735: - bq. I'd think you'd want a comment at least in

[jira] [Updated] (HDFS-6735) A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream

2014-07-23 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6735: Attachment: HDFS-6735-v2.txt A minor optimization to avoid pread() be blocked by read() inside the same

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-23 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071475#comment-14071475 ] Liang Xie commented on HDFS-6698: - TestPipelinesFailover probably is due to ulimit setting,

[jira] [Commented] (HDFS-6735) A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream

2014-07-23 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071655#comment-14071655 ] Liang Xie commented on HDFS-6735: - The failed TestPipelinesFailover

[jira] [Created] (HDFS-6735) A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream

2014-07-22 Thread Liang Xie (JIRA)
Liang Xie created HDFS-6735: --- Summary: A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream Key: HDFS-6735 URL: https://issues.apache.org/jira/browse/HDFS-6735 Project:

[jira] [Updated] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-22 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6698: Issue Type: Sub-task (was: Improvement) Parent: HDFS-6735 try to optimize

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-22 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071316#comment-14071316 ] Liang Xie commented on HDFS-6698: - Any thoughts, [~stack]? try to optimize

[jira] [Updated] (HDFS-6735) A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream

2014-07-22 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6735: Attachment: HDFS-6735.txt A minor optimization to avoid pread() be blocked by read() inside the same

[jira] [Updated] (HDFS-6735) A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream

2014-07-22 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6735: Status: Patch Available (was: Open) A minor optimization to avoid pread() be blocked by read() inside the

[jira] [Commented] (HDFS-6735) A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream

2014-07-22 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071335#comment-14071335 ] Liang Xie commented on HDFS-6735: - This patch includes HDFS-6698 already. With the source

[jira] [Updated] (HDFS-6735) A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream

2014-07-22 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6735: Description: In current DFSInputStream impl, there're a couple of coarser-grained locks in read/pread

[jira] [Updated] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-21 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6698: Attachment: HDFS-6698.txt try to optimize DFSInputStream.getFileLength()

[jira] [Updated] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-21 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6698: Status: Patch Available (was: Open) try to optimize DFSInputStream.getFileLength()

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-21 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068361#comment-14068361 ] Liang Xie commented on HDFS-6698: - In normal situation, The HFiles which all of HBase

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-21 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068467#comment-14068467 ] Liang Xie commented on HDFS-6698: - Those three failure cases are not related with current

[jira] [Commented] (HDFS-6450) Support non-positional hedged reads in HDFS

2014-07-18 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066126#comment-14066126 ] Liang Xie commented on HDFS-6450: - bq. How is testHedgedReadBasic exercising the new

[jira] [Commented] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-17 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14065990#comment-14065990 ] Liang Xie commented on HDFS-6698: - bq. Makes sense Liang Xie You see this as prob in prod?

[jira] [Commented] (HDFS-6695) Investigate using Java 7's nonblocking file I/O in BlockReaderLocal to implement read timeouts

2014-07-16 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064550#comment-14064550 ] Liang Xie commented on HDFS-6695: - I did not look through AsynchronousfileChannel impl, but

[jira] [Created] (HDFS-6698) try to optimize DFSInputStream.getFileLength()

2014-07-16 Thread Liang Xie (JIRA)
Liang Xie created HDFS-6698: --- Summary: try to optimize DFSInputStream.getFileLength() Key: HDFS-6698 URL: https://issues.apache.org/jira/browse/HDFS-6698 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-6450) Support non-positional hedged reads in HDFS

2014-07-16 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064564#comment-14064564 ] Liang Xie commented on HDFS-6450: - bq. I think in the short term, applications will have

[jira] [Commented] (HDFS-6450) Support non-positional hedged reads in HDFS

2014-07-15 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14061760#comment-14061760 ] Liang Xie commented on HDFS-6450: - After a deep looking, it's kind of hard to

[jira] [Updated] (HDFS-6450) Support non-positional hedged reads in HDFS

2014-07-10 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6450: Attachment: (was: HDFS-6450-like-pread.txt) Support non-positional hedged reads in HDFS

[jira] [Updated] (HDFS-6450) Support non-positional hedged reads in HDFS

2014-07-10 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6450: Attachment: HDFS-6450-like-pread.txt Support non-positional hedged reads in HDFS

[jira] [Created] (HDFS-6656) flakey TestProcessCorruptBlocks#testByAddingAnExtraDataNode

2014-07-10 Thread Liang Xie (JIRA)
Liang Xie created HDFS-6656: --- Summary: flakey TestProcessCorruptBlocks#testByAddingAnExtraDataNode Key: HDFS-6656 URL: https://issues.apache.org/jira/browse/HDFS-6656 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-6656) flakey TestProcessCorruptBlocks#testByAddingAnExtraDataNode

2014-07-10 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6656: Attachment: PreCommit-HDFS-Build #7320 test - testByAddingAnExtraDataNode [Jenkins].html flakey

[jira] [Commented] (HDFS-6631) TestPread#testHedgedReadLoopTooManyTimes fails intermittently.

2014-07-09 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14056006#comment-14056006 ] Liang Xie commented on HDFS-6631: - I see, compared with my dev box logfile, found inside

[jira] [Updated] (HDFS-6631) TestPread#testHedgedReadLoopTooManyTimes fails intermittently.

2014-07-09 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6631: Attachment: HDFS-6631.txt TestPread#testHedgedReadLoopTooManyTimes fails intermittently.

[jira] [Updated] (HDFS-6631) TestPread#testHedgedReadLoopTooManyTimes fails intermittently.

2014-07-09 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6631: Status: Patch Available (was: Open) TestPread#testHedgedReadLoopTooManyTimes fails intermittently.

[jira] [Commented] (HDFS-6631) TestPread#testHedgedReadLoopTooManyTimes fails intermittently.

2014-07-09 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14056019#comment-14056019 ] Liang Xie commented on HDFS-6631: - I just uploaded a tentitive patch, [~cnauroth], could

[jira] [Assigned] (HDFS-6631) TestPread#testHedgedReadLoopTooManyTimes fails intermittently.

2014-07-09 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie reassigned HDFS-6631: --- Assignee: Liang Xie TestPread#testHedgedReadLoopTooManyTimes fails intermittently.

[jira] [Updated] (HDFS-6631) TestPread#testHedgedReadLoopTooManyTimes fails intermittently.

2014-07-09 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6631: Attachment: (was: HDFS-6631.txt) TestPread#testHedgedReadLoopTooManyTimes fails intermittently.

[jira] [Updated] (HDFS-6631) TestPread#testHedgedReadLoopTooManyTimes fails intermittently.

2014-07-09 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6631: Attachment: HDFS-6631.txt emm, why QA complain couldn't compile, i verified again it works. let me remove

[jira] [Commented] (HDFS-6631) TestPread#testHedgedReadLoopTooManyTimes fails intermittently.

2014-07-08 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054655#comment-14054655 ] Liang Xie commented on HDFS-6631: - I could not repro on my dev box so far. probably it

[jira] [Created] (HDFS-6638) shorten test run time with a smaller retry timeout setting

2014-07-08 Thread Liang Xie (JIRA)
Liang Xie created HDFS-6638: --- Summary: shorten test run time with a smaller retry timeout setting Key: HDFS-6638 URL: https://issues.apache.org/jira/browse/HDFS-6638 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-6638) shorten test run time with a smaller retry timeout setting

2014-07-08 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6638: Attachment: HDFS-6638.txt shorten test run time with a smaller retry timeout setting

[jira] [Updated] (HDFS-6638) shorten test run time with a smaller retry timeout setting

2014-07-08 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6638: Status: Patch Available (was: Open) shorten test run time with a smaller retry timeout setting

[jira] [Commented] (HDFS-6638) shorten test run time with a smaller retry timeout setting

2014-07-08 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054813#comment-14054813 ] Liang Xie commented on HDFS-6638: - with attached patch, we could reduce more than 2.5

[jira] [Commented] (HDFS-6614) shorten TestPread run time with a smaller retry timeout setting

2014-07-08 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054814#comment-14054814 ] Liang Xie commented on HDFS-6614: - Filed HDFS-6638, since this tuning tips could optimize

[jira] [Updated] (HDFS-6450) Support non-positional hedged reads in HDFS

2014-07-07 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6450: Attachment: HDFS-6450-like-pread.txt Attached is a preliminary patch similar with pread() doing, means

[jira] [Updated] (HDFS-6450) Support non-positional hedged reads in HDFS

2014-07-07 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6450: Status: Patch Available (was: Open) Support non-positional hedged reads in HDFS

[jira] [Updated] (HDFS-6614) shorten TestPread run time with a smaller retry timeout setting

2014-07-07 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6614: Attachment: (was: HDFS-6614-addmium.txt) shorten TestPread run time with a smaller retry timeout

[jira] [Updated] (HDFS-6614) shorten TestPread run time with a smaller retry timeout setting

2014-07-07 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6614: Attachment: HDFS-6614-addmium.txt shorten TestPread run time with a smaller retry timeout setting

[jira] [Commented] (HDFS-6614) shorten TestPread run time with a smaller retry timeout setting

2014-07-07 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054487#comment-14054487 ] Liang Xie commented on HDFS-6614: - [~cnauroth] you are right, i remade an addendum patch,

[jira] [Commented] (HDFS-6450) Support non-positional hedged reads in HDFS

2014-07-06 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14053324#comment-14053324 ] Liang Xie commented on HDFS-6450: - [~cmccabe] [~saint@gmail.com] I made a prototype

[jira] [Updated] (HDFS-6614) shorten TestPread run time with a smaller retry timeout setting

2014-07-04 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6614: Attachment: HDFS-6614-addmium.txt shorten TestPread run time with a smaller retry timeout setting

[jira] [Commented] (HDFS-6614) shorten TestPread run time with a smaller retry timeout setting

2014-07-04 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14052313#comment-14052313 ] Liang Xie commented on HDFS-6614: - [~cnauroth], i found still had several non-zero waiting

[jira] [Commented] (HDFS-6624) TestBlockTokenWithDFS#testEnd2End fails sometimes

2014-07-03 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14051183#comment-14051183 ] Liang Xie commented on HDFS-6624: - It should be related with the chooseExcessReplicates

[jira] [Updated] (HDFS-6617) Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op

2014-07-03 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6617: Attachment: HDFS-6617-v2.txt Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a

[jira] [Commented] (HDFS-6617) Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op

2014-07-03 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14051286#comment-14051286 ] Liang Xie commented on HDFS-6617: - [~cnauroth], the above suggestion should be better

[jira] [Commented] (HDFS-6614) shorten TestPread run time with a smaller retry timeout setting

2014-07-03 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14051293#comment-14051293 ] Liang Xie commented on HDFS-6614: - bq. I did discover that the new

[jira] [Created] (HDFS-6627) getReplicaVisibleLength() should do checkReadAccess insteading of checkWriteAccess

2014-07-03 Thread Liang Xie (JIRA)
Liang Xie created HDFS-6627: --- Summary: getReplicaVisibleLength() should do checkReadAccess insteading of checkWriteAccess Key: HDFS-6627 URL: https://issues.apache.org/jira/browse/HDFS-6627 Project: Hadoop

[jira] [Updated] (HDFS-6627) getReplicaVisibleLength() should do checkReadAccess insteading of checkWriteAccess

2014-07-03 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6627: Status: Patch Available (was: Open) getReplicaVisibleLength() should do checkReadAccess insteading of

[jira] [Updated] (HDFS-6627) getReplicaVisibleLength() should do checkReadAccess insteading of checkWriteAccess

2014-07-03 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6627: Attachment: HDFS-6627.txt getReplicaVisibleLength() should do checkReadAccess insteading of

[jira] [Created] (HDFS-6614) shorten TestPread run time with a smaller retry timeout setting

2014-07-01 Thread Liang Xie (JIRA)
Liang Xie created HDFS-6614: --- Summary: shorten TestPread run time with a smaller retry timeout setting Key: HDFS-6614 URL: https://issues.apache.org/jira/browse/HDFS-6614 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6614) shorten TestPread run time with a smaller retry timeout setting

2014-07-01 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6614: Attachment: HDFS-6614.txt shorten TestPread run time with a smaller retry timeout setting

[jira] [Updated] (HDFS-6614) shorten TestPread run time with a smaller retry timeout setting

2014-07-01 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang Xie updated HDFS-6614: Status: Patch Available (was: Open) shorten TestPread run time with a smaller retry timeout setting

[jira] [Created] (HDFS-6617) Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op

2014-07-01 Thread Liang Xie (JIRA)
Liang Xie created HDFS-6617: --- Summary: Flake TestDFSZKFailoverController.testManualFailoverWithDFSHAAdmin due to a long edit log sync op Key: HDFS-6617 URL: https://issues.apache.org/jira/browse/HDFS-6617

[jira] [Commented] (HDFS-6614) shorten TestPread run time with a smaller retry timeout setting

2014-07-01 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048742#comment-14048742 ] Liang Xie commented on HDFS-6614: - The failed case is not related with current change,

  1   2   3   4   >