[jira] [Commented] (HDFS-12104) libhdfs++: Make sure all steps in SaslProtocol end up calling AuthComplete

2017-07-07 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078781#comment-16078781 ] Xiaowei Zhu commented on HDFS-12104: +1, the patch looks good. > libhdfs++: Make sure all steps in

[jira] [Commented] (HDFS-12103) libhdfs++: Provide workaround to support cancel on filesystem connect until HDFS-11437 is resolved

2017-07-07 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078771#comment-16078771 ] Xiaowei Zhu commented on HDFS-12103: +1. The workaround looks reasonable to me. > libhdfs++: Provide

[jira] [Updated] (HDFS-12013) libhdfs++: read with offset at EOF should return 0 bytes instead of error

2017-07-05 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-12013: --- Attachment: HDFS-12013.HDFS-8707.000.patch HDFS-12013.HDFS-8707.000.patch fixes the issue by not

[jira] [Updated] (HDFS-12013) libhdfs++: read with offset at EOF should return 0 bytes instead of error

2017-07-05 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-12013: --- Status: Patch Available (was: Open) > libhdfs++: read with offset at EOF should return 0 bytes

[jira] [Created] (HDFS-12013) libhdfs++: read with offset at EOF should return 0 bytes instead of error

2017-06-22 Thread Xiaowei Zhu (JIRA)
Xiaowei Zhu created HDFS-12013: -- Summary: libhdfs++: read with offset at EOF should return 0 bytes instead of error Key: HDFS-12013 URL: https://issues.apache.org/jira/browse/HDFS-12013 Project: Hadoop

[jira] [Commented] (HDFS-11730) libhdfs++: RPC connection should handle authorization error call id

2017-05-01 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15991535#comment-15991535 ] Xiaowei Zhu commented on HDFS-11730: +1. The fix looks good and useful. > libhdfs++: RPC connection

[jira] [Commented] (HDFS-11544) libhdfs++: Improve C API error reporting

2017-03-21 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15934777#comment-15934777 ] Xiaowei Zhu commented on HDFS-11544: +1 on 001.patch for fixing typos. > libhdfs++: Improve C API

[jira] [Commented] (HDFS-11544) libhdfs++: Improve C API error reporting

2017-03-20 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15933417#comment-15933417 ] Xiaowei Zhu commented on HDFS-11544: +1. Changes look good to me. > libhdfs++: Improve C API error

[jira] [Commented] (HDFS-11106) libhdfs++: Some refactoring to better organize files

2017-03-06 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15897635#comment-15897635 ] Xiaowei Zhu commented on HDFS-11106: +1 on 001.patch. The refactoring is definitely helpful for future

[jira] [Updated] (HDFS-11449) libhdfs++: Log Datanode read size when reading an HDFS block

2017-02-23 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-11449: --- Status: Patch Available (was: In Progress) > libhdfs++: Log Datanode read size when reading an HDFS

[jira] [Updated] (HDFS-11449) libhdfs++: Log Datanode read size when reading an HDFS block

2017-02-23 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-11449: --- Attachment: HDFS-11449.HDFS-8707.000.patch 000.patch added additional logging of read size along with

[jira] [Work started] (HDFS-11449) libhdfs++: Log Datanode read size when reading an HDFS block

2017-02-23 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-11449 started by Xiaowei Zhu. -- > libhdfs++: Log Datanode read size when reading an HDFS block >

[jira] [Updated] (HDFS-11449) libhdfs++: Log Datanode read size when reading an HDFS block

2017-02-23 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-11449: --- Issue Type: Sub-task (was: Task) Parent: HDFS-8707 > libhdfs++: Log Datanode read size when

[jira] [Created] (HDFS-11449) libhdfs++: Log Datanode read size when reading an HDFS block

2017-02-23 Thread Xiaowei Zhu (JIRA)
Xiaowei Zhu created HDFS-11449: -- Summary: libhdfs++: Log Datanode read size when reading an HDFS block Key: HDFS-11449 URL: https://issues.apache.org/jira/browse/HDFS-11449 Project: Hadoop HDFS

[jira] [Commented] (HDFS-11436) libhdfs++: Fix race condition in ScopedResolver

2017-02-21 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15876707#comment-15876707 ] Xiaowei Zhu commented on HDFS-11436: +1 on the short term fix. > libhdfs++: Fix race condition in

[jira] [Commented] (HDFS-10685) libhdfs++: return explicit error when non-secured client connects to secured server

2017-01-10 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816089#comment-15816089 ] Xiaowei Zhu commented on HDFS-10685: +1 > libhdfs++: return explicit error when non-secured client

[jira] [Commented] (HDFS-10685) libhdfs++: return explicit error when non-secured client connects to secured server

2017-01-10 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15815959#comment-15815959 ] Xiaowei Zhu commented on HDFS-10685: Looks good. Just one word change in this message: "You have an

[jira] [Updated] (HDFS-11305) libhdfs++: Log Datanode information when reading an HDFS block

2017-01-09 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-11305: --- Attachment: HDFS-11305.HDFS-8707.001.patch Cleaned up white spaces. > libhdfs++: Log Datanode

[jira] [Updated] (HDFS-11305) libhdfs++: Log Datanode information when reading an HDFS block

2017-01-09 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-11305: --- Attachment: HDFS-11305.HDFS-8707.000.patch 000.patch adds a debug log in

[jira] [Updated] (HDFS-11305) libhdfs++: Log Datanode information when reading an HDFS block

2017-01-09 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-11305: --- Status: Patch Available (was: Open) > libhdfs++: Log Datanode information when reading an HDFS block

[jira] [Updated] (HDFS-11305) libhdfs++: Log Datanode information when reading an HDFS block

2017-01-09 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-11305: --- Summary: libhdfs++: Log Datanode information when reading an HDFS block (was: Log Datanode

[jira] [Created] (HDFS-11305) Log Datanode information when reading an HDFS block

2017-01-09 Thread Xiaowei Zhu (JIRA)
Xiaowei Zhu created HDFS-11305: -- Summary: Log Datanode information when reading an HDFS block Key: HDFS-11305 URL: https://issues.apache.org/jira/browse/HDFS-11305 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-10796) libhdfs++: rationalize ioservice interactions

2016-12-09 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736518#comment-15736518 ] Xiaowei Zhu commented on HDFS-10796: +1. > libhdfs++: rationalize ioservice interactions >

[jira] [Commented] (HDFS-10796) libhdfs++: rationalize ioservice interactions

2016-12-09 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736377#comment-15736377 ] Xiaowei Zhu commented on HDFS-10796: Things look good to me. The only concern is the failures with

[jira] [Commented] (HDFS-11106) libhdfs++: Some refactoring to better organize files

2016-11-29 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15705938#comment-15705938 ] Xiaowei Zhu commented on HDFS-11106: +1. Changes all look reasonable, except the parts which are not

[jira] [Updated] (HDFS-11099) Expose rack id in hdfsDNInfo

2016-11-04 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-11099: --- Attachment: HDFS-11099.HDFS-8707.001.patch HDFS-11099.HDFS-8707.001.patch modified hdfs_ext_test.cc

[jira] [Updated] (HDFS-11099) Expose rack id in hdfsDNInfo

2016-11-03 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-11099: --- Attachment: (was: HDFS-11099.HDFS-8707.000.patch) > Expose rack id in hdfsDNInfo >

[jira] [Updated] (HDFS-11099) Expose rack id in hdfsDNInfo

2016-11-03 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-11099: --- Attachment: HDFS-11099.HDFS-8707.000.patch > Expose rack id in hdfsDNInfo >

[jira] [Updated] (HDFS-11099) Expose rack id in hdfsDNInfo

2016-11-03 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-11099: --- Status: Patch Available (was: Open) > Expose rack id in hdfsDNInfo > >

[jira] [Updated] (HDFS-11099) Expose rack id in hdfsDNInfo

2016-11-03 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-11099: --- Attachment: HDFS-11099.HDFS-8707.000.patch HDFS-11099.HDFS-8707.000.patch is available for review. >

[jira] [Updated] (HDFS-11099) Expose rack id in hdfsDNInfo

2016-11-03 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-11099: --- Issue Type: Sub-task (was: Bug) Parent: HDFS-8707 > Expose rack id in hdfsDNInfo >

[jira] [Created] (HDFS-11099) Expose rack id in hdfsDNInfo

2016-11-03 Thread Xiaowei Zhu (JIRA)
Xiaowei Zhu created HDFS-11099: -- Summary: Expose rack id in hdfsDNInfo Key: HDFS-11099 URL: https://issues.apache.org/jira/browse/HDFS-11099 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-11027) libhdfs++: Don't retry if there is an authentication failure

2016-10-20 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592273#comment-15592273 ] Xiaowei Zhu commented on HDFS-11027: We should consider that if there are more cases we do not want to

[jira] [Commented] (HDFS-11014) libhdfs++: Make connection to HA clusters faster

2016-10-14 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15575593#comment-15575593 ] Xiaowei Zhu commented on HDFS-11014: +1. The changes all make good sense. > libhdfs++: Make

[jira] [Commented] (HDFS-10409) libhdfs++: Something is holding connection_state_lock in RpcConnectionImpl destructor

2016-10-13 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573267#comment-15573267 ] Xiaowei Zhu commented on HDFS-10409: +1 on 001.patch. Adding MEMCHECKED_CLASS can be helpful. >

[jira] [Commented] (HDFS-10441) libhdfs++: HA namenode support

2016-07-13 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15375865#comment-15375865 ] Xiaowei Zhu commented on HDFS-10441: The latest patch looks almost good to go with one small typo in

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-07-12 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.016.patch The last build shows a compile warning in webhdfs client code.

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-07-11 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.016.patch HDFS-9890.HDFS-8707.016.patch change threads value back to 1

[jira] [Commented] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-07-11 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371124#comment-15371124 ] Xiaowei Zhu commented on HDFS-9890: --- I found the root cause of the non-deterministic failures in our unit

[jira] [Commented] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-07-08 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15368595#comment-15368595 ] Xiaowei Zhu commented on HDFS-9890: --- The test failures all look like something in the mini dfs cluster

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-07-08 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.015.patch > libhdfs++: Add test suite to simulate network issues >

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-07-05 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.014.patch HDFS-9890.HDFS-8707.014.patch removes the debug build flag in

[jira] [Commented] (HDFS-10543) hdfsRead read stops at block boundary

2016-07-05 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15363033#comment-15363033 ] Xiaowei Zhu commented on HDFS-10543: Thanks Colin for the review. I believe this patch still supports

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-07-05 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.013.patch > libhdfs++: Add test suite to simulate network issues >

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-07-01 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.013.patch HDFS-9890.HDFS-8707.013.patch debug patch that set random seed

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-07-01 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.012.patch > libhdfs++: Add test suite to simulate network issues >

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-07-01 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.012.patch HDFS-9890.HDFS-8707.012.patch silents compile warnings in

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-06-30 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.011.patch HDFS-9890.HDFS-8707.011.patch fixes compile warnings showing

[jira] [Updated] (HDFS-8790) Add Filesystem level stress tests

2016-06-30 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-8790: -- Attachment: HDFS-8790.HDFS-8707.002.patch HDFS-8790.HDFS-8707.002.patch fix segfault in the test some

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-06-29 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.010.patch HDFS-9890.HDFS-8707.010.patch is from James which mainly fixes

[jira] [Commented] (HDFS-10409) libhdfs++: Something is holding connection_state_lock in RpcConnectionImpl destructor

2016-06-28 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15353777#comment-15353777 ] Xiaowei Zhu commented on HDFS-10409: +1 on not holding lock in dtor for this case. > libhdfs++:

[jira] [Commented] (HDFS-10578) libhdfs++: Silence compile warnings from URI parser

2016-06-28 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15353312#comment-15353312 ] Xiaowei Zhu commented on HDFS-10578: I see. +1 on the patch. > libhdfs++: Silence compile warnings

[jira] [Commented] (HDFS-10578) libhdfs++: Silence compile warnings from URI parser

2016-06-28 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15353197#comment-15353197 ] Xiaowei Zhu commented on HDFS-10578: Do we actually want to silence everything? > libhdfs++: Silence

[jira] [Commented] (HDFS-10543) hdfsRead read stops at block boundary

2016-06-23 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347158#comment-15347158 ] Xiaowei Zhu commented on HDFS-10543: Latest patch fixes the compile warning and clean up the code

[jira] [Updated] (HDFS-10543) hdfsRead read stops at block boundary

2016-06-23 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-10543: --- Attachment: HDFS-10543.HDFS-8707.004.patch > hdfsRead read stops at block boundary >

[jira] [Updated] (HDFS-10543) hdfsRead read stops at block boundary

2016-06-21 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-10543: --- Attachment: HDFS-10543.HDFS-8707.003.patch Fix whitespace issue. > hdfsRead read stops at block

[jira] [Updated] (HDFS-10543) hdfsRead read stops at block boundary

2016-06-21 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-10543: --- Attachment: HDFS-10543.HDFS-8707.002.patch HDFS-10543.HDFS-8707.002.patch fixed the issue that after

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-06-21 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.009.patch HDFS-9890.HDFS-8707.009.patch uses a new flag

[jira] [Updated] (HDFS-10543) hdfsRead read stops at block boundary

2016-06-20 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-10543: --- Attachment: HDFS-10543.HDFS-8707.001.patch HDFS-10543.HDFS-8707.001.patch moves retry loop of reading

[jira] [Updated] (HDFS-10543) hdfsRead read stops at block boundary

2016-06-20 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-10543: --- Attachment: HDFS-10543.HDFS-8707.000.patch The patch fixed the issue that hdfsRead return only the

[jira] [Updated] (HDFS-10543) hdfsRead read stops at block boundary

2016-06-17 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-10543: --- Description: Reproducer: char *buf2 = new char[file_info->mSize]; memset(buf2, 0,

[jira] [Created] (HDFS-10543) hdfsRead read stops at block boundary

2016-06-17 Thread Xiaowei Zhu (JIRA)
Xiaowei Zhu created HDFS-10543: -- Summary: hdfsRead read stops at block boundary Key: HDFS-10543 URL: https://issues.apache.org/jira/browse/HDFS-10543 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-10527) libhdfs++: hdfsGetBlockLocations doesn't null terminate ip address strings

2016-06-16 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15334031#comment-15334031 ] Xiaowei Zhu commented on HDFS-10527: +1. The patch looks straightforward. > libhdfs++:

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-06-16 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.008.patch The new HDFS-9890.HDFS-8707.008.patch fix merge conflicts and

[jira] [Updated] (HDFS-8790) Add Filesystem level stress tests

2016-06-15 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-8790: -- Attachment: HDFS-8790.HDFS-8707.001.patch Things added to the new patch 001.patch: 1. Use actually file

[jira] [Commented] (HDFS-10188) libhdfs++: Implement debug allocators

2016-05-18 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15289972#comment-15289972 ] Xiaowei Zhu commented on HDFS-10188: +1 on the patch HDFS-10188.HDFS-8707.004.patch. I misunderstood

[jira] [Commented] (HDFS-10188) libhdfs++: Implement debug allocators

2016-05-18 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15289915#comment-15289915 ] Xiaowei Zhu commented on HDFS-10188: What does sizeof(clazz) return? Will it always be the size of

[jira] [Updated] (HDFS-10188) libhdfs++: Implement debug allocators

2016-05-17 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-10188: --- Attachment: HDFS-10188.HDFS-8707.003.patch > libhdfs++: Implement debug allocators >

[jira] [Updated] (HDFS-10188) libhdfs++: Implement debug allocators

2016-05-17 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-10188: --- Attachment: (was: HDFS-10188.HDFS-8707.003.patch) > libhdfs++: Implement debug allocators >

[jira] [Updated] (HDFS-10188) libhdfs++: Implement debug allocators

2016-05-17 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-10188: --- Attachment: HDFS-10188.HDFS-8707.003.patch New patch using decltype as suggested by James. For new[]

[jira] [Commented] (HDFS-10188) libhdfs++: Implement debug allocators

2016-05-17 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15286914#comment-15286914 ] Xiaowei Zhu commented on HDFS-10188: Sorry. I think for new/delete, mem_struct is not needed at all.

[jira] [Commented] (HDFS-10188) libhdfs++: Implement debug allocators

2016-05-17 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15286912#comment-15286912 ] Xiaowei Zhu commented on HDFS-10188: When we allocate memory with new, we actually allocate

[jira] [Commented] (HDFS-10188) libhdfs++: Implement debug allocators

2016-05-15 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15284110#comment-15284110 ] Xiaowei Zhu commented on HDFS-10188: New patch 002 uses macro to override new/delete operators. >

[jira] [Updated] (HDFS-10188) libhdfs++: Implement debug allocators

2016-05-15 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-10188: --- Attachment: (was: HDFS-10188.HDFS-8707.002.patch) > libhdfs++: Implement debug allocators >

[jira] [Updated] (HDFS-10188) libhdfs++: Implement debug allocators

2016-05-15 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-10188: --- Attachment: HDFS-10188.HDFS-8707.002.patch > libhdfs++: Implement debug allocators >

[jira] [Updated] (HDFS-10188) libhdfs++: Implement debug allocators

2016-05-12 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-10188: --- Attachment: HDFS-10188.HDFS-8707.002.patch > libhdfs++: Implement debug allocators >

[jira] [Updated] (HDFS-10188) libhdfs++: Implement debug allocators

2016-05-11 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-10188: --- Attachment: HDFS-10188.HDFS-8707.001.patch > libhdfs++: Implement debug allocators >

[jira] [Updated] (HDFS-10188) libhdfs++: Implement debug allocators

2016-05-10 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-10188: --- Attachment: HDFS-10188.HDFS-8707.000.patch > libhdfs++: Implement debug allocators >

[jira] [Updated] (HDFS-10188) libhdfs++: Implement debug allocators

2016-05-10 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-10188: --- Status: Patch Available (was: Open) First patch overrides new/delete globally w/ memset before free

[jira] [Commented] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-05-05 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273131#comment-15273131 ] Xiaowei Zhu commented on HDFS-9890: --- Previous patches have bad merges. Resubmit

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-05-05 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.007.patch > libhdfs++: Add test suite to simulate network issues >

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-05-05 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-9890: -- Attachment: (was: HDFS-9890.HDFS-8707.007.patch) > libhdfs++: Add test suite to simulate network

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-05-05 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.007.patch > libhdfs++: Add test suite to simulate network issues >

[jira] [Assigned] (HDFS-8790) Add Filesystem level stress tests

2016-05-05 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu reassigned HDFS-8790: - Assignee: Xiaowei Zhu (was: James Clampffer) > Add Filesystem level stress tests >

[jira] [Commented] (HDFS-8790) Add Filesystem level stress tests

2016-05-05 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273002#comment-15273002 ] Xiaowei Zhu commented on HDFS-8790: --- Per James, 1. Ideally it should stat the file it's running tests

[jira] [Assigned] (HDFS-10188) libhdfs++: Implement debug allocators

2016-05-05 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu reassigned HDFS-10188: -- Assignee: Xiaowei Zhu (was: James Clampffer) > libhdfs++: Implement debug allocators >

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-05-05 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.006.patch > libhdfs++: Add test suite to simulate network issues >

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-05-05 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-9890: -- Attachment: (was: HDFS-9890.HDFS-8707.006.patch) > libhdfs++: Add test suite to simulate network

[jira] [Commented] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-05-05 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272695#comment-15272695 ] Xiaowei Zhu commented on HDFS-9890: --- The latest patch HDFS-9890.HDFS-8707.006.patch fixed a bug in

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-05-05 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.006.patch > libhdfs++: Add test suite to simulate network issues >

[jira] [Updated] (HDFS-8790) Add Filesystem level stress tests

2016-05-05 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-8790: -- Attachment: (was: HDFS-9890.HDFS-8707.006.patch) > Add Filesystem level stress tests >

[jira] [Updated] (HDFS-8790) Add Filesystem level stress tests

2016-05-05 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-8790: -- Attachment: HDFS-9890.HDFS-8707.006.patch > Add Filesystem level stress tests >

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-05-03 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.005.patch > libhdfs++: Add test suite to simulate network issues >

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-05-03 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.004.patch > libhdfs++: Add test suite to simulate network issues >

[jira] [Commented] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-05-02 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15267551#comment-15267551 ] Xiaowei Zhu commented on HDFS-9890: --- Uploaded a patch with changes mainly replacing the code blocks that

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-05-02 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.003.patch > libhdfs++: Add test suite to simulate network issues >

[jira] [Assigned] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-04-20 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu reassigned HDFS-9890: - Assignee: Xiaowei Zhu (was: Stephen) > libhdfs++: Add test suite to simulate network issues >

[jira] [Updated] (HDFS-10299) libhdfs++: File length doesn't always going the last block if it's being written to

2016-04-15 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-10299: --- Attachment: HDFS-10299.HDFS-8707.000.patch > libhdfs++: File length doesn't always going the last

[jira] [Updated] (HDFS-10299) libhdfs++: File length doesn't always going the last block if it's being written to

2016-04-15 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaowei Zhu updated HDFS-10299: --- Status: Patch Available (was: In Progress) > libhdfs++: File length doesn't always going the last

[jira] [Work started] (HDFS-10299) libhdfs++: File length doesn't always going the last block if it's being written to

2016-04-15 Thread Xiaowei Zhu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-10299 started by Xiaowei Zhu. -- > libhdfs++: File length doesn't always going the last block if it's being >

  1   2   >