[jira] [Updated] (HDFS-10311) libhdfs++: DatanodeConnection::Cancel should not delete the underlying socket

2016-04-21 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10311: --- Resolution: Fixed Status: Resolved (was: Patch Available) > libhdfs++:

[jira] [Commented] (HDFS-10311) libhdfs++: DatanodeConnection::Cancel should not delete the underlying socket

2016-04-21 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15253186#comment-15253186 ] James Clampffer commented on HDFS-10311: I've committed this to HDFS-8707, thanks for the reviews

[jira] [Updated] (HDFS-10311) libhdfs++: DatanodeConnection::Cancel should not delete the underlying socket

2016-04-21 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10311: --- Attachment: HDFS-10311.HDFS-8707.002.patch New patch addressing [~bobhansen]'s comments -got

[jira] [Commented] (HDFS-10311) libhdfs++: DatanodeConnection::Cancel should not delete the underlying socket

2016-04-21 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252043#comment-15252043 ] James Clampffer commented on HDFS-10311: bq. The calling code can provide the context of the

[jira] [Commented] (HDFS-10311) libhdfs++: DatanodeConnection::Cancel should not delete the underlying socket

2016-04-21 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15251959#comment-15251959 ] James Clampffer commented on HDFS-10311: bq. SafeDisconnect should log some details at DEBUG level

[jira] [Updated] (HDFS-10311) libhdfs++: DatanodeConnection::Cancel should not delete the underlying socket

2016-04-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10311: --- Attachment: HDFS-10311.HDFS-8707.001.patch New patch, cleaned some stuff up. > libhdfs++:

[jira] [Updated] (HDFS-10311) libhdfs++: DatanodeConnection::Cancel should not delete the underlying socket

2016-04-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10311: --- Status: Patch Available (was: Open) > libhdfs++: DatanodeConnection::Cancel should not

[jira] [Updated] (HDFS-10311) libhdfs++: DatanodeConnection::Cancel should not delete the underlying socket

2016-04-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10311: --- Attachment: HDFS-10311.HDFS-8707.000.patch Fix for this bug: -add lock guards to

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-04-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.002.patch Uploaded a patch with some of the read pipeline error

[jira] [Created] (HDFS-10311) libhdfs++: DatanodeConnection::Cancel should not delete the underlying socket

2016-04-19 Thread James Clampffer (JIRA)
James Clampffer created HDFS-10311: -- Summary: libhdfs++: DatanodeConnection::Cancel should not delete the underlying socket Key: HDFS-10311 URL: https://issues.apache.org/jira/browse/HDFS-10311

[jira] [Created] (HDFS-10310) libhdfs++: hdfsConnect needs timeout logic

2016-04-19 Thread James Clampffer (JIRA)
James Clampffer created HDFS-10310: -- Summary: libhdfs++: hdfsConnect needs timeout logic Key: HDFS-10310 URL: https://issues.apache.org/jira/browse/HDFS-10310 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-04-19 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.001.patch New patch to get rid of merge conflicts and trailing

[jira] [Updated] (HDFS-10299) libhdfs++: File length doesn't always count the last block if it's being written to

2016-04-18 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10299: --- Resolution: Fixed Status: Resolved (was: Patch Available) > libhdfs++: File length

[jira] [Updated] (HDFS-9271) Implement basic NN operations

2016-04-18 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9271: -- Attachment: HDFS-9271.HDFS-8707.000.patch First patch, half baked and not ready to use.

[jira] [Commented] (HDFS-10299) libhdfs++: File length doesn't always count the last block if it's being written to

2016-04-18 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245660#comment-15245660 ] James Clampffer commented on HDFS-10299: Committed this to HDFS-8707. We should add some more

[jira] [Updated] (HDFS-10299) libhdfs++: File length doesn't always count the last block if it's being written to

2016-04-18 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10299: --- Summary: libhdfs++: File length doesn't always count the last block if it's being written to

[jira] [Commented] (HDFS-10299) libhdfs++: File length doesn't always going the last block if it's being written to

2016-04-18 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245552#comment-15245552 ] James Clampffer commented on HDFS-10299: This looks good to me, thanks for the fix Xiaowei. I'll

[jira] [Commented] (HDFS-9539) libhdfs++: enable default configuration files

2016-04-15 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15243402#comment-15243402 ] James Clampffer commented on HDFS-9539: --- So the idea is just grab a default config file, turn it into

[jira] [Created] (HDFS-10299) libhdfs++: File length doesn't always going the last block if it's being written to

2016-04-15 Thread James Clampffer (JIRA)
James Clampffer created HDFS-10299: -- Summary: libhdfs++: File length doesn't always going the last block if it's being written to Key: HDFS-10299 URL: https://issues.apache.org/jira/browse/HDFS-10299

[jira] [Assigned] (HDFS-9271) Implement basic NN operations

2016-04-14 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer reassigned HDFS-9271: - Assignee: James Clampffer (was: Aliaksei Sandryhaila) > Implement basic NN operations >

[jira] [Updated] (HDFS-10247) libhdfs++: Datanode protocol version mismatch

2016-04-13 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10247: --- Resolution: Fixed Status: Resolved (was: Patch Available) > libhdfs++: Datanode

[jira] [Commented] (HDFS-10247) libhdfs++: Datanode protocol version mismatch

2016-04-13 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239379#comment-15239379 ] James Clampffer commented on HDFS-10247: Thanks for the reviews and feedback Bob! I've committed

[jira] [Commented] (HDFS-10247) libhdfs++: Datanode protocol version mismatch

2016-04-12 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15238125#comment-15238125 ] James Clampffer commented on HDFS-10247: Thanks for taking a look at this Bob. bq. Is there a

[jira] [Updated] (HDFS-10247) libhdfs++: Datanode protocol version mismatch

2016-04-12 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10247: --- Attachment: HDFS-10247.HDFS-8707.002.patch New patch up, just cleaned up old patch, also

[jira] [Commented] (HDFS-10247) libhdfs++: Datanode protocol version mismatch

2016-04-11 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15236021#comment-15236021 ] James Clampffer commented on HDFS-10247: Results of tons of continued testing: -Valgrind shows no

[jira] [Updated] (HDFS-10247) libhdfs++: Datanode protocol version mismatch

2016-04-07 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10247: --- Attachment: HDFS-10247.HDFS-8707.001.patch Update to make read/write continuations take

[jira] [Updated] (HDFS-8790) Add Filesystem level stress tests

2016-04-07 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-8790: -- Status: Patch Available (was: Open) > Add Filesystem level stress tests >

[jira] [Updated] (HDFS-10247) libhdfs++: Datanode protocol version mismatch

2016-04-07 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10247: --- Status: Patch Available (was: Open) > libhdfs++: Datanode protocol version mismatch >

[jira] [Updated] (HDFS-8790) Add Filesystem level stress tests

2016-04-07 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-8790: -- Attachment: HDFS-8790.HDFS-8707.000.patch Added patch that just does open-seek-read-close

[jira] [Updated] (HDFS-10247) libhdfs++: Datanode protocol version mismatch

2016-04-07 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10247: --- Attachment: HDFS-10247.HDFS-8707.000.patch First patch. This seems to fix things, but I'm

[jira] [Commented] (HDFS-10231) libhdfs++: Fix race conditions in RPC layer

2016-04-01 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15222340#comment-15222340 ] James Clampffer commented on HDFS-10231: New patch looks good to me, +1 > libhdfs++: Fix race

[jira] [Created] (HDFS-10247) libhdfs++: Datanode protocol version mismatch

2016-04-01 Thread James Clampffer (JIRA)
James Clampffer created HDFS-10247: -- Summary: libhdfs++: Datanode protocol version mismatch Key: HDFS-10247 URL: https://issues.apache.org/jira/browse/HDFS-10247 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-10241) libhdfs++: Objects should never return mutable references to internal state

2016-03-31 Thread James Clampffer (JIRA)
James Clampffer created HDFS-10241: -- Summary: libhdfs++: Objects should never return mutable references to internal state Key: HDFS-10241 URL: https://issues.apache.org/jira/browse/HDFS-10241

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-03-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9890: -- Status: Patch Available (was: Open) > libhdfs++: Add test suite to simulate network issues >

[jira] [Updated] (HDFS-10231) libhdfs++: Fix race conditions in RPC layer

2016-03-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10231: --- Attachment: HDFS-10231.HDFS-8707.002.patch New patch, now tests should pass. > libhdfs++:

[jira] [Updated] (HDFS-10222) libhdfs++: Shutdown sockets to avoid "Connection reset by peer"

2016-03-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10222: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to HDFS-8707 >

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-03-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9890: -- Attachment: HDFS-9890.HDFS-8707.000.patch Initial patch, right now error injection is turned on

[jira] [Commented] (HDFS-10231) libhdfs++: Fix race conditions in RPC layer

2016-03-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15218397#comment-15218397 ] James Clampffer commented on HDFS-10231: Test failure is due to a bad merge I made; [~bobthansen]

[jira] [Commented] (HDFS-10222) libhdfs++: Shutdown sockets to avoid "Connection reset by peer"

2016-03-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15218235#comment-15218235 ] James Clampffer commented on HDFS-10222: Thanks for reviewing Stephen! As long as the users

[jira] [Updated] (HDFS-10231) libhdfs++: Fix race conditions in RPC layer

2016-03-29 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10231: --- Status: Patch Available (was: Open) > libhdfs++: Fix race conditions in RPC layer >

[jira] [Updated] (HDFS-10231) libhdfs++: Fix race conditions in RPC layer

2016-03-29 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10231: --- Attachment: HDFS-10231.HDFS-8707.001.patch Took the first patch and isolated the rpc fixes.

[jira] [Updated] (HDFS-10231) libhdfs++: Fix race conditions in RPC layer

2016-03-29 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10231: --- Attachment: HDFS-10231.HDFS-8707.000.patch Attaching first patch. Contains all of HDFS-9890

[jira] [Created] (HDFS-10231) libhdfs++: Fix race conditions in RPC layer

2016-03-29 Thread James Clampffer (JIRA)
James Clampffer created HDFS-10231: -- Summary: libhdfs++: Fix race conditions in RPC layer Key: HDFS-10231 URL: https://issues.apache.org/jira/browse/HDFS-10231 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-9823) libhdfs++: Cancel outstanding operations without calling shutdown

2016-03-29 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216428#comment-15216428 ] James Clampffer commented on HDFS-9823: --- [~bobthansen], would you mind if we held off on this a

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-03-29 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9890: -- Assignee: Stephen > libhdfs++: Add test suite to simulate network issues >

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-03-29 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9890: -- Assignee: (was: James Clampffer) > libhdfs++: Add test suite to simulate network issues >

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-03-29 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9890: -- Description: I propose adding a test suite to simulate various network issues/failures in order

[jira] [Updated] (HDFS-10222) libhdfs++: Shutdown sockets to avoid "Connection reset by peer"

2016-03-28 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10222: --- Status: Patch Available (was: Open) > libhdfs++: Shutdown sockets to avoid "Connection reset

[jira] [Updated] (HDFS-10222) libhdfs++: Shutdown sockets to avoid "Connection reset by peer"

2016-03-28 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10222: --- Attachment: HDFS-10222.HDFS-8707.000.patch Added patch. The fix has two parts: 1) Always

[jira] [Created] (HDFS-10222) libhdfs++: Shutdown sockets to avoid "Connection reset by peer"

2016-03-28 Thread James Clampffer (JIRA)
James Clampffer created HDFS-10222: -- Summary: libhdfs++: Shutdown sockets to avoid "Connection reset by peer" Key: HDFS-10222 URL: https://issues.apache.org/jira/browse/HDFS-10222 Project: Hadoop

[jira] [Updated] (HDFS-10188) libhdfs++: Implement debug allocators

2016-03-24 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-10188: --- Description: I propose implementing a set of memory new/delete pairs with additional

[jira] [Created] (HDFS-10205) libhdfs++: Integrate logging with the C API

2016-03-24 Thread James Clampffer (JIRA)
James Clampffer created HDFS-10205: -- Summary: libhdfs++: Integrate logging with the C API Key: HDFS-10205 URL: https://issues.apache.org/jira/browse/HDFS-10205 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-9616) libhdfs++ Add runtime hooks to allow a client application to add low level monitoring and tests.

2016-03-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9616: -- Resolution: Fixed Status: Resolved (was: Patch Available) > libhdfs++ Add runtime hooks

[jira] [Commented] (HDFS-9616) libhdfs++ Add runtime hooks to allow a client application to add low level monitoring and tests.

2016-03-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209718#comment-15209718 ] James Clampffer commented on HDFS-9616: --- I committed this to HDFS-8707. Thanks [~bobhansen]! >

[jira] [Commented] (HDFS-9118) Add logging system for libdhfs++

2016-03-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209270#comment-15209270 ] James Clampffer commented on HDFS-9118: --- Thanks for the reviews Bob. I'll open a jira for tying

[jira] [Updated] (HDFS-9118) Add logging system for libdhfs++

2016-03-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9118: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Add logging system for

[jira] [Updated] (HDFS-9118) Add logging system for libdhfs++

2016-03-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9118: -- Attachment: HDFS-9118.HDFS-8707.004.patch New patch incorporating nearly all of [~bobhansen]'s

[jira] [Commented] (HDFS-9616) libhdfs++ Add runtime hooks to allow a client application to add low level monitoring and tests.

2016-03-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15209063#comment-15209063 ] James Clampffer commented on HDFS-9616: --- Looks good to me, +1 > libhdfs++ Add runtime hooks to allow

[jira] [Commented] (HDFS-9118) Add logging system for libdhfs++

2016-03-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15208701#comment-15208701 ] James Clampffer commented on HDFS-9118: --- Didn't see you had more comments above my last message,

[jira] [Commented] (HDFS-9118) Add logging system for libdhfs++

2016-03-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15208612#comment-15208612 ] James Clampffer commented on HDFS-9118: --- bq. Before we commit it, do you think we should add a _FILE_

[jira] [Commented] (HDFS-9616) libhdfs++ Add runtime hooks to allow a client application to add low level monitoring and tests.

2016-03-22 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15206554#comment-15206554 ] James Clampffer commented on HDFS-9616: --- Just took a look at this. Could you change the indentation

[jira] [Updated] (HDFS-9118) Add logging system for libdhfs++

2016-03-21 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9118: -- Attachment: HDFS-9118.HDFS-8707.003.patch New patch, incorporates a lot of [~bobhansen]'s

[jira] [Created] (HDFS-10188) libhdfs++: Implement debug allocators

2016-03-21 Thread James Clampffer (JIRA)
James Clampffer created HDFS-10188: -- Summary: libhdfs++: Implement debug allocators Key: HDFS-10188 URL: https://issues.apache.org/jira/browse/HDFS-10188 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-9118) Add logging system for libdhfs++

2016-03-19 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198193#comment-15198193 ] James Clampffer commented on HDFS-9118: --- bq. The downside of this approach is that all of the

[jira] [Updated] (HDFS-9118) Add logging system for libdhfs++

2016-03-11 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9118: -- Attachment: HDFS-9118.HDFS-8707.002.patch -Now with unit tests -Pluggable loggers for C and

[jira] [Commented] (HDFS-9556) libhdfs++: pull Options from default configs by default

2016-03-11 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15191193#comment-15191193 ] James Clampffer commented on HDFS-9556: --- Looks good to me. From what I can tell the whitespace and

[jira] [Commented] (HDFS-9932) libhdfs++: find a URI parsing library

2016-03-10 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15190087#comment-15190087 ] James Clampffer commented on HDFS-9932: --- Looks good to me, +1. > libhdfs++: find a URI parsing

[jira] [Commented] (HDFS-9930) libhdfs++: add hooks to facilitate fault testing

2016-03-10 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15190085#comment-15190085 ] James Clampffer commented on HDFS-9930: --- Duplicate of HDFS-9616? > libhdfs++: add hooks to

[jira] [Commented] (HDFS-9118) Add logging system for libdhfs++

2016-03-10 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15189643#comment-15189643 ] James Clampffer commented on HDFS-9118: --- Disregard the stuff about template instantiations not

[jira] [Commented] (HDFS-9118) Add logging system for libdhfs++

2016-03-10 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15189499#comment-15189499 ] James Clampffer commented on HDFS-9118: --- bq. Great. If we can, let's implement the plugins for the

[jira] [Commented] (HDFS-9118) Add logging system for libdhfs++

2016-03-09 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187815#comment-15187815 ] James Clampffer commented on HDFS-9118: --- Thanks for the feedback [~bobthansen], I hadn't thought

[jira] [Commented] (HDFS-9792) libhdfs++: EACCES not setting errno correctly

2016-03-09 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187634#comment-15187634 ] James Clampffer commented on HDFS-9792: --- Just looked at this again, disregard my last comment. For

[jira] [Commented] (HDFS-9556) libhdfs++: pull Options from default configs by default

2016-03-08 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15186102#comment-15186102 ] James Clampffer commented on HDFS-9556: --- That makes sense, I'm running gcc 4.8.2. Is this something

[jira] [Updated] (HDFS-9118) Add logging system for libdhfs++

2016-03-08 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9118: -- Attachment: HDFS-9118.HDFS-8707.001.patch New patch: -LogManager no longer a singleton, just

[jira] [Commented] (HDFS-9556) libhdfs++: pull Options from default configs by default

2016-03-08 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185541#comment-15185541 ] James Clampffer commented on HDFS-9556: --- Just checked again after I realized applied patch to one

[jira] [Commented] (HDFS-9556) libhdfs++: pull Options from default configs by default

2016-03-08 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15185516#comment-15185516 ] James Clampffer commented on HDFS-9556: --- It looks like you could get rid of the following in

[jira] [Updated] (HDFS-9118) Add logging system for libdhfs++

2016-03-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9118: -- Attachment: HDFS-9118.HDFS-8707.000.patch Initial patch: -extend logging to be able to filter by

[jira] [Updated] (HDFS-9118) Add logging system for libdhfs++

2016-03-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9118: -- Status: Patch Available (was: Open) > Add logging system for libdhfs++ >

[jira] [Updated] (HDFS-9699) libhdfs++: Add appropriate catch blocks for ASIO operations that throw

2016-03-03 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9699: -- Resolution: Fixed Status: Resolved (was: Patch Available) > libhdfs++: Add appropriate

[jira] [Commented] (HDFS-9699) libhdfs++: Add appropriate catch blocks for ASIO operations that throw

2016-03-03 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15177971#comment-15177971 ] James Clampffer commented on HDFS-9699: --- Committed this to HDFS-8707. > libhdfs++: Add appropriate

[jira] [Updated] (HDFS-9699) libhdfs++: Add appropriate catch blocks for ASIO operations that throw

2016-03-03 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9699: -- Assignee: Bob Hansen (was: James Clampffer) > libhdfs++: Add appropriate catch blocks for ASIO

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-03-02 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9890: -- Description: I propose adding a test suite to simulate various network issues/failures in order

[jira] [Commented] (HDFS-9699) libhdfs++: Add appropriate catch blocks for ASIO operations that throw

2016-03-02 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15176384#comment-15176384 ] James Clampffer commented on HDFS-9699: --- New patch looks good to me, +1. > libhdfs++: Add

[jira] [Updated] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-03-02 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9890: -- Description: I propose adding a test suite to simulate various network issues/failures in order

[jira] [Created] (HDFS-9890) libhdfs++: Add test suite to simulate network issues

2016-03-02 Thread James Clampffer (JIRA)
James Clampffer created HDFS-9890: - Summary: libhdfs++: Add test suite to simulate network issues Key: HDFS-9890 URL: https://issues.apache.org/jira/browse/HDFS-9890 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9699) libhdfs++: Add appropriate catch blocks for ASIO operations that throw

2016-03-01 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15173914#comment-15173914 ] James Clampffer commented on HDFS-9699: --- bq. Perhaps we should put it into a loop and respond to

[jira] [Commented] (HDFS-9699) libhdfs++: Add appropriate catch blocks for ASIO operations that throw

2016-02-29 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15172540#comment-15172540 ] James Clampffer commented on HDFS-9699: --- Realized I didn't look at the change in filesystem.cc (was

[jira] [Commented] (HDFS-9699) libhdfs++: Add appropriate catch blocks for ASIO operations that throw

2016-02-29 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15172508#comment-15172508 ] James Clampffer commented on HDFS-9699: --- Seems like a good improvement. Nitpick (not a blocker)

[jira] [Commented] (HDFS-9823) libhdfs++: Cancel outstanding operations without calling shutdown

2016-02-22 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157889#comment-15157889 ] James Clampffer commented on HDFS-9823: --- Looking at this again, why not use {code} conn_->is_open()

[jira] [Commented] (HDFS-9791) libhfds++: ConfigurationLoader throws parse_exception on invalid input

2016-02-18 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15152591#comment-15152591 ] James Clampffer commented on HDFS-9791: --- bq. Adding a Status to the return is going to make the API

[jira] [Commented] (HDFS-9792) libhdfs++: EACCES not setting errno correctly

2016-02-18 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15152574#comment-15152574 ] James Clampffer commented on HDFS-9792: --- The errno fix is a clear improvement. It looks like a side

[jira] [Commented] (HDFS-9823) libhdfs++: Cancel outstanding operations without calling shutdown

2016-02-18 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15152541#comment-15152541 ] James Clampffer commented on HDFS-9823: --- I think the shutdown() call is important for working on

[jira] [Commented] (HDFS-9827) libhfds++: C++ exceptions should never escape the C API

2016-02-18 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15152468#comment-15152468 ] James Clampffer commented on HDFS-9827: --- Superset of the work HDFS-9699. Depending on how granular

[jira] [Updated] (HDFS-8765) Implement local block reader in libhdfspp

2016-02-10 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-8765: -- Attachment: short-circuit-demo.patch4 Rebased to head again. I haven't really touched this

[jira] [Commented] (HDFS-9753) libhdfs++: Client fails to pass TokenProto from LocatedBlockProto to server when reading a block

2016-02-05 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134410#comment-15134410 ] James Clampffer commented on HDFS-9753: --- Thanks for the reviews Bob. I've committed to HDFS-8707. >

[jira] [Updated] (HDFS-9753) libhdfs++: Client fails to pass TokenProto from LocatedBlockProto to server when reading a block

2016-02-05 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9753: -- Resolution: Fixed Status: Resolved (was: Patch Available) > libhdfs++: Client fails to

[jira] [Commented] (HDFS-9757) libhdfs++: examples fail to build with static libproto/openssl

2016-02-05 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134417#comment-15134417 ] James Clampffer commented on HDFS-9757: --- Just to make sure I understand the problem: Is it the case

[jira] [Created] (HDFS-9758) libhdfs++: Implement Python bindings

2016-02-04 Thread James Clampffer (JIRA)
James Clampffer created HDFS-9758: - Summary: libhdfs++: Implement Python bindings Key: HDFS-9758 URL: https://issues.apache.org/jira/browse/HDFS-9758 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-9753) libhdfs++: Client fails to pass TokenProto from LocatedBlockProto to server when reading a block

2016-02-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9753: -- Attachment: HDFS-9753.HDFS-8707.001.patch Uploaded new version of patch with fixes suggested by

[jira] [Commented] (HDFS-9753) libhdfs++: Client fails to pass TokenProto from LocatedBlockProto to server when reading a block

2016-02-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15132505#comment-15132505 ] James Clampffer commented on HDFS-9753: --- Thanks for the feedback Bob. bq. Should we shave a few

<    1   2   3   4   5   6   7   8   9   10   >