[jira] [Commented] (HDFS-9103) Retry reads on DN failure

2015-11-05 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992431#comment-14992431 ] James Clampffer commented on HDFS-9103: --- Thanks for the comments Bob! "Include an abstraction

[jira] [Commented] (HDFS-9328) Formalize coding standards for libhdfs++ and put them in a README.txt

2015-11-05 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992445#comment-14992445 ] James Clampffer commented on HDFS-9328: --- I'm fine with relaxing the clang-format rule as well. If

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

2015-11-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990464#comment-14990464 ] James Clampffer commented on HDFS-9103: --- The thumbs down was supposed to be a log base 2. One of

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

2015-11-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14990381#comment-14990381 ] James Clampffer commented on HDFS-9103: --- "Every node in the set requires a separate heap allocation.

[jira] [Assigned] (HDFS-9328) Formalize coding standards for libhdfs++ and put them in a README.txt

2015-11-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer reassigned HDFS-9328: - Assignee: James Clampffer (was: Haohui Mai) > Formalize coding standards for libhdfs++

[jira] [Updated] (HDFS-9103) Retry reads on DN failure

2015-11-04 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9103: -- Attachment: HDFS-9103.HDFS-8707.007.patch New patch, there's a bit of extra noise due to

[jira] [Commented] (HDFS-9328) Formalize coding standards for libhdfs++ and put them in a README.txt

2015-11-03 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987448#comment-14987448 ] James Clampffer commented on HDFS-9328: --- Right now Haohui wants to use google's C++ style guide with

[jira] [Updated] (HDFS-9367) Get libhdfs++ gmock tests running with CI

2015-11-03 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9367: -- Assignee: Haohui Mai (was: James Clampffer) > Get libhdfs++ gmock tests running with CI >

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

2015-11-03 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988349#comment-14988349 ] James Clampffer commented on HDFS-9103: --- Thanks for the feedback Haohui! "The name_match function

[jira] [Updated] (HDFS-9368) Implement reads with implicit offset state in libhdfs++

2015-11-03 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9368: -- Attachment: HDFS-9368.HDFS-8707.000.patch Implemented just enough to unblock HDFS-9359 (test I

[jira] [Created] (HDFS-9368) Implement reads with implicit offset state in libhdfs++

2015-11-03 Thread James Clampffer (JIRA)
James Clampffer created HDFS-9368: - Summary: Implement reads with implicit offset state in libhdfs++ Key: HDFS-9368 URL: https://issues.apache.org/jira/browse/HDFS-9368 Project: Hadoop HDFS

[jira] [Created] (HDFS-9359) Enable libhdfs++ to use existing libhdfs CLI tests

2015-11-02 Thread James Clampffer (JIRA)
James Clampffer created HDFS-9359: - Summary: Enable libhdfs++ to use existing libhdfs CLI tests Key: HDFS-9359 URL: https://issues.apache.org/jira/browse/HDFS-9359 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-9320) libhdfspp should not use sizeof for stream parsing

2015-11-02 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9320: -- Attachment: HDFS-9320.HDFS-8707.001.patch Changed size in bytes to sizeof(int16_t | int32_t). >

[jira] [Commented] (HDFS-9117) Config file reader / options classes for libhdfs++

2015-11-02 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14985948#comment-14985948 ] James Clampffer commented on HDFS-9117: --- That sounds good to me. +1 on the new patch > Config file

[jira] [Updated] (HDFS-9320) libhdfspp should not use sizeof for stream parsing

2015-11-02 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9320: -- Attachment: HDFS-9320.HDFS-8707.002.patch Ah ok. This fixes it. > libhdfspp should not use

[jira] [Updated] (HDFS-9320) libhdfspp should not use sizeof for stream parsing

2015-10-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9320: -- Attachment: HDFS-9320.HDFS-8707.000.patch Added constants defining the size of java ints and

[jira] [Assigned] (HDFS-9320) libhdfspp should not use sizeof for stream parsing

2015-10-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer reassigned HDFS-9320: - Assignee: James Clampffer > libhdfspp should not use sizeof for stream parsing >

[jira] [Updated] (HDFS-9320) libhdfspp should not use sizeof for stream parsing

2015-10-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9320: -- Status: Patch Available (was: Open) > libhdfspp should not use sizeof for stream parsing >

[jira] [Resolved] (HDFS-9272) Implement a unix-like cat utility

2015-10-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer resolved HDFS-9272. --- Resolution: Won't Fix I went down the wrong path with this so I'll close it. Will either open

[jira] [Assigned] (HDFS-9103) Retry reads on DN failure

2015-10-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer reassigned HDFS-9103: - Assignee: James Clampffer (was: Bob Hansen) > Retry reads on DN failure >

[jira] [Updated] (HDFS-9103) Retry reads on DN failure

2015-10-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9103: -- Attachment: HDFS-9103.HDFS-8707.006.patch Adding a patch: This is effectively the logic I had

[jira] [Commented] (HDFS-9340) libhdfspp fails to compile after HDFS-9207

2015-10-29 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981461#comment-14981461 ] James Clampffer commented on HDFS-9340: --- Fantastic. It looks like it's building all the binaries.

[jira] [Commented] (HDFS-9117) Config file reader / options classes for libhdfs++

2015-10-29 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981582#comment-14981582 ] James Clampffer commented on HDFS-9117: --- "The principle is that the C++ APIs should be able to solely

[jira] [Commented] (HDFS-9340) libhdfspp fails to compile after HDFS-9207

2015-10-29 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14981637#comment-14981637 ] James Clampffer commented on HDFS-9340: --- +1 on the patch, but I think a jira that wires up make test

[jira] [Commented] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-28 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14978378#comment-14978378 ] James Clampffer commented on HDFS-8766: --- Thanks for the review Haohui! Good catch on the "using

[jira] [Created] (HDFS-9325) Allow the location of hdfs.h to be passed to CMake during a build.

2015-10-28 Thread James Clampffer (JIRA)
James Clampffer created HDFS-9325: - Summary: Allow the location of hdfs.h to be passed to CMake during a build. Key: HDFS-9325 URL: https://issues.apache.org/jira/browse/HDFS-9325 Project: Hadoop

[jira] [Updated] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-28 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-8766: -- Attachment: HDFS-8766.HDFS-8707.011.patch Should have all the fixes for your last comment

[jira] [Created] (HDFS-9326) Create a generic function to synchronize async functions and methods.

2015-10-28 Thread James Clampffer (JIRA)
James Clampffer created HDFS-9326: - Summary: Create a generic function to synchronize async functions and methods. Key: HDFS-9326 URL: https://issues.apache.org/jira/browse/HDFS-9326 Project: Hadoop

[jira] [Commented] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-28 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14979012#comment-14979012 ] James Clampffer commented on HDFS-8766: --- "Please wrap the statement with braces though it is a single

[jira] [Created] (HDFS-9328) Formalize coding standards for libhdfs++ and put them in a README.txt

2015-10-28 Thread James Clampffer (JIRA)
James Clampffer created HDFS-9328: - Summary: Formalize coding standards for libhdfs++ and put them in a README.txt Key: HDFS-9328 URL: https://issues.apache.org/jira/browse/HDFS-9328 Project: Hadoop

[jira] [Updated] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-28 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-8766: -- Attachment: HDFS-8766.HDFS-8707.012.patch Added brackets to if blocks. Got all the error

[jira] [Updated] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-27 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-8766: -- Attachment: HDFS-8766.HDFS-8707.010.patch Thanks for the input Bob, I put the file handle and

[jira] [Commented] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-27 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977422#comment-14977422 ] James Clampffer commented on HDFS-8766: --- I'm not sure what I'm missing with regards to style stuff:

[jira] [Commented] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-27 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14977440#comment-14977440 ] James Clampffer commented on HDFS-8766: --- Thanks for the +1! I agree that we should be able to

[jira] [Commented] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-26 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14975188#comment-14975188 ] James Clampffer commented on HDFS-8766: --- Thanks for the input Haohui! I have the bulk of the next

[jira] [Commented] (HDFS-9117) Config file reader / options classes for libhdfs++

2015-10-26 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14974789#comment-14974789 ] James Clampffer commented on HDFS-9117: --- +1 > Config file reader / options classes for libhdfs++ >

[jira] [Commented] (HDFS-9117) Config file reader / options classes for libhdfs++

2015-10-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971142#comment-14971142 ] James Clampffer commented on HDFS-9117: --- Thanks for the update Bob! The last patch covered all of my

[jira] [Commented] (HDFS-9272) Implement a unix-like cat utility

2015-10-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971177#comment-14971177 ] James Clampffer commented on HDFS-9272: --- Will do. Is there generally a preference in the HDFS

[jira] [Commented] (HDFS-9288) Add RapidXML to third-party

2015-10-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14971166#comment-14971166 ] James Clampffer commented on HDFS-9288: --- I agree with Haohui about adding an intermediate /rapidxml

[jira] [Commented] (HDFS-9288) Add RapidXML to third-party

2015-10-22 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970033#comment-14970033 ] James Clampffer commented on HDFS-9288: --- ..and I was looking at the wrong jira > Add RapidXML to

[jira] [Updated] (HDFS-9288) Add RapidXML to third-party

2015-10-22 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9288: -- Attachment: (was: HDFS-8766.HDFS-8707.009.patch) > Add RapidXML to third-party >

[jira] [Updated] (HDFS-9288) Add RapidXML to third-party

2015-10-22 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9288: -- Attachment: HDFS-8766.HDFS-8707.009.patch fixes remaining style issues, split class defs into a

[jira] [Updated] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-22 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-8766: -- Attachment: HDFS-8766.HDFS-8707.009.patch Split class defs into header, add apache header stubs,

[jira] [Commented] (HDFS-9272) Implement a unix-like cat utility

2015-10-22 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14969299#comment-14969299 ] James Clampffer commented on HDFS-9272: --- Thanks for the tip Haohui, I didn't think to check that out.

[jira] [Commented] (HDFS-9117) Config file reader / options classes for libhdfs++

2015-10-21 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967395#comment-14967395 ] James Clampffer commented on HDFS-9117: --- Some Feedback: More comments would be nice, particularly

[jira] [Updated] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-21 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-8766: -- Attachment: HDFS-8766.HDFS-8707.008.patch Got rid of macros, changed pread to Pread, got rid of

[jira] [Created] (HDFS-9272) Implement a unix-like cat utility

2015-10-20 Thread James Clampffer (JIRA)
James Clampffer created HDFS-9272: - Summary: Implement a unix-like cat utility Key: HDFS-9272 URL: https://issues.apache.org/jira/browse/HDFS-9272 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-9144) Refactor libhdfs into stateful/ephemeral objects

2015-10-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965491#comment-14965491 ] James Clampffer commented on HDFS-9144: --- This looks like a solid plan to me. > Refactor libhdfs into

[jira] [Updated] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-8766: -- Attachment: HDFS-8766.HDFS-8707.007.patch A rebase of the last patch to unblock Bob's work.

[jira] [Updated] (HDFS-9272) Implement a unix-like cat utility

2015-10-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9272: -- Attachment: HDFS-9272.HDFS-8707.000.patch Built on top of the HDFS-8766 patch that hasn't landed

[jira] [Commented] (HDFS-9272) Implement a unix-like cat utility

2015-10-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965826#comment-14965826 ] James Clampffer commented on HDFS-9272: --- Thanks for the explanation! I didn't know that was already

[jira] [Updated] (HDFS-9265) Use of undefined behavior in remote_block_reader causing deterministic crashes.

2015-10-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9265: -- Description: The remote block reader relies on undefined behavior in how it uses

[jira] [Commented] (HDFS-9272) Implement a unix-like cat utility

2015-10-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965784#comment-14965784 ] James Clampffer commented on HDFS-9272: --- Hi Allen, Thanks for the input. Do you have a JIRA or

[jira] [Assigned] (HDFS-9265) Use of undefined behavior in remote_block_reader causing deterministic crashes.

2015-10-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer reassigned HDFS-9265: - Assignee: James Clampffer > Use of undefined behavior in remote_block_reader causing

[jira] [Updated] (HDFS-9265) Use of undefined behavior in remote_block_reader causing deterministic crashes.

2015-10-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9265: -- Status: Patch Available (was: Open) > Use of undefined behavior in remote_block_reader causing

[jira] [Updated] (HDFS-9265) Use of undefined behavior in remote_block_reader causing deterministic crashes.

2015-10-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9265: -- Attachment: HDFS-9265.HDFS-8707.000.patch Simple fix. As far as I can tell it won't cause any

[jira] [Created] (HDFS-9265) Use of undefined behavior in remote_block_reader causing deterministic crashes.

2015-10-19 Thread James Clampffer (JIRA)
James Clampffer created HDFS-9265: - Summary: Use of undefined behavior in remote_block_reader causing deterministic crashes. Key: HDFS-9265 URL: https://issues.apache.org/jira/browse/HDFS-9265

[jira] [Commented] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-19 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964024#comment-14964024 ] James Clampffer commented on HDFS-8766: --- Thanks Bob and Haohui for the feedback. Bob, I'll make

[jira] [Updated] (HDFS-9265) Use of undefined behavior in remote_block_reader causing deterministic crashes.

2015-10-19 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9265: -- Description: The remote block reader relies on undefined behavior in how it uses

[jira] [Updated] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-15 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-8766: -- Attachment: HDFS-8766.HDFS-8707.006.patch Stripped stuff out. > Implement a libhdfs(3)

[jira] [Commented] (HDFS-9207) Move the implementation to the hdfs-native-client module

2015-10-15 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959267#comment-14959267 ] James Clampffer commented on HDFS-9207: --- +1 > Move the implementation to the hdfs-native-client

[jira] [Commented] (HDFS-9207) Move the implementation to the hdfs-native-client module

2015-10-12 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14953424#comment-14953424 ] James Clampffer commented on HDFS-9207: --- Looks like a pretty simple patch to me, just a couple

[jira] [Updated] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-12 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-8766: -- Attachment: HDFS-8766.HDFS-8707.005.patch Added basic error checking tests in gmock. They use

[jira] [Updated] (HDFS-9186) Simplify embedding libhdfspp into other projects

2015-10-02 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9186: -- Status: Patch Available (was: Open) > Simplify embedding libhdfspp into other projects >

[jira] [Updated] (HDFS-9186) Simplify embedding libhdfspp into other projects

2015-10-02 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9186: -- Attachment: HDFS-9186.HDFS-8707.000.patch Simple script that copies only the things needed to

[jira] [Updated] (HDFS-9186) Simplify embedding libhdfspp into other projects

2015-10-02 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9186: -- Status: Open (was: Patch Available) > Simplify embedding libhdfspp into other projects >

[jira] [Commented] (HDFS-9186) Simplify embedding libhdfspp into other projects

2015-10-02 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14941597#comment-14941597 ] James Clampffer commented on HDFS-9186: --- Decided to close this. While it does what I need I think

[jira] [Resolved] (HDFS-9186) Simplify embedding libhdfspp into other projects

2015-10-02 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer resolved HDFS-9186. --- Resolution: Not A Problem > Simplify embedding libhdfspp into other projects >

[jira] [Created] (HDFS-9192) Add valgrind suppression for statically initialized library objects

2015-10-02 Thread James Clampffer (JIRA)
James Clampffer created HDFS-9192: - Summary: Add valgrind suppression for statically initialized library objects Key: HDFS-9192 URL: https://issues.apache.org/jira/browse/HDFS-9192 Project: Hadoop

[jira] [Updated] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-01 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-8766: -- Attachment: HDFS-8766.HDFS-8707.003.patch Added another patch Forgot to change include guard in

[jira] [Created] (HDFS-9186) Simplify embedding libhdfspp into other projects

2015-10-01 Thread James Clampffer (JIRA)
James Clampffer created HDFS-9186: - Summary: Simplify embedding libhdfspp into other projects Key: HDFS-9186 URL: https://issues.apache.org/jira/browse/HDFS-9186 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-01 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14940047#comment-14940047 ] James Clampffer commented on HDFS-8766: --- Thanks for the review Bob. 1) Thanks for pointing that out.

[jira] [Updated] (HDFS-8790) Add Filesystem level stress tests

2015-10-01 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-8790: -- Description: I propose adding stress tests on libhdfs(3) compatibility layer was well as the

[jira] [Updated] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-10-01 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-8766: -- Attachment: HDFS-8766.HDFS-8707.004.patch Thanks Bob and Haohui for the reviews. The new patch

[jira] [Updated] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-09-30 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-8766: -- Attachment: HDFS-8766.HDFS-8707.002.patch Thanks for the review Haohui, this patch should

[jira] [Updated] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-09-28 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-8766: -- Attachment: HDFS-8766.HDFS-8707.001.patch Changes in new patch: -ran clang-format with google

[jira] [Commented] (HDFS-9108) InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

2015-09-24 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14907122#comment-14907122 ] James Clampffer commented on HDFS-9108: --- +1 > InputStreamImpl::ReadBlockContinuation stores wrong

[jira] [Updated] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-09-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-8766: -- Status: Patch Available (was: In Progress) > Implement a libhdfs(3) compatible API >

[jira] [Updated] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-09-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-8766: -- Attachment: HDFS-8766.HDFS-8707.000.patch Some notes on first patch: -Just enough done to open,

[jira] [Updated] (HDFS-9062) Add a parameter to MiniDFSCluster to turn off security checks on the domain socked path

2015-09-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9062: -- Status: Patch Available (was: In Progress) > Add a parameter to MiniDFSCluster to turn off

[jira] [Updated] (HDFS-9062) Add a parameter to MiniDFSCluster to turn off security checks on the domain socked path

2015-09-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9062: -- Attachment: HDFS-9062.HDFS-8700.000.patch Basic patch, still need to figure out how to write a

[jira] [Commented] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-09-23 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14905488#comment-14905488 ] James Clampffer commented on HDFS-8766: --- Thanks for the input! Re: It looks like that the code needs

[jira] [Work started] (HDFS-9062) Add a parameter to MiniDFSCluster to turn off security checks on the domain socked path

2015-09-22 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-9062 started by James Clampffer. - > Add a parameter to MiniDFSCluster to turn off security checks on the domain

[jira] [Commented] (HDFS-9108) InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

2015-09-22 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903536#comment-14903536 ] James Clampffer commented on HDFS-9108: --- Thanks for the patch! Looks like everything works; I'm

[jira] [Commented] (HDFS-9108) InputStreamImpl::ReadBlockContinuation stores wrong pointers of buffers

2015-09-22 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903591#comment-14903591 ] James Clampffer commented on HDFS-9108: --- I agree about the stack still being valid in the current

[jira] [Updated] (HDFS-9108) Pointer to read buffer isn't being passed to recvmsg syscall

2015-09-21 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9108: -- Summary: Pointer to read buffer isn't being passed to recvmsg syscall (was: Pointer to read

[jira] [Updated] (HDFS-9108) Pointer to read buffer isn't being passed to recvmsg syscall

2015-09-21 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9108: -- Attachment: 9108-async-repro.patch1 Attached a reproducer with a temporary bandaid fix for the

[jira] [Commented] (HDFS-9095) RPC client should fail gracefully when the connection is timed out or reset

2015-09-21 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901293#comment-14901293 ] James Clampffer commented on HDFS-9095: --- Agree with bob about making the CMakeLists as robust as

[jira] [Updated] (HDFS-9108) Pointer to read buffer isn't being passed to recvmsg syscall

2015-09-21 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9108: -- Priority: Blocker (was: Major) > Pointer to read buffer isn't being passed to recvmsg syscall >

[jira] [Commented] (HDFS-9103) Retry reads on DN failure

2015-09-21 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901213#comment-14901213 ] James Clampffer commented on HDFS-9103: --- I agree with Bob that the C++ API should be reasonably

[jira] [Commented] (HDFS-9116) Suppress false positives from Valgrind on uninitialized variables in tests

2015-09-21 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14901201#comment-14901201 ] James Clampffer commented on HDFS-9116: --- +1 > Suppress false positives from Valgrind on

[jira] [Updated] (HDFS-9108) Pointer to read buffer isn't being passed to kernel

2015-09-20 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9108: -- Attachment: 9108-async-repro.patch Simple reproducer using async api. If using gcc you'll

[jira] [Created] (HDFS-9108) Pointer to read buffer isn't being passed to kernel

2015-09-18 Thread James Clampffer (JIRA)
James Clampffer created HDFS-9108: - Summary: Pointer to read buffer isn't being passed to kernel Key: HDFS-9108 URL: https://issues.apache.org/jira/browse/HDFS-9108 Project: Hadoop HDFS

[jira] [Work started] (HDFS-8766) Implement a libhdfs(3) compatible API

2015-09-18 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-8766 started by James Clampffer. - > Implement a libhdfs(3) compatible API > -

[jira] [Updated] (HDFS-9108) Pointer to read buffer isn't being passed to kernel

2015-09-18 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9108: -- Description: Somewhere between InputStream->PositionRead and the asio code the pointer to the

[jira] [Work started] (HDFS-9108) Pointer to read buffer isn't being passed to kernel

2015-09-18 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-9108 started by James Clampffer. - > Pointer to read buffer isn't being passed to kernel >

[jira] [Commented] (HDFS-9062) Add a parameter to MiniDFSCluster to turn off security checks on the domain socked path

2015-09-11 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741286#comment-14741286 ] James Clampffer commented on HDFS-9062: --- Hi Chris, Thanks for the suggestions and usage examples.

[jira] [Commented] (HDFS-9062) Add a parameter to MiniDFSCluster to turn off security checks on the domain socked path

2015-09-11 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14741481#comment-14741481 ] James Clampffer commented on HDFS-9062: --- That's correct. Glad it sounds like a reasonable change. >

[jira] [Created] (HDFS-9062) Add a parameter to MiniDFSCluster to turn off security checks on the domain socked path

2015-09-11 Thread James Clampffer (JIRA)
James Clampffer created HDFS-9062: - Summary: Add a parameter to MiniDFSCluster to turn off security checks on the domain socked path Key: HDFS-9062 URL: https://issues.apache.org/jira/browse/HDFS-9062

[jira] [Commented] (HDFS-9025) Fix compilation issues on arch linux

2015-09-10 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739964#comment-14739964 ] James Clampffer commented on HDFS-9025: --- +1 > Fix compilation issues on arch linux >

<    4   5   6   7   8   9   10   >