[jira] [Resolved] (ARROW-3399) [Python] Cannot serialize numpy matrix object

2019-04-16 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara resolved ARROW-3399. - Resolution: Fixed Issue resolved by pull request 4096

[jira] [Created] (ARROW-5099) Compiling Plasma TensorFlow op has Python 2 bug.

2019-04-03 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-5099: --- Summary: Compiling Plasma TensorFlow op has Python 2 bug. Key: ARROW-5099 URL: https://issues.apache.org/jira/browse/ARROW-5099 Project: Apache Arrow

[jira] [Commented] (ARROW-3399) [Python] Cannot serialize numpy matrix object

2019-04-01 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16807314#comment-16807314 ] Robert Nishihara commented on ARROW-3399: - Hi Mitar, can you submit your change as a PR? I

[jira] [Resolved] (ARROW-4983) [Plasma] Unmap memory when the client is destroyed

2019-03-21 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara resolved ARROW-4983. - Resolution: Fixed Fix Version/s: 0.13.0 Issue resolved by pull request 4001

[jira] [Resolved] (ARROW-4690) [Python] Building TensorFlow compatible wheels for Arrow

2019-02-28 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara resolved ARROW-4690. - Resolution: Fixed Issue resolved by pull request 3766

[jira] [Commented] (ARROW-1628) [Python] Incorrect serialization of numpy datetimes.

2019-02-05 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16761477#comment-16761477 ] Robert Nishihara commented on ARROW-1628: - [~wesmckinn] It'd still be good to fix, so I think we

[jira] [Resolved] (ARROW-4475) [Python] Serializing objects that contain themselves

2019-02-04 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara resolved ARROW-4475. - Resolution: Fixed Fix Version/s: 0.13.0 Issue resolved by pull request 3556

[jira] [Commented] (ARROW-4418) [Plasma] replace event loop with boost::asio for plasma store

2019-02-04 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16760130#comment-16760130 ] Robert Nishihara commented on ARROW-4418: - [~zhijunfu] [~suquark] note that we will need to

[jira] [Commented] (ARROW-4418) [Plasma] replace event loop with boost::asio for plasma store

2019-01-30 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16756791#comment-16756791 ] Robert Nishihara commented on ARROW-4418: - [~zhijunfu], I'd suggest doing a straightforward

[jira] [Commented] (ARROW-4418) [Plasma] replace event loop with boost::asio for plasma store

2019-01-29 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16755381#comment-16755381 ] Robert Nishihara commented on ARROW-4418: - If preferable, there is also a non-boost version of

[jira] [Created] (ARROW-4379) Register pyarrow serializers for collections.Counter and collections.deque.

2019-01-25 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-4379: --- Summary: Register pyarrow serializers for collections.Counter and collections.deque. Key: ARROW-4379 URL: https://issues.apache.org/jira/browse/ARROW-4379

[jira] [Assigned] (ARROW-4269) [Python] AttributeError: module 'pandas.core' has no attribute 'arrays'

2019-01-15 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara reassigned ARROW-4269: --- Assignee: Philipp Moritz > [Python] AttributeError: module 'pandas.core' has no

[jira] [Resolved] (ARROW-4269) [Python] AttributeError: module 'pandas.core' has no attribute 'arrays'

2019-01-15 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara resolved ARROW-4269. - Resolution: Fixed Fix Version/s: 0.12.0 Issue resolved by pull request 3410

[jira] [Resolved] (ARROW-4249) [Plasma] Remove reference to logging.h from plasma/common.h

2019-01-13 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara resolved ARROW-4249. - Resolution: Fixed Fix Version/s: (was: 0.13.0) 0.12.0

[jira] [Commented] (ARROW-4217) [Plasma] Remove custom object metadata

2019-01-09 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16738761#comment-16738761 ] Robert Nishihara commented on ARROW-4217: - We've started using the metadata to specify the object

[jira] [Resolved] (ARROW-3958) [Plasma] Reduce number of IPCs

2018-12-13 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara resolved ARROW-3958. - Resolution: Fixed Issue resolved by pull request 3124

[jira] [Created] (ARROW-3920) Plasma reference counting not properly done in TensorFlow custom operator.

2018-11-30 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-3920: --- Summary: Plasma reference counting not properly done in TensorFlow custom operator. Key: ARROW-3920 URL: https://issues.apache.org/jira/browse/ARROW-3920

[jira] [Resolved] (ARROW-3607) [Java] delete() method via JNI for plasma

2018-11-23 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara resolved ARROW-3607. - Resolution: Fixed Fix Version/s: 0.12.0 Issue resolved by pull request 2829

[jira] [Resolved] (ARROW-3648) [Plasma] Add API to get metadata and data at the same time

2018-11-03 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara resolved ARROW-3648. - Resolution: Fixed Fix Version/s: 0.12.0 Issue resolved by pull request 2862

[jira] [Resolved] (ARROW-3555) [Plasma] Unify plasma client get function using metadata.

2018-10-29 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara resolved ARROW-3555. - Resolution: Fixed Fix Version/s: 0.12.0 Issue resolved by pull request 2788

[jira] [Created] (ARROW-3611) Give error more quickly when pyarrow serialization context is used incorrectly.

2018-10-24 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-3611: --- Summary: Give error more quickly when pyarrow serialization context is used incorrectly. Key: ARROW-3611 URL: https://issues.apache.org/jira/browse/ARROW-3611

[jira] [Created] (ARROW-3605) Remove AE library from plasma header files.

2018-10-24 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-3605: --- Summary: Remove AE library from plasma header files. Key: ARROW-3605 URL: https://issues.apache.org/jira/browse/ARROW-3605 Project: Apache Arrow Issue

[jira] [Created] (ARROW-3574) Fix remaining bug with plasma static versus shared libraries.

2018-10-20 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-3574: --- Summary: Fix remaining bug with plasma static versus shared libraries. Key: ARROW-3574 URL: https://issues.apache.org/jira/browse/ARROW-3574 Project: Apache

[jira] [Created] (ARROW-3559) Statically link libraries for plasma_store_server executable.

2018-10-18 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-3559: --- Summary: Statically link libraries for plasma_store_server executable. Key: ARROW-3559 URL: https://issues.apache.org/jira/browse/ARROW-3559 Project: Apache

[jira] [Created] (ARROW-3558) Remove fatal error when plasma client calls get on an unsealed object that it created.

2018-10-18 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-3558: --- Summary: Remove fatal error when plasma client calls get on an unsealed object that it created. Key: ARROW-3558 URL: https://issues.apache.org/jira/browse/ARROW-3558

[jira] [Updated] (ARROW-3548) Speed up storing small objects in the object store.

2018-10-17 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara updated ARROW-3548: Issue Type: Improvement (was: Bug) > Speed up storing small objects in the object store.

[jira] [Updated] (ARROW-2363) [Plasma] Have an automatic object-releasing Create() variant

2018-10-17 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara updated ARROW-2363: Affects Version/s: (was: 0.8.0) > [Plasma] Have an automatic object-releasing Create()

[jira] [Created] (ARROW-3548) Speed up storing small objects in the object store.

2018-10-17 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-3548: --- Summary: Speed up storing small objects in the object store. Key: ARROW-3548 URL: https://issues.apache.org/jira/browse/ARROW-3548 Project: Apache Arrow

[jira] [Created] (ARROW-3454) Tab complete doesn't work for plasma client.

2018-10-06 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-3454: --- Summary: Tab complete doesn't work for plasma client. Key: ARROW-3454 URL: https://issues.apache.org/jira/browse/ARROW-3454 Project: Apache Arrow

[jira] [Created] (ARROW-3373) Fix bug in which plasma store can die when client gets multiple objects and object becomes available.

2018-09-30 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-3373: --- Summary: Fix bug in which plasma store can die when client gets multiple objects and object becomes available. Key: ARROW-3373 URL:

[jira] [Resolved] (ARROW-3348) Plasma store dies when an object that a dead client is waiting for gets created.

2018-09-29 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara resolved ARROW-3348. - Resolution: Fixed Fix Version/s: 0.11.0 Issue resolved by pull request 2650

[jira] [Created] (ARROW-3348) Plasma store dies when an object that a dead client is waiting for gets created.

2018-09-27 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-3348: --- Summary: Plasma store dies when an object that a dead client is waiting for gets created. Key: ARROW-3348 URL: https://issues.apache.org/jira/browse/ARROW-3348

[jira] [Resolved] (ARROW-2975) [Plasma] TensorFlow op: Compilation only working if arrow found by pkg-config

2018-08-08 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara resolved ARROW-2975. - Resolution: Fixed Fix Version/s: JS-0.4.0 Issue resolved by pull request 2368

[jira] [Commented] (ARROW-3012) Installation crashes on Python 3.7

2018-08-07 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16572121#comment-16572121 ] Robert Nishihara commented on ARROW-3012: - I've seen this issue as well even without Python 3.7.

[jira] [Commented] (ARROW-2956) [Python]Arrow plasma throws ArrowIOError and process crashed

2018-08-02 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566448#comment-16566448 ] Robert Nishihara commented on ARROW-2956: - I'm not sure we support memory sizes this small.

[jira] [Assigned] (ARROW-2953) [Plasma] Store memory usage

2018-08-01 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara reassigned ARROW-2953: --- Assignee: Philipp Moritz > [Plasma] Store memory usage >

[jira] [Resolved] (ARROW-2953) [Plasma] Store memory usage

2018-08-01 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara resolved ARROW-2953. - Resolution: Fixed Fix Version/s: JS-0.4.0 Issue resolved by pull request 2359

[jira] [Resolved] (ARROW-2940) [Python] Import error with pytorch 0.3

2018-07-30 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara resolved ARROW-2940. - Resolution: Fixed Fix Version/s: JS-0.4.0 Issue resolved by pull request 2342

[jira] [Commented] (ARROW-2920) [Python] Segfault with pytorch 0.4

2018-07-26 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16559017#comment-16559017 ] Robert Nishihara commented on ARROW-2920: - Does the problem only occur when TensorFlow is *not*

[jira] [Commented] (ARROW-2916) [C++] Plasma Seal is slow due to hashing

2018-07-25 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16556353#comment-16556353 ] Robert Nishihara commented on ARROW-2916: - In my experience, profilers often show the hashing

[jira] [Resolved] (ARROW-1744) [Plasma] Provide TensorFlow operator to read tensors from plasma

2018-07-17 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara resolved ARROW-1744. - Resolution: Fixed Fix Version/s: (was: 0.11.0) JS-0.4.0

[jira] [Resolved] (ARROW-2805) [Python] TensorFlow import workaround not working with tensorflow-gpu if CUDA is not installed

2018-07-06 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara resolved ARROW-2805. - Resolution: Fixed Fix Version/s: JS-0.4.0 Issue resolved by pull request 2224

[jira] [Commented] (ARROW-2657) Segfault when importing TensorFlow after Pyarrow

2018-05-31 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497286#comment-16497286 ] Robert Nishihara commented on ARROW-2657: - Note that the issue does not appear when building

[jira] [Updated] (ARROW-2657) Segfault when importing TensorFlow after Pyarrow

2018-05-31 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara updated ARROW-2657: Description: The following will segfault when pyarrow wheels are built using the

[jira] [Updated] (ARROW-2657) Segfault when importing TensorFlow after Pyarrow

2018-05-31 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara updated ARROW-2657: Description: The following will segfault when pyarrow wheels are built using the

[jira] [Updated] (ARROW-2657) Segfault when importing TensorFlow after Pyarrow

2018-05-31 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara updated ARROW-2657: Docs Text: (was: The following will segfault when pyarrow wheels are built using the

[jira] [Created] (ARROW-2657) Segfault when importing TensorFlow after Pyarrow

2018-05-31 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-2657: --- Summary: Segfault when importing TensorFlow after Pyarrow Key: ARROW-2657 URL: https://issues.apache.org/jira/browse/ARROW-2657 Project: Apache Arrow

[jira] [Commented] (ARROW-2641) [C++] Investigate spurious memset() calls

2018-05-28 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16492909#comment-16492909 ] Robert Nishihara commented on ARROW-2641: - Most likely unrelated, but we memset some unused

[jira] [Commented] (ARROW-2578) [Plasma] Valgrind errors related to std::random_device

2018-05-13 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16473737#comment-16473737 ] Robert Nishihara commented on ARROW-2578: - This is suspiciously similar to

[jira] [Commented] (ARROW-2506) [Plasma] Build error on macOS

2018-04-24 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16450461#comment-16450461 ] Robert Nishihara commented on ARROW-2506: - I think it makes sense to just remove the {{= 1}}. >

[jira] [Resolved] (ARROW-2264) [Python] Efficiently serialize numpy arrays with dtype of unicode fixed length string

2018-04-21 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara resolved ARROW-2264. - Resolution: Fixed > [Python] Efficiently serialize numpy arrays with dtype of unicode

[jira] [Assigned] (ARROW-2264) [Python] Efficiently serialize numpy arrays with dtype of unicode fixed length string

2018-04-21 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara reassigned ARROW-2264: --- Assignee: Robert Nishihara > [Python] Efficiently serialize numpy arrays with dtype

[jira] [Commented] (ARROW-2264) [Python] Efficiently serialize numpy arrays with dtype of unicode fixed length string

2018-04-21 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16447038#comment-16447038 ] Robert Nishihara commented on ARROW-2264: - Fixed by https://github.com/apache/arrow/pull/1887. >

[jira] [Commented] (ARROW-2489) [Plasma] test_plasma.py crashes

2018-04-21 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16446988#comment-16446988 ] Robert Nishihara commented on ARROW-2489: - Ok, that makes sense. > [Plasma] test_plasma.py

[jira] [Commented] (ARROW-2489) [Plasma] test_plasma.py crashes

2018-04-21 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16446980#comment-16446980 ] Robert Nishihara commented on ARROW-2489: - Oh wow, nice job tracking that down. I'm all for the

[jira] [Resolved] (ARROW-2458) [Plasma] PlasmaClient uses global variable

2018-04-19 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara resolved ARROW-2458. - Resolution: Fixed Fix Version/s: JS-0.4.0 Issue resolved by pull request 1893

[jira] [Updated] (ARROW-2469) Make out arguments last in ReadMessage API.

2018-04-18 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara updated ARROW-2469: Component/s: C++ > Make out arguments last in ReadMessage API. >

[jira] [Created] (ARROW-2469) Make out arguments last in ReadMessage API.

2018-04-18 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-2469: --- Summary: Make out arguments last in ReadMessage API. Key: ARROW-2469 URL: https://issues.apache.org/jira/browse/ARROW-2469 Project: Apache Arrow Issue

[jira] [Resolved] (ARROW-2397) Document changes in Tensor encoding in IPC.md.

2018-04-14 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara resolved ARROW-2397. - Resolution: Fixed Fix Version/s: JS-0.4.0 Issue resolved by pull request 1837

[jira] [Comment Edited] (ARROW-2448) Segfault when plasma client goes out of scope before buffer.

2018-04-12 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16436675#comment-16436675 ] Robert Nishihara edited comment on ARROW-2448 at 4/13/18 1:55 AM: -- We may

[jira] [Commented] (ARROW-2448) Segfault when plasma client goes out of scope before buffer.

2018-04-12 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16436675#comment-16436675 ] Robert Nishihara commented on ARROW-2448: - We may need to wrap the {{PlasmaClient}} in a wrapper

[jira] [Resolved] (ARROW-2437) [C++] Change of arrow::ipc::ReadMessage signature breaks ABI compability

2018-04-12 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara resolved ARROW-2437. - Resolution: Fixed Fix Version/s: (was: 0.9.1) JS-0.4.0

[jira] [Assigned] (ARROW-2437) [C++] Change of arrow::ipc::ReadMessage signature breaks ABI compability

2018-04-12 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara reassigned ARROW-2437: --- Assignee: Robert Nishihara > [C++] Change of arrow::ipc::ReadMessage signature

[jira] [Resolved] (ARROW-2451) Handle more dtypes efficiently in custom numpy array serializer.

2018-04-12 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara resolved ARROW-2451. - Resolution: Fixed Fix Version/s: JS-0.4.0 Issue resolved by pull request 1887

[jira] [Assigned] (ARROW-2451) Handle more dtypes efficiently in custom numpy array serializer.

2018-04-12 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara reassigned ARROW-2451: --- Assignee: Robert Nishihara > Handle more dtypes efficiently in custom numpy array

[jira] [Created] (ARROW-2451) Handle more dtypes efficiently in custom numpy array serializer.

2018-04-12 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-2451: --- Summary: Handle more dtypes efficiently in custom numpy array serializer. Key: ARROW-2451 URL: https://issues.apache.org/jira/browse/ARROW-2451 Project: Apache

[jira] [Created] (ARROW-2448) Segfault when plasma client goes out of scope before buffer.

2018-04-11 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-2448: --- Summary: Segfault when plasma client goes out of scope before buffer. Key: ARROW-2448 URL: https://issues.apache.org/jira/browse/ARROW-2448 Project: Apache

[jira] [Created] (ARROW-2397) Document changes in Tensor encoding in IPC.md.

2018-04-04 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-2397: --- Summary: Document changes in Tensor encoding in IPC.md. Key: ARROW-2397 URL: https://issues.apache.org/jira/browse/ARROW-2397 Project: Apache Arrow

[jira] [Commented] (ARROW-2308) Serialized tensor data should be 64-byte aligned.

2018-03-14 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398143#comment-16398143 ] Robert Nishihara commented on ARROW-2308: - It's probably worth discussing what the best way to do

[jira] [Comment Edited] (ARROW-2308) Serialized tensor data should be 64-byte aligned.

2018-03-14 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398143#comment-16398143 ] Robert Nishihara edited comment on ARROW-2308 at 3/14/18 6:27 AM: -- It's

[jira] [Created] (ARROW-2308) Serialized tensor data should be 64-byte aligned.

2018-03-13 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-2308: --- Summary: Serialized tensor data should be 64-byte aligned. Key: ARROW-2308 URL: https://issues.apache.org/jira/browse/ARROW-2308 Project: Apache Arrow

[jira] [Created] (ARROW-2265) Serializing subclasses of np.ndarray returns a np.ndarray.

2018-03-05 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-2265: --- Summary: Serializing subclasses of np.ndarray returns a np.ndarray. Key: ARROW-2265 URL: https://issues.apache.org/jira/browse/ARROW-2265 Project: Apache Arrow

[jira] [Commented] (ARROW-2237) [Python] Huge tables test failure

2018-03-01 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382868#comment-16382868 ] Robert Nishihara commented on ARROW-2237: - Interesting, does {{/mnt/hugepages}} exist locally? If

[jira] [Resolved] (ARROW-2215) [Plasma] Error when using huge pages

2018-02-28 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara resolved ARROW-2215. - Resolution: Fixed Fix Version/s: JS-0.4.0 Issue resolved by pull request 1660

[jira] [Assigned] (ARROW-2215) [Plasma] Error when using huge pages

2018-02-28 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara reassigned ARROW-2215: --- Assignee: Philipp Moritz > [Plasma] Error when using huge pages >

[jira] [Commented] (ARROW-2193) [Plasma] plasma_store forks endlessly

2018-02-21 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371973#comment-16371973 ] Robert Nishihara commented on ARROW-2193: - Do you know that {{fork}} is being called? Another way

[jira] [Commented] (ARROW-2138) [C++] Have FatalLog abort instead of exiting

2018-02-12 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361134#comment-16361134 ] Robert Nishihara commented on ARROW-2138: - We did this in Ray a while back (to generate core

[jira] [Updated] (ARROW-2122) Pyarrow fails to serialize dataframe with timestamp.

2018-02-08 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara updated ARROW-2122: Description: The bug can be reproduced as follows. {code:java} import pyarrow as pa import

[jira] [Created] (ARROW-2122) Pyarrow fails to serialize dataframe with timestamp.

2018-02-08 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-2122: --- Summary: Pyarrow fails to serialize dataframe with timestamp. Key: ARROW-2122 URL: https://issues.apache.org/jira/browse/ARROW-2122 Project: Apache Arrow

[jira] [Created] (ARROW-2121) Consider special casing object arrays in pandas serializers.

2018-02-08 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-2121: --- Summary: Consider special casing object arrays in pandas serializers. Key: ARROW-2121 URL: https://issues.apache.org/jira/browse/ARROW-2121 Project: Apache

[jira] [Created] (ARROW-2065) Fix bug in SerializationContext.clone().

2018-01-30 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-2065: --- Summary: Fix bug in SerializationContext.clone(). Key: ARROW-2065 URL: https://issues.apache.org/jira/browse/ARROW-2065 Project: Apache Arrow Issue

[jira] [Commented] (ARROW-2045) More primitive operations on plasma store

2018-01-27 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16342457#comment-16342457 ] Robert Nishihara commented on ARROW-2045: - That makes sense. So if I understand correctly, the

[jira] [Commented] (ARROW-1880) [Python] Plasma test flakiness in Travis CI

2018-01-25 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16340472#comment-16340472 ] Robert Nishihara commented on ARROW-1880: - Thanks, please point it out if you do see it. >

[jira] [Created] (ARROW-2024) Remove global SerializationContext variables.

2018-01-23 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-2024: --- Summary: Remove global SerializationContext variables. Key: ARROW-2024 URL: https://issues.apache.org/jira/browse/ARROW-2024 Project: Apache Arrow

[jira] [Comment Edited] (ARROW-2016) [Python] Fix up ASV benchmarking setup and document procedure for use

2018-01-21 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333689#comment-16333689 ] Robert Nishihara edited comment on ARROW-2016 at 1/21/18 9:24 PM: -- Are

[jira] [Commented] (ARROW-2016) [Python] Fix up ASV benchmarking setup and document procedure for use

2018-01-21 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333689#comment-16333689 ] Robert Nishihara commented on ARROW-2016: - Are all of the benchmarks in

[jira] [Created] (ARROW-2011) Allow setting the pickler to use in pyarrow serialization.

2018-01-18 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-2011: --- Summary: Allow setting the pickler to use in pyarrow serialization. Key: ARROW-2011 URL: https://issues.apache.org/jira/browse/ARROW-2011 Project: Apache Arrow

[jira] [Created] (ARROW-2000) Deduplicate file descriptors when plasma store replies to get request.

2018-01-15 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-2000: --- Summary: Deduplicate file descriptors when plasma store replies to get request. Key: ARROW-2000 URL: https://issues.apache.org/jira/browse/ARROW-2000 Project:

[jira] [Commented] (ARROW-1972) Deserialization of buffer objects (and pandas dataframes) segfaults on different processes.

2018-01-06 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314927#comment-16314927 ] Robert Nishihara commented on ARROW-1972: - Note that I encountered this first when using pandas

[jira] [Created] (ARROW-1972) Deserialization of buffer objects (and pandas dataframes) segfaults on different processes.

2018-01-06 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-1972: --- Summary: Deserialization of buffer objects (and pandas dataframes) segfaults on different processes. Key: ARROW-1972 URL: https://issues.apache.org/jira/browse/ARROW-1972

[jira] [Updated] (ARROW-1972) Deserialization of buffer objects (and pandas dataframes) segfaults on different processes.

2018-01-06 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Nishihara updated ARROW-1972: Description: To see the issue, first serialize a pyarrow buffer. {code} import pyarrow as

[jira] [Commented] (ARROW-1880) [Python] Plasma test flakiness in Travis CI

2017-12-05 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279234#comment-16279234 ] Robert Nishihara commented on ARROW-1880: - Thanks for filing the issue, I hope to get to this over

[jira] [Commented] (ARROW-1854) [Python] Improve performance of serializing object dtype ndarrays

2017-11-25 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265919#comment-16265919 ] Robert Nishihara commented on ARROW-1854: - We may run into problems when the numpy array can't be

[jira] [Commented] (ARROW-1854) [Python] Improve performance of serializing object dtype ndarrays

2017-11-25 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265914#comment-16265914 ] Robert Nishihara commented on ARROW-1854: - That would certainly work. It wouldn't give us any of

[jira] [Comment Edited] (ARROW-1854) [Python] Improve performance of serializing object dtype ndarrays

2017-11-24 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265525#comment-16265525 ] Robert Nishihara edited comment on ARROW-1854 at 11/24/17 8:43 PM: --- Your

[jira] [Comment Edited] (ARROW-1854) [Python] Improve performance of serializing object dtype ndarrays

2017-11-24 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265525#comment-16265525 ] Robert Nishihara edited comment on ARROW-1854 at 11/24/17 8:42 PM: --- Your

[jira] [Commented] (ARROW-1854) [Python] Improve performance of serializing object dtype ndarrays

2017-11-24 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16265525#comment-16265525 ] Robert Nishihara commented on ARROW-1854: - Your numbers are much better than what I'm seeing. It

[jira] [Created] (ARROW-1829) [Plasma] Clean up eviction policy bookkeeping

2017-11-16 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-1829: --- Summary: [Plasma] Clean up eviction policy bookkeeping Key: ARROW-1829 URL: https://issues.apache.org/jira/browse/ARROW-1829 Project: Apache Arrow

[jira] [Commented] (ARROW-1792) [Plasma C++] continuous write tensor failed

2017-11-14 Thread Robert Nishihara (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252940#comment-16252940 ] Robert Nishihara commented on ARROW-1792: - One natural way to express this, would be the

[jira] [Created] (ARROW-1745) Compilation failure on Mac OS in plasma tests

2017-10-28 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-1745: --- Summary: Compilation failure on Mac OS in plasma tests Key: ARROW-1745 URL: https://issues.apache.org/jira/browse/ARROW-1745 Project: Apache Arrow

  1   2   >