[
https://issues.apache.org/jira/browse/ARROW-1689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16214101#comment-16214101
]
ASF GitHub Bot commented on ARROW-1689:
---------------------------------------
GitHub user njwhite opened a pull request:
https://github.com/apache/arrow/pull/1233
ARROW-1689 Allow User To Request No Data Copies
This makes performance debugging much easier, as it allows you to track
down what (Arrow) data is causing unexpected delays in loading. It also makes
testing features like ARROW-1689 easier as you can prove (via unit tests) that
copies are not being made.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/njwhite/arrow feature/zerocopycategories
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/arrow/pull/1233.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1233
----
commit f0384f0969550401df59be26a7f146b9af9e0920
Author: Nick White <[email protected]>
Date: 2017-10-21T20:51:36Z
ARROW-1689 Allow User To Request No Data Copies
This makes performance debugging much easier, as it
allows you to track down what (arrow) data is causing
unexpected delays in loading.
----
> [Python] Categorical Indices Should Be Zero-Copy
> ------------------------------------------------
>
> Key: ARROW-1689
> URL: https://issues.apache.org/jira/browse/ARROW-1689
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Python
> Affects Versions: 0.7.1
> Reporter: Nick White
> Labels: pull-request-available
>
> It seems like
> [WriteIndices|https://github.com/apache/arrow/blob/0c8b861f93884f2868eb631d8fceee3a8b8905ec/cpp/src/arrow/python/arrow_to_pandas.cc#L955-L981]
> could reuse some of the logic in
> [ConvertValuesZeroCopy|https://github.com/apache/arrow/blob/0c8b861f93884f2868eb631d8fceee3a8b8905ec/cpp/src/arrow/python/arrow_to_pandas.cc#L1348-L1385]
> to avoid copying the integer indices array?
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
