[
https://issues.apache.org/jira/browse/ARROW-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16387094#comment-16387094
]
Wes McKinney commented on ARROW-1391:
-------------------------------------
See some recent work on this
https://github.com/apache/arrow/commit/0ada87531dca52d51d4f60d3148a9ba733d96a48.
> [Python] Benchmarks for python serialization
> --------------------------------------------
>
> Key: ARROW-1391
> URL: https://issues.apache.org/jira/browse/ARROW-1391
> Project: Apache Arrow
> Issue Type: Wish
> Reporter: Philipp Moritz
> Priority: Minor
>
> It would be great to have a suite of relevant benchmarks for the Python
> serialization code in ARROW-759. These could be used to guide profiling and
> performance improvements.
> Relevant use cases include:
> - dictionaries of large numpy arrays that are used to represent weights of a
> neural network
> - long lists of primitive types like ints, floats or strings
> - lists of user defined python objects
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
