[
https://issues.apache.org/jira/browse/BEAM-12418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17352883#comment-17352883
]
Brian Hulette commented on BEAM-12418:
--------------------------------------
If/when this is completed we should compare the performance of the example
DataFrame API pipelines on Dataflow (run in Python PostCommits). It would be
interesting to see what sort of impact this has.
> Add support for out-of-band pickling (pickle 5) in PickleCoder
> --------------------------------------------------------------
>
> Key: BEAM-12418
> URL: https://issues.apache.org/jira/browse/BEAM-12418
> Project: Beam
> Issue Type: Improvement
> Components: sdk-py-core
> Reporter: Brian Hulette
> Priority: P2
>
> dev@ discussion:
> https://lists.apache.org/thread.html/r266f37640901544927205b913d4903340d6c59c3d94905e5dda0db42%40%3Cdev.beam.apache.org%3E
> PickleCoder should support out-of-band pickling to avoid unnecessary memory
> copies for types that support it (including numpy and pandas types).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
