[
https://issues.apache.org/jira/browse/BEAM-11064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17214125#comment-17214125
]
Brian Hulette commented on BEAM-11064:
--------------------------------------
CC: [~robertwb]
I'm thinking we should have typehints for pandas and pyarrow parameterized by
field types. Then we could add infrastructure for automatically converting
between compatible schema-aware types, including batching/unbatching if
necessary.
Users could also have the option of adding a transform like BatchElements if
they need control over batching parameters.
> Consider adding a pandas typehint
> ---------------------------------
>
> Key: BEAM-11064
> URL: https://issues.apache.org/jira/browse/BEAM-11064
> Project: Beam
> Issue Type: Improvement
> Components: sdk-py-core
> Reporter: Brian Hulette
> Assignee: Brian Hulette
> Priority: P2
>
> The typehint should be parameterized by a proxy object. This way we could
> retrieve the proxy for use in {{to_dataframe}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
