[
https://issues.apache.org/jira/browse/BEAM-10814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17194568#comment-17194568
]
Brian Hulette commented on BEAM-10814:
--------------------------------------
CC: [~robertwb]
When I proposed this I forgot that DataframeTransform can have multiple inputs
and multiple outputs. We could still do something similar: if all inputs are
DataFrames, yield DataFrames, if all inputs are elements yield elements.
The question is what to do when inputs are mixed (some elements, some
DataFrames). I'm inclined to either:
- Keep it simple and do no conversion, just produce DataFrames. The user can
manually convert to elements if they want.
- Throw an error and require the user to tell us what they want to do.
> DataframeTransform: when input is element-wise produce element-wise output
> --------------------------------------------------------------------------
>
> Key: BEAM-10814
> URL: https://issues.apache.org/jira/browse/BEAM-10814
> Project: Beam
> Issue Type: Improvement
> Components: sdk-py-core
> Reporter: Brian Hulette
> Assignee: Brian Hulette
> Priority: P2
> Fix For: 2.25.0
>
>
> If input is DataFrame yield DataFrames, if it's elements yield elements.
> We should also provide a way to override the default
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
