[
https://issues.apache.org/jira/browse/BEAM-12795?focusedWorklogId=641349&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-641349
]
ASF GitHub Bot logged work on BEAM-12795:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 24/Aug/21 21:34
Start Date: 24/Aug/21 21:34
Worklog Time Spent: 10m
Work Description: reuvenlax opened a new pull request #15382:
URL: https://github.com/apache/beam/pull/15382
In order to implement BEAM-12795, we need to add non-trivial expansion to
ParDo.MultiOuput. This cannot be done today since runners treat MultiOutput as
a primitive and replace it wholesale. In this PR we create a new
ParDo.MultiOutputPrimitive and update runners to replace that instead.
All runners in the Beam codebase have been updated. Any runners outside the
Beam codebase will need to start replacing MultiOutputPrimitive before updating
to the next Beam release.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 641349)
Time Spent: 20m (was: 10m)
> KVs should not be needed when using schemas
> -------------------------------------------
>
> Key: BEAM-12795
> URL: https://issues.apache.org/jira/browse/BEAM-12795
> Project: Beam
> Issue Type: New Feature
> Components: sdk-java-core
> Reporter: Reuven Lax
> Priority: P2
> Time Spent: 20m
> Remaining Estimate: 0h
>
> When using schemas there should be no need to require a KV, as any. key or
> keys can be act as the K or a V in a KV. Users can use schemas without the
> need for KV in all cases except for state/timers DoFns, which today require
> that the input have type KV. We would like to eliminate this requirement.
> Users should be able to specify a key field extraction in their ParDo, e.g.
> ParDo.of(...).withKeyFields("user.location.city"));
> Or in the DoFn itself.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
