[
https://issues.apache.org/jira/browse/BEAM-4076?focusedWorklogId=127667&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-127667
]
ASF GitHub Bot logged work on BEAM-4076:
----------------------------------------
Author: ASF GitHub Bot
Created on: 26/Jul/18 06:15
Start Date: 26/Jul/18 06:15
Worklog Time Spent: 10m
Work Description: reuvenlax opened a new pull request #6072: [BEAM-4076]
Fix schemas on Dataflow and FnApi
URL: https://github.com/apache/beam/pull/6072
Two issues:
1. For Dataflow, the problem is that the Dataflow replacement for
ParDo.Single incorrectly broke the correspondence between mainOutputTupleTag
and the actual outputs. It generated a new PCollection, which by default
generates a new TupleTag, and no longer matched the output TupleTag. Fix this
by making sure that the new PCollection has the same tag.
2. For FnApiRunner, the problem is that input/output coders might be
WindowedValueCoders, preventing us from recognizing a SchemaCoder. Detect this
case and extract the value coder.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 127667)
Time Spent: 16h (was: 15h 50m)
> Schema followups
> ----------------
>
> Key: BEAM-4076
> URL: https://issues.apache.org/jira/browse/BEAM-4076
> Project: Beam
> Issue Type: Improvement
> Components: beam-model, dsl-sql, sdk-java-core
> Reporter: Kenneth Knowles
> Priority: Major
> Time Spent: 16h
> Remaining Estimate: 0h
>
> This umbrella bug contains subtasks with followups for Beam schemas, which
> were moved from SQL to the core Java SDK and made to be type-name-based
> rather than coder based.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
