[
https://issues.apache.org/jira/browse/BEAM-3301?focusedWorklogId=402558&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-402558
]
ASF GitHub Bot logged work on BEAM-3301:
----------------------------------------
Author: ASF GitHub Bot
Created on: 12/Mar/20 23:44
Start Date: 12/Mar/20 23:44
Worklog Time Spent: 10m
Work Description: youngoli commented on issue #10991: [BEAM-3301]
Refactor DoFn validation & allow specifying main inputs.
URL: https://github.com/apache/beam/pull/10991#issuecomment-598480073
I think doing this validation in the ParDo transform is something worth
looking into, and I'd be up for it if it worked as well as you describe. I'm
definitely not a fan of having to do validation without any info about the
actual output/input involved. I've even entertained the idea of doing something
similar, but it would be a decently large refactor (2-3 days?) and has the
chance of hitting additional roadblocks, so I haven't really made time to look
into it yet. Definitely something worth taking a day or two to look into after
SDF is done.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 402558)
Time Spent: 4h 40m (was: 4.5h)
> Go SplittableDoFn support
> -------------------------
>
> Key: BEAM-3301
> URL: https://issues.apache.org/jira/browse/BEAM-3301
> Project: Beam
> Issue Type: Improvement
> Components: sdk-go
> Reporter: Henning Rohde
> Assignee: Daniel Oliveira
> Priority: Major
> Time Spent: 4h 40m
> Remaining Estimate: 0h
>
> SDFs will be the only way to add streaming and liquid sharded IO for Go.
> Design doc: https://s.apache.org/splittable-do-fn
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
