[ https://issues.apache.org/jira/browse/BEAM-3301?focusedWorklogId=402558&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-402558 ]
ASF GitHub Bot logged work on BEAM-3301: ---------------------------------------- Author: ASF GitHub Bot Created on: 12/Mar/20 23:44 Start Date: 12/Mar/20 23:44 Worklog Time Spent: 10m Work Description: youngoli commented on issue #10991: [BEAM-3301] Refactor DoFn validation & allow specifying main inputs. URL: https://github.com/apache/beam/pull/10991#issuecomment-598480073 I think doing this validation in the ParDo transform is something worth looking into, and I'd be up for it if it worked as well as you describe. I'm definitely not a fan of having to do validation without any info about the actual output/input involved. I've even entertained the idea of doing something similar, but it would be a decently large refactor (2-3 days?) and has the chance of hitting additional roadblocks, so I haven't really made time to look into it yet. Definitely something worth taking a day or two to look into after SDF is done. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org Issue Time Tracking ------------------- Worklog Id: (was: 402558) Time Spent: 4h 40m (was: 4.5h) > Go SplittableDoFn support > ------------------------- > > Key: BEAM-3301 > URL: https://issues.apache.org/jira/browse/BEAM-3301 > Project: Beam > Issue Type: Improvement > Components: sdk-go > Reporter: Henning Rohde > Assignee: Daniel Oliveira > Priority: Major > Time Spent: 4h 40m > Remaining Estimate: 0h > > SDFs will be the only way to add streaming and liquid sharded IO for Go. > Design doc: https://s.apache.org/splittable-do-fn -- This message was sent by Atlassian Jira (v8.3.4#803005)