[
https://issues.apache.org/jira/browse/BEAM-3301?focusedWorklogId=407180&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-407180
]
ASF GitHub Bot logged work on BEAM-3301:
----------------------------------------
Author: ASF GitHub Bot
Created on: 20/Mar/20 19:01
Start Date: 20/Mar/20 19:01
Worklog Time Spent: 10m
Work Description: youngoli commented on pull request #11179: [BEAM-3301]
Bugfix in DoFn validation.
URL: https://github.com/apache/beam/pull/11179#discussion_r395836071
##########
File path: sdks/go/pkg/beam/pcollection.go
##########
@@ -60,6 +60,12 @@ func (p PCollection) Type() FullType {
return p.n.Type()
}
+// OutputsKV returns whether the output of this PCollection are single value
+// elements or KV pairs.
+func (p PCollection) OutputsKV() bool {
Review comment:
I was originally picturing this as a helper function for callers of NewDoFn.
It seems easy for future callers to make a mistake and only check if the
PCollection is a KV and forget to check for CoGBK, so I thought a helper method
would be useful in the future.
1. I missed that pardo.go is in the same package as pcollection.go. I'm also
leaning to not expanding the user surface if it's not necessary.
2 & 3. Yeah I was unsure about the name, since it's not technically checking
for KVs, I just couldn't think of anything better. IsKeyed sounds good though.
4. That's the other part I was debating. My goal was to make it easy to
avoid the mistake in the future, but thinking about it... It seems unlikely
that anyone else would even be using this code, and I would expect that if they
were they were an advanced user doing something tricky.
I think I'll go with just putting the conditional in pardo.go and adding a
comment. We can always turn it into a helper later if it does get used in
multiple places.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 407180)
Time Spent: 7.5h (was: 7h 20m)
> Go SplittableDoFn support
> -------------------------
>
> Key: BEAM-3301
> URL: https://issues.apache.org/jira/browse/BEAM-3301
> Project: Beam
> Issue Type: Improvement
> Components: sdk-go
> Reporter: Henning Rohde
> Assignee: Daniel Oliveira
> Priority: Major
> Time Spent: 7.5h
> Remaining Estimate: 0h
>
> SDFs will be the only way to add streaming and liquid sharded IO for Go.
> Design doc: https://s.apache.org/splittable-do-fn
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
