[
https://issues.apache.org/jira/browse/BEAM-14484?focusedWorklogId=772603&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-772603
]
ASF GitHub Bot logged work on BEAM-14484:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 19/May/22 21:01
Start Date: 19/May/22 21:01
Worklog Time Spent: 10m
Work Description: jrmccluskey commented on code in PR #17716:
URL: https://github.com/apache/beam/pull/17716#discussion_r877537731
##########
sdks/go/pkg/beam/core/runtime/exec/datasource.go:
##########
@@ -385,11 +396,16 @@ func (n *DataSource) Checkpoint() (SplitResult,
time.Duration, bool, error) {
if err != nil {
return SplitResult{}, -1 * time.Minute, false, err
}
+ if len(rs) == 0 {
+ return SplitResult{}, -1 * time.Minute, false, nil
Review Comment:
A no-residual return is indicative of a no-op split, which can happen. In a
checkpointing context we wouldn't necessarily expect it but it adds some
protection if a user schedules a bundle to resume that didn't have any work
left.
Issue Time Tracking
-------------------
Worklog Id: (was: 772603)
Time Spent: 4h 20m (was: 4h 10m)
> Improve error message surrounding primary returns in the self-checkpointing
> code
> --------------------------------------------------------------------------------
>
> Key: BEAM-14484
> URL: https://issues.apache.org/jira/browse/BEAM-14484
> Project: Beam
> Issue Type: Improvement
> Components: sdk-go
> Reporter: Jack McCluskey
> Assignee: Jack McCluskey
> Priority: P1
> Time Spent: 4h 20m
> Remaining Estimate: 0h
>
> The error message in the Go SDK harness around returned primaries in the
> self-checkpointing code
> ([https://github.com/apache/beam/blob/ea1f292e9cf31fc8c4803b10d811f0d3ee184ae7/sdks/go/pkg/beam/core/runtime/exec/datasource.go#L375)]
> is unclear and should be made more explicit. It should also guide the user
> towards making sure that the restriction behaves properly in the
> self-checkpointing case.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
