[
https://issues.apache.org/jira/browse/BEAM-5974?focusedWorklogId=163291&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-163291
]
ASF GitHub Bot logged work on BEAM-5974:
----------------------------------------
Author: ASF GitHub Bot
Created on: 07/Nov/18 00:38
Start Date: 07/Nov/18 00:38
Worklog Time Spent: 10m
Work Description: swegner commented on a change in pull request #6949:
[BEAM-5974] Fix ByteKeyRangeTracker to handle tryClaim(ByteKey.EMPTY) instead
of exposing markDone
URL: https://github.com/apache/beam/pull/6949#discussion_r231346178
##########
File path:
sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/splittabledofn/ByteKeyRangeTracker.java
##########
@@ -64,23 +87,36 @@ public synchronized ByteKeyRange checkpoint() {
/**
* Attempts to claim the given key.
*
- * <p>Must be larger than the last successfully claimed key.
+ * <p>Must be larger than the last attempted key. Note that passing in
{@link ByteKey#EMPTY}
Review comment:
Why do we care about whether the key is greater than last attempted rather
than last claimed?
Would you mind adding a short javadoc defining what `lastAttemptedKey`
represents? I believe it represents the last attempted claim, regardless of
whether it succeeded or not.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 163291)
Time Spent: 1h (was: 50m)
> Migrate ByteKeyRangeTracker to use tryClaim(ByteKey.EMPTY) as end of range
> claim instead of markDone
> ----------------------------------------------------------------------------------------------------
>
> Key: BEAM-5974
> URL: https://issues.apache.org/jira/browse/BEAM-5974
> Project: Beam
> Issue Type: Bug
> Components: io-java-hbase, sdk-java-core
> Affects Versions: 2.8.0
> Reporter: Luke Cwik
> Assignee: Luke Cwik
> Priority: Major
> Time Spent: 1h
> Remaining Estimate: 0h
>
> org.apache.beam.sdk.transforms.splittabledofn.ByteKeyRangeTracker doesn't
> handle tryClaim(ByteKey.EMPTY) and the related doneness check or
> checkpointing since doneness checking can't handle the empty interval,
> checkpointing returns invalid checkpoints or errors out since it is using the
> lastClaimedKey vs the lastAttemptedKey for doneness checking
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
