[
https://issues.apache.org/jira/browse/BEAM-7473?focusedWorklogId=344733&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-344733
]
ASF GitHub Bot logged work on BEAM-7473:
----------------------------------------
Author: ASF GitHub Bot
Created on: 16/Nov/19 00:53
Start Date: 16/Nov/19 00:53
Worklog Time Spent: 10m
Work Description: robertwb commented on pull request #10118: [BEAM-7473]
Pack RangeTracker into restriction
URL: https://github.com/apache/beam/pull/10118#discussion_r347061566
##########
File path: sdks/python/apache_beam/io/iobase.py
##########
@@ -1404,18 +1404,21 @@ class _SDFBoundedSourceWrapper(ptransform.PTransform):
"""
class _SDFBoundedSourceRestrictionTracker(RestrictionTracker):
"""An `iobase.RestrictionTracker` implementations for wrapping
BoundedSource
- with SDF.
+ with SDF. The tracked restriction is a (SourceBundle, RangeTracker) pair.
+ In order to save bytes sent across the wire, the RangeTracker is set as
+ system tracking RangeTracker only when current_restriction is called.
Review comment:
This is not only to save bytes across the wire--range trackers are not meant
to be serialized. I might say that logically the restriction is a
(SourceBundle, RangeTracker) pair, but the second argument is never serialized.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 344733)
> Update RestrictionTracker within Python to not be required to be thread safe
> ----------------------------------------------------------------------------
>
> Key: BEAM-7473
> URL: https://issues.apache.org/jira/browse/BEAM-7473
> Project: Beam
> Issue Type: Improvement
> Components: sdk-py-core, sdk-py-harness
> Reporter: Luke Cwik
> Assignee: Boyuan Zhang
> Priority: Major
> Fix For: 2.17.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> The commit
> [https://github.com/apache/beam/commit/8faffb2bcf28ccab5e9a95322743cc60df65077c#diff-ed95abb6bc30a9ed07faef5c3fea93f0]
> modified the Java SDK removed the need for users to be thread safe and
> instead made the framework provide the necessary locking around a restriction
> tracker.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
