[
https://issues.apache.org/jira/browse/BEAM-8537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Boyuan Zhang updated BEAM-8537:
-------------------------------
Description:
This is a follow up for in-progress PR:
https://github.com/apache/beam/pull/9794.
Current implementation in PR9794 provides a default implementation of
WatermarkEstimator. For further work, we want to let WatermarkEstimator to be a
pure Interface. We'll provide a WatermarkEstimatorProvider to be able to create
a custom WatermarkEstimator per windowed value. It should be similar to how we
track restriction for SDF:
WatermarkEstimator <---> RestrictionTracker
WatermarkEstimatorProvider <---> RestrictionTrackerProvider
WatermarkEstimatorParam <---> RestrictionDoFnParam
was:
This is a follow up for in-progress PR:
https://github.com/apache/beam/pull/9794.
Current implementation in PR9794 provides a default implementation of
WatermarkEstimator. For further work, we want to let WatermarkEstimator to be a
pure Interface. We'll provide a WatermarkEstimatorProvider to be able to create
a custom WatermarkEstimator per windowed value. It should be similar to how we
track restriction for SDF: WatermarkEstimator <---> RestrictionTracker,
WatermarkEstimatorProvider <---> RestrictionTrackerProvider,
_WatermarkEstimatorParam <---> _RestrictionDoFnParam
> Provide WatermarkEstimatorProvider for different types of WatermarkEstimator
> ----------------------------------------------------------------------------
>
> Key: BEAM-8537
> URL: https://issues.apache.org/jira/browse/BEAM-8537
> Project: Beam
> Issue Type: Improvement
> Components: sdk-py-core, sdk-py-harness
> Reporter: Boyuan Zhang
> Assignee: Boyuan Zhang
> Priority: Major
>
> This is a follow up for in-progress PR:
> https://github.com/apache/beam/pull/9794.
> Current implementation in PR9794 provides a default implementation of
> WatermarkEstimator. For further work, we want to let WatermarkEstimator to be
> a pure Interface. We'll provide a WatermarkEstimatorProvider to be able to
> create a custom WatermarkEstimator per windowed value. It should be similar
> to how we track restriction for SDF:
> WatermarkEstimator <---> RestrictionTracker
> WatermarkEstimatorProvider <---> RestrictionTrackerProvider
> WatermarkEstimatorParam <---> RestrictionDoFnParam
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
