[
https://issues.apache.org/jira/browse/BEAM-7428?focusedWorklogId=269574&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-269574
]
ASF GitHub Bot logged work on BEAM-7428:
----------------------------------------
Author: ASF GitHub Bot
Created on: 28/Jun/19 22:13
Start Date: 28/Jun/19 22:13
Worklog Time Spent: 10m
Work Description: lukecwik commented on issue #8741: [BEAM-7428] Output
the timestamp on elements in ReadAllViaFileBasedSource
URL: https://github.com/apache/beam/pull/8741#issuecomment-506892324
The trouble I have is that advancing the output watermark for the specific
element+restriction doesn't really provide much since the runner needs to be
able to maintain that the `output watermark <= input watermark` since it is the
only thing that knows what future element+restriction may be produced. In the
case when the input to a SplittableDoFn is bounded, once all the
elements+restrictions are being processed, the runner can then use the min
watermark of element+restrictions as the output watermark.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 269574)
Time Spent: 5h 50m (was: 5h 40m)
> ReadAllViaFileBasedSource does not output the timestamps of the read elements
> -----------------------------------------------------------------------------
>
> Key: BEAM-7428
> URL: https://issues.apache.org/jira/browse/BEAM-7428
> Project: Beam
> Issue Type: Bug
> Components: sdk-java-core
> Reporter: Ismaël Mejía
> Assignee: Ismaël Mejía
> Priority: Minor
> Time Spent: 5h 50m
> Remaining Estimate: 0h
>
> This differs from the implementation of JavaReadViaImpulse that tackles a
> similar problem but does output the timestamps correctly.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
