[
https://issues.apache.org/jira/browse/BEAM-7428?focusedWorklogId=256078&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-256078
]
ASF GitHub Bot logged work on BEAM-7428:
----------------------------------------
Author: ASF GitHub Bot
Created on: 07/Jun/19 17:11
Start Date: 07/Jun/19 17:11
Worklog Time Spent: 10m
Work Description: kennknowles commented on issue #8741: [BEAM-7428]
Output the timestamp on elements in ReadAllViaFileBasedSource
URL: https://github.com/apache/beam/pull/8741#issuecomment-499965273
So I understand why the output timestamp is -inf. That is just how
BoundedSource works; it always outputs everything at -inf so that it is safe to
move forward to anywhere you want.
So you can't run a bounded source and use those timestamps if the input
element has a timestamp later than -inf. But you can just output at the same
timestamp as the input if you want, I guess. I think this is an area of SDF
that I talked about with Eugene and the conclusion was that we might need
per-key watermarks or something crazy. I don't think it got solved.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 256078)
Time Spent: 3h (was: 2h 50m)
> ReadAllViaFileBasedSource does not output the timestamps of the read elements
> -----------------------------------------------------------------------------
>
> Key: BEAM-7428
> URL: https://issues.apache.org/jira/browse/BEAM-7428
> Project: Beam
> Issue Type: Bug
> Components: sdk-java-core
> Reporter: Ismaël Mejía
> Assignee: Ismaël Mejía
> Priority: Minor
> Time Spent: 3h
> Remaining Estimate: 0h
>
> This differs from the implementation of JavaReadViaImpulse that tackles a
> similar problem but does output the timestamps correctly.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
