SreeramGarlapati commented on pull request #3039: URL: https://github.com/apache/iceberg/pull/3039#issuecomment-913962703
> Can we please use `as-of-timestamp` instead of introducing a new configuration option? If users need to be strictly greater than some time or strictly less than some time, I believe they can use `as-of-timestamp` and simply add one to the milliseconds as we don’t store snapshot timestamps at a lower granularity than milliseconds iirc (will double check the spec but I’m almost certain). > > We need `as-of-timestamp` to be consistent with the batch API and Flink streaming APIs anyway and it already exists. > > If there's a motivating reason that we _can't_ use `as-of-timestamp`, I'd love to hear it. Very open to the existence of a possibility that I didn't consider which would prevent the use of `as-of-timestamp`. 🙂 @kbendick - the existing flag - `as-of-timestamp` is intended to be use for time travel scenarios. Using this flag - users would read full table data. whereas - the new flag `stream-from-timestamp` is for streaming reads. In this case - the flag need to explicitly express that - user is interested to read data that is added to the table - **from** this timestamp. Did this rationale make sense!? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
