mapshen edited a comment on issue #7004:
URL:
https://github.com/apache/incubator-pinot/issues/7004#issuecomment-882858547
Sure. Say we have an inventory table of products and, to begin with, a query
like
```
select count, offset from inventory where product = 'A' limit 1
```
is executed, from which I record the offset.
Next time a query is issued, if I don't want to reprocess, or even fetch,
the rows I have already seen, and only care about the latest change if any, I
would do
```
select count, offset from inventory where offset > last_recorded_offset and
product = 'A' limit 1
```
If I don't want to miss any messages/rows in between since the last fetch, I
could do
```
select count, offset from inventory where offset > last_recorded_offset and
product = 'A'
```
From here, I would record the new offset again (if any) and repeat.
There was more context in the original thread on Slack, but I couldn't find
it anymore. Seems all messages prior to 06/16 got purged (?).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
