[ 
https://issues.apache.org/jira/browse/CALCITE-3073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16857838#comment-16857838
 ] 

Matt Wang commented on CALCITE-3073:
------------------------------------

[~zhztheplayer] I have updated the JIRA title, now the PR just support to 
consume form the special timestamp.

Now we can set the start timestamp in `modern.json` file, then we can read from 
the special timestamp. I do not know it's necessary to support the end 
timestamp, because the data in Kafka is a streaming data and it is producing 
all the time.

But like [~mingmxu] suggested, if we add a special reserved 
keyword(`KAFKA_TIMESTAMP`) in KafkaAdapter, we can query like `SELECT * FROM 
KAFKA_TABLE WHERE KAFKA_TIMESTAMP > CURRENT_TIMESTAMP-1`, it will make easy to 
use, but I'm not sure is a good idea.

> Support to consume from timestamp in KafkaAdapter
> -------------------------------------------------
>
>                 Key: CALCITE-3073
>                 URL: https://issues.apache.org/jira/browse/CALCITE-3073
>             Project: Calcite
>          Issue Type: Improvement
>          Components: kafka-adapter
>            Reporter: Xu Mingmin
>            Assignee: Matt Wang
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 3h 20m
>  Remaining Estimate: 0h
>
> Currently the KafkaAdapter consumes data from default 
> offset(latest/earliest/last_offset) and runs forever. With support of from/to 
> timestamp/offset, it's more flexible for users to query a specific range.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to