[
https://issues.apache.org/jira/browse/HUDI-184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16977098#comment-16977098
]
Vinoth Chandar commented on HUDI-184:
-------------------------------------
Interesting idea. [~yanghua] so IIUC, we can map one window to a delta
commit/commit and this can just be based on arrival time, which is what
_hoodie_commit_time is. May be start a RFC on this and we can flesh it out? We
can just iterate on concepts first and leave out implementation. Also this gave
me a thought on the Indexing as well. Given the state is checkpointed to s3 or
dfs anyway, why not consider an index based on existing state store mechanism?
May perform ok actually.
> Integrate Hudi with Apache Flink
> --------------------------------
>
> Key: HUDI-184
> URL: https://issues.apache.org/jira/browse/HUDI-184
> Project: Apache Hudi (incubating)
> Issue Type: New Feature
> Components: Write Client
> Reporter: vinoyang
> Assignee: vinoyang
> Priority: Major
>
> Apache Flink is a popular streaming processing engine.
> Integrating Hudi with Flink is a valuable work.
> The discussion mailing thread is here:
> [https://lists.apache.org/api/source.lua/1533de2d4cd4243fa9e8f8bf057ffd02f2ac0bec7c7539d8f72166ea@%3Cdev.hudi.apache.org%3E]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
