[
https://issues.apache.org/jira/browse/HUDI-538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17019814#comment-17019814
]
vinoyang edited comment on HUDI-538 at 1/21/20 2:32 AM:
--------------------------------------------------------
bq. Initially, the DeltaStreamer will not work over Flink, and that may be
okay?
[~vinoth] {{DeltaStreamer}} may not support Flink in the first phase. However,
there should be some sources support Flink(let Flink connector with the
upstream system) to read records then write to Hudi. Otherwise, where the
records wait to be writen come from?
was (Author: yanghua):
bg. Initially, the DeltaStreamer will not work over Flink, and that may be
okay?
{{DeltaStreamer}} may not support Flink in the first phase. However, there
should be some sources support Flink(let Flink connector with the upstream
system) to read records then write to Hudi. Otherwise, where the records wait
to be writen come from?
> Restructuring hudi client module for multi engine support
> ---------------------------------------------------------
>
> Key: HUDI-538
> URL: https://issues.apache.org/jira/browse/HUDI-538
> Project: Apache Hudi (incubating)
> Issue Type: Wish
> Components: Code Cleanup
> Reporter: vinoyang
> Priority: Major
>
> Hudi is currently tightly coupled with the Spark framework. It caused the
> integration with other computing engine more difficult. We plan to decouple
> it with Spark. This umbrella issue used to track this work.
> Some thoughts wrote here:
> https://docs.google.com/document/d/1Q9w_4K6xzGbUrtTS0gAlzNYOmRXjzNUdbbe0q59PX9w/edit?usp=sharing
> The feature branch is {{restructure-hudi-client}}.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
