Vinay created HUDI-2082: --------------------------- Summary: Provide option to choose Spark or Flink Delta Streamer Key: HUDI-2082 URL: https://issues.apache.org/jira/browse/HUDI-2082 Project: Apache Hudi Issue Type: New Feature Components: DeltaStreamer Reporter: Vinay Assignee: Vinay
Currently, Hudi supports Flink as well Spark engine, there are two different classes for DeltaStreamer 1. HoodieDeltaStreamer 2.HoodieFlinkStreamer We should have a provision to pass the flag like --runner to choose between Flink or Spark and have a single entry point class which will take all the common configs. Based on the runner flag, we can call HoodieDeltaStreamer or HoodieFlinkStreamer This also takes care of making DeltaStreamer generic -- This message was sent by Atlassian Jira (v8.3.4#803005)