XIAOYU YU created GRIFFIN-340:
---------------------------------
Summary: Flink in Griffin
Key: GRIFFIN-340
URL: https://issues.apache.org/jira/browse/GRIFFIN-340
Project: Griffin
Issue Type: Wish
Reporter: XIAOYU YU
We have been using Griffin for batch data quality measurement for some time.
Recently, we are working on streaming data quality. We have investigated and
tested Griffin, but it can not meet our needs.
Therefore, we are developing a streaming data quality measurement tool based on
Apache Flink and reusing Griffin DSL.
So we have some thoughts:
1. Is it possible that the Griffin DSL batch jobs could also be executed by
Flink? Because Flink works good on batch data as well. We will try to support
batch data quality measurement (defined by Griffin DSL) with Flink.
2. Can we separate the computing engine layer from Griffin, as an optional
plug-in? So that the Griffin DSL jobs can run on both Spark and Flink.
Are the above thoughts feasible? We want to know the community's opinions.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
