[ 
https://issues.apache.org/jira/browse/FLINK-25618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17474436#comment-17474436
 ] 

tanjialiang commented on FLINK-25618:
-------------------------------------

[~MartijnVisser] Thanks for your reply. I had started a thread in 
[https://lists.apache.org/thread/lytryplwttln192brn91q32f2trw8k5v|https://lists.apache.org/thread/lytryplwttln192brn91q32f2trw8k5v,]

 

> Data quality by apache flink
> ----------------------------
>
>                 Key: FLINK-25618
>                 URL: https://issues.apache.org/jira/browse/FLINK-25618
>             Project: Flink
>          Issue Type: New Feature
>            Reporter: tanjialiang
>            Priority: Not a Priority
>
> This is discussing about how to support data quality through apache flink.
> For example, I has a sql job, a table in this job has a column named phone, 
> and the data of the column phone must match the pattern of telephone, if not 
> match, i can choose drop it or ignored, and we can mark it in the metrics, so 
> that user can monitor the data of quality in source and sink.
> After this, user can kown about the data quality from the source and sink, it 
> is useful for the downstream.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to