Hi, there We would like to start a discussion thread on "FLIP-404: Create a Redis HyperLogLog Connector for Flink"[1].
There has also been a lot of discussion in the past about Redis connectors, including creating lookup and sink connectors for generic key-value get and put, and creating source and sink connectors for streams structures. Different data structures are used in different ways. I think we can build generic connectors based on KVs and create special-purpose connectors for specific data structures. For example, for list structure, end-user can specify the data to be placed or get on the left or right side of the list to build the sink or source connector, and for hyperloglog, end-user needs to write the data to multiple keys by the content of the table field. For the differentiated usage of different data structures, a unified connector may be difficult to maintain due to too much capacity. Based on above, this FLIP is proposed. Looking forward to any comment or feedback. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-404%3A+Create+a+Redis+HyperLogLog+Connector+for+Flink Best regards, Jinsui