Hi, there

We would like to start a discussion thread on "FLIP-404: Create a Redis
HyperLogLog Connector for Flink"[1].

There has also been a lot of discussion in the past about Redis connectors,
including creating lookup and sink connectors for generic key-value get and
put, and creating source and sink connectors for streams structures.

Different data structures are used in different ways. I think we can build
generic connectors based on KVs and create special-purpose connectors for
specific data structures.

For example, for list structure, end-user can specify the data to be placed
or get on the left or right side of the list to build the sink or source
connector, and for hyperloglog, end-user needs to write the data to
multiple keys by the content of the table field.

For the differentiated usage of different data structures, a unified
connector may be difficult to maintain due to too much capacity.

Based on above, this FLIP is proposed.

Looking forward to any comment or feedback.

[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-404%3A+Create+a+Redis+HyperLogLog+Connector+for+Flink

Best regards,
Jinsui

Reply via email to