Following up on a proposal I shared in the dev thread <https://lists.apache.org/thread/sov9vg1jl0tnv4d1857sk69s96dcnwq1> — we’re working on externalizing and modernizing the Flink-Pinot connector (currently in Apache Bahir, which is now in the Attic). The plan includes:
- Moving the connector to a separate Flink community-managed repo - Upgrading to *Flink 2.0 + Pinot 1.2+* - Adding *Flink SQL/Table API* support - Supporting *Pinot upserts* by generating primary-key-aware segments and pushing them to the Pinot controller This builds on the existing Bahir connector’s streaming + checkpoint-aware foundation, and aims to make it production-grade for long-term use. Would love to hear if: - You’re currently using the connector (or wanted to but couldn’t) - You see value in SQL/upsert support - You’d be interested in contributing or helping review More details: here <https://docs.google.com/document/d/1XgTH-vummF-JZz5VUibKxRRtXMhDQE3T7tJbU18Cb7c/edit?tab=t.0> Thanks, Poorvank
