Re: [DISCUSS] Add SQL module dynamic function loading possibility

2025-08-18 Thread Zsombor Chikán
Hi Gabor! i appreciate your answers, it clarified a lot of details for me that I misunderstood from your first email. now i understand that the State Processor API is only the service loader entry point, and the actual TableFunction implementations will stay in the connector jars, which indeed av

Re: [DISCUSS] Add SQL module dynamic function loading possibility

2025-08-18 Thread Gabor Somogyi
Hi Zsombor, Thanks for your contribution, please see my answers inline. G On Mon, Aug 18, 2025 at 7:24 PM Zsombor Chikán wrote: > Hi Gabor, > > Thanks for sharing this idea, I think it makes a lot of sense, and the > Kafka offsets example is a very practical starting point. > > a few thoughts

Re: [DISCUSS] Add SQL module dynamic function loading possibility

2025-08-18 Thread Zsombor Chikán
Hi Gabor, Thanks for sharing this idea, I think it makes a lot of sense, and the Kafka offsets example is a very practical starting point. a few thoughts/questions from my side: - is the state processor API the proper place to put these new functions? or do you think it worth to have separ

[DISCUSS] Add SQL module dynamic function loading possibility

2025-08-18 Thread Gabor Somogyi
Hi all, SQL modules like the state processor API could potentially add SQL functions which are coming from external connectors like Kafka, Iceberg, etc... The dynamic nature, instead of hardcoding it into the module comes from the fact that we're not intended to add direct external connector depen