Hi, Junbo

Thanks for the detailed proposal. I have a couple of questions about the 
technology choice and the future SQL path.

For the current scope—REST writes and metadata/DDL—have we considered 
implementing the Gateway with a Java/Netty REST stack backed by the existing 
Fluss Java client? This would be similar in spirit to how Flink SQL Gateway 
reuses Flink’s native Java stack and Netty-based REST infrastructure. The Fluss 
Java client already supports append, upsert, delete, partial update, metadata 
operations, and lookup. It would be helpful if the FIP could compare this 
alternative with the proposed

I also have a question about the future DataFusion integration. Is DataFusion 
expected to execute SQL queries inside the same Gateway process? If so, complex 
or resource-intensive queries could compete with REST ingestion and metadata 
operations for CPU and memory, and a query failure or OOM could potentially 
affect the entire Gateway. Do we plan to provide admission control, memory and 
concurrency limits, query timeout/cancellation, spilling, or process-level 
isolation?

If the initial read use case is mainly primary-key or prefix lookup, could we 
expose a lightweight lookup REST API backed directly by the Fluss client, 
without introducing DataFusion? DataFusion seems more valuable when the 
intended scope includes general SQL capabilities such as scans, filters, 
aggregations, and joins? If that is the long-term goal, would it be preferable 
to keep complex SQL execution in a separate optional SQL service or worker 
process, so that it does not increase the failure domain of the REST write 
Gateway?


From: Michael Koepf <[email protected]>
Date: Thursday, July 30, 2026 at 22:15
To: [email protected] <[email protected]>
Subject: Re: [DISCUSS] FIP-49: Fluss Gateway REST API

Hi Juno,

Thanks for the FIP, great initiative.

A question that comes to my mind: Why not expose metrics via vendor neutral 
OTEL instead of limiting it to Prometheus?
--
Best,
MKO


> On 30.07.2026, at 12:23, Forward Xu <[email protected]> wrote:
>
> Thanks junbo,
>
> The proposal looks good to me in general. +1
>
> Best,
> Foward
>
> Junbo Wang <[email protected]> 于2026年7月30日周四 11:49写道:
>
>> Hi all, I'd like to start a discussion on FIP-49: Fluss Gateway REST API.
>>
>> The proposal is available here:
>> https://cwiki.apache.org/confluence/spaces/FLUSS/pages/444334561/FIP-49+Fluss+Gateway+REST+API
>>
>> This FIP is an extension of FIP-32 (Multiprotocol Query Gateway) [1] and
>> does not conflict with it. Following the earlier suggestion to split the
>> gateway work into focused FIPs, FIP-49 defines the REST write path and DDL
>> / metadata management in detail, while REST read and the SQL path remain in
>> the scope of FIP-32.
>>
>> In short, it proposes a standalone, stateless fluss-gateway process (Rust,
>> axum + tokio, built on fluss-rust) providing:
>>
>> HTTP/JSON ingestion into KV and Log tables, at-least-once, with per-row
>> success/failure reporting
>> Full database / table / partition DDL
>> Pluggable client authentication, and a service / user (act-as) identity
>> mode towards Fluss
>> Multi-cluster routing, Prometheus metrics, a unified error model
>>
>> No Fluss server-side changes are required— the gateway accesses existing
>> clusters purely as a fluss-rust client.
>>
>> Looking forward to your feedback and suggestions.
>>
>>
>>
>> [1] https://lists.apache.org/thread/sf0qfxhr9j2g0dtxvp586p9zknxvpx6x
>>
>>
>> Best regards,
>> Junbo Wang
>>
>>

Reply via email to