Hi Shammon,
Thank you for your answer and explanation, my latest experiment was a SELECT
query and my assumptions were based on that, INSERT works as described.
Regarding the state of FLIP-295, I just checked out the recently created jiras
[1] and if I can help out with any part, please let me
Hi Ferenc,
If I understand correctly, there will be two types of jobs in sql-gateway:
`SELECT` and `NON-SELECT` such as `INSERT`.
1. `SELECT` jobs need to collect results from Flink cluster in a
corresponding session of sql gateway, and when the session is closed, the
job should be canceled. Thes
Hi Jark,
In the current implementation, any job submitted via the SQL Gateway has to be
done through a session, cause all the operations are grouped under sessions.
Starting from there, if I close a session, that will close the
"SessionContext", which closes the "OperationManager" [1], and the
Hi Ferenc,
But the job lifecycle doesn't tie to the SQL Gateway session.
Even if the session is closed, all the running jobs are not affected.
Best,
Jark
On Tue, 27 Jun 2023 at 04:14, Ferenc Csaky
wrote:
> Hi Jark,
>
> Thank you for pointing out FLIP-295 abouth catalog persistence, I was no
Hi Jark,
Thank you for pointing out FLIP-295 abouth catalog persistence, I was not aware
the current state. Although as far as I see, that persistent catalogs are
necessary, but not sufficient achieving a "persistent gateway".
The current implementation ties the job lifecycle to the SQL gateway
Hi Ferenc,
Making SQL Gateway to be an easy-to-use platform infrastructure of Flink
SQL
is one of the important roadmaps [1].
The persistence ability of the SQL Gateway is a major work in 1.18 release.
One of the persistence demand is that the registered catalogs are currently
kept in memory and
Hello devs,
I would like to open a discussion about persistence possibilitis for the SQL
Gateway. At Cloudera, we are happy to see the work already done on this project
and looking for ways to utilize it on our platform as well, but currently it
lacks some features that would be essential in ou
