Hi,

Currently `sql-gateway` can be started with the script `sql-gateway.sh` in
an existing node, it is more like a simple "standalone" node. I think it's
valuable if we can do more work to start it in k8s.

For xiaolong:
Do you want to start a sql-gateway instance in the jobmanager pod? I think
maybe we need a script like `kubernetes-sql-gatewah.sh` to start
`sql-gateway` pods with a flink image, what do you think?

Best,
Shammon FY


On Fri, Sep 15, 2023 at 10:02 AM Xiaolong Wang
<xiaolong.w...@smartnews.com.invalid> wrote:

> Hi, I've experiment this feature on K8S recently, here is some of my trial:
>
>
> 1. Create a new kubernetes-jobmanager.sh script with the following content
>
> #!/usr/bin/env bash
> $FLINK_HOME/bin/sql-gateway.sh start
> $FLINK_HOME/bin/kubernetes-jobmanager1.sh kubernetes-session
>
> 2. Build your own Flink docker image something like this
> FROM flink:1.17.1-scala_2.12-java11
>
> RUN mv $FLINK_HOME/bin/kubernetes-jobmanager.sh $FLINK_HOME/bin/
> kubernetes-jobmanager1.sh
> COPY ./kubernetes-jobmanager.sh $FLINK_HOME/bin/kubernetes-jobmanager.sh
>
> RUN chmod +x $FLINK_HOME/bin/*.sh
> USER flink
>
> 3. Create a Flink session job with the operator using the above image.
>
> On Thu, Sep 14, 2023 at 9:49 PM Gyula Fóra <gyula.f...@gmail.com> wrote:
>
> > Hi!
> >
> > I don't completely understand what would be a content of such CRD, could
> > you give a minimal example how the Flink SQL Gateway CR yaml would look
> > like?
> >
> > Adding a CRD would mean you need to add some operator/controller logic as
> > well. Why not simply use a Deployment / StatefulSet in Kubernetes?
> >
> > Or a Helm chart if you want to make it more user friendly?
> >
> > Cheers,
> > Gyula
> >
> > On Thu, Sep 14, 2023 at 12:57 PM Dongwoo Kim <dongwoo7....@gmail.com>
> > wrote:
> >
> > > Hi all,
> > >
> > > I've been working on setting up a flink SQL gateway in a k8s
> environment
> > > and it got me thinking — what if we had a CRD for this?
> > >
> > > So I have quick questions below.
> > > 1. Is there ongoing work to create a CRD for the Flink SQL Gateway?
> > > 2. If not, would the community be open to considering a CRD for this?
> > >
> > > I've noticed a growing demand for simplified setup of the flink sql
> > gateway
> > > in flink's slack channel.
> > > Implementing a CRD could make deployments easier and offer better
> > > integration with k8s.
> > >
> > > If this idea is accepted, I'm open to drafting a FLIP for further
> > > discussion
> > >
> > > Thanks for your time and looking forward to your thoughts!
> > >
> > > Best regards,
> > > Dongwoo
> > >
> >
>

Reply via email to