Re: Upsert to Kafka with flink SQL
From: Emil Hjelle (ekstern) Sent: Wednesday, November 27, 2024 4:35 PM To: dev@flink.apache.org Subject: Upsert to Kafka with flink SQL Hi! I am new to Flink and not sure if this is the right place to ask this question. I am trying to create a demo of Flink SQL with the Kubernetes operator. I am using the example from https://github.com/apache/flink-kubernetes-operator/tree/main/examples/flink-sql-runner-example I have modified sample.sql, pom.xml and Dockerfile to the files included in this e-mail. Everything looks good in the UI when port-forward the rest service and I can also see that I am consuming data from the source topic in the Confluent platform, but the data don't show up in the sink topic. Do you have any advice on how to debug this problem? Kind regards Emil Hjelle
Upsert to Kafka with flink SQL
Hi! I am new to Flink and not sure if this is the right place to ask this
question.
I am trying to create a demo of Flink SQL with the Kubernetes operator.
I am using the example from
https://github.com/apache/flink-kubernetes-operator/tree/main/examples/flink-sql-runner-example
I have modified sample.sql, pom.xml and Dockerfile to the files included in
this e-mail. Everything looks good in the UI when port-forward the rest service
and I can also see that I am consuming data from the source topic in the
Confluent platform, but the data don't show up in the sink topic.
Do you have any advice on how to debug this problem?
Kind regards Emil Hjelle
http://maven.apache.org/POM/4.0.0"; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance";
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd";>
4.0.0
org.apache.flink
flink-kubernetes-operator-parent
1.11-SNAPSHOT
../..
flink-sql-runner-example
Flink SQL Runner Example
true
org.apache.flink
flink-streaming-java
${flink.version}
provided
org.apache.flink
flink-table-api-java
${flink.version}
provided
org.apache.flink
flink-connector-kafka
3.1.0-1.18
org.apache.flink
flink-sql-connector-kafka
3.1.0-1.18
org.apache.flink
flink-streaming-scala_2.12
${flink.version}
org.apache.flink
flink-clients
${flink.version}
org.apache.flink
flink-table-planner_2.12
${flink.version}
provided
org.slf4j
slf4j-api
${slf4j.version}
provided
org.apache.logging.log4j
log4j-slf4j-impl
${log4j.version}
runtime
org.apache.logging.log4j
log4j-api
${log4j.version}
runtime
org.apache.logging.log4j
log4j-core
${log4j.version}
runtime
org.apache.maven.plugins
maven-shade-plugin
3.1.1
package
shade
org.apache.flink:flink-shaded-force-shading
com.google.code.findbugs:jsr305
org.slf4j:*
org.apache.logging.log4j:*
*:*
META-INF/*.SF
META-INF/*.DSA
META-INF/*.RSA
org.apache.flink.examples.SqlRunner
