ChenpiDog opened a new issue, #2018: URL: https://github.com/apache/incubator-seatunnel/issues/2018
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened Set Up with Kubernetes, JDBC as source, based on the Flink engine, the task failed. Dockerfile: `FROM flink:1.13 ENV SEATUNNEL_VERSION="2.1.0" RUN wget https://archive.apache.org/dist/incubator/seatunnel/${SEATUNNEL_VERSION}/apache-seatunnel-incubating-${SEATUNNEL_VERSION}-bin.tar.gz RUN tar -xzvf apache-seatunnel-incubating-${SEATUNNEL_VERSION}-bin.tar.gz RUN mkdir -p $FLINK_HOME/usrlib RUN cp apache-seatunnel-incubating-${SEATUNNEL_VERSION}/lib/seatunnel-core-flink.jar $FLINK_HOME/usrlib/seatunnel-core-flink.jar RUN rm -fr apache-seatunnel-incubating-${SEATUNNEL_VERSION}*` ### SeaTunnel Version 2.1.0 ### SeaTunnel Config ```conf env { execution.parallelism = 1 } source { JdbcSource { driver = com.mysql.jdbc.Driver url = "My Database Address" username = "My Database Username" password = "My Database Password" query = "select column1, column2 from TABLE_NAME" result_table_name = TABLE_NAME } } transform { sql { sql = "select column1, column2 from TABLE_NAME" } } sink { ConsoleSink {} } ``` ### Running Command ```shell docker build -t seatunnel:2.1.0-flink-1.13 -f Dockerfile . kubectl create -f https://github.com/jetstack/cert-manager/releases/download/v1.7.1/cert-manager.yaml helm repo add flink-operator-repo https://downloads.apache.org/flink/flink-kubernetes-operator-0.1.0/ helm install flink-kubernetes-operator flink-operator-repo/flink-kubernetes-operator kubectl get pods mkdir -p /mnt/data mv flink.streaming.conf /mnt/data/ kubectl apply -f seatunnel-flink.yaml kubectl logs -f deploy/seatunnel-flink-streaming-example ``` ### Error Exception ```log sed: couldn't open temporary file /opt/flink/conf/sed1i8RS3: Read-only file system sed: couldn't open temporary file /opt/flink/conf/sedsVQITo: Read-only file system /docker-entrypoint.sh: line 73: /opt/flink/conf/flink-conf.yaml: Read-only file system sed: couldn't open temporary file /opt/flink/conf/sedD2KtW7: Read-only file system /docker-entrypoint.sh: line 88: /opt/flink/conf/flink-conf.yaml.tmp: Read-only file system Starting kubernetes-application as a console application on host seatunnel-flink-streaming-example-6c5cbb8969-b8zl2. 2022-06-16 03:42:24,557 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -------------------------------------------------------------------------------- 2022-06-16 03:42:24,559 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Preconfiguration: 2022-06-16 03:42:24,559 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - RESOURCE_PARAMS extraction logs: jvm_params: -Xmx1530082096 -Xms1530082096 -XX:MaxMetaspaceSize=268435456 dynamic_configs: -D jobmanager.memory.off-heap.size=134217728b -D jobmanager.memory.jvm-overhead.min=214748368b -D jobmanager.memory.jvm-metaspace.size=268435456b -D jobmanager.memory.heap.size=1530082096b -D jobmanager.memory.jvm-overhead.max=214748368b logs: INFO [] - Loading configuration property: blob.server.port, 6124 INFO [] - Loading configuration property: kubernetes.jobmanager.replicas, 1 INFO [] - Loading configuration property: jobmanager.rpc.address, seatunnel-flink-streaming-example.default INFO [] - Loading configuration property: kubernetes.taskmanager.cpu, 2.0 INFO [] - Loading configuration property: kubernetes.service-account, flink INFO [] - Loading configuration property: kubernetes.cluster-id, seatunnel-flink-streaming-example INFO [] - Loading configuration property: $internal.application.program-args, --config;/data/mysql-polardb.base_station.conf INFO [] - Loading configuration property: kubernetes.container.image, seatunnel:2.1.0-flink-1.13 INFO [] - Loading configuration property: parallelism.default, 2 INFO [] - Loading configuration property: kubernetes.namespace, default INFO [] - Loading configuration property: taskmanager.numberOfTaskSlots, 2 INFO [] - Loading configuration property: kubernetes.rest-service.exposed.type, ClusterIP INFO [] - Loading configuration property: $internal.application.main, org.apache.seatunnel.SeatunnelFlink INFO [] - Loading configuration property: taskmanager.memory.process.size, 2048m INFO [] - Loading configuration property: kubernetes.internal.jobmanager.entrypoint.class, org.apache.flink.kubernetes.entrypoint.KubernetesApplicationClusterEntrypoint INFO [] - Loading configuration property: kubernetes.pod-template-file, /tmp/podTemplate_9550636116110032429.yaml INFO [] - Loading configuration property: kubernetes.pod-template-file.taskmanager, /tmp/podTemplate_17231682581835062062.yaml INFO [] - Loading configuration property: execution.target, kubernetes-application INFO [] - Loading configuration property: jobmanager.memory.process.size, 2048m INFO [] - Loading configuration property: jobmanager.rpc.port, 6123 INFO [] - Loading configuration property: taskmanager.rpc.port, 6122 INFO [] - Loading configuration property: internal.cluster.execution-mode, NORMAL INFO [] - Loading configuration property: queryable-state.proxy.ports, 6125 INFO [] - Loading configuration property: pipeline.jars, local:///opt/flink/usrlib/seatunnel-core-flink.jar INFO [] - Loading configuration property: kubernetes.jobmanager.cpu, 1.0 INFO [] - Loading configuration property: kubernetes.pod-template-file.jobmanager, /tmp/podTemplate_9424114359362793158.yaml INFO [] - Final Master Memory configuration: INFO [] - Total Process Memory: 2.000gb (2147483648 bytes) INFO [] - Total Flink Memory: 1.550gb (1664299824 bytes) INFO [] - JVM Heap: 1.425gb (1530082096 bytes) INFO [] - Off-heap: 128.000mb (134217728 bytes) INFO [] - JVM Metaspace: 256.000mb (268435456 bytes) INFO [] - JVM Overhead: 204.800mb (214748368 bytes) 2022-06-16 03:42:24,559 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -------------------------------------------------------------------------------- 2022-06-16 03:42:24,560 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting KubernetesApplicationClusterEntrypoint (Version: 1.13.6, Scala: 2.12, Rev:b2ca390, Date:2022-02-03T14:54:22+01:00) 2022-06-16 03:42:24,560 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - OS current user: flink 2022-06-16 03:42:24,560 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Current Hadoop/Kerberos user: <no hadoop dependency found> 2022-06-16 03:42:24,560 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM: OpenJDK 64-Bit Server VM - Oracle Corporation - 1.8/25.332-b09 2022-06-16 03:42:24,560 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Maximum heap size: 1411 MiBytes 2022-06-16 03:42:24,560 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JAVA_HOME: /usr/local/openjdk-8 2022-06-16 03:42:24,560 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - No Hadoop Dependency available 2022-06-16 03:42:24,560 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM Options: 2022-06-16 03:42:24,560 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xmx1530082096 2022-06-16 03:42:24,560 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xms1530082096 2022-06-16 03:42:24,560 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -XX:MaxMetaspaceSize=268435456 2022-06-16 03:42:24,561 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog.file=/opt/flink/log/flink--kubernetes-application-0-seatunnel-flink-streaming-example-6c5cbb8969-b8zl2.log 2022-06-16 03:42:24,561 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog4j.configuration=file:/opt/flink/conf/log4j-console.properties 2022-06-16 03:42:24,561 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog4j.configurationFile=file:/opt/flink/conf/log4j-console.properties 2022-06-16 03:42:24,561 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlogback.configurationFile=file:/opt/flink/conf/logback-console.xml 2022-06-16 03:42:24,561 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Program Arguments: 2022-06-16 03:42:24,561 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D 2022-06-16 03:42:24,561 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.off-heap.size=134217728b 2022-06-16 03:42:24,562 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D 2022-06-16 03:42:24,562 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-overhead.min=214748368b 2022-06-16 03:42:24,562 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D 2022-06-16 03:42:24,562 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-metaspace.size=268435456b 2022-06-16 03:42:24,562 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D 2022-06-16 03:42:24,562 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.heap.size=1530082096b 2022-06-16 03:42:24,562 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D 2022-06-16 03:42:24,562 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-overhead.max=214748368b 2022-06-16 03:42:24,562 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Classpath: /opt/flink/lib/flink-csv-1.13.6.jar:/opt/flink/lib/flink-json-1.13.6.jar:/opt/flink/lib/flink-shaded-zookeeper-3.4.14.jar:/opt/flink/lib/flink-table-blink_2.12-1.13.6.jar:/opt/flink/lib/flink-table_2.12-1.13.6.jar:/opt/flink/lib/log4j-1.2-api-2.17.1.jar:/opt/flink/lib/log4j-api-2.17.1.jar:/opt/flink/lib/log4j-core-2.17.1.jar:/opt/flink/lib/log4j-slf4j-impl-2.17.1.jar:/opt/flink/lib/flink-dist_2.12-1.13.6.jar::: 2022-06-16 03:42:24,562 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -------------------------------------------------------------------------------- 2022-06-16 03:42:24,563 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Registered UNIX signal handlers for [TERM, HUP, INT] 2022-06-16 03:42:24,571 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: blob.server.port, 6124 2022-06-16 03:42:24,571 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.jobmanager.replicas, 1 2022-06-16 03:42:24,571 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.address, seatunnel-flink-streaming-example.default 2022-06-16 03:42:24,571 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.taskmanager.cpu, 2.0 2022-06-16 03:42:24,571 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.service-account, flink 2022-06-16 03:42:24,571 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.cluster-id, seatunnel-flink-streaming-example 2022-06-16 03:42:24,571 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.application.program-args, --config;/data/mysql-polardb.base_station.conf 2022-06-16 03:42:24,571 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.container.image, seatunnel:2.1.0-flink-1.13 2022-06-16 03:42:24,571 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: parallelism.default, 2 2022-06-16 03:42:24,572 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.namespace, default 2022-06-16 03:42:24,572 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.numberOfTaskSlots, 2 2022-06-16 03:42:24,572 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.rest-service.exposed.type, ClusterIP 2022-06-16 03:42:24,572 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.application.main, org.apache.seatunnel.SeatunnelFlink 2022-06-16 03:42:24,572 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.process.size, 2048m 2022-06-16 03:42:24,572 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.internal.jobmanager.entrypoint.class, org.apache.flink.kubernetes.entrypoint.KubernetesApplicationClusterEntrypoint 2022-06-16 03:42:24,572 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.pod-template-file, /tmp/podTemplate_9550636116110032429.yaml 2022-06-16 03:42:24,572 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.pod-template-file.taskmanager, /tmp/podTemplate_17231682581835062062.yaml 2022-06-16 03:42:24,572 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.target, kubernetes-application 2022-06-16 03:42:24,573 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.memory.process.size, 2048m 2022-06-16 03:42:24,573 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.port, 6123 2022-06-16 03:42:24,573 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.rpc.port, 6122 2022-06-16 03:42:24,573 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: internal.cluster.execution-mode, NORMAL 2022-06-16 03:42:24,573 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: queryable-state.proxy.ports, 6125 2022-06-16 03:42:24,573 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: pipeline.jars, local:///opt/flink/usrlib/seatunnel-core-flink.jar 2022-06-16 03:42:24,573 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.jobmanager.cpu, 1.0 2022-06-16 03:42:24,573 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.pod-template-file.jobmanager, /tmp/podTemplate_9424114359362793158.yaml 2022-06-16 03:42:24,879 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting KubernetesApplicationClusterEntrypoint. 2022-06-16 03:42:24,885 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install default filesystem. 2022-06-16 03:42:24,888 INFO org.apache.flink.core.fs.FileSystem [] - Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available. 2022-06-16 03:42:24,948 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install security context. 2022-06-16 03:42:24,954 INFO org.apache.flink.runtime.security.modules.HadoopModuleFactory [] - Cannot create Hadoop Security Module because Hadoop cannot be found in the Classpath. 2022-06-16 03:42:24,956 INFO org.apache.flink.runtime.security.modules.JaasModule [] - Jaas file will be created as /tmp/jaas-7841622857492996650.conf. 2022-06-16 03:42:24,959 INFO org.apache.flink.runtime.security.contexts.HadoopSecurityContextFactory [] - Cannot install HadoopSecurityContext because Hadoop cannot be found in the Classpath. 2022-06-16 03:42:24,960 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Initializing cluster services. 2022-06-16 03:42:24,972 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to start actor system, external address seatunnel-flink-streaming-example.default:6123, bind address 0.0.0.0:6123. 2022-06-16 03:42:25,875 INFO akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started 2022-06-16 03:42:25,939 INFO akka.remote.Remoting [] - Starting remoting 2022-06-16 03:42:26,142 INFO akka.remote.Remoting [] - Remoting started; listening on addresses :[akka.tcp://[email protected]:6123] 2022-06-16 03:42:26,336 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system started at akka.tcp://[email protected]:6123 2022-06-16 03:42:26,353 INFO org.apache.flink.configuration.Configuration [] - Config uses fallback configuration key 'jobmanager.rpc.address' instead of key 'rest.address' 2022-06-16 03:42:26,360 INFO org.apache.flink.runtime.blob.BlobServer [] - Created BLOB server storage directory /tmp/blobStore-57d1cab5-5fdc-42e1-91d8-90e18692e21d 2022-06-16 03:42:26,362 INFO org.apache.flink.runtime.blob.BlobServer [] - Started BLOB server at 0.0.0.0:6124 - max concurrent requests: 50 - max backlog: 1000 2022-06-16 03:42:26,368 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl [] - No metrics reporter configured, no metrics will be exposed/reported. 2022-06-16 03:42:26,370 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to start actor system, external address seatunnel-flink-streaming-example.default:0, bind address 0.0.0.0:0. 2022-06-16 03:42:26,436 INFO akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started 2022-06-16 03:42:26,441 INFO akka.remote.Remoting [] - Starting remoting 2022-06-16 03:42:26,448 INFO akka.remote.Remoting [] - Remoting started; listening on addresses :[akka.tcp://[email protected]:44706] 2022-06-16 03:42:26,456 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system started at akka.tcp://[email protected]:44706 2022-06-16 03:42:26,531 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/rpc/MetricQueryService . 2022-06-16 03:42:26,646 INFO org.apache.flink.configuration.Configuration [] - Config uses fallback configuration key 'jobmanager.rpc.address' instead of key 'rest.address' 2022-06-16 03:42:26,647 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Upload directory /tmp/flink-web-cfab19b8-ae0f-40e5-a09e-7f80d7ea93a3/flink-web-upload does not exist. 2022-06-16 03:42:26,648 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Created directory /tmp/flink-web-cfab19b8-ae0f-40e5-a09e-7f80d7ea93a3/flink-web-upload for file uploads. 2022-06-16 03:42:26,662 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Starting rest endpoint. 2022-06-16 03:42:26,833 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined location of main cluster component log file: /opt/flink/log/flink--kubernetes-application-0-seatunnel-flink-streaming-example-6c5cbb8969-b8zl2.log 2022-06-16 03:42:26,833 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined location of main cluster component stdout file: /opt/flink/log/flink--kubernetes-application-0-seatunnel-flink-streaming-example-6c5cbb8969-b8zl2.out 2022-06-16 03:42:27,055 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Rest endpoint listening at seatunnel-flink-streaming-example.default:8081 2022-06-16 03:42:27,056 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - http://seatunnel-flink-streaming-example.default:8081 was granted leadership with leaderSessionID=00000000-0000-0000-0000-000000000000 2022-06-16 03:42:27,057 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Web frontend listening at http://seatunnel-flink-streaming-example.default:8081. 2022-06-16 03:42:27,544 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: blob.server.port, 6124 2022-06-16 03:42:27,544 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.jobmanager.replicas, 1 2022-06-16 03:42:27,544 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.address, seatunnel-flink-streaming-example.default 2022-06-16 03:42:27,544 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.taskmanager.cpu, 2.0 2022-06-16 03:42:27,544 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.service-account, flink 2022-06-16 03:42:27,544 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.cluster-id, seatunnel-flink-streaming-example 2022-06-16 03:42:27,544 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.application.program-args, --config;/data/mysql-polardb.base_station.conf 2022-06-16 03:42:27,544 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.container.image, seatunnel:2.1.0-flink-1.13 2022-06-16 03:42:27,544 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: parallelism.default, 2 2022-06-16 03:42:27,544 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.namespace, default 2022-06-16 03:42:27,544 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.numberOfTaskSlots, 2 2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.rest-service.exposed.type, ClusterIP 2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.application.main, org.apache.seatunnel.SeatunnelFlink 2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.process.size, 2048m 2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.internal.jobmanager.entrypoint.class, org.apache.flink.kubernetes.entrypoint.KubernetesApplicationClusterEntrypoint 2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.pod-template-file, /tmp/podTemplate_9550636116110032429.yaml 2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.pod-template-file.taskmanager, /tmp/podTemplate_17231682581835062062.yaml 2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.target, kubernetes-application 2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.memory.process.size, 2048m 2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.port, 6123 2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.rpc.port, 6122 2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: internal.cluster.execution-mode, NORMAL 2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: queryable-state.proxy.ports, 6125 2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: pipeline.jars, local:///opt/flink/usrlib/seatunnel-core-flink.jar 2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.jobmanager.cpu, 1.0 2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.pod-template-file.jobmanager, /tmp/podTemplate_9424114359362793158.yaml 2022-06-16 03:42:27,549 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager at akka://flink/user/rpc/resourcemanager_0 . 2022-06-16 03:42:27,562 INFO org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunner [] - DefaultDispatcherRunner was granted leadership with leader id 00000000-0000-0000-0000-000000000000. Creating new DispatcherLeaderProcess. 2022-06-16 03:42:27,565 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Start SessionDispatcherLeaderProcess. 2022-06-16 03:42:27,630 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Recover all persisted job graphs. 2022-06-16 03:42:27,630 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Successfully recovered 0 persisted job graphs. 2022-06-16 03:42:27,632 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Starting the resource manager. 2022-06-16 03:42:27,638 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at akka://flink/user/rpc/dispatcher_1 . 2022-06-16 03:42:27,651 INFO org.apache.flink.client.ClientUtils [] - Starting program (detached: true) 2022-06-16 03:42:27,758 INFO org.apache.seatunnel.config.ConfigBuilder [] - Loading config file: /data/mysql-polardb.base_station.conf 2022-06-16 03:42:27,856 INFO org.apache.seatunnel.config.ConfigBuilder [] - parsed config file: { "env" : { "execution.parallelism" : 1 }, "sink" : [ { "plugin_name" : "ConsoleSink" } ], "source" : [ { "driver" : "com.mysql.jdbc.Driver", "password" : "My Database Password", "plugin_name" : "JdbcSource", "query" : "select column1, column2 from TABLE_NAME", "result_table_name" : "TABLE_NAME", "url" : "My Database Address", "username" : "My Database Username" } ], "transform" : [ { "plugin_name" : "sql", "sql" : "select column1, column2 from TABLE_NAME" } ] } 2022-06-16 03:42:28,629 WARN org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap [] - Application failed unexpectedly: java.util.concurrent.CompletionException: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application. at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) ~[?:1.8.0_332] at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) ~[?:1.8.0_332] at java.util.concurrent.CompletableFuture.uniCompose(CompletableFuture.java:957) ~[?:1.8.0_332] at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:940) ~[?:1.8.0_332] at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_332] at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_332] at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:257) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.lambda$runApplicationAsync$1(ApplicationDispatcherBootstrap.java:212) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_332] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_332] at org.apache.flink.runtime.concurrent.akka.ActorSystemScheduledExecutorAdapter$ScheduledFutureTask.run(ActorSystemScheduledExecutorAdapter.java:159) [flink-dist_2.12-1.13.6.jar:1.13.6] at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:40) [flink-dist_2.12-1.13.6.jar:1.13.6] at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:44) [flink-dist_2.12-1.13.6.jar:1.13.6] at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) [flink-dist_2.12-1.13.6.jar:1.13.6] at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) [flink-dist_2.12-1.13.6.jar:1.13.6] at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) [flink-dist_2.12-1.13.6.jar:1.13.6] at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) [flink-dist_2.12-1.13.6.jar:1.13.6] Caused by: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application. ... 11 more Caused by: java.lang.NoClassDefFoundError: org/apache/flink/connector/jdbc/JdbcInputFormat at org.apache.seatunnel.flink.source.JdbcSource.prepare(JdbcSource.java:163) ~[?:?] at org.apache.seatunnel.flink.source.JdbcSource.prepare(JdbcSource.java:60) ~[?:?] at org.apache.seatunnel.Seatunnel.lambda$prepare$0(Seatunnel.java:160) ~[?:?] at java.util.ArrayList.forEach(ArrayList.java:1259) ~[?:1.8.0_332] at org.apache.seatunnel.Seatunnel.prepare(Seatunnel.java:160) ~[?:?] at org.apache.seatunnel.Seatunnel.entryPoint(Seatunnel.java:104) ~[?:?] at org.apache.seatunnel.Seatunnel.run(Seatunnel.java:65) ~[?:?] at org.apache.seatunnel.SeatunnelFlink.main(SeatunnelFlink.java:29) ~[?:?] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_332] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_332] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_332] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_332] at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:242) ~[flink-dist_2.12-1.13.6.jar:1.13.6] ... 10 more Caused by: java.lang.ClassNotFoundException: org.apache.flink.connector.jdbc.JdbcInputFormat at java.net.URLClassLoader.findClass(URLClassLoader.java:387) ~[?:1.8.0_332] at java.lang.ClassLoader.loadClass(ClassLoader.java:418) ~[?:1.8.0_332] at org.apache.flink.util.FlinkUserCodeClassLoader.loadClassWithoutExceptionHandling(FlinkUserCodeClassLoader.java:64) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.util.ChildFirstClassLoader.loadClassWithoutExceptionHandling(ChildFirstClassLoader.java:65) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.util.FlinkUserCodeClassLoader.loadClass(FlinkUserCodeClassLoader.java:48) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ~[?:1.8.0_332] at org.apache.seatunnel.flink.source.JdbcSource.prepare(JdbcSource.java:163) ~[?:?] at org.apache.seatunnel.flink.source.JdbcSource.prepare(JdbcSource.java:60) ~[?:?] at org.apache.seatunnel.Seatunnel.lambda$prepare$0(Seatunnel.java:160) ~[?:?] at java.util.ArrayList.forEach(ArrayList.java:1259) ~[?:1.8.0_332] at org.apache.seatunnel.Seatunnel.prepare(Seatunnel.java:160) ~[?:?] at org.apache.seatunnel.Seatunnel.entryPoint(Seatunnel.java:104) ~[?:?] at org.apache.seatunnel.Seatunnel.run(Seatunnel.java:65) ~[?:?] at org.apache.seatunnel.SeatunnelFlink.main(SeatunnelFlink.java:29) ~[?:?] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_332] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_332] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_332] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_332] at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:242) ~[flink-dist_2.12-1.13.6.jar:1.13.6] ... 10 more 2022-06-16 03:42:28,641 ERROR org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Fatal error occurred in the cluster entrypoint. org.apache.flink.util.FlinkException: Application failed unexpectedly. at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.lambda$runApplicationAndShutdownClusterAsync$0(ApplicationDispatcherBootstrap.java:170) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:836) ~[?:1.8.0_332] at java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:811) ~[?:1.8.0_332] at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_332] at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_332] at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:257) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.lambda$runApplicationAsync$1(ApplicationDispatcherBootstrap.java:212) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_332] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_332] at org.apache.flink.runtime.concurrent.akka.ActorSystemScheduledExecutorAdapter$ScheduledFutureTask.run(ActorSystemScheduledExecutorAdapter.java:159) [flink-dist_2.12-1.13.6.jar:1.13.6] at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:40) [flink-dist_2.12-1.13.6.jar:1.13.6] at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:44) [flink-dist_2.12-1.13.6.jar:1.13.6] at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) [flink-dist_2.12-1.13.6.jar:1.13.6] at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) [flink-dist_2.12-1.13.6.jar:1.13.6] at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) [flink-dist_2.12-1.13.6.jar:1.13.6] at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) [flink-dist_2.12-1.13.6.jar:1.13.6] Caused by: java.util.concurrent.CompletionException: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application. at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) ~[?:1.8.0_332] at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) ~[?:1.8.0_332] at java.util.concurrent.CompletableFuture.uniCompose(CompletableFuture.java:957) ~[?:1.8.0_332] at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:940) ~[?:1.8.0_332] ... 13 more Caused by: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application. ... 11 more Caused by: java.lang.NoClassDefFoundError: org/apache/flink/connector/jdbc/JdbcInputFormat at org.apache.seatunnel.flink.source.JdbcSource.prepare(JdbcSource.java:163) ~[?:?] at org.apache.seatunnel.flink.source.JdbcSource.prepare(JdbcSource.java:60) ~[?:?] at org.apache.seatunnel.Seatunnel.lambda$prepare$0(Seatunnel.java:160) ~[?:?] at java.util.ArrayList.forEach(ArrayList.java:1259) ~[?:1.8.0_332] at org.apache.seatunnel.Seatunnel.prepare(Seatunnel.java:160) ~[?:?] at org.apache.seatunnel.Seatunnel.entryPoint(Seatunnel.java:104) ~[?:?] at org.apache.seatunnel.Seatunnel.run(Seatunnel.java:65) ~[?:?] at org.apache.seatunnel.SeatunnelFlink.main(SeatunnelFlink.java:29) ~[?:?] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_332] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_332] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_332] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_332] at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:242) ~[flink-dist_2.12-1.13.6.jar:1.13.6] ... 10 more Caused by: java.lang.ClassNotFoundException: org.apache.flink.connector.jdbc.JdbcInputFormat at java.net.URLClassLoader.findClass(URLClassLoader.java:387) ~[?:1.8.0_332] at java.lang.ClassLoader.loadClass(ClassLoader.java:418) ~[?:1.8.0_332] at org.apache.flink.util.FlinkUserCodeClassLoader.loadClassWithoutExceptionHandling(FlinkUserCodeClassLoader.java:64) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.util.ChildFirstClassLoader.loadClassWithoutExceptionHandling(ChildFirstClassLoader.java:65) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.util.FlinkUserCodeClassLoader.loadClass(FlinkUserCodeClassLoader.java:48) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ~[?:1.8.0_332] at org.apache.seatunnel.flink.source.JdbcSource.prepare(JdbcSource.java:163) ~[?:?] at org.apache.seatunnel.flink.source.JdbcSource.prepare(JdbcSource.java:60) ~[?:?] at org.apache.seatunnel.Seatunnel.lambda$prepare$0(Seatunnel.java:160) ~[?:?] at java.util.ArrayList.forEach(ArrayList.java:1259) ~[?:1.8.0_332] at org.apache.seatunnel.Seatunnel.prepare(Seatunnel.java:160) ~[?:?] at org.apache.seatunnel.Seatunnel.entryPoint(Seatunnel.java:104) ~[?:?] at org.apache.seatunnel.Seatunnel.run(Seatunnel.java:65) ~[?:?] at org.apache.seatunnel.SeatunnelFlink.main(SeatunnelFlink.java:29) ~[?:?] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_332] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_332] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_332] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_332] at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) ~[flink-dist_2.12-1.13.6.jar:1.13.6] at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:242) ~[flink-dist_2.12-1.13.6.jar:1.13.6] ... 10 more 2022-06-16 03:42:29,651 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Shutting down remote daemon. 2022-06-16 03:42:29,653 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remote daemon shut down; proceeding with flushing remote transports. 2022-06-16 03:42:29,654 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Shutting down remote daemon. 2022-06-16 03:42:29,655 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remote daemon shut down; proceeding with flushing remote transports. 2022-06-16 03:42:29,735 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remoting shut down. 2022-06-16 03:42:29,736 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remoting shut down. ``` ### Flink or Spark Version Flink version:1.13 ### Java or Scala Version _No response_ ### Screenshots _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
