francocalvo commented on issue #2267: URL: https://github.com/apache/fluss/issues/2267#issuecomment-3694371531
I've tried re-deploying many times. I can start fresh and share logs. These were the first logs from the current deployment. I already saw data in the Fluss table by this point. <details> <summary> logs </summary> ``` 2025-12-28 01:27:51,046 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -------------------------------------------------------------------------------- 2025-12-28 01:27:51,051 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Preconfiguration: 2025-12-28 01:27:51,051 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - RESOURCE_PARAMS extraction logs: jvm_params: -Xmx1073741824 -Xms1073741824 -XX:MaxMetaspaceSize=268435456 dynamic_configs: -D jobmanager.memory.off-heap.size=134217728b -D jobmanager.memory.jvm-overhead.min=201326592b -D jobmanager.memory.jvm-metaspace.size=268435456b -D jobmanager.memory.heap.size=1073741824b -D jobmanager.memory.jvm-overhead.max=201326592b logs: INFO [] - Using standard YAML parser to load flink configuration file from /opt/flink/conf/config.yaml. INFO [] - Loading configuration property: blob.server.port, 6124 INFO [] - Loading configuration property: s3.path-style-access, true INFO [] - Loading configuration property: s3.entropy.enabled, true INFO [] - Loading configuration property: taskmanager.memory.process.size, 1728m INFO [] - Loading configuration property: taskmanager.bind-host, 0.0.0.0 INFO [] - Loading configuration property: jobmanager.execution.failover-strategy, region INFO [] - Loading configuration property: jobmanager.rpc.address, jobmanager INFO [] - Loading configuration property: jobmanager.memory.process.size, 1600m INFO [] - Loading configuration property: state.savepoints.dir, s3://warehouse/savepoints INFO [] - Loading configuration property: jobmanager.rpc.port, 6123 INFO [] - Loading configuration property: query.server.port, 6125 INFO [] - Loading configuration property: rest.bind-address, 0.0.0.0 INFO [] - Loading configuration property: s3.access-key, GK52146e50e9e1136a72bdfb00 INFO [] - Loading configuration property: s3.secret-key, ****** INFO [] - Loading configuration property: jobmanager.bind-host, 0.0.0.0 INFO [] - Loading configuration property: s3.endpoint, http://192.168.1.4:3900 INFO [] - Loading configuration property: s3.multiobjectdelete.enable, false INFO [] - Loading configuration property: parallelism.default, 1 INFO [] - Loading configuration property: taskmanager.numberOfTaskSlots, 1 INFO [] - Loading configuration property: rest.address, 0.0.0.0 INFO [] - Loading configuration property: env.java.opts.all, --add-exports=java.base/sun.net.util=ALL-UNNAMED --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.api=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.parser=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.tree=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.util=ALL-UNNAMED --add-exports=java.security.jgss/sun.security.krb5=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.net=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.nio=ALL-UNNAMED --add-opens=java.base/sun.nio.ch=ALL-UNNAMED --add-opens=java.base/java.lang.reflect=ALL-UNNAMED --add-opens=java.base/java.text=ALL-UNNAMED --add-opens=java.base/java.time=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL- UNNAMED --add-opens=java.base/java.util.concurrent.atomic=ALL-UNNAMED --add-opens=java.base/java.util.concurrent.locks=ALL-UNNAMED INFO [] - Loading configuration property: state.backend.type, rocksdb INFO [] - Loading configuration property: state.checkpoints.dir, s3://warehouse/checkpoints INFO [] - The derived from fraction jvm overhead memory (160.000mb (167772162 bytes)) is less than its min value 192.000mb (201326592 bytes), min value will be used instead INFO [] - Final Master Memory configuration: INFO [] - Total Process Memory: 1.563gb (1677721600 bytes) INFO [] - Total Flink Memory: 1.125gb (1207959552 bytes) INFO [] - JVM Heap: 1024.000mb (1073741824 bytes) INFO [] - Off-heap: 128.000mb (134217728 bytes) INFO [] - JVM Metaspace: 256.000mb (268435456 bytes) INFO [] - JVM Overhead: 192.000mb (201326592 bytes) 2025-12-28 01:27:51,053 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -------------------------------------------------------------------------------- 2025-12-28 01:27:51,054 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting StandaloneSessionClusterEntrypoint (Version: 1.20.3, Scala: 2.12, Rev:01e3a6d, Date:2025-09-20T02:22:05+02:00) 2025-12-28 01:27:51,054 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - OS current user: flink 2025-12-28 01:27:51,471 WARN org.apache.hadoop.util.NativeCodeLoader [] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2025-12-28 01:27:51,571 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Current Hadoop/Kerberos user: flink 2025-12-28 01:27:51,571 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM: OpenJDK 64-Bit Server VM - Eclipse Adoptium - 17/17.0.17+10 2025-12-28 01:27:51,571 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Arch: amd64 2025-12-28 01:27:51,571 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Maximum heap size: 1024 MiBytes 2025-12-28 01:27:51,571 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JAVA_HOME: /opt/java/openjdk 2025-12-28 01:27:51,574 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Hadoop version: 2.8.3 2025-12-28 01:27:51,574 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM Options: 2025-12-28 01:27:51,575 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xmx1073741824 2025-12-28 01:27:51,575 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xms1073741824 2025-12-28 01:27:51,575 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -XX:MaxMetaspaceSize=268435456 2025-12-28 01:27:51,575 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -XX:+IgnoreUnrecognizedVMOptions 2025-12-28 01:27:51,575 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-exports=java.base/sun.net.util=ALL-UNNAMED 2025-12-28 01:27:51,576 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED 2025-12-28 01:27:51,576 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-exports=jdk.compiler/com.sun.tools.javac.api=ALL-UNNAMED 2025-12-28 01:27:51,576 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED 2025-12-28 01:27:51,577 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-exports=jdk.compiler/com.sun.tools.javac.parser=ALL-UNNAMED 2025-12-28 01:27:51,577 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-exports=jdk.compiler/com.sun.tools.javac.tree=ALL-UNNAMED 2025-12-28 01:27:51,577 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-exports=jdk.compiler/com.sun.tools.javac.util=ALL-UNNAMED 2025-12-28 01:27:51,577 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-exports=java.security.jgss/sun.security.krb5=ALL-UNNAMED 2025-12-28 01:27:51,577 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-opens=java.base/java.lang=ALL-UNNAMED 2025-12-28 01:27:51,578 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-opens=java.base/java.net=ALL-UNNAMED 2025-12-28 01:27:51,578 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-opens=java.base/java.io=ALL-UNNAMED 2025-12-28 01:27:51,578 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-opens=java.base/java.nio=ALL-UNNAMED 2025-12-28 01:27:51,578 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-opens=java.base/sun.nio.ch=ALL-UNNAMED 2025-12-28 01:27:51,579 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-opens=java.base/java.lang.reflect=ALL-UNNAMED 2025-12-28 01:27:51,579 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-opens=java.base/java.text=ALL-UNNAMED 2025-12-28 01:27:51,579 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-opens=java.base/java.time=ALL-UNNAMED 2025-12-28 01:27:51,579 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-opens=java.base/java.util=ALL-UNNAMED 2025-12-28 01:27:51,579 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-opens=java.base/java.util.concurrent=ALL-UNNAMED 2025-12-28 01:27:51,580 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-opens=java.base/java.util.concurrent.atomic=ALL-UNNAMED 2025-12-28 01:27:51,580 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --add-opens=java.base/java.util.concurrent.locks=ALL-UNNAMED 2025-12-28 01:27:51,580 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog.file=/opt/flink/log/flink--standalonesession-0-1f1247f7c4c2.log 2025-12-28 01:27:51,580 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog4j.configuration=file:/opt/flink/conf/log4j-console.properties 2025-12-28 01:27:51,580 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog4j.configurationFile=file:/opt/flink/conf/log4j-console.properties 2025-12-28 01:27:51,580 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlogback.configurationFile=file:/opt/flink/conf/logback-console.xml 2025-12-28 01:27:51,581 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Program Arguments: 2025-12-28 01:27:51,582 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D 2025-12-28 01:27:51,582 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.off-heap.size=134217728b 2025-12-28 01:27:51,583 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D 2025-12-28 01:27:51,583 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-overhead.min=201326592b 2025-12-28 01:27:51,583 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D 2025-12-28 01:27:51,583 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-metaspace.size=268435456b 2025-12-28 01:27:51,583 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D 2025-12-28 01:27:51,583 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.heap.size=1073741824b 2025-12-28 01:27:51,584 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D 2025-12-28 01:27:51,584 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-overhead.max=201326592b 2025-12-28 01:27:51,584 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --configDir 2025-12-28 01:27:51,584 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - /opt/flink/conf 2025-12-28 01:27:51,584 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --executionMode 2025-12-28 01:27:51,584 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - cluster 2025-12-28 01:27:51,585 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Classpath: /opt/flink/lib/flink-cdc-pipeline-connector-doris-3.5.0.jar:/opt/flink/lib/flink-cdc-pipeline-connector-fluss-3.5.0.jar:/opt/flink/lib/flink-cdc-pipeline-connector-kafka-3.5.0.jar:/opt/flink/lib/flink-cdc-pipeline-connector-mysql-3.5.0.jar:/opt/flink/lib/flink-cdc-pipeline-connector-paimon-3.5.0.jar:/opt/flink/lib/flink-cdc-pipeline-connector-postgres-3.5.0.jar:/opt/flink/lib/flink-cdc-pipeline-connector-starrocks-3.5.0.jar:/opt/flink/lib/flink-cep-1.20.3.jar:/opt/flink/lib/flink-connector-files-1.20.3.jar:/opt/flink/lib/flink-csv-1.20.3.jar:/opt/flink/lib/flink-json-1.20.3.jar:/opt/flink/lib/flink-scala_2.12-1.20.3.jar:/opt/flink/lib/flink-shaded-hadoop-2-uber-2.8.3-10.0.jar:/opt/flink/lib/flink-sql-avro-1.20.0.jar:/opt/flink/lib/flink-sql-connector-kafka-3.4.0-1.20.jar:/opt/flink/lib/flink-sql-parquet-1.20.0.jar:/opt/flink/lib/flink-table-api-java-uber-1.20.3.jar:/opt/flin k/lib/flink-table-planner-loader-1.20.3.jar:/opt/flink/lib/flink-table-runtime-1.20.3.jar:/opt/flink/lib/fluss-flink-1.20-0.8.0-incubating.jar:/opt/flink/lib/fluss-flink-tiering-0.8.0-incubating.jar:/opt/flink/lib/fluss-fs-hdfs-0.8.0-incubating.jar:/opt/flink/lib/fluss-fs-s3-0.8.0-incubating.jar:/opt/flink/lib/fluss-lake-paimon-0.8.0-incubating.jar:/opt/flink/lib/log4j-1.2-api-2.24.3.jar:/opt/flink/lib/log4j-api-2.24.3.jar:/opt/flink/lib/log4j-core-2.24.3.jar:/opt/flink/lib/log4j-slf4j-impl-2.24.3.jar:/opt/flink/lib/mysql-connector-j-8.3.0.jar:/opt/flink/lib/paimon-flink-1.20-1.3.1.jar:/opt/flink/lib/paimon-flink-action-1.3.1.jar:/opt/flink/lib/paimon-s3-1.3.1.jar:/opt/flink/lib/postgresql-42.7.3.jar:/opt/flink/lib/flink-dist-1.20.3.jar:::: 2025-12-28 01:27:51,585 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -------------------------------------------------------------------------------- 2025-12-28 01:27:51,586 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Registered UNIX signal handlers for [TERM, HUP, INT] 2025-12-28 01:27:51,620 INFO org.apache.flink.configuration.GlobalConfiguration [] - Using standard YAML parser to load flink configuration file from /opt/flink/conf/config.yaml. 2025-12-28 01:27:51,743 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: blob.server.port, 6124 2025-12-28 01:27:51,746 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.path-style-access, true 2025-12-28 01:27:51,747 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.entropy.enabled, true 2025-12-28 01:27:51,749 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.process.size, 1728m 2025-12-28 01:27:51,750 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.bind-host, 0.0.0.0 2025-12-28 01:27:51,750 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.execution.failover-strategy, region 2025-12-28 01:27:51,750 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.address, jobmanager 2025-12-28 01:27:51,750 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.memory.process.size, 1600m 2025-12-28 01:27:51,751 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.savepoints.dir, s3://warehouse/savepoints 2025-12-28 01:27:51,751 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.port, 6123 2025-12-28 01:27:51,751 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: query.server.port, 6125 2025-12-28 01:27:51,751 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: rest.bind-address, 0.0.0.0 2025-12-28 01:27:51,751 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.access-key, GK52146e50e9e1136a72bdfb00 2025-12-28 01:27:51,751 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.secret-key, ****** 2025-12-28 01:27:51,752 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.bind-host, 0.0.0.0 2025-12-28 01:27:51,753 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.endpoint, http://192.168.1.4:3900 2025-12-28 01:27:51,753 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: s3.multiobjectdelete.enable, false 2025-12-28 01:27:51,753 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: parallelism.default, 1 2025-12-28 01:27:51,754 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.numberOfTaskSlots, 1 2025-12-28 01:27:51,759 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: rest.address, 0.0.0.0 2025-12-28 01:27:51,760 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: env.java.opts.all, --add-exports=java.base/sun.net.util=ALL-UNNAMED --add-exports=java.rmi/sun.rmi.registry=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.api=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.file=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.parser=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.tree=ALL-UNNAMED --add-exports=jdk.compiler/com.sun.tools.javac.util=ALL-UNNAMED --add-exports=java.security.jgss/sun.security.krb5=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.net=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.nio=ALL-UNNAMED --add-opens=java.base/sun.nio.ch=ALL-UNNAMED --add-opens=java.base/java.lang.reflect=ALL-UNNAMED --add-opens=java.base/java.text=ALL-UNNAMED --add-opens=java.base/java.time=ALL-UNNAMED --add- opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.base/java.util.concurrent.atomic=ALL-UNNAMED --add-opens=java.base/java.util.concurrent.locks=ALL-UNNAMED 2025-12-28 01:27:51,760 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.backend.type, rocksdb 2025-12-28 01:27:51,760 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: state.checkpoints.dir, s3://warehouse/checkpoints 2025-12-28 01:27:51,761 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading dynamic configuration property: jobmanager.memory.off-heap.size, 134217728b 2025-12-28 01:27:51,761 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading dynamic configuration property: jobmanager.memory.jvm-overhead.min, 201326592b 2025-12-28 01:27:51,761 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading dynamic configuration property: jobmanager.memory.jvm-metaspace.size, 268435456b 2025-12-28 01:27:51,762 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading dynamic configuration property: jobmanager.memory.heap.size, 1073741824b 2025-12-28 01:27:51,762 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading dynamic configuration property: jobmanager.memory.jvm-overhead.max, 201326592b 2025-12-28 01:27:51,815 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting StandaloneSessionClusterEntrypoint. 2025-12-28 01:27:51,899 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install default filesystem. 2025-12-28 01:27:51,948 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID not found, creating it: metrics-prometheus 2025-12-28 01:27:51,960 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID not found, creating it: metrics-graphite 2025-12-28 01:27:51,961 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID not found, creating it: external-resource-gpu 2025-12-28 01:27:51,962 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID not found, creating it: metrics-jmx 2025-12-28 01:27:51,963 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID not found, creating it: metrics-statsd 2025-12-28 01:27:51,966 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID not found, creating it: metrics-slf4j 2025-12-28 01:27:51,967 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID not found, creating it: metrics-datadog 2025-12-28 01:27:51,971 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID not found, creating it: metrics-influx 2025-12-28 01:27:51,971 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID not found, creating it: s3-fs-hadoop 2025-12-28 01:27:52,083 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install security context. 2025-12-28 01:27:52,121 WARN org.apache.flink.runtime.util.HadoopUtils [] - Could not find Hadoop configuration via any of the supported methods (Flink configuration, environment variables). 2025-12-28 01:27:52,169 INFO org.apache.flink.runtime.security.modules.HadoopModule [] - Hadoop user set to flink (auth:SIMPLE) 2025-12-28 01:27:52,170 INFO org.apache.flink.runtime.security.modules.HadoopModule [] - Kerberos security is disabled. 2025-12-28 01:27:52,178 INFO org.apache.flink.runtime.security.modules.JaasModule [] - Jaas file will be created as /tmp/jaas-15926593478831733710.conf. 2025-12-28 01:27:52,187 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Initializing cluster services. 2025-12-28 01:27:52,197 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Using working directory: WorkingDirectory(/tmp/jm_188638b6e5a2aaf53ebe17ee807080bf). 2025-12-28 01:27:52,553 INFO org.apache.flink.runtime.rpc.pekko.PekkoRpcServiceUtils [] - Trying to start actor system, external address jobmanager:6123, bind address 0.0.0.0:6123. 2025-12-28 01:27:53,204 INFO org.apache.pekko.event.slf4j.Slf4jLogger [] - Slf4jLogger started 2025-12-28 01:27:53,232 INFO org.apache.pekko.remote.RemoteActorRefProvider [] - Pekko Cluster not in use - enabling unsafe features anyway because `pekko.remote.use-unsafe-remote-features-outside-cluster` has been enabled. 2025-12-28 01:27:53,234 INFO org.apache.pekko.remote.Remoting [] - Starting remoting 2025-12-28 01:27:53,445 INFO org.apache.pekko.remote.Remoting [] - Remoting started; listening on addresses :[pekko.tcp://flink@jobmanager:6123] 2025-12-28 01:27:53,753 INFO org.apache.flink.runtime.rpc.pekko.PekkoRpcServiceUtils [] - Actor system started at pekko.tcp://flink@jobmanager:6123 2025-12-28 01:27:53,831 INFO org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - Loading delegation token providers 2025-12-28 01:27:53,842 WARN org.apache.flink.runtime.util.HadoopUtils [] - Could not find Hadoop configuration via any of the supported methods (Flink configuration, environment variables). 2025-12-28 01:27:53,847 INFO org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - Delegation token provider hadoopfs loaded and initialized 2025-12-28 01:27:53,852 WARN org.apache.flink.runtime.util.HadoopUtils [] - Could not find Hadoop configuration via any of the supported methods (Flink configuration, environment variables). 2025-12-28 01:27:53,853 INFO org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - Delegation token provider hbase loaded and initialized 2025-12-28 01:27:53,854 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-prometheus 2025-12-28 01:27:53,854 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-graphite 2025-12-28 01:27:53,854 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: external-resource-gpu 2025-12-28 01:27:53,854 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-jmx 2025-12-28 01:27:53,854 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-statsd 2025-12-28 01:27:53,855 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-slf4j 2025-12-28 01:27:53,855 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-datadog 2025-12-28 01:27:53,855 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-influx 2025-12-28 01:27:53,856 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: s3-fs-hadoop 2025-12-28 01:27:53,861 INFO org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - Delegation token provider s3-hadoop loaded and initialized 2025-12-28 01:27:53,864 INFO org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - Delegation token providers loaded successfully 2025-12-28 01:27:53,866 INFO org.apache.flink.runtime.security.token.DelegationTokenReceiverRepository [] - Loading delegation token receivers 2025-12-28 01:27:53,870 INFO org.apache.flink.runtime.security.token.DelegationTokenReceiverRepository [] - Delegation token receiver hadoopfs loaded and initialized 2025-12-28 01:27:53,874 INFO org.apache.flink.runtime.security.token.DelegationTokenReceiverRepository [] - Delegation token receiver hbase loaded and initialized 2025-12-28 01:27:53,876 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-prometheus 2025-12-28 01:27:53,876 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-graphite 2025-12-28 01:27:53,876 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: external-resource-gpu 2025-12-28 01:27:53,876 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-jmx 2025-12-28 01:27:53,877 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-statsd 2025-12-28 01:27:53,877 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-slf4j 2025-12-28 01:27:53,879 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-datadog 2025-12-28 01:27:53,879 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: metrics-influx 2025-12-28 01:27:53,880 INFO org.apache.flink.core.plugin.DefaultPluginManager [] - Plugin loader with ID found, reusing it: s3-fs-hadoop 2025-12-28 01:27:53,885 INFO org.apache.flink.runtime.security.token.DelegationTokenReceiverRepository [] - Delegation token receiver s3-hadoop loaded and initialized 2025-12-28 01:27:53,887 INFO org.apache.flink.runtime.security.token.DelegationTokenReceiverRepository [] - Delegation token receivers loaded successfully 2025-12-28 01:27:53,887 INFO org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - Checking provider and receiver instances consistency 2025-12-28 01:27:53,888 INFO org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - Provider and receiver instances are consistent 2025-12-28 01:27:53,890 INFO org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - Obtaining delegation tokens 2025-12-28 01:27:53,902 INFO org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - Delegation tokens obtained successfully 2025-12-28 01:27:53,906 WARN org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - No tokens obtained so skipping notifications 2025-12-28 01:27:53,939 INFO org.apache.flink.runtime.blob.BlobServer [] - Created BLOB server storage directory /tmp/jm_188638b6e5a2aaf53ebe17ee807080bf/blobStorage 2025-12-28 01:27:53,945 INFO org.apache.flink.runtime.blob.BlobServer [] - Started BLOB server at 0.0.0.0:6124 - max concurrent requests: 50 - max backlog: 1000 2025-12-28 01:27:53,967 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl [] - No metrics reporter configured, no metrics will be exposed/reported. 2025-12-28 01:27:53,968 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl [] - No trace reporter configured, no metrics will be exposed/reported. 2025-12-28 01:27:53,974 INFO org.apache.flink.runtime.rpc.pekko.PekkoRpcServiceUtils [] - Trying to start actor system, external address jobmanager:0, bind address 0.0.0.0:0. 2025-12-28 01:27:53,996 INFO org.apache.pekko.event.slf4j.Slf4jLogger [] - Slf4jLogger started 2025-12-28 01:27:54,001 INFO org.apache.pekko.remote.RemoteActorRefProvider [] - Pekko Cluster not in use - enabling unsafe features anyway because `pekko.remote.use-unsafe-remote-features-outside-cluster` has been enabled. 2025-12-28 01:27:54,002 INFO org.apache.pekko.remote.Remoting [] - Starting remoting 2025-12-28 01:27:54,019 INFO org.apache.pekko.remote.Remoting [] - Remoting started; listening on addresses :[pekko.tcp://flink-metrics@jobmanager:42695] 2025-12-28 01:27:54,042 INFO org.apache.flink.runtime.rpc.pekko.PekkoRpcServiceUtils [] - Actor system started at pekko.tcp://flink-metrics@jobmanager:42695 2025-12-28 01:27:54,084 INFO org.apache.flink.runtime.rpc.pekko.PekkoRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at pekko://flink-metrics/user/rpc/MetricQueryService . 2025-12-28 01:27:54,253 INFO org.apache.flink.runtime.dispatcher.FileExecutionGraphInfoStore [] - Initializing FileExecutionGraphInfoStore: Storage directory /tmp/executionGraphStore-e0ec66ce-0115-4a7e-9b10-c66c16e89e24, expiration time 3600000, maximum cache size 52428800 bytes. 2025-12-28 01:27:54,313 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Upload directory /tmp/flink-web-e918ec35-b35a-4ec8-a09e-5d0d48c1e878/flink-web-upload does not exist. 2025-12-28 01:27:54,314 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Created directory /tmp/flink-web-e918ec35-b35a-4ec8-a09e-5d0d48c1e878/flink-web-upload for file uploads. 2025-12-28 01:27:54,317 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Starting rest endpoint. 2025-12-28 01:27:54,697 WARN org.apache.flink.configuration.Configuration [] - Config uses deprecated configuration key 'state.savepoints.dir' instead of proper key 'execution.checkpointing.savepoint-dir' 2025-12-28 01:27:54,750 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined location of main cluster component log file: /opt/flink/log/flink--standalonesession-0-1f1247f7c4c2.log 2025-12-28 01:27:54,750 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined location of main cluster component stdout file: /opt/flink/log/flink--standalonesession-0-1f1247f7c4c2.out 2025-12-28 01:27:54,795 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Rest endpoint listening at 0.0.0.0:8081 2025-12-28 01:27:54,800 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - http://0.0.0.0:8081 was granted leadership with leaderSessionID=00000000-0000-0000-0000-000000000000 2025-12-28 01:27:54,810 INFO org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint [] - Web frontend listening at http://0.0.0.0:8081. 2025-12-28 01:27:54,852 INFO org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunner [] - DefaultDispatcherRunner was granted leadership with leader id 00000000-0000-0000-0000-000000000000. Creating new DispatcherLeaderProcess. 2025-12-28 01:27:54,865 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Start SessionDispatcherLeaderProcess. 2025-12-28 01:27:54,870 INFO org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl [] - Starting resource manager service. 2025-12-28 01:27:54,873 INFO org.apache.flink.runtime.resourcemanager.ResourceManagerServiceImpl [] - Resource manager service is granted leadership with session id 00000000-0000-0000-0000-000000000000. 2025-12-28 01:27:54,880 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Recover all persisted job graphs that are not finished, yet. 2025-12-28 01:27:54,884 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Successfully recovered 0 persisted job graphs. 2025-12-28 01:27:54,923 INFO org.apache.flink.runtime.rpc.pekko.PekkoRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at pekko://flink/user/rpc/dispatcher_0 . 2025-12-28 01:27:54,940 INFO org.apache.flink.runtime.rpc.pekko.PekkoRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at pekko://flink/user/rpc/resourcemanager_1 . 2025-12-28 01:27:54,965 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Starting the resource manager. 2025-12-28 01:27:54,976 INFO org.apache.flink.runtime.resourcemanager.slotmanager.FineGrainedSlotManager [] - Starting the slot manager. 2025-12-28 01:27:54,981 INFO org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - Starting tokens update task 2025-12-28 01:27:54,982 WARN org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - No tokens obtained so skipping notifications 2025-12-28 01:27:54,982 WARN org.apache.flink.runtime.security.token.DefaultDelegationTokenManager [] - Tokens update task not started because either no tokens obtained or none of the tokens specified its renewal date 2025-12-28 01:27:55,813 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registering TaskManager with ResourceID 10.89.7.3:46441-e26865 (pekko.tcp://[email protected]:46441/user/rpc/taskmanager_0) at ResourceManager 2025-12-28 01:27:55,852 INFO org.apache.flink.runtime.resourcemanager.slotmanager.FineGrainedSlotManager [] - Registering task executor 10.89.7.3:46441-e26865 under cd3f98485e087bd6685a1f3b91480ec3 at the slot manager. 2025-12-28 01:30:35,360 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Received JobGraph submission 'insert-into_fluss_catalog.osb_staging.tickets_staging' (7d19009552267ad3c9408aef84a4718d). 2025-12-28 01:30:35,364 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Submitting job 'insert-into_fluss_catalog.osb_staging.tickets_staging' (7d19009552267ad3c9408aef84a4718d). 2025-12-28 01:30:35,381 INFO org.apache.flink.runtime.jobmaster.JobMasterServiceLeadershipRunner [] - JobMasterServiceLeadershipRunner for job 7d19009552267ad3c9408aef84a4718d was granted leadership with leader id 00000000-0000-0000-0000-000000000000. Creating new JobMasterServiceProcess. 2025-12-28 01:30:35,398 INFO org.apache.flink.runtime.rpc.pekko.PekkoRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_2 . 2025-12-28 01:30:35,414 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Initializing job 'insert-into_fluss_catalog.osb_staging.tickets_staging' (7d19009552267ad3c9408aef84a4718d). 2025-12-28 01:30:35,444 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using restart back off time strategy ExponentialDelayRestartBackoffTimeStrategy(initialBackoffMS=1000, maxBackoffMS=60000, backoffMultiplier=1.5, resetBackoffThresholdMS=3600000, jitterFactor=0.1, attemptsBeforeResetBackoff=2147483647, currentRestartAttempt=0, nextRestartTimestamp=-2147483648) for insert-into_fluss_catalog.osb_staging.tickets_staging (7d19009552267ad3c9408aef84a4718d). 2025-12-28 01:30:35,475 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Created execution graph 6389c8aab8815de3d6d28b7643bdb1bb for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:30:35,485 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Running initialization on master for job insert-into_fluss_catalog.osb_staging.tickets_staging (7d19009552267ad3c9408aef84a4718d). 2025-12-28 01:30:35,486 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Successfully ran initialization on master in 0 ms. 2025-12-28 01:30:35,604 INFO org.apache.flink.runtime.scheduler.adapter.DefaultExecutionTopology [] - Built 1 new pipelined regions in 0 ms, total 1 pipelined regions currently. 2025-12-28 01:30:35,607 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Loading state backend via factory org.apache.flink.contrib.streaming.state.EmbeddedRocksDBStateBackendFactory 2025-12-28 01:30:35,623 INFO org.apache.flink.contrib.streaming.state.EmbeddedRocksDBStateBackend [] - Using predefined options: DEFAULT. 2025-12-28 01:30:35,625 INFO org.apache.flink.runtime.state.StateBackendLoader [] - State backend loader loads the state backend as EmbeddedRocksDBStateBackend 2025-12-28 01:30:35,627 WARN org.apache.flink.configuration.Configuration [] - Config uses deprecated configuration key 'state.checkpoints.dir' instead of proper key 'execution.checkpointing.dir' 2025-12-28 01:30:35,628 WARN org.apache.flink.configuration.Configuration [] - Config uses deprecated configuration key 'state.checkpoints.dir' instead of proper key 'execution.checkpointing.dir' 2025-12-28 01:30:35,629 WARN org.apache.flink.configuration.Configuration [] - Config uses deprecated configuration key 'state.savepoints.dir' instead of proper key 'execution.checkpointing.savepoint-dir' 2025-12-28 01:30:35,629 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Checkpoint storage is set to 'filesystem': (checkpoints "s3://warehouse/checkpoints") 2025-12-28 01:30:35,706 INFO org.apache.flink.fs.s3.common.token.AbstractS3DelegationTokenReceiver [] - Updating Hadoop configuration 2025-12-28 01:30:35,708 INFO org.apache.flink.fs.s3.common.token.AbstractS3DelegationTokenReceiver [] - Updated Hadoop configuration successfully 2025-12-28 01:30:35,862 WARN org.apache.hadoop.metrics2.impl.MetricsConfig [] - Cannot locate configuration: tried hadoop-metrics2-s3a-file-system.properties,hadoop-metrics2.properties 2025-12-28 01:30:35,888 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl [] - Scheduled Metric snapshot period at 10 second(s). 2025-12-28 01:30:35,888 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl [] - s3a-file-system metrics system started 2025-12-28 01:30:35,918 WARN org.apache.hadoop.util.NativeCodeLoader [] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2025-12-28 01:30:35,958 WARN com.amazonaws.util.VersionInfoUtils [] - The AWS SDK for Java 1.x entered maintenance mode starting July 31, 2024 and will reach end of support on December 31, 2025. For more information, see https://aws.amazon.com/blogs/developer/the-aws-sdk-for-java-1-x-is-in-maintenance-mode-effective-july-31-2024/ You can print where on the file system the AWS SDK for Java 1.x core runtime is located by setting the AWS_JAVA_V1_PRINT_LOCATION environment variable or aws.java.v1.printLocation system property to 'true'. This message can be disabled by setting the AWS_JAVA_V1_DISABLE_DEPRECATION_ANNOUNCEMENT environment variable or aws.java.v1.disableDeprecationAnnouncement system property to 'true'. The AWS SDK for Java 1.x is being used here: at java.base/java.lang.Thread.getStackTrace(Unknown Source) at com.amazonaws.util.VersionInfoUtils.printDeprecationAnnouncement(VersionInfoUtils.java:81) at com.amazonaws.util.VersionInfoUtils.<clinit>(VersionInfoUtils.java:59) at com.amazonaws.internal.EC2ResourceFetcher.<clinit>(EC2ResourceFetcher.java:44) at com.amazonaws.auth.InstanceMetadataServiceCredentialsFetcher.<init>(InstanceMetadataServiceCredentialsFetcher.java:38) at com.amazonaws.auth.InstanceProfileCredentialsProvider.<init>(InstanceProfileCredentialsProvider.java:111) at com.amazonaws.auth.InstanceProfileCredentialsProvider.<init>(InstanceProfileCredentialsProvider.java:91) at com.amazonaws.auth.InstanceProfileCredentialsProvider.<init>(InstanceProfileCredentialsProvider.java:75) at com.amazonaws.auth.InstanceProfileCredentialsProvider.<clinit>(InstanceProfileCredentialsProvider.java:58) at com.amazonaws.auth.EC2ContainerCredentialsProviderWrapper.initializeProvider(EC2ContainerCredentialsProviderWrapper.java:66) at com.amazonaws.auth.EC2ContainerCredentialsProviderWrapper.<init>(EC2ContainerCredentialsProviderWrapper.java:55) at org.apache.hadoop.fs.s3a.auth.IAMInstanceCredentialsProvider.<init>(IAMInstanceCredentialsProvider.java:49) at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source) at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source) at java.base/java.lang.reflect.Constructor.newInstanceWithCaller(Unknown Source) at java.base/java.lang.reflect.Constructor.newInstance(Unknown Source) at org.apache.hadoop.fs.s3a.S3AUtils.createAWSCredentialProvider(S3AUtils.java:766) at org.apache.hadoop.fs.s3a.S3AUtils.buildAWSProviderList(S3AUtils.java:698) at org.apache.hadoop.fs.s3a.S3AUtils.createAWSCredentialProviderSet(S3AUtils.java:631) at org.apache.hadoop.fs.s3a.S3AFileSystem.bindAWSClient(S3AFileSystem.java:877) at org.apache.hadoop.fs.s3a.S3AFileSystem.initialize(S3AFileSystem.java:534) at org.apache.flink.fs.s3.common.AbstractS3FileSystemFactory.create(AbstractS3FileSystemFactory.java:129) at org.apache.flink.core.fs.PluginFileSystemFactory.create(PluginFileSystemFactory.java:62) at org.apache.flink.core.fs.FileSystem.getUnguardedFileSystem(FileSystem.java:507) at org.apache.flink.core.fs.FileSystem.get(FileSystem.java:408) at org.apache.flink.core.fs.Path.getFileSystem(Path.java:284) at org.apache.flink.runtime.state.filesystem.FsCheckpointStorageAccess.<init>(FsCheckpointStorageAccess.java:88) at org.apache.flink.runtime.state.storage.FileSystemCheckpointStorage.createCheckpointStorage(FileSystemCheckpointStorage.java:336) at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.<init>(CheckpointCoordinator.java:358) at org.apache.flink.runtime.checkpoint.CheckpointCoordinator.<init>(CheckpointCoordinator.java:274) at org.apache.flink.runtime.executiongraph.DefaultExecutionGraph.enableCheckpointing(DefaultExecutionGraph.java:514) at org.apache.flink.runtime.executiongraph.DefaultExecutionGraphBuilder.buildGraph(DefaultExecutionGraphBuilder.java:338) at org.apache.flink.runtime.scheduler.DefaultExecutionGraphFactory.createAndRestoreExecutionGraph(DefaultExecutionGraphFactory.java:173) at org.apache.flink.runtime.scheduler.SchedulerBase.createAndRestoreExecutionGraph(SchedulerBase.java:382) at org.apache.flink.runtime.scheduler.SchedulerBase.<init>(SchedulerBase.java:225) at org.apache.flink.runtime.scheduler.DefaultScheduler.<init>(DefaultScheduler.java:142) at org.apache.flink.runtime.scheduler.DefaultSchedulerFactory.createInstance(DefaultSchedulerFactory.java:162) at org.apache.flink.runtime.jobmaster.DefaultSlotPoolServiceSchedulerFactory.createScheduler(DefaultSlotPoolServiceSchedulerFactory.java:121) at org.apache.flink.runtime.jobmaster.JobMaster.createScheduler(JobMaster.java:406) at org.apache.flink.runtime.jobmaster.JobMaster.<init>(JobMaster.java:383) at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.internalCreateJobMasterService(DefaultJobMasterServiceFactory.java:128) at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.lambda$createJobMasterService$0(DefaultJobMasterServiceFactory.java:100) at org.apache.flink.util.function.FunctionUtils.lambda$uncheckedSupplier$4(FunctionUtils.java:112) at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(Unknown Source) at org.apache.flink.util.MdcUtils.lambda$wrapRunnable$1(MdcUtils.java:70) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source) 2025-12-28 01:30:36,728 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - No checkpoint found during restore. 2025-12-28 01:30:36,735 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@142296bb for insert-into_fluss_catalog.osb_staging.tickets_staging (7d19009552267ad3c9408aef84a4718d). 2025-12-28 01:30:36,745 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Starting execution of job 'insert-into_fluss_catalog.osb_staging.tickets_staging' (7d19009552267ad3c9408aef84a4718d) under job master id 00000000000000000000000000000000. 2025-12-28 01:30:36,748 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Starting split enumerator for source Source: pg_osb_tickets[1]. 2025-12-28 01:30:36,821 INFO org.apache.flink.cdc.connectors.base.relational.connection.JdbcConnectionPools [] - Create and register connection pool [email protected]:5432, database=source_db, dataSourcePoolFactoryIdentifier=org.apache.flink.cdc.connectors.postgres.source.PostgresConnectionPoolFactory 2025-12-28 01:30:36,837 INFO com.zaxxer.hikari.HikariDataSource [] - connection-pool-192.168.1.4:5432 - Starting... 2025-12-28 01:30:36,962 INFO com.zaxxer.hikari.HikariDataSource [] - connection-pool-192.168.1.4:5432 - Start completed. 2025-12-28 01:30:37,031 INFO org.apache.flink.cdc.connectors.postgres.source.utils.TableDiscoveryUtils [] - Postgres captured tables : osb.tickets . 2025-12-28 01:30:37,033 INFO io.debezium.jdbc.JdbcConnection [] - Connection gracefully closed 2025-12-28 01:30:37,043 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy] 2025-12-28 01:30:37,043 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job insert-into_fluss_catalog.osb_staging.tickets_staging (7d19009552267ad3c9408aef84a4718d) switched from state CREATED to RUNNING. 2025-12-28 01:30:37,050 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: pg_osb_tickets[1] -> DropUpdateBefore[2] -> ConstraintEnforcer[3] (1/1) (6389c8aab8815de3d6d28b7643bdb1bb_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED. 2025-12-28 01:30:37,050 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - tickets_staging[3]: Writer (1/1) (6389c8aab8815de3d6d28b7643bdb1bb_306d8342cb5b2ad8b53f1be57f65bee8_0_0) switched from CREATED to SCHEDULED. 2025-12-28 01:30:37,060 INFO io.debezium.connector.postgresql.connection.PostgresConnection [] - Obtained valid replication slot ReplicationSlot [active=false, latestFlushedLsn=LSN{0/229C370}, catalogXmin=949] 2025-12-28 01:30:37,062 INFO io.debezium.jdbc.JdbcConnection [] - Connection gracefully closed 2025-12-28 01:30:37,069 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Connecting to ResourceManager pekko.tcp://flink@jobmanager:6123/user/rpc/resourcemanager_*(00000000000000000000000000000000) 2025-12-28 01:30:37,077 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Resolved ResourceManager address, beginning registration 2025-12-28 01:30:37,081 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registering job manager [email protected]://flink@jobmanager:6123/user/rpc/jobmanager_2 for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:30:37,091 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registered job manager [email protected]://flink@jobmanager:6123/user/rpc/jobmanager_2 for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:30:37,094 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - JobManager successfully registered at ResourceManager, leader id: 00000000000000000000000000000000. 2025-12-28 01:30:37,094 INFO org.apache.flink.cdc.connectors.base.source.assigner.SnapshotSplitAssigner [] - Start splitting table osb.tickets into chunks... 2025-12-28 01:30:37,097 INFO org.apache.flink.runtime.resourcemanager.slotmanager.FineGrainedSlotManager [] - Received resource requirements from job 7d19009552267ad3c9408aef84a4718d: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}] 2025-12-28 01:30:37,100 INFO io.debezium.connector.postgresql.PostgresSnapshotChangeEventSource [] - Creating initial offset context 2025-12-28 01:30:37,110 INFO io.debezium.connector.postgresql.PostgresSnapshotChangeEventSource [] - Read xlogStart at 'LSN{0/229C420}' from transaction '949' 2025-12-28 01:30:37,172 INFO org.apache.flink.runtime.resourcemanager.slotmanager.FineGrainedSlotManager [] - Matching resource requirements against available resources. Missing resources: Job 7d19009552267ad3c9408aef84a4718d ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1} Current resources: TaskManager 10.89.7.3:46441-e26865 Available: ResourceProfile{cpuCores=8, taskHeapMemory=537.600mb (563714445 bytes), taskOffHeapMemory=0 bytes, managedMemory=634.880mb (665719939 bytes), networkMemory=158.720mb (166429984 bytes)} Total: ResourceProfile{cpuCores=8, taskHeapMemory=537.600mb (563714445 bytes), taskOffHeapMemory=0 bytes, managedMemory=634.880mb (665719939 bytes), networkMemory=158.720mb (166429984 bytes)} 2025-12-28 01:30:37,178 INFO org.apache.flink.runtime.resourcemanager.slotmanager.DefaultSlotStatusSyncer [] - Starting allocation of slot 0c7a9266a17d0690cee8feeea1b2aab9 from 10.89.7.3:46441-e26865 for job 7d19009552267ad3c9408aef84a4718d with resource profile ResourceProfile{cpuCores=1, taskHeapMemory=67.200mb (70464305 bytes), taskOffHeapMemory=0 bytes, managedMemory=79.360mb (83214992 bytes), networkMemory=19.840mb (20803748 bytes)}. 2025-12-28 01:30:37,344 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: pg_osb_tickets[1] -> DropUpdateBefore[2] -> ConstraintEnforcer[3] (1/1) (6389c8aab8815de3d6d28b7643bdb1bb_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING. 2025-12-28 01:30:37,344 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying Source: pg_osb_tickets[1] -> DropUpdateBefore[2] -> ConstraintEnforcer[3] (1/1) (attempt #0) with attempt id 6389c8aab8815de3d6d28b7643bdb1bb_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 10.89.7.3:46441-e26865 @ flink-taskmanager (dataPort=46067) with allocation id 0c7a9266a17d0690cee8feeea1b2aab9 2025-12-28 01:30:37,350 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - tickets_staging[3]: Writer (1/1) (6389c8aab8815de3d6d28b7643bdb1bb_306d8342cb5b2ad8b53f1be57f65bee8_0_0) switched from SCHEDULED to DEPLOYING. 2025-12-28 01:30:37,352 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying tickets_staging[3]: Writer (1/1) (attempt #0) with attempt id 6389c8aab8815de3d6d28b7643bdb1bb_306d8342cb5b2ad8b53f1be57f65bee8_0_0 and vertex id 306d8342cb5b2ad8b53f1be57f65bee8_0 to 10.89.7.3:46441-e26865 @ flink-taskmanager (dataPort=46067) with allocation id 0c7a9266a17d0690cee8feeea1b2aab9 2025-12-28 01:30:37,468 INFO org.apache.flink.cdc.connectors.postgres.source.utils.PostgresQueryUtils [] - queryApproximateRowCnt: SELECT reltuples::bigint FROM pg_class c JOIN pg_namespace n ON n.oid = c.relnamespace WHERE n.nspname = ? AND c.relname = ? => 70012 2025-12-28 01:30:37,471 INFO org.apache.flink.cdc.connectors.base.source.assigner.splitter.JdbcSourceChunkSplitter [] - The distribution factor of table osb.tickets is 1.0 according to the min split key 1, max split key 70012 and approximate row count 70012 2025-12-28 01:30:37,471 INFO org.apache.flink.cdc.connectors.base.source.assigner.splitter.JdbcSourceChunkSplitter [] - The actual distribution factor for table osb.tickets is 1.0, the lower bound of evenly distribution factor is 0.05, the upper bound of evenly distribution factor is 1000.0 2025-12-28 01:30:37,471 INFO org.apache.flink.cdc.connectors.base.source.assigner.splitter.JdbcSourceChunkSplitter [] - Use evenly-sized chunk optimization for table osb.tickets, the approximate row count is 70012, the chunk size is 8096, the dynamic chunk size is 8096 2025-12-28 01:30:37,484 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add remaining split: osb.tickets:0 2025-12-28 01:30:37,484 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add remaining split: osb.tickets:1 2025-12-28 01:30:37,484 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add remaining split: osb.tickets:2 2025-12-28 01:30:37,484 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add remaining split: osb.tickets:3 2025-12-28 01:30:37,484 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add remaining split: osb.tickets:4 2025-12-28 01:30:37,485 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add remaining split: osb.tickets:5 2025-12-28 01:30:37,488 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add remaining split: osb.tickets:6 2025-12-28 01:30:37,489 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add remaining split: osb.tickets:7 2025-12-28 01:30:37,489 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add remaining split: osb.tickets:8 2025-12-28 01:30:37,490 INFO org.apache.flink.cdc.connectors.base.source.assigner.SnapshotSplitAssigner [] - Split table osb.tickets into 9 chunks, time cost: 396ms. 2025-12-28 01:30:37,652 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - tickets_staging[3]: Writer (1/1) (6389c8aab8815de3d6d28b7643bdb1bb_306d8342cb5b2ad8b53f1be57f65bee8_0_0) switched from DEPLOYING to INITIALIZING. 2025-12-28 01:30:37,657 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: pg_osb_tickets[1] -> DropUpdateBefore[2] -> ConstraintEnforcer[3] (1/1) (6389c8aab8815de3d6d28b7643bdb1bb_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING. 2025-12-28 01:30:37,718 INFO org.apache.flink.runtime.checkpoint.CheckpointFailureManager [] - Failed to trigger checkpoint for job 7d19009552267ad3c9408aef84a4718d since Checkpoint triggering task Source: pg_osb_tickets[1] -> DropUpdateBefore[2] -> ConstraintEnforcer[3] (1/1) of job 7d19009552267ad3c9408aef84a4718d is not being executed at the moment. Aborting checkpoint. Failure reason: Not all required tasks are currently running.. 2025-12-28 01:30:37,824 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: pg_osb_tickets[1] registering reader for parallel task 0 (#0) @ 10.89.7.3 2025-12-28 01:30:37,827 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: pg_osb_tickets[1] received split request from parallel task 0 (#0) 2025-12-28 01:30:37,828 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add processed split: osb.tickets:8 2025-12-28 01:30:37,828 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - remove remaining split: osb.tickets:8 2025-12-28 01:30:37,851 INFO org.apache.flink.cdc.connectors.base.source.enumerator.IncrementalSourceEnumerator [] - Assign split SnapshotSplit{tableId=osb.tickets, splitId='osb.tickets:8', splitKeyType=[`ticket_id` BIGINT NOT NULL], splitStart=[64769], splitEnd=null, highWatermark=null} to subtask 0 2025-12-28 01:30:37,856 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: pg_osb_tickets[1] -> DropUpdateBefore[2] -> ConstraintEnforcer[3] (1/1) (6389c8aab8815de3d6d28b7643bdb1bb_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING. 2025-12-28 01:30:38,532 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - tickets_staging[3]: Writer (1/1) (6389c8aab8815de3d6d28b7643bdb1bb_306d8342cb5b2ad8b53f1be57f65bee8_0_0) switched from INITIALIZING to RUNNING. 2025-12-28 01:30:40,193 INFO org.apache.flink.cdc.connectors.base.source.enumerator.IncrementalSourceEnumerator [] - The enumerator receives finished split offsets FinishedSnapshotSplitsReportEvent{finishedOffsets={osb.tickets:8=Offset{lsn=LSN{0/229C4F0}, txId=951, lastCommitTs=-9223372036854775808}}} from subtask 0. 2025-12-28 01:30:40,195 INFO org.apache.flink.cdc.connectors.base.source.assigner.SnapshotSplitAssigner [] - splitFinishedCheckpointIds size in onFinishedSplits: 1 2025-12-28 01:30:40,198 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: pg_osb_tickets[1] received split request from parallel task 0 (#0) 2025-12-28 01:30:40,198 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add processed split: osb.tickets:0 2025-12-28 01:30:40,198 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - remove remaining split: osb.tickets:0 2025-12-28 01:30:40,200 INFO org.apache.flink.cdc.connectors.base.source.enumerator.IncrementalSourceEnumerator [] - Assign split SnapshotSplit{tableId=osb.tickets, splitId='osb.tickets:0', splitKeyType=[`ticket_id` BIGINT NOT NULL], splitStart=null, splitEnd=[8097], highWatermark=null} to subtask 0 2025-12-28 01:30:41,951 INFO org.apache.flink.cdc.connectors.base.source.enumerator.IncrementalSourceEnumerator [] - The enumerator receives finished split offsets FinishedSnapshotSplitsReportEvent{finishedOffsets={osb.tickets:0=Offset{lsn=LSN{0/229D058}, txId=953, lastCommitTs=-9223372036854775808}}} from subtask 0. 2025-12-28 01:30:41,952 INFO org.apache.flink.cdc.connectors.base.source.assigner.SnapshotSplitAssigner [] - splitFinishedCheckpointIds size in onFinishedSplits: 2 2025-12-28 01:30:41,969 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: pg_osb_tickets[1] received split request from parallel task 0 (#0) 2025-12-28 01:30:41,969 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add processed split: osb.tickets:1 2025-12-28 01:30:41,969 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - remove remaining split: osb.tickets:1 2025-12-28 01:30:41,978 INFO org.apache.flink.cdc.connectors.base.source.enumerator.IncrementalSourceEnumerator [] - Assign split SnapshotSplit{tableId=osb.tickets, splitId='osb.tickets:1', splitKeyType=[`ticket_id` BIGINT NOT NULL], splitStart=[8097], splitEnd=[16193], highWatermark=null} to subtask 0 2025-12-28 01:30:42,719 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 1 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1766885442707 for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:30:42,769 INFO org.apache.flink.cdc.connectors.base.source.assigner.SnapshotSplitAssigner [] - SnapshotSplitAssigner snapshotState on checkpoint 1 with splitFinishedCheckpointIds size 2. 2025-12-28 01:30:42,939 INFO org.apache.flink.fs.s3.common.writer.S3Committer [] - Committing checkpoints/7d19009552267ad3c9408aef84a4718d/chk-1/_metadata with MPU ID a3ef4d8ddfc1fd0ae512f93bb40b37168879b9ff3bf3d22dfa81e2ec72d5cfd9 2025-12-28 01:30:42,962 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 1 for job 7d19009552267ad3c9408aef84a4718d (8782 bytes, checkpointDuration=252 ms, finalizationTime=3 ms). 2025-12-28 01:30:42,965 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Marking checkpoint 1 as completed for source Source: pg_osb_tickets[1]. 2025-12-28 01:30:42,969 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add finished split: osb.tickets:0 2025-12-28 01:30:42,969 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add finished split: osb.tickets:8 2025-12-28 01:30:42,969 INFO org.apache.flink.cdc.connectors.base.source.assigner.SnapshotSplitAssigner [] - Checkpoint completed on checkpoint 1 with splitFinishedCheckpointIds size 0. 2025-12-28 01:30:43,565 INFO org.apache.flink.cdc.connectors.base.source.enumerator.IncrementalSourceEnumerator [] - The enumerator receives finished split offsets FinishedSnapshotSplitsReportEvent{finishedOffsets={osb.tickets:1=Offset{lsn=LSN{0/229D0F0}, txId=955, lastCommitTs=-9223372036854775808}}} from subtask 0. 2025-12-28 01:30:43,567 INFO org.apache.flink.cdc.connectors.base.source.assigner.SnapshotSplitAssigner [] - splitFinishedCheckpointIds size in onFinishedSplits: 1 2025-12-28 01:30:43,571 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: pg_osb_tickets[1] received split request from parallel task 0 (#0) 2025-12-28 01:30:43,574 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add processed split: osb.tickets:2 2025-12-28 01:30:43,577 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - remove remaining split: osb.tickets:2 2025-12-28 01:30:43,594 INFO org.apache.flink.cdc.connectors.base.source.enumerator.IncrementalSourceEnumerator [] - Assign split SnapshotSplit{tableId=osb.tickets, splitId='osb.tickets:2', splitKeyType=[`ticket_id` BIGINT NOT NULL], splitStart=[16193], splitEnd=[24289], highWatermark=null} to subtask 0 2025-12-28 01:30:44,690 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Received JobGraph submission 'Fluss Tiering Service' (00d2a9a9da2ddfc1a31510f59580f348). 2025-12-28 01:30:44,690 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Submitting job 'Fluss Tiering Service' (00d2a9a9da2ddfc1a31510f59580f348). 2025-12-28 01:30:44,692 INFO org.apache.flink.runtime.jobmaster.JobMasterServiceLeadershipRunner [] - JobMasterServiceLeadershipRunner for job 00d2a9a9da2ddfc1a31510f59580f348 was granted leadership with leader id 00000000-0000-0000-0000-000000000000. Creating new JobMasterServiceProcess. 2025-12-28 01:30:44,695 INFO org.apache.flink.runtime.rpc.pekko.PekkoRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_3 . 2025-12-28 01:30:44,696 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Initializing job 'Fluss Tiering Service' (00d2a9a9da2ddfc1a31510f59580f348). 2025-12-28 01:30:44,700 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using restart back off time strategy NoRestartBackoffTimeStrategy for Fluss Tiering Service (00d2a9a9da2ddfc1a31510f59580f348). 2025-12-28 01:30:44,702 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Created execution graph b7de61f78de77a0971b81c754f27dc73 for job 00d2a9a9da2ddfc1a31510f59580f348. 2025-12-28 01:30:44,703 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Running initialization on master for job Fluss Tiering Service (00d2a9a9da2ddfc1a31510f59580f348). 2025-12-28 01:30:44,704 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Successfully ran initialization on master in 0 ms. 2025-12-28 01:30:44,728 INFO org.apache.flink.runtime.scheduler.adapter.DefaultExecutionTopology [] - Built 1 new pipelined regions in 0 ms, total 1 pipelined regions currently. 2025-12-28 01:30:44,728 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Loading state backend via factory org.apache.flink.contrib.streaming.state.EmbeddedRocksDBStateBackendFactory 2025-12-28 01:30:44,729 INFO org.apache.flink.contrib.streaming.state.EmbeddedRocksDBStateBackend [] - Using predefined options: DEFAULT. 2025-12-28 01:30:44,729 INFO org.apache.flink.runtime.state.StateBackendLoader [] - State backend loader loads the state backend as EmbeddedRocksDBStateBackend 2025-12-28 01:30:44,731 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using job/cluster config to configure application-defined checkpoint storage: org.apache.flink.runtime.state.storage.FileSystemCheckpointStorage@ce7b8147 2025-12-28 01:30:44,731 WARN org.apache.flink.configuration.Configuration [] - Config uses deprecated configuration key 'state.savepoints.dir' instead of proper key 'execution.checkpointing.savepoint-dir' 2025-12-28 01:30:44,732 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - No checkpoint found during restore. 2025-12-28 01:30:44,732 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@2529cc5c for Fluss Tiering Service (00d2a9a9da2ddfc1a31510f59580f348). 2025-12-28 01:30:44,734 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Starting execution of job 'Fluss Tiering Service' (00d2a9a9da2ddfc1a31510f59580f348) under job master id 00000000000000000000000000000000. 2025-12-28 01:30:44,735 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Starting split enumerator for source Source: TieringSource. 2025-12-28 01:30:44,744 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy] 2025-12-28 01:30:44,744 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job Fluss Tiering Service (00d2a9a9da2ddfc1a31510f59580f348) switched from state CREATED to RUNNING. 2025-12-28 01:30:44,744 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: TieringSource (1/2) (b7de61f78de77a0971b81c754f27dc73_dc9385c83dde82d19e268af15cd693e7_0_0) switched from CREATED to SCHEDULED. 2025-12-28 01:30:44,745 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: TieringSource (2/2) (b7de61f78de77a0971b81c754f27dc73_dc9385c83dde82d19e268af15cd693e7_1_0) switched from CREATED to SCHEDULED. 2025-12-28 01:30:44,745 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - TieringCommitter -> end: Writer (1/1) (b7de61f78de77a0971b81c754f27dc73_405fa275195da3cb38000f33da11e22e_0_0) switched from CREATED to SCHEDULED. 2025-12-28 01:30:44,746 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Connecting to ResourceManager pekko.tcp://flink@jobmanager:6123/user/rpc/resourcemanager_*(00000000000000000000000000000000) 2025-12-28 01:30:44,750 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Resolved ResourceManager address, beginning registration 2025-12-28 01:30:44,752 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registering job manager [email protected]://flink@jobmanager:6123/user/rpc/jobmanager_3 for job 00d2a9a9da2ddfc1a31510f59580f348. 2025-12-28 01:30:44,754 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registered job manager [email protected]://flink@jobmanager:6123/user/rpc/jobmanager_3 for job 00d2a9a9da2ddfc1a31510f59580f348. 2025-12-28 01:30:44,760 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - JobManager successfully registered at ResourceManager, leader id: 00000000000000000000000000000000. 2025-12-28 01:30:44,761 INFO org.apache.flink.runtime.resourcemanager.slotmanager.FineGrainedSlotManager [] - Received resource requirements from job 00d2a9a9da2ddfc1a31510f59580f348: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2}] 2025-12-28 01:30:44,769 INFO org.apache.fluss.metrics.registry.MetricRegistry [] - No metrics reporter configured, no metrics will be exposed/reported. 2025-12-28 01:30:44,831 INFO org.apache.flink.runtime.resourcemanager.slotmanager.FineGrainedSlotManager [] - Matching resource requirements against available resources. Missing resources: Job 00d2a9a9da2ddfc1a31510f59580f348 ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=2} Current resources: TaskManager 10.89.7.3:46441-e26865 Available: ResourceProfile{cpuCores=7, taskHeapMemory=470.400mb (493250140 bytes), taskOffHeapMemory=0 bytes, managedMemory=555.520mb (582504947 bytes), networkMemory=138.880mb (145626236 bytes)} Total: ResourceProfile{cpuCores=8, taskHeapMemory=537.600mb (563714445 bytes), taskOffHeapMemory=0 bytes, managedMemory=634.880mb (665719939 bytes), networkMemory=158.720mb (166429984 bytes)} 2025-12-28 01:30:44,834 INFO org.apache.flink.runtime.resourcemanager.slotmanager.DefaultSlotStatusSyncer [] - Starting allocation of slot 21d45bdc8cd8219710c21c06e6792b25 from 10.89.7.3:46441-e26865 for job 00d2a9a9da2ddfc1a31510f59580f348 with resource profile ResourceProfile{cpuCores=1, taskHeapMemory=67.200mb (70464305 bytes), taskOffHeapMemory=0 bytes, managedMemory=79.360mb (83214992 bytes), networkMemory=19.840mb (20803748 bytes)}. 2025-12-28 01:30:44,835 INFO org.apache.flink.runtime.resourcemanager.slotmanager.DefaultSlotStatusSyncer [] - Starting allocation of slot 4384861bd0d7cadb75383fb7a0c43510 from 10.89.7.3:46441-e26865 for job 00d2a9a9da2ddfc1a31510f59580f348 with resource profile ResourceProfile{cpuCores=1, taskHeapMemory=67.200mb (70464305 bytes), taskOffHeapMemory=0 bytes, managedMemory=79.360mb (83214992 bytes), networkMemory=19.840mb (20803748 bytes)}. 2025-12-28 01:30:44,893 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: TieringSource (1/2) (b7de61f78de77a0971b81c754f27dc73_dc9385c83dde82d19e268af15cd693e7_0_0) switched from SCHEDULED to DEPLOYING. 2025-12-28 01:30:44,893 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying Source: TieringSource (1/2) (attempt #0) with attempt id b7de61f78de77a0971b81c754f27dc73_dc9385c83dde82d19e268af15cd693e7_0_0 and vertex id dc9385c83dde82d19e268af15cd693e7_0 to 10.89.7.3:46441-e26865 @ flink-taskmanager (dataPort=46067) with allocation id 21d45bdc8cd8219710c21c06e6792b25 2025-12-28 01:30:44,894 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: TieringSource (2/2) (b7de61f78de77a0971b81c754f27dc73_dc9385c83dde82d19e268af15cd693e7_1_0) switched from SCHEDULED to DEPLOYING. 2025-12-28 01:30:44,894 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying Source: TieringSource (2/2) (attempt #0) with attempt id b7de61f78de77a0971b81c754f27dc73_dc9385c83dde82d19e268af15cd693e7_1_0 and vertex id dc9385c83dde82d19e268af15cd693e7_1 to 10.89.7.3:46441-e26865 @ flink-taskmanager (dataPort=46067) with allocation id 4384861bd0d7cadb75383fb7a0c43510 2025-12-28 01:30:44,895 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - TieringCommitter -> end: Writer (1/1) (b7de61f78de77a0971b81c754f27dc73_405fa275195da3cb38000f33da11e22e_0_0) switched from SCHEDULED to DEPLOYING. 2025-12-28 01:30:44,895 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying TieringCommitter -> end: Writer (1/1) (attempt #0) with attempt id b7de61f78de77a0971b81c754f27dc73_405fa275195da3cb38000f33da11e22e_0_0 and vertex id 405fa275195da3cb38000f33da11e22e_0 to 10.89.7.3:46441-e26865 @ flink-taskmanager (dataPort=46067) with allocation id 21d45bdc8cd8219710c21c06e6792b25 2025-12-28 01:30:45,087 INFO org.apache.flink.cdc.connectors.base.source.enumerator.IncrementalSourceEnumerator [] - The enumerator receives finished split offsets FinishedSnapshotSplitsReportEvent{finishedOffsets={osb.tickets:2=Offset{lsn=LSN{0/229D188}, txId=957, lastCommitTs=-9223372036854775808}}} from subtask 0. 2025-12-28 01:30:45,087 INFO org.apache.flink.cdc.connectors.base.source.assigner.SnapshotSplitAssigner [] - splitFinishedCheckpointIds size in onFinishedSplits: 2 2025-12-28 01:30:45,092 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: pg_osb_tickets[1] received split request from parallel task 0 (#0) 2025-12-28 01:30:45,092 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add processed split: osb.tickets:3 2025-12-28 01:30:45,092 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - remove remaining split: osb.tickets:3 2025-12-28 01:30:45,101 INFO org.apache.flink.cdc.connectors.base.source.enumerator.IncrementalSourceEnumerator [] - Assign split SnapshotSplit{tableId=osb.tickets, splitId='osb.tickets:3', splitKeyType=[`ticket_id` BIGINT NOT NULL], splitStart=[24289], splitEnd=[32385], highWatermark=null} to subtask 0 2025-12-28 01:30:45,242 INFO org.apache.fluss.flink.tiering.source.enumerator.TieringSourceEnumerator [] - Starting register Tiering Service to Fluss Coordinator... 2025-12-28 01:30:45,257 INFO org.apache.fluss.flink.tiering.source.enumerator.TieringSourceEnumerator [] - Register Tiering Service to Fluss Coordinator(epoch=0) success. 2025-12-28 01:30:46,009 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - TieringCommitter -> end: Writer (1/1) (b7de61f78de77a0971b81c754f27dc73_405fa275195da3cb38000f33da11e22e_0_0) switched from DEPLOYING to INITIALIZING. 2025-12-28 01:30:46,014 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: TieringSource (1/2) (b7de61f78de77a0971b81c754f27dc73_dc9385c83dde82d19e268af15cd693e7_0_0) switched from DEPLOYING to INITIALIZING. 2025-12-28 01:30:46,021 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: TieringSource (2/2) (b7de61f78de77a0971b81c754f27dc73_dc9385c83dde82d19e268af15cd693e7_1_0) switched from DEPLOYING to INITIALIZING. 2025-12-28 01:30:46,098 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: TieringSource registering reader for parallel task 0 (#0) @ 10.89.7.3 2025-12-28 01:30:46,098 INFO org.apache.fluss.flink.tiering.source.enumerator.TieringSourceEnumerator [] - Adding reader: 0 to Tiering Source enumerator. 2025-12-28 01:30:46,098 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: TieringSource received split request from parallel task 0 (#0) 2025-12-28 01:30:46,098 INFO org.apache.fluss.flink.tiering.source.enumerator.TieringSourceEnumerator [] - TiringSourceReader 0 requests split. 2025-12-28 01:30:46,101 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: TieringSource (1/2) (b7de61f78de77a0971b81c754f27dc73_dc9385c83dde82d19e268af15cd693e7_0_0) switched from INITIALIZING to RUNNING. 2025-12-28 01:30:46,106 INFO org.apache.fluss.flink.tiering.source.enumerator.TieringSourceEnumerator [] - No available Tiering table found, will poll later. 2025-12-28 01:30:46,114 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: TieringSource registering reader for parallel task 1 (#0) @ 10.89.7.3 2025-12-28 01:30:46,115 INFO org.apache.fluss.flink.tiering.source.enumerator.TieringSourceEnumerator [] - Adding reader: 1 to Tiering Source enumerator. 2025-12-28 01:30:46,115 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: TieringSource received split request from parallel task 1 (#0) 2025-12-28 01:30:46,115 INFO org.apache.fluss.flink.tiering.source.enumerator.TieringSourceEnumerator [] - TiringSourceReader 1 requests split. 2025-12-28 01:30:46,114 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: TieringSource (2/2) (b7de61f78de77a0971b81c754f27dc73_dc9385c83dde82d19e268af15cd693e7_1_0) switched from INITIALIZING to RUNNING. 2025-12-28 01:30:46,121 INFO org.apache.fluss.flink.tiering.source.enumerator.TieringSourceEnumerator [] - No available Tiering table found, will poll later. 2025-12-28 01:30:46,137 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - TieringCommitter -> end: Writer (1/1) (b7de61f78de77a0971b81c754f27dc73_405fa275195da3cb38000f33da11e22e_0_0) switched from INITIALIZING to RUNNING. 2025-12-28 01:30:46,472 INFO org.apache.flink.cdc.connectors.base.source.enumerator.IncrementalSourceEnumerator [] - The enumerator receives finished split offsets FinishedSnapshotSplitsReportEvent{finishedOffsets={osb.tickets:3=Offset{lsn=LSN{0/229D220}, txId=959, lastCommitTs=-9223372036854775808}}} from subtask 0. 2025-12-28 01:30:46,472 INFO org.apache.flink.cdc.connectors.base.source.assigner.SnapshotSplitAssigner [] - splitFinishedCheckpointIds size in onFinishedSplits: 3 2025-12-28 01:30:46,476 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: pg_osb_tickets[1] received split request from parallel task 0 (#0) 2025-12-28 01:30:46,476 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add processed split: osb.tickets:4 2025-12-28 01:30:46,476 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - remove remaining split: osb.tickets:4 2025-12-28 01:30:46,478 INFO org.apache.flink.cdc.connectors.base.source.enumerator.IncrementalSourceEnumerator [] - Assign split SnapshotSplit{tableId=osb.tickets, splitId='osb.tickets:4', splitKeyType=[`ticket_id` BIGINT NOT NULL], splitStart=[32385], splitEnd=[40481], highWatermark=null} to subtask 0 2025-12-28 01:30:47,264 INFO org.apache.flink.cdc.connectors.base.source.enumerator.IncrementalSourceEnumerator [] - The enumerator receives finished split offsets FinishedSnapshotSplitsReportEvent{finishedOffsets={osb.tickets:4=Offset{lsn=LSN{0/229D288}, txId=961, lastCommitTs=-9223372036854775808}}} from subtask 0. 2025-12-28 01:30:47,264 INFO org.apache.flink.cdc.connectors.base.source.assigner.SnapshotSplitAssigner [] - splitFinishedCheckpointIds size in onFinishedSplits: 4 2025-12-28 01:30:47,265 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: pg_osb_tickets[1] received split request from parallel task 0 (#0) 2025-12-28 01:30:47,265 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add processed split: osb.tickets:5 2025-12-28 01:30:47,265 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - remove remaining split: osb.tickets:5 2025-12-28 01:30:47,268 INFO org.apache.flink.cdc.connectors.base.source.enumerator.IncrementalSourceEnumerator [] - Assign split SnapshotSplit{tableId=osb.tickets, splitId='osb.tickets:5', splitKeyType=[`ticket_id` BIGINT NOT NULL], splitStart=[40481], splitEnd=[48577], highWatermark=null} to subtask 0 2025-12-28 01:30:47,708 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 2 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1766885447706 for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:30:47,761 INFO org.apache.flink.cdc.connectors.base.source.assigner.SnapshotSplitAssigner [] - SnapshotSplitAssigner snapshotState on checkpoint 2 with splitFinishedCheckpointIds size 4. 2025-12-28 01:30:47,804 INFO org.apache.flink.fs.s3.common.writer.S3Committer [] - Committing checkpoints/7d19009552267ad3c9408aef84a4718d/chk-2/_metadata with MPU ID 34cad45eeb2a9a4f52623b84101cf96b95c0f55759d8ca5696b5a702a404dd27 2025-12-28 01:30:47,826 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 2 for job 7d19009552267ad3c9408aef84a4718d (9224 bytes, checkpointDuration=116 ms, finalizationTime=4 ms). 2025-12-28 01:30:47,827 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Marking checkpoint 2 as completed for source Source: pg_osb_tickets[1]. 2025-12-28 01:30:47,828 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add finished split: osb.tickets:1 2025-12-28 01:30:47,828 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add finished split: osb.tickets:2 2025-12-28 01:30:47,829 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add finished split: osb.tickets:3 2025-12-28 01:30:47,830 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add finished split: osb.tickets:4 2025-12-28 01:30:47,830 INFO org.apache.flink.cdc.connectors.base.source.assigner.SnapshotSplitAssigner [] - Checkpoint completed on checkpoint 2 with splitFinishedCheckpointIds size 0. 2025-12-28 01:30:47,984 INFO org.apache.flink.cdc.connectors.base.source.enumerator.IncrementalSourceEnumerator [] - The enumerator receives finished split offsets FinishedSnapshotSplitsReportEvent{finishedOffsets={osb.tickets:5=Offset{lsn=LSN{0/229D320}, txId=963, lastCommitTs=-9223372036854775808}}} from subtask 0. 2025-12-28 01:30:47,985 INFO org.apache.flink.cdc.connectors.base.source.assigner.SnapshotSplitAssigner [] - splitFinishedCheckpointIds size in onFinishedSplits: 1 2025-12-28 01:30:47,985 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: pg_osb_tickets[1] received split request from parallel task 0 (#0) 2025-12-28 01:30:47,985 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add processed split: osb.tickets:6 2025-12-28 01:30:47,985 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - remove remaining split: osb.tickets:6 2025-12-28 01:30:47,986 INFO org.apache.flink.cdc.connectors.base.source.enumerator.IncrementalSourceEnumerator [] - Assign split SnapshotSplit{tableId=osb.tickets, splitId='osb.tickets:6', splitKeyType=[`ticket_id` BIGINT NOT NULL], splitStart=[48577], splitEnd=[56673], highWatermark=null} to subtask 0 2025-12-28 01:30:48,696 INFO org.apache.flink.cdc.connectors.base.source.enumerator.IncrementalSourceEnumerator [] - The enumerator receives finished split offsets FinishedSnapshotSplitsReportEvent{finishedOffsets={osb.tickets:6=Offset{lsn=LSN{0/229D3B8}, txId=965, lastCommitTs=-9223372036854775808}}} from subtask 0. 2025-12-28 01:30:48,697 INFO org.apache.flink.cdc.connectors.base.source.assigner.SnapshotSplitAssigner [] - splitFinishedCheckpointIds size in onFinishedSplits: 2 2025-12-28 01:30:48,697 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: pg_osb_tickets[1] received split request from parallel task 0 (#0) 2025-12-28 01:30:48,698 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add processed split: osb.tickets:7 2025-12-28 01:30:48,698 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - remove remaining split: osb.tickets:7 2025-12-28 01:30:48,700 INFO org.apache.flink.cdc.connectors.base.source.enumerator.IncrementalSourceEnumerator [] - Assign split SnapshotSplit{tableId=osb.tickets, splitId='osb.tickets:7', splitKeyType=[`ticket_id` BIGINT NOT NULL], splitStart=[56673], splitEnd=[64769], highWatermark=null} to subtask 0 2025-12-28 01:30:49,896 INFO org.apache.flink.cdc.connectors.base.source.enumerator.IncrementalSourceEnumerator [] - The enumerator receives finished split offsets FinishedSnapshotSplitsReportEvent{finishedOffsets={osb.tickets:7=Offset{lsn=LSN{0/229D480}, txId=967, lastCommitTs=-9223372036854775808}}} from subtask 0. 2025-12-28 01:30:49,897 INFO org.apache.flink.cdc.connectors.base.source.assigner.SnapshotSplitAssigner [] - splitFinishedCheckpointIds size in onFinishedSplits: 3 2025-12-28 01:30:49,897 INFO org.apache.flink.cdc.connectors.base.source.assigner.AssignerStatus [] - Assigner status changes from INITIAL_ASSIGNING to INITIAL_ASSIGNING_FINISHED 2025-12-28 01:30:49,897 INFO org.apache.flink.cdc.connectors.base.source.assigner.SnapshotSplitAssigner [] - Snapshot split assigner received all splits finished and the job parallelism is 1, snapshot split assigner is turn into finished status. 2025-12-28 01:30:49,897 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: pg_osb_tickets[1] received split request from parallel task 0 (#0) 2025-12-28 01:30:49,904 INFO org.apache.flink.cdc.connectors.base.source.enumerator.IncrementalSourceEnumerator [] - Assign split StreamSplit{splitId='stream-split', offset=Offset{lsn=LSN{0/229C4F0}, txId=951, lastCommitTs=-9223372036854775808}, endOffset=Offset{lsn=LSN{FFFFFFFF/FFFFFFFF}, txId=null, lastCommitTs=-9223372036853775810}, isSuspended=false, isSnapshotCompleted=true} to subtask 0 2025-12-28 01:30:50,096 INFO org.apache.flink.cdc.connectors.base.source.enumerator.IncrementalSourceEnumerator [] - The enumerator receives notice from subtask 0 for the stream split assignment. 2025-12-28 01:30:52,708 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 3 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1766885452707 for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:30:52,764 INFO org.apache.flink.cdc.connectors.base.source.assigner.SnapshotSplitAssigner [] - SnapshotSplitAssigner snapshotState on checkpoint 3 with splitFinishedCheckpointIds size 3. 2025-12-28 01:30:52,829 INFO org.apache.flink.fs.s3.common.writer.S3Committer [] - Committing checkpoints/7d19009552267ad3c9408aef84a4718d/chk-3/_metadata with MPU ID 40fe4a4ae5c658bdcd48c952653db216537499240d94a7b35b24fbf75e1d3e7f 2025-12-28 01:30:52,843 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 3 for job 7d19009552267ad3c9408aef84a4718d (17186 bytes, checkpointDuration=136 ms, finalizationTime=0 ms). 2025-12-28 01:30:52,845 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Marking checkpoint 3 as completed for source Source: pg_osb_tickets[1]. 2025-12-28 01:30:52,845 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add finished split: osb.tickets:7 2025-12-28 01:30:52,845 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add finished split: osb.tickets:5 2025-12-28 01:30:52,845 INFO org.apache.flink.cdc.connectors.base.source.metrics.SourceEnumeratorMetrics [] - add finished split: osb.tickets:6 2025-12-28 01:30:52,845 INFO org.apache.flink.cdc.connectors.base.source.assigner.SnapshotSplitAssigner [] - Checkpoint completed on checkpoint 3 with splitFinishedCheckpointIds size 0. 2025-12-28 01:30:53,499 ERROR org.apache.flink.runtime.rest.handler.job.JobDetailsHandler [] - Exception occurred in REST handler: Job 2d8b2da4d49c7dd1ed2d63af3805debd not found 2025-12-28 01:30:53,524 ERROR org.apache.flink.runtime.rest.handler.job.JobExceptionsHandler [] - Exception occurred in REST handler: Job 2d8b2da4d49c7dd1ed2d63af3805debd not found 2025-12-28 01:30:54,863 ERROR org.apache.flink.runtime.rest.handler.job.JobDetailsHandler [] - Exception occurred in REST handler: Job 2d8b2da4d49c7dd1ed2d63af3805debd not found 2025-12-28 01:30:54,880 ERROR org.apache.flink.runtime.rest.handler.job.JobExceptionsHandler [] - Exception occurred in REST handler: Job 2d8b2da4d49c7dd1ed2d63af3805debd not found 2025-12-28 01:30:57,709 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 4 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1766885457707 for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:30:57,810 INFO org.apache.flink.fs.s3.common.writer.S3Committer [] - Committing checkpoints/7d19009552267ad3c9408aef84a4718d/chk-4/_metadata with MPU ID 84a8d11348f92ae501f7378f35da38520eb65fc703c4ea71880eedf4ec09a575 2025-12-28 01:30:57,823 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 4 for job 7d19009552267ad3c9408aef84a4718d (17117 bytes, checkpointDuration=115 ms, finalizationTime=1 ms). 2025-12-28 01:30:57,828 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Marking checkpoint 4 as completed for source Source: pg_osb_tickets[1]. 2025-12-28 01:31:02,708 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 5 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1766885462706 for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:31:02,798 INFO org.apache.flink.fs.s3.common.writer.S3Committer [] - Committing checkpoints/7d19009552267ad3c9408aef84a4718d/chk-5/_metadata with MPU ID 00713ca97c9357f9bdc156bb5d6b4cfe366d28e286c5cafa1b65980ee035a6b8 2025-12-28 01:31:02,811 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 5 for job 7d19009552267ad3c9408aef84a4718d (17117 bytes, checkpointDuration=104 ms, finalizationTime=0 ms). 2025-12-28 01:31:02,815 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Marking checkpoint 5 as completed for source Source: pg_osb_tickets[1]. 2025-12-28 01:31:07,708 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 6 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1766885467707 for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:31:07,818 INFO org.apache.flink.fs.s3.common.writer.S3Committer [] - Committing checkpoints/7d19009552267ad3c9408aef84a4718d/chk-6/_metadata with MPU ID 2ff618f68dc7bef60cab66dc99ec3fe1ac5c72760bf1e971318daf3545ba9f4c 2025-12-28 01:31:07,830 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 6 for job 7d19009552267ad3c9408aef84a4718d (17117 bytes, checkpointDuration=122 ms, finalizationTime=1 ms). 2025-12-28 01:31:07,832 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Marking checkpoint 6 as completed for source Source: pg_osb_tickets[1]. 2025-12-28 01:31:12,708 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 7 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1766885472706 for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:31:12,809 INFO org.apache.flink.fs.s3.common.writer.S3Committer [] - Committing checkpoints/7d19009552267ad3c9408aef84a4718d/chk-7/_metadata with MPU ID 67101720ee5479a7e7259acf727dd953086feb0853b91d8d90e1025f194e99a7 2025-12-28 01:31:12,825 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 7 for job 7d19009552267ad3c9408aef84a4718d (17117 bytes, checkpointDuration=118 ms, finalizationTime=1 ms). 2025-12-28 01:31:12,826 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Marking checkpoint 7 as completed for source Source: pg_osb_tickets[1]. 2025-12-28 01:31:15,269 INFO org.apache.fluss.flink.tiering.source.enumerator.TieringSourceEnumerator [] - Generate Tiering splits for table osb_staging.tickets_staging. 2025-12-28 01:31:15,519 INFO org.apache.fluss.flink.tiering.source.enumerator.TieringSourceEnumerator [] - Generate Tiering 4 splits for table osb_staging.tickets_staging with cost 250ms. 2025-12-28 01:31:17,707 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 8 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1766885477707 for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:31:17,866 INFO org.apache.flink.fs.s3.common.writer.S3Committer [] - Committing checkpoints/7d19009552267ad3c9408aef84a4718d/chk-8/_metadata with MPU ID a2314cbbd161e856639385c2220f2dcb7e58187ae9e26482e24a1c6e9930a931 2025-12-28 01:31:17,893 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 8 for job 7d19009552267ad3c9408aef84a4718d (17117 bytes, checkpointDuration=183 ms, finalizationTime=3 ms). 2025-12-28 01:31:17,895 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Marking checkpoint 8 as completed for source Source: pg_osb_tickets[1]. 2025-12-28 01:31:22,708 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 9 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1766885482706 for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:31:22,791 INFO org.apache.flink.fs.s3.common.writer.S3Committer [] - Committing checkpoints/7d19009552267ad3c9408aef84a4718d/chk-9/_metadata with MPU ID daa614e855f3a719742d085a879db399128920bb521b00654b7a27018298a924 2025-12-28 01:31:22,801 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 9 for job 7d19009552267ad3c9408aef84a4718d (17117 bytes, checkpointDuration=94 ms, finalizationTime=1 ms). 2025-12-28 01:31:22,801 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Marking checkpoint 9 as completed for source Source: pg_osb_tickets[1]. 2025-12-28 01:31:27,708 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 10 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1766885487707 for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:31:27,789 INFO org.apache.flink.fs.s3.common.writer.S3Committer [] - Committing checkpoints/7d19009552267ad3c9408aef84a4718d/chk-10/_metadata with MPU ID b2aa921d248f161d8b8af24138db6554a6c1012f8b72d4b237703aa1c2ba4359 2025-12-28 01:31:27,798 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 10 for job 7d19009552267ad3c9408aef84a4718d (17117 bytes, checkpointDuration=90 ms, finalizationTime=1 ms). 2025-12-28 01:31:27,800 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Marking checkpoint 10 as completed for source Source: pg_osb_tickets[1]. 2025-12-28 01:31:32,707 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 11 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1766885492706 for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:31:32,803 INFO org.apache.flink.fs.s3.common.writer.S3Committer [] - Committing checkpoints/7d19009552267ad3c9408aef84a4718d/chk-11/_metadata with MPU ID f43ac7c14387809ff2721e2bed3464cbb5580285f26d32f603979038252b6d79 2025-12-28 01:31:32,813 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 11 for job 7d19009552267ad3c9408aef84a4718d (17117 bytes, checkpointDuration=107 ms, finalizationTime=0 ms). 2025-12-28 01:31:32,814 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Marking checkpoint 11 as completed for source Source: pg_osb_tickets[1]. 2025-12-28 01:31:37,708 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 12 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1766885497707 for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:31:37,817 INFO org.apache.flink.fs.s3.common.writer.S3Committer [] - Committing checkpoints/7d19009552267ad3c9408aef84a4718d/chk-12/_metadata with MPU ID 0138a148345a188b93e9528d683a3924dd917117ab7d19b9ac0e0f3a141d2257 2025-12-28 01:31:37,828 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 12 for job 7d19009552267ad3c9408aef84a4718d (17117 bytes, checkpointDuration=120 ms, finalizationTime=1 ms). 2025-12-28 01:31:37,829 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Marking checkpoint 12 as completed for source Source: pg_osb_tickets[1]. 2025-12-28 01:31:42,708 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 13 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1766885502707 for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:31:42,810 INFO org.apache.flink.fs.s3.common.writer.S3Committer [] - Committing checkpoints/7d19009552267ad3c9408aef84a4718d/chk-13/_metadata with MPU ID aec4982432ff7bd80d4852948a624f3b4342ef1078337b7f11297ab40e70a620 2025-12-28 01:31:42,821 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 13 for job 7d19009552267ad3c9408aef84a4718d (17117 bytes, checkpointDuration=113 ms, finalizationTime=1 ms). 2025-12-28 01:31:42,822 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Marking checkpoint 13 as completed for source Source: pg_osb_tickets[1]. 2025-12-28 01:31:47,707 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 14 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1766885507706 for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:31:47,806 INFO org.apache.flink.fs.s3.common.writer.S3Committer [] - Committing checkpoints/7d19009552267ad3c9408aef84a4718d/chk-14/_metadata with MPU ID e01cdb1a86d2882982e43eadf1546c8f2de328f316b385ba48a965bd60a3be98 2025-12-28 01:31:47,818 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 14 for job 7d19009552267ad3c9408aef84a4718d (17117 bytes, checkpointDuration=111 ms, finalizationTime=1 ms). 2025-12-28 01:31:47,819 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Marking checkpoint 14 as completed for source Source: pg_osb_tickets[1]. 2025-12-28 01:31:52,243 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Received JobGraph submission 'SELECT `tickets_staging`.`ticket_id`, `tickets_staging`.`movie_id`, `tickets_staging`.`user_id`, `tickets_staging`.`cost`, `tickets_staging`.`purchased_at` FROM `fluss_catalog`.`osb_staging`.`tickets_staging` AS `tickets_staging`' (a6e7ff5071b0eb27363dc2b161699317). 2025-12-28 01:31:52,243 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Submitting job 'SELECT `tickets_staging`.`ticket_id`, `tickets_staging`.`movie_id`, `tickets_staging`.`user_id`, `tickets_staging`.`cost`, `tickets_staging`.`purchased_at` FROM `fluss_catalog`.`osb_staging`.`tickets_staging` AS `tickets_staging`' (a6e7ff5071b0eb27363dc2b161699317). 2025-12-28 01:31:52,244 INFO org.apache.flink.runtime.jobmaster.JobMasterServiceLeadershipRunner [] - JobMasterServiceLeadershipRunner for job a6e7ff5071b0eb27363dc2b161699317 was granted leadership with leader id 00000000-0000-0000-0000-000000000000. Creating new JobMasterServiceProcess. 2025-12-28 01:31:52,246 INFO org.apache.flink.runtime.rpc.pekko.PekkoRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_4 . 2025-12-28 01:31:52,246 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Initializing job 'SELECT `tickets_staging`.`ticket_id`, `tickets_staging`.`movie_id`, `tickets_staging`.`user_id`, `tickets_staging`.`cost`, `tickets_staging`.`purchased_at` FROM `fluss_catalog`.`osb_staging`.`tickets_staging` AS `tickets_staging`' (a6e7ff5071b0eb27363dc2b161699317). 2025-12-28 01:31:52,248 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using restart back off time strategy NoRestartBackoffTimeStrategy for SELECT `tickets_staging`.`ticket_id`, `tickets_staging`.`movie_id`, `tickets_staging`.`user_id`, `tickets_staging`.`cost`, `tickets_staging`.`purchased_at` FROM `fluss_catalog`.`osb_staging`.`tickets_staging` AS `tickets_staging` (a6e7ff5071b0eb27363dc2b161699317). 2025-12-28 01:31:52,248 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Created execution graph 7a68ea4fbf4324b36f7dca75230d6ef0 for job a6e7ff5071b0eb27363dc2b161699317. 2025-12-28 01:31:52,249 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Running initialization on master for job SELECT `tickets_staging`.`ticket_id`, `tickets_staging`.`movie_id`, `tickets_staging`.`user_id`, `tickets_staging`.`cost`, `tickets_staging`.`purchased_at` FROM `fluss_catalog`.`osb_staging`.`tickets_staging` AS `tickets_staging` (a6e7ff5071b0eb27363dc2b161699317). 2025-12-28 01:31:52,249 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Successfully ran initialization on master in 0 ms. 2025-12-28 01:31:52,270 INFO org.apache.flink.runtime.scheduler.adapter.DefaultExecutionTopology [] - Built 1 new pipelined regions in 1 ms, total 1 pipelined regions currently. 2025-12-28 01:31:52,270 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Loading state backend via factory org.apache.flink.contrib.streaming.state.EmbeddedRocksDBStateBackendFactory 2025-12-28 01:31:52,270 INFO org.apache.flink.contrib.streaming.state.EmbeddedRocksDBStateBackend [] - Using predefined options: DEFAULT. 2025-12-28 01:31:52,271 INFO org.apache.flink.runtime.state.StateBackendLoader [] - State backend loader loads the state backend as EmbeddedRocksDBStateBackend 2025-12-28 01:31:52,271 WARN org.apache.flink.configuration.Configuration [] - Config uses deprecated configuration key 'state.checkpoints.dir' instead of proper key 'execution.checkpointing.dir' 2025-12-28 01:31:52,271 WARN org.apache.flink.configuration.Configuration [] - Config uses deprecated configuration key 'state.checkpoints.dir' instead of proper key 'execution.checkpointing.dir' 2025-12-28 01:31:52,271 WARN org.apache.flink.configuration.Configuration [] - Config uses deprecated configuration key 'state.savepoints.dir' instead of proper key 'execution.checkpointing.savepoint-dir' 2025-12-28 01:31:52,271 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Checkpoint storage is set to 'filesystem': (checkpoints "s3://warehouse/checkpoints") 2025-12-28 01:31:52,272 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - No checkpoint found during restore. 2025-12-28 01:31:52,272 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@939596d for SELECT `tickets_staging`.`ticket_id`, `tickets_staging`.`movie_id`, `tickets_staging`.`user_id`, `tickets_staging`.`cost`, `tickets_staging`.`purchased_at` FROM `fluss_catalog`.`osb_staging`.`tickets_staging` AS `tickets_staging` (a6e7ff5071b0eb27363dc2b161699317). 2025-12-28 01:31:52,273 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Starting execution of job 'SELECT `tickets_staging`.`ticket_id`, `tickets_staging`.`movie_id`, `tickets_staging`.`user_id`, `tickets_staging`.`cost`, `tickets_staging`.`purchased_at` FROM `fluss_catalog`.`osb_staging`.`tickets_staging` AS `tickets_staging`' (a6e7ff5071b0eb27363dc2b161699317) under job master id 00000000000000000000000000000000. 2025-12-28 01:31:52,273 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Starting split enumerator for source Source: tickets_staging[1]. 2025-12-28 01:31:52,276 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy] 2025-12-28 01:31:52,277 INFO org.apache.fluss.metrics.registry.MetricRegistry [] - No metrics reporter configured, no metrics will be exposed/reported. 2025-12-28 01:31:52,277 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job SELECT `tickets_staging`.`ticket_id`, `tickets_staging`.`movie_id`, `tickets_staging`.`user_id`, `tickets_staging`.`cost`, `tickets_staging`.`purchased_at` FROM `fluss_catalog`.`osb_staging`.`tickets_staging` AS `tickets_staging` (a6e7ff5071b0eb27363dc2b161699317) switched from state CREATED to RUNNING. 2025-12-28 01:31:52,277 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: tickets_staging[1] -> ConstraintEnforcer[2] -> Sink: Collect table sink (1/1) (7a68ea4fbf4324b36f7dca75230d6ef0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED. 2025-12-28 01:31:52,277 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Connecting to ResourceManager pekko.tcp://flink@jobmanager:6123/user/rpc/resourcemanager_*(00000000000000000000000000000000) 2025-12-28 01:31:52,279 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Resolved ResourceManager address, beginning registration 2025-12-28 01:31:52,279 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registering job manager [email protected]://flink@jobmanager:6123/user/rpc/jobmanager_4 for job a6e7ff5071b0eb27363dc2b161699317. 2025-12-28 01:31:52,281 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registered job manager [email protected]://flink@jobmanager:6123/user/rpc/jobmanager_4 for job a6e7ff5071b0eb27363dc2b161699317. 2025-12-28 01:31:52,282 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - JobManager successfully registered at ResourceManager, leader id: 00000000000000000000000000000000. 2025-12-28 01:31:52,283 INFO org.apache.flink.runtime.resourcemanager.slotmanager.FineGrainedSlotManager [] - Received resource requirements from job a6e7ff5071b0eb27363dc2b161699317: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}] 2025-12-28 01:31:52,331 INFO org.apache.fluss.flink.source.enumerator.FlinkSourceEnumerator [] - No more FlussSplits to assign. Sending NoMoreSplitsEvent to reader [] 2025-12-28 01:31:52,352 INFO org.apache.flink.runtime.resourcemanager.slotmanager.FineGrainedSlotManager [] - Matching resource requirements against available resources. Missing resources: Job a6e7ff5071b0eb27363dc2b161699317 ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1} Current resources: TaskManager 10.89.7.3:46441-e26865 Available: ResourceProfile{cpuCores=5, taskHeapMemory=336.000mb (352321530 bytes), taskOffHeapMemory=0 bytes, managedMemory=396.800mb (416074963 bytes), networkMemory=99.200mb (104018740 bytes)} Total: ResourceProfile{cpuCores=8, taskHeapMemory=537.600mb (563714445 bytes), taskOffHeapMemory=0 bytes, managedMemory=634.880mb (665719939 bytes), networkMemory=158.720mb (166429984 bytes)} 2025-12-28 01:31:52,353 INFO org.apache.flink.runtime.resourcemanager.slotmanager.DefaultSlotStatusSyncer [] - Starting allocation of slot fc482a880db3485533fa243e3a64707c from 10.89.7.3:46441-e26865 for job a6e7ff5071b0eb27363dc2b161699317 with resource profile ResourceProfile{cpuCores=1, taskHeapMemory=67.200mb (70464305 bytes), taskOffHeapMemory=0 bytes, managedMemory=79.360mb (83214992 bytes), networkMemory=19.840mb (20803748 bytes)}. 2025-12-28 01:31:52,435 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: tickets_staging[1] -> ConstraintEnforcer[2] -> Sink: Collect table sink (1/1) (7a68ea4fbf4324b36f7dca75230d6ef0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING. 2025-12-28 01:31:52,435 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying Source: tickets_staging[1] -> ConstraintEnforcer[2] -> Sink: Collect table sink (1/1) (attempt #0) with attempt id 7a68ea4fbf4324b36f7dca75230d6ef0_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 10.89.7.3:46441-e26865 @ flink-taskmanager (dataPort=46067) with allocation id fc482a880db3485533fa243e3a64707c 2025-12-28 01:31:52,468 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: tickets_staging[1] -> ConstraintEnforcer[2] -> Sink: Collect table sink (1/1) (7a68ea4fbf4324b36f7dca75230d6ef0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING. 2025-12-28 01:31:52,562 INFO org.apache.flink.streaming.api.operators.collect.CollectSinkOperatorCoordinator [] - Received sink socket server address: /10.89.7.3:34587 2025-12-28 01:31:52,569 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: tickets_staging[1] registering reader for parallel task 0 (#0) @ 10.89.7.3 2025-12-28 01:31:52,576 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: tickets_staging[1] -> ConstraintEnforcer[2] -> Sink: Collect table sink (1/1) (7a68ea4fbf4324b36f7dca75230d6ef0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING. 2025-12-28 01:31:52,570 INFO org.apache.fluss.flink.source.enumerator.FlinkSourceEnumerator [] - Assigning splits to readers {0=[LogSplit{tableBucket=TableBucket{tableId=0, bucket=0}, partitionName='null', startingOffset=-2, stoppingOffset=-9223372036854775808}, LogSplit{tableBucket=TableBucket{tableId=0, bucket=1}, partitionName='null', startingOffset=-2, stoppingOffset=-9223372036854775808}, LogSplit{tableBucket=TableBucket{tableId=0, bucket=2}, partitionName='null', startingOffset=-2, stoppingOffset=-9223372036854775808}, LogSplit{tableBucket=TableBucket{tableId=0, bucket=3}, partitionName='null', startingOffset=-2, stoppingOffset=-9223372036854775808}]} 2025-12-28 01:31:52,583 INFO org.apache.fluss.flink.source.enumerator.FlinkSourceEnumerator [] - No more FlussSplits to assign. Sending NoMoreSplitsEvent to reader [0] 2025-12-28 01:31:52,608 INFO org.apache.flink.streaming.api.operators.collect.CollectSinkOperatorCoordinator [] - Sink connection established 2025-12-28 01:31:52,709 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 15 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1766885512707 for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:31:52,851 INFO org.apache.flink.fs.s3.common.writer.S3Committer [] - Committing checkpoints/7d19009552267ad3c9408aef84a4718d/chk-15/_metadata with MPU ID 0fdb170691aab99c6f90d5deb783a9b27b15b65e81beebf118b13bd9ad72618d 2025-12-28 01:31:52,880 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 15 for job 7d19009552267ad3c9408aef84a4718d (17117 bytes, checkpointDuration=173 ms, finalizationTime=0 ms). 2025-12-28 01:31:52,890 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Marking checkpoint 15 as completed for source Source: pg_osb_tickets[1]. 2025-12-28 01:31:57,706 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 16 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1766885517706 for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:31:57,738 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job SELECT `tickets_staging`.`ticket_id`, `tickets_staging`.`movie_id`, `tickets_staging`.`user_id`, `tickets_staging`.`cost`, `tickets_staging`.`purchased_at` FROM `fluss_catalog`.`osb_staging`.`tickets_staging` AS `tickets_staging` (a6e7ff5071b0eb27363dc2b161699317) switched from state RUNNING to CANCELLING. 2025-12-28 01:31:57,740 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: tickets_staging[1] -> ConstraintEnforcer[2] -> Sink: Collect table sink (1/1) (7a68ea4fbf4324b36f7dca75230d6ef0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from RUNNING to CANCELING. 2025-12-28 01:31:57,801 INFO org.apache.flink.fs.s3.common.writer.S3Committer [] - Committing checkpoints/7d19009552267ad3c9408aef84a4718d/chk-16/_metadata with MPU ID e7b01dd641e5ab827a5424e35ff6eeb5ffb4f5710789d6964c2320bbcd781446 2025-12-28 01:31:57,815 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 16 for job 7d19009552267ad3c9408aef84a4718d (17117 bytes, checkpointDuration=109 ms, finalizationTime=0 ms). 2025-12-28 01:31:57,817 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Marking checkpoint 16 as completed for source Source: pg_osb_tickets[1]. 2025-12-28 01:31:59,846 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: tickets_staging[1] -> ConstraintEnforcer[2] -> Sink: Collect table sink (1/1) (7a68ea4fbf4324b36f7dca75230d6ef0_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CANCELING to CANCELED. 2025-12-28 01:31:59,855 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job SELECT `tickets_staging`.`ticket_id`, `tickets_staging`.`movie_id`, `tickets_staging`.`user_id`, `tickets_staging`.`cost`, `tickets_staging`.`purchased_at` FROM `fluss_catalog`.`osb_staging`.`tickets_staging` AS `tickets_staging` (a6e7ff5071b0eb27363dc2b161699317) switched from state CANCELLING to CANCELED. 2025-12-28 01:31:59,855 INFO org.apache.flink.runtime.resourcemanager.slotmanager.FineGrainedSlotManager [] - Clearing resource requirements of job a6e7ff5071b0eb27363dc2b161699317 2025-12-28 01:31:59,855 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Stopping checkpoint coordinator for job a6e7ff5071b0eb27363dc2b161699317. 2025-12-28 01:31:59,869 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Job a6e7ff5071b0eb27363dc2b161699317 reached terminal state CANCELED. 2025-12-28 01:31:59,892 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Stopping the JobMaster for job 'SELECT `tickets_staging`.`ticket_id`, `tickets_staging`.`movie_id`, `tickets_staging`.`user_id`, `tickets_staging`.`cost`, `tickets_staging`.`purchased_at` FROM `fluss_catalog`.`osb_staging`.`tickets_staging` AS `tickets_staging`' (a6e7ff5071b0eb27363dc2b161699317). 2025-12-28 01:31:59,895 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Closing SourceCoordinator for source Source: tickets_staging[1]. 2025-12-28 01:31:59,897 INFO org.apache.flink.streaming.api.operators.collect.CollectSinkOperatorCoordinator [] - Closing the CollectSinkOperatorCoordinator. 2025-12-28 01:31:59,899 INFO org.apache.flink.runtime.checkpoint.StandaloneCompletedCheckpointStore [] - Shutting down 2025-12-28 01:31:59,902 INFO org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool [] - Releasing slot [fc482a880db3485533fa243e3a64707c]. 2025-12-28 01:31:59,903 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Disconnect TaskExecutor 10.89.7.3:46441-e26865 because: Stopping JobMaster for job 'SELECT `tickets_staging`.`ticket_id`, `tickets_staging`.`movie_id`, `tickets_staging`.`user_id`, `tickets_staging`.`cost`, `tickets_staging`.`purchased_at` FROM `fluss_catalog`.`osb_staging`.`tickets_staging` AS `tickets_staging`' (a6e7ff5071b0eb27363dc2b161699317). 2025-12-28 01:31:59,904 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Close ResourceManager connection 188638b6e5a2aaf53ebe17ee807080bf: Stopping JobMaster for job 'SELECT `tickets_staging`.`ticket_id`, `tickets_staging`.`movie_id`, `tickets_staging`.`user_id`, `tickets_staging`.`cost`, `tickets_staging`.`purchased_at` FROM `fluss_catalog`.`osb_staging`.`tickets_staging` AS `tickets_staging`' (a6e7ff5071b0eb27363dc2b161699317). 2025-12-28 01:31:59,905 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Disconnect job manager [email protected]://flink@jobmanager:6123/user/rpc/jobmanager_4 for job a6e7ff5071b0eb27363dc2b161699317 from the resource manager. 2025-12-28 01:31:59,922 INFO org.apache.flink.runtime.resourcemanager.slotmanager.DefaultSlotStatusSyncer [] - Freeing slot fc482a880db3485533fa243e3a64707c. 2025-12-28 01:32:01,925 INFO org.apache.fluss.rpc.netty.client.NettyClient [] - Netty client was shutdown successfully. 2025-12-28 01:32:01,927 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source coordinator for source Source: tickets_staging[1] closed. 2025-12-28 01:32:02,706 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 17 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1766885522706 for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:32:02,743 INFO org.apache.flink.fs.s3.common.writer.S3Committer [] - Committing checkpoints/7d19009552267ad3c9408aef84a4718d/chk-17/_metadata with MPU ID f9bc64c53b3132cfd706adfb7b7be988d5db757be8528faf71a7a23cf05206fc 2025-12-28 01:32:02,750 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 17 for job 7d19009552267ad3c9408aef84a4718d (17117 bytes, checkpointDuration=44 ms, finalizationTime=0 ms). 2025-12-28 01:32:02,752 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Marking checkpoint 17 as completed for source Source: pg_osb_tickets[1]. 2025-12-28 01:32:07,708 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 18 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1766885527707 for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:32:07,802 INFO org.apache.flink.fs.s3.common.writer.S3Committer [] - Committing checkpoints/7d19009552267ad3c9408aef84a4718d/chk-18/_metadata with MPU ID f72e29a22928c6efa5205af7b7b813044e215f6f2c0b883104c0792f6a95f571 2025-12-28 01:32:07,819 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 18 for job 7d19009552267ad3c9408aef84a4718d (17117 bytes, checkpointDuration=110 ms, finalizationTime=0 ms). 2025-12-28 01:32:07,823 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Marking checkpoint 18 as completed for source Source: pg_osb_tickets[1]. 2025-12-28 01:32:08,219 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Received JobGraph submission 'SELECT `tickets_staging$lake`.`ticket_id`, `tickets_staging$lake`.`movie_id`, `tickets_staging$lake`.`user_id`, `tickets_staging$lake`.`cost`, `tickets_staging$lake`.`purchased_at`, `tickets_staging$lake`.`__bucket`, `tickets_staging$lake`.`__offset`, `tickets_staging$lake`.`__timestamp` FROM `fluss_catalog`.`osb_staging`.`tickets_staging$lake` AS `tickets_staging$lake`' (001f4dc87c493d3b21013dc119166f09). 2025-12-28 01:32:08,219 INFO org.apache.flink.runtime.dispatcher.StandaloneDispatcher [] - Submitting job 'SELECT `tickets_staging$lake`.`ticket_id`, `tickets_staging$lake`.`movie_id`, `tickets_staging$lake`.`user_id`, `tickets_staging$lake`.`cost`, `tickets_staging$lake`.`purchased_at`, `tickets_staging$lake`.`__bucket`, `tickets_staging$lake`.`__offset`, `tickets_staging$lake`.`__timestamp` FROM `fluss_catalog`.`osb_staging`.`tickets_staging$lake` AS `tickets_staging$lake`' (001f4dc87c493d3b21013dc119166f09). 2025-12-28 01:32:08,220 INFO org.apache.flink.runtime.jobmaster.JobMasterServiceLeadershipRunner [] - JobMasterServiceLeadershipRunner for job 001f4dc87c493d3b21013dc119166f09 was granted leadership with leader id 00000000-0000-0000-0000-000000000000. Creating new JobMasterServiceProcess. 2025-12-28 01:32:08,221 INFO org.apache.flink.runtime.rpc.pekko.PekkoRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.jobmaster.JobMaster at pekko://flink/user/rpc/jobmanager_5 . 2025-12-28 01:32:08,222 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Initializing job 'SELECT `tickets_staging$lake`.`ticket_id`, `tickets_staging$lake`.`movie_id`, `tickets_staging$lake`.`user_id`, `tickets_staging$lake`.`cost`, `tickets_staging$lake`.`purchased_at`, `tickets_staging$lake`.`__bucket`, `tickets_staging$lake`.`__offset`, `tickets_staging$lake`.`__timestamp` FROM `fluss_catalog`.`osb_staging`.`tickets_staging$lake` AS `tickets_staging$lake`' (001f4dc87c493d3b21013dc119166f09). 2025-12-28 01:32:08,223 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using restart back off time strategy NoRestartBackoffTimeStrategy for SELECT `tickets_staging$lake`.`ticket_id`, `tickets_staging$lake`.`movie_id`, `tickets_staging$lake`.`user_id`, `tickets_staging$lake`.`cost`, `tickets_staging$lake`.`purchased_at`, `tickets_staging$lake`.`__bucket`, `tickets_staging$lake`.`__offset`, `tickets_staging$lake`.`__timestamp` FROM `fluss_catalog`.`osb_staging`.`tickets_staging$lake` AS `tickets_staging$lake` (001f4dc87c493d3b21013dc119166f09). 2025-12-28 01:32:08,224 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Created execution graph 000529c1866ad5fb4710efba73d3a128 for job 001f4dc87c493d3b21013dc119166f09. 2025-12-28 01:32:08,224 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Running initialization on master for job SELECT `tickets_staging$lake`.`ticket_id`, `tickets_staging$lake`.`movie_id`, `tickets_staging$lake`.`user_id`, `tickets_staging$lake`.`cost`, `tickets_staging$lake`.`purchased_at`, `tickets_staging$lake`.`__bucket`, `tickets_staging$lake`.`__offset`, `tickets_staging$lake`.`__timestamp` FROM `fluss_catalog`.`osb_staging`.`tickets_staging$lake` AS `tickets_staging$lake` (001f4dc87c493d3b21013dc119166f09). 2025-12-28 01:32:08,224 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Successfully ran initialization on master in 0 ms. 2025-12-28 01:32:08,225 WARN org.apache.flink.metrics.MetricGroup [] - The operator name Source: tickets_staging$lake[3] -> ConstraintEnforcer[4] -> Sink: Collect table sink exceeded the 80 characters length limit and was truncated. 2025-12-28 01:32:08,276 WARN org.apache.flink.metrics.MetricGroup [] - The operator name Source: tickets_staging$lake[3] -> ConstraintEnforcer[4] -> Sink: Collect table sink exceeded the 80 characters length limit and was truncated. 2025-12-28 01:32:08,277 INFO org.apache.flink.runtime.scheduler.adapter.DefaultExecutionTopology [] - Built 1 new pipelined regions in 0 ms, total 1 pipelined regions currently. 2025-12-28 01:32:08,278 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Loading state backend via factory org.apache.flink.contrib.streaming.state.EmbeddedRocksDBStateBackendFactory 2025-12-28 01:32:08,278 INFO org.apache.flink.contrib.streaming.state.EmbeddedRocksDBStateBackend [] - Using predefined options: DEFAULT. 2025-12-28 01:32:08,279 INFO org.apache.flink.runtime.state.StateBackendLoader [] - State backend loader loads the state backend as EmbeddedRocksDBStateBackend 2025-12-28 01:32:08,279 WARN org.apache.flink.configuration.Configuration [] - Config uses deprecated configuration key 'state.checkpoints.dir' instead of proper key 'execution.checkpointing.dir' 2025-12-28 01:32:08,280 WARN org.apache.flink.configuration.Configuration [] - Config uses deprecated configuration key 'state.checkpoints.dir' instead of proper key 'execution.checkpointing.dir' 2025-12-28 01:32:08,281 WARN org.apache.flink.configuration.Configuration [] - Config uses deprecated configuration key 'state.savepoints.dir' instead of proper key 'execution.checkpointing.savepoint-dir' 2025-12-28 01:32:08,281 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Checkpoint storage is set to 'filesystem': (checkpoints "s3://warehouse/checkpoints") 2025-12-28 01:32:08,281 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - No checkpoint found during restore. 2025-12-28 01:32:08,282 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Using failover strategy org.apache.flink.runtime.executiongraph.failover.RestartPipelinedRegionFailoverStrategy@742db838 for SELECT `tickets_staging$lake`.`ticket_id`, `tickets_staging$lake`.`movie_id`, `tickets_staging$lake`.`user_id`, `tickets_staging$lake`.`cost`, `tickets_staging$lake`.`purchased_at`, `tickets_staging$lake`.`__bucket`, `tickets_staging$lake`.`__offset`, `tickets_staging$lake`.`__timestamp` FROM `fluss_catalog`.`osb_staging`.`tickets_staging$lake` AS `tickets_staging$lake` (001f4dc87c493d3b21013dc119166f09). 2025-12-28 01:32:08,282 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Starting execution of job 'SELECT `tickets_staging$lake`.`ticket_id`, `tickets_staging$lake`.`movie_id`, `tickets_staging$lake`.`user_id`, `tickets_staging$lake`.`cost`, `tickets_staging$lake`.`purchased_at`, `tickets_staging$lake`.`__bucket`, `tickets_staging$lake`.`__offset`, `tickets_staging$lake`.`__timestamp` FROM `fluss_catalog`.`osb_staging`.`tickets_staging$lake` AS `tickets_staging$lake`' (001f4dc87c493d3b21013dc119166f09) under job master id 00000000000000000000000000000000. 2025-12-28 01:32:08,283 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Starting split enumerator for source Source: tickets_staging$lake[3]. 2025-12-28 01:32:08,788 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Starting scheduling with scheduling strategy [org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy] 2025-12-28 01:32:08,788 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Job SELECT `tickets_staging$lake`.`ticket_id`, `tickets_staging$lake`.`movie_id`, `tickets_staging$lake`.`user_id`, `tickets_staging$lake`.`cost`, `tickets_staging$lake`.`purchased_at`, `tickets_staging$lake`.`__bucket`, `tickets_staging$lake`.`__offset`, `tickets_staging$lake`.`__timestamp` FROM `fluss_catalog`.`osb_staging`.`tickets_staging$lake` AS `tickets_staging$lake` (001f4dc87c493d3b21013dc119166f09) switched from state CREATED to RUNNING. 2025-12-28 01:32:08,788 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: tickets_staging$lake[3] -> ConstraintEnforcer[4] -> Sink: Collect table sink (1/1) (000529c1866ad5fb4710efba73d3a128_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from CREATED to SCHEDULED. 2025-12-28 01:32:08,789 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Connecting to ResourceManager pekko.tcp://flink@jobmanager:6123/user/rpc/resourcemanager_*(00000000000000000000000000000000) 2025-12-28 01:32:08,790 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - Resolved ResourceManager address, beginning registration 2025-12-28 01:32:08,791 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registering job manager [email protected]://flink@jobmanager:6123/user/rpc/jobmanager_5 for job 001f4dc87c493d3b21013dc119166f09. 2025-12-28 01:32:08,793 INFO org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - Registered job manager [email protected]://flink@jobmanager:6123/user/rpc/jobmanager_5 for job 001f4dc87c493d3b21013dc119166f09. 2025-12-28 01:32:08,798 INFO org.apache.flink.runtime.jobmaster.JobMaster [] - JobManager successfully registered at ResourceManager, leader id: 00000000000000000000000000000000. 2025-12-28 01:32:08,799 INFO org.apache.flink.runtime.resourcemanager.slotmanager.FineGrainedSlotManager [] - Received resource requirements from job 001f4dc87c493d3b21013dc119166f09: [ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1}] 2025-12-28 01:32:08,862 INFO org.apache.flink.runtime.resourcemanager.slotmanager.FineGrainedSlotManager [] - Matching resource requirements against available resources. Missing resources: Job 001f4dc87c493d3b21013dc119166f09 ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN}, numberOfRequiredSlots=1} Current resources: TaskManager 10.89.7.3:46441-e26865 Available: ResourceProfile{cpuCores=5, taskHeapMemory=336.000mb (352321530 bytes), taskOffHeapMemory=0 bytes, managedMemory=396.800mb (416074963 bytes), networkMemory=99.200mb (104018740 bytes)} Total: ResourceProfile{cpuCores=8, taskHeapMemory=537.600mb (563714445 bytes), taskOffHeapMemory=0 bytes, managedMemory=634.880mb (665719939 bytes), networkMemory=158.720mb (166429984 bytes)} 2025-12-28 01:32:08,866 INFO org.apache.flink.runtime.resourcemanager.slotmanager.DefaultSlotStatusSyncer [] - Starting allocation of slot c0c713e3a13aa21db6389543479b6e16 from 10.89.7.3:46441-e26865 for job 001f4dc87c493d3b21013dc119166f09 with resource profile ResourceProfile{cpuCores=1, taskHeapMemory=67.200mb (70464305 bytes), taskOffHeapMemory=0 bytes, managedMemory=79.360mb (83214992 bytes), networkMemory=19.840mb (20803748 bytes)}. 2025-12-28 01:32:08,893 WARN org.apache.paimon.utils.HadoopUtils [] - Could not find Hadoop configuration via any of the supported methods 2025-12-28 01:32:08,924 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: tickets_staging$lake[3] -> ConstraintEnforcer[4] -> Sink: Collect table sink (1/1) (000529c1866ad5fb4710efba73d3a128_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from SCHEDULED to DEPLOYING. 2025-12-28 01:32:08,924 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Deploying Source: tickets_staging$lake[3] -> ConstraintEnforcer[4] -> Sink: Collect table sink (1/1) (attempt #0) with attempt id 000529c1866ad5fb4710efba73d3a128_cbc357ccb763df2852fee8c4fc7d55f2_0_0 and vertex id cbc357ccb763df2852fee8c4fc7d55f2_0 to 10.89.7.3:46441-e26865 @ flink-taskmanager (dataPort=46067) with allocation id c0c713e3a13aa21db6389543479b6e16 2025-12-28 01:32:08,968 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: tickets_staging$lake[3] -> ConstraintEnforcer[4] -> Sink: Collect table sink (1/1) (000529c1866ad5fb4710efba73d3a128_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from DEPLOYING to INITIALIZING. 2025-12-28 01:32:09,098 INFO org.apache.flink.streaming.api.operators.collect.CollectSinkOperatorCoordinator [] - Received sink socket server address: /10.89.7.3:37245 2025-12-28 01:32:09,106 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: tickets_staging$lake[3] registering reader for parallel task 0 (#0) @ 10.89.7.3 2025-12-28 01:32:09,108 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Source Source: tickets_staging$lake[3] received split request from parallel task 0 (#0) 2025-12-28 01:32:09,118 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph [] - Source: tickets_staging$lake[3] -> ConstraintEnforcer[4] -> Sink: Collect table sink (1/1) (000529c1866ad5fb4710efba73d3a128_cbc357ccb763df2852fee8c4fc7d55f2_0_0) switched from INITIALIZING to RUNNING. 2025-12-28 01:32:09,130 INFO org.apache.flink.streaming.api.operators.collect.CollectSinkOperatorCoordinator [] - Sink connection established 2025-12-28 01:32:09,392 WARN org.apache.hadoop.metrics2.impl.MetricsConfig [] - Cannot locate configuration: tried hadoop-metrics2-s3a-file-system.properties,hadoop-metrics2.properties 2025-12-28 01:32:09,424 WARN org.apache.hadoop.metrics2.util.MBeans [] - Failed to register MBean "Hadoop:service=s3a-file-system,name=MetricsSystem,sub=Stats": Instance already exists. 2025-12-28 01:32:09,425 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl [] - Scheduled Metric snapshot period at 10 second(s). 2025-12-28 01:32:09,425 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl [] - s3a-file-system metrics system started 2025-12-28 01:32:09,426 WARN org.apache.hadoop.metrics2.util.MBeans [] - Failed to register MBean "Hadoop:service=s3a-file-system,name=MetricsSystem,sub=Control": Instance already exists. 2025-12-28 01:32:09,430 WARN org.apache.hadoop.metrics2.util.MBeans [] - Failed to register MBean "Hadoop:service=s3a-file-system,name=S3AMetrics1-warehouse": Instance already exists. 2025-12-28 01:32:09,474 WARN org.apache.hadoop.util.NativeCodeLoader [] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2025-12-28 01:32:12,707 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 19 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1766885532706 for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:32:12,793 INFO org.apache.flink.fs.s3.common.writer.S3Committer [] - Committing checkpoints/7d19009552267ad3c9408aef84a4718d/chk-19/_metadata with MPU ID bfefc42c91fde08d4bc5370f22d8e90ba528272e0ad088164ffd63e0ace7c7df 2025-12-28 01:32:12,810 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 19 for job 7d19009552267ad3c9408aef84a4718d (17117 bytes, checkpointDuration=103 ms, finalizationTime=1 ms). 2025-12-28 01:32:12,811 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Marking checkpoint 19 as completed for source Source: pg_osb_tickets[1]. 2025-12-28 01:32:17,707 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 20 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1766885537706 for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:32:17,782 INFO org.apache.flink.fs.s3.common.writer.S3Committer [] - Committing checkpoints/7d19009552267ad3c9408aef84a4718d/chk-20/_metadata with MPU ID 5f7e53fab12225fd02160615e87768ef6548776aea7efa502c1c50635956300b 2025-12-28 01:32:17,799 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 20 for job 7d19009552267ad3c9408aef84a4718d (17117 bytes, checkpointDuration=93 ms, finalizationTime=0 ms). 2025-12-28 01:32:17,802 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Marking checkpoint 20 as completed for source Source: pg_osb_tickets[1]. 2025-12-28 01:32:22,707 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 21 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1766885542706 for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:32:22,769 INFO org.apache.flink.fs.s3.common.writer.S3Committer [] - Committing checkpoints/7d19009552267ad3c9408aef84a4718d/chk-21/_metadata with MPU ID 0ef014b75d520260c81e79a0c3ad1778b3ade771aa95d369c11d2f4e9decb579 2025-12-28 01:32:22,781 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 21 for job 7d19009552267ad3c9408aef84a4718d (17117 bytes, checkpointDuration=74 ms, finalizationTime=1 ms). 2025-12-28 01:32:22,781 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Marking checkpoint 21 as completed for source Source: pg_osb_tickets[1]. 2025-12-28 01:32:27,707 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 22 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1766885547706 for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:32:27,773 INFO org.apache.flink.fs.s3.common.writer.S3Committer [] - Committing checkpoints/7d19009552267ad3c9408aef84a4718d/chk-22/_metadata with MPU ID 61279759a0a5ec21f41f464fc2b9b7d753f9e639c95a341509b88d80a547d390 2025-12-28 01:32:27,784 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 22 for job 7d19009552267ad3c9408aef84a4718d (17117 bytes, checkpointDuration=78 ms, finalizationTime=0 ms). 2025-12-28 01:32:27,785 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Marking checkpoint 22 as completed for source Source: pg_osb_tickets[1]. 2025-12-28 01:32:32,707 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Triggering checkpoint 23 (type=CheckpointType{name='Checkpoint', sharingFilesStrategy=FORWARD_BACKWARD}) @ 1766885552706 for job 7d19009552267ad3c9408aef84a4718d. 2025-12-28 01:32:32,756 INFO org.apache.flink.fs.s3.common.writer.S3Committer [] - Committing checkpoints/7d19009552267ad3c9408aef84a4718d/chk-23/_metadata with MPU ID 9014b6078acb874d7ccbacfe860bcb194e4ac2089abc5f329856ee44bd0e20bc 2025-12-28 01:32:32,767 INFO org.apache.flink.runtime.checkpoint.CheckpointCoordinator [] - Completed checkpoint 23 for job 7d19009552267ad3c9408aef84a4718d (17117 bytes, checkpointDuration=60 ms, finalizationTime=1 ms). 2025-12-28 01:32:32,769 INFO org.apache.flink.runtime.source.coordinator.SourceCoordinator [] - Marking checkpoint 23 as completed for source Source: pg_osb_tickets[1]. ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
