luzongzhu opened a new issue, #5441: URL: https://github.com/apache/seatunnel/issues/5441
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened source:oracle sink:paimon sink paimon java.lang.OutOfMemoryError: Java heap space ### SeaTunnel Version 2.3.3 ### SeaTunnel Config ```conf env { execution.parallelism = 2 job.mode = "BATCH" } source { Jdbc { url = "jdbc:oracle:thin:@******:1521/WFLDBDEV" driver = "oracle.jdbc.OracleDriver" user = "biods" password = "******" query = "SELECT * FROM BIODS.EKKN" } } sink { Paimon { warehouse = "hdfs://******:9820/paimon" database = "biods" table = "ekkn" } } ``` ### Running Command ```shell ./seatunnel.sh --config ../config/v2.batch.config.template -e local ``` ### Error Exception ```log 2023-09-07 11:13:03,608 INFO org.apache.seatunnel.core.starter.utils.ConfigShadeUtils - Load config shade spi: [base64] 2023-09-07 11:13:03,650 INFO org.apache.seatunnel.core.starter.utils.ConfigBuilder - Parsed config file: { "env" : { "execution.parallelism" : 1, "job.mode" : "BATCH" }, "source" : [ { "password" : "biods2020", "driver" : "oracle.jdbc.OracleDriver", "query" : "SELECT * FROM BIODS.EKKN", "plugin_name" : "Jdbc", "user" : "biods", "url" : "jdbc:oracle:thin:@10.102.2.32:1521/WFLDBDEV" } ], "sink" : [ { "database" : "biods", "warehouse" : "hdfs://10.109.1.83:9820/paimon", "plugin_name" : "Paimon", "table" : "ekkn" } ] } 2023-09-07 11:13:03,672 INFO org.apache.seatunnel.api.configuration.ReadonlyConfig - Config uses fallback configuration key 'plugin_name' instead of key 'factory' 2023-09-07 11:13:03,672 INFO org.apache.seatunnel.api.configuration.ReadonlyConfig - Config uses fallback configuration key 'plugin_name' instead of key 'factory' 2023-09-07 11:13:03,676 INFO org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Load SeaTunnelSink Plugin from /opt/apache-seatunnel-2.3.3/connectors/seatunnel 2023-09-07 11:13:03,680 INFO org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Discovery plugin jar: Jdbc at: file:/opt/apache-seatunnel-2.3.3/connectors/seatunnel/connector-jdbc-2.3.3.jar 2023-09-07 11:13:03,681 INFO org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Discovery plugin jar: Paimon at: file:/opt/apache-seatunnel-2.3.3/connectors/seatunnel/connector-paimon-2.3.3.jar 2023-09-07 11:13:03,684 INFO org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser - start generating all sources. 2023-09-07 11:13:03,685 INFO org.apache.seatunnel.api.configuration.ReadonlyConfig - Config uses fallback configuration key 'plugin_name' instead of key 'factory' 2023-09-07 11:13:03,703 INFO org.apache.seatunnel.api.configuration.ReadonlyConfig - Config uses fallback configuration key 'plugin_name' instead of key 'factory' 2023-09-07 11:13:03,705 INFO org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Load SeaTunnelSource Plugin from /opt/apache-seatunnel-2.3.3/connectors/seatunnel 2023-09-07 11:13:03,712 INFO org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Discovery plugin jar: Jdbc at: file:/opt/apache-seatunnel-2.3.3/connectors/seatunnel/connector-jdbc-2.3.3.jar 2023-09-07 11:13:03,717 INFO org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Load plugin: PluginIdentifier{engineType='seatunnel', pluginType='source', pluginName='Jdbc'} from classpath 2023-09-07 11:13:04,132 INFO org.apache.seatunnel.engine.server.CoordinatorService - [localhost]:5801 [seatunnel-748082] [5.1] This node become a new active master node, begin init coordinator service 2023-09-07 11:13:04,170 INFO com.hazelcast.internal.partition.impl.PartitionStateManager - [localhost]:5801 [seatunnel-748082] [5.1] Initializing cluster partition table arrangement... 2023-09-07 11:13:04,474 INFO org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSource - The partition_column parameter is not configured, and the source parallelism is set to 1 2023-09-07 11:13:04,509 INFO org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser - start generating all transforms. 2023-09-07 11:13:04,509 INFO org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser - start generating all sinks. 2023-09-07 11:13:04,510 INFO org.apache.seatunnel.api.configuration.ReadonlyConfig - Config uses fallback configuration key 'plugin_name' instead of key 'factory' 2023-09-07 11:13:04,514 INFO org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Load SeaTunnelSink Plugin from /opt/apache-seatunnel-2.3.3/connectors/seatunnel 2023-09-07 11:13:04,515 INFO org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Discovery plugin jar: Paimon at: file:/opt/apache-seatunnel-2.3.3/connectors/seatunnel/connector-paimon-2.3.3.jar 2023-09-07 11:13:04,517 INFO org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Load plugin: PluginIdentifier{engineType='seatunnel', pluginType='sink', pluginName='Paimon'} from classpath 2023-09-07 11:13:04,669 WARN org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-07 11:13:05,608 INFO org.apache.seatunnel.engine.client.job.ClientJobProxy - Start submit job, job id: 752003406054293505, with plugin jar [file:/opt/apache-seatunnel-2.3.3/connectors/seatunnel/connector-paimon-2.3.3.jar, file:/opt/apache-seatunnel-2.3.3/connectors/seatunnel/connector-jdbc-2.3.3.jar] 2023-09-07 11:13:05,619 INFO org.apache.seatunnel.engine.server.resourcemanager.AbstractResourceManager - Init ResourceManager 2023-09-07 11:13:05,619 INFO org.apache.seatunnel.engine.server.resourcemanager.AbstractResourceManager - initWorker... 2023-09-07 11:13:05,619 INFO org.apache.seatunnel.engine.server.resourcemanager.AbstractResourceManager - initWorker live nodes: [[localhost]:5801] 2023-09-07 11:13:05,620 INFO org.apache.seatunnel.engine.server.resourcemanager.AbstractResourceManager - registerWorker: {[localhost]:5801=WorkerProfile(address=[localhost]:5801, profile=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=1029177344}}, unassignedResource=ResourceProfile{cpu=CPU{core=0}, heapMemory=Memory{bytes=1029177344}}, assignedSlots=[], unassignedSlots=[])} 2023-09-07 11:13:05,640 INFO org.apache.seatunnel.engine.server.master.JobMaster - Init JobMaster for Job SeaTunnel_Job (752003406054293505) 2023-09-07 11:13:05,640 INFO org.apache.seatunnel.engine.server.master.JobMaster - Job SeaTunnel_Job (752003406054293505) needed jar urls [file:/opt/apache-seatunnel-2.3.3/connectors/seatunnel/connector-paimon-2.3.3.jar, file:/opt/apache-seatunnel-2.3.3/connectors/seatunnel/connector-jdbc-2.3.3.jar] 2023-09-07 11:13:05,819 INFO org.apache.seatunnel.engine.checkpoint.storage.hdfs.HdfsStorage - Path /tmp/seatunnel/checkpoint_snapshot/752003406054293505 is not a directory 2023-09-07 11:13:05,819 INFO org.apache.seatunnel.engine.checkpoint.storage.hdfs.HdfsStorage - No checkpoint found for job, job id is: 752003406054293505 2023-09-07 11:13:05,822 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - The task Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] is in state CREATED when init state future 2023-09-07 11:13:05,823 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - The task Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] is in state CREATED when init state future 2023-09-07 11:13:05,824 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - The task Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Sink[0]-Paimon-default-identifier]-AggregatedCommitterTask (1/1)] is in state CREATED when init state future 2023-09-07 11:13:05,826 INFO org.apache.seatunnel.engine.client.job.ClientJobProxy - Submit job finished, job id: 752003406054293505, job name: SeaTunnel 2023-09-07 11:13:05,828 INFO org.apache.seatunnel.engine.server.master.JobMaster - Job Job SeaTunnel_Job (752003406054293505) waiting for scheduler finished 2023-09-07 11:13:05,831 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalPlan - Job SeaTunnel_Job (752003406054293505) turn from state CREATED to SCHEDULED. 2023-09-07 11:13:05,835 INFO org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)] turn from state CREATED to SCHEDULED. 2023-09-07 11:13:05,839 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] state from CREATED to SCHEDULED 2023-09-07 11:13:05,842 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] turn from state CREATED to SCHEDULED. 2023-09-07 11:13:05,848 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Sink[0]-Paimon-default-identifier]-AggregatedCommitterTask (1/1)] state from CREATED to SCHEDULED 2023-09-07 11:13:05,849 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Sink[0]-Paimon-default-identifier]-AggregatedCommitterTask (1/1)] turn from state CREATED to SCHEDULED. 2023-09-07 11:13:05,850 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] state from CREATED to SCHEDULED 2023-09-07 11:13:05,851 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] turn from state CREATED to SCHEDULED. 2023-09-07 11:13:05,859 WARN org.apache.seatunnel.engine.client.job.JobMetricsRunner - Failed to get job metrics summary, it maybe first-run 2023-09-07 11:13:05,859 INFO org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)] turn from state SCHEDULED to DEPLOYING. 2023-09-07 11:13:05,862 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] state from SCHEDULED to DEPLOYING 2023-09-07 11:13:05,863 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] turn from state SCHEDULED to DEPLOYING. 2023-09-07 11:13:05,865 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Sink[0]-Paimon-default-identifier]-AggregatedCommitterTask (1/1)] state from SCHEDULED to DEPLOYING 2023-09-07 11:13:05,867 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Sink[0]-Paimon-default-identifier]-AggregatedCommitterTask (1/1)] turn from state SCHEDULED to DEPLOYING. 2023-09-07 11:13:05,868 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] state from SCHEDULED to DEPLOYING 2023-09-07 11:13:05,869 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] turn from state SCHEDULED to DEPLOYING. 2023-09-07 11:13:05,883 INFO org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] received deploying task executionId [752003415764107265] 2023-09-07 11:13:05,894 INFO org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] received deploying task executionId [752003415764172801] 2023-09-07 11:13:05,904 INFO org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] deploying task TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=1}, executionId [752003415764107265] 2023-09-07 11:13:05,904 INFO org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] deploying TaskGroup TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=1} init success 2023-09-07 11:13:05,905 INFO org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] received deploying task executionId [752003415764238337] 2023-09-07 11:13:05,909 INFO org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] deploying TaskGroup TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=1} success 2023-09-07 11:13:05,910 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] state from DEPLOYING to RUNNING 2023-09-07 11:13:05,910 INFO org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask - starting seatunnel source split enumerator task, source name: pipeline-1 [Source[0]-Jdbc-default-identifier] 2023-09-07 11:13:05,912 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SplitEnumerator (1/1)] turn from state DEPLOYING to RUNNING. 2023-09-07 11:13:05,931 INFO org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] deploying task TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=3}, executionId [752003415764172801] 2023-09-07 11:13:05,932 INFO org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] deploying TaskGroup TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=3} init success 2023-09-07 11:13:05,932 INFO org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] deploying TaskGroup TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=3} success 2023-09-07 11:13:05,934 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Sink[0]-Paimon-default-identifier]-AggregatedCommitterTask (1/1)] state from DEPLOYING to RUNNING 2023-09-07 11:13:05,935 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Sink[0]-Paimon-default-identifier]-AggregatedCommitterTask (1/1)] turn from state DEPLOYING to RUNNING. 2023-09-07 11:13:05,955 INFO org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] deploying task TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=50000}, executionId [752003415764238337] 2023-09-07 11:13:05,956 INFO org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] deploying TaskGroup TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=50000} init success 2023-09-07 11:13:05,957 INFO org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] deploying TaskGroup TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=50000} success 2023-09-07 11:13:05,957 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Try to update the task Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] state from DEPLOYING to RUNNING 2023-09-07 11:13:05,960 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] turn from state DEPLOYING to RUNNING. 2023-09-07 11:13:05,960 INFO org.apache.seatunnel.engine.server.dag.physical.SubPlan - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)] turn from state DEPLOYING to RUNNING. 2023-09-07 11:13:05,961 INFO org.apache.seatunnel.engine.server.task.TransformSeaTunnelTask - starting seatunnel transform task, index 0 2023-09-07 11:13:05,961 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalPlan - Job SeaTunnel_Job (752003406054293505) turn from state SCHEDULED to RUNNING. 2023-09-07 11:13:05,962 INFO org.apache.seatunnel.engine.server.master.JobMaster - Job SeaTunnel_Job (752003406054293505) scheduler finished 2023-09-07 11:13:05,969 INFO org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask - starting seatunnel source task, index 0 2023-09-07 11:13:06,332 INFO org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask - received reader register, readerID: TaskLocation{taskGroupLocation=TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=50000}, taskID=60000, index=0} 2023-09-07 11:13:07,017 INFO org.apache.seatunnel.engine.server.task.SourceSplitEnumeratorTask - received enough reader, starting enumerator... 2023-09-07 11:13:07,019 INFO org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator - Starting to calculate splits. 2023-09-07 11:13:07,020 INFO org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator - Assigning JdbcSourceSplit(parameterValues=null, splitId=0) to 0 reader. 2023-09-07 11:13:07,021 INFO org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceSplitEnumerator - Assign splits [JdbcSourceSplit(parameterValues=null, splitId=0)] to reader 0 java.lang.OutOfMemoryError: Java heap space Dumping heap to java_pid57818.hprof ... Heap dump file created [72102428 bytes in 0.305 secs] 2023-09-07 11:13:08,678 WARN org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] Exception in org.apache.seatunnel.engine.server.task.TransformSeaTunnelTask@1a7e3661 java.lang.OutOfMemoryError: Java heap space at java.util.Arrays.copyOf(Arrays.java:3236) ~[?:1.8.0_221] at org.apache.paimon.data.AbstractBinaryWriter.grow(AbstractBinaryWriter.java:262) ~[connector-paimon-2.3.3.jar:2.3.3] at org.apache.paimon.data.AbstractBinaryWriter.ensureCapacity(AbstractBinaryWriter.java:194) ~[connector-paimon-2.3.3.jar:2.3.3] at org.apache.paimon.data.AbstractBinaryWriter.writeSegmentsToVarLenPart(AbstractBinaryWriter.java:203) ~[connector-paimon-2.3.3.jar:2.3.3] at org.apache.paimon.data.AbstractBinaryWriter.writeString(AbstractBinaryWriter.java:71) ~[connector-paimon-2.3.3.jar:2.3.3] at org.apache.paimon.data.BinaryRowWriter.writeString(BinaryRowWriter.java:25) ~[connector-paimon-2.3.3.jar:2.3.3] at org.apache.paimon.data.BinaryWriter.write(BinaryWriter.java:121) ~[connector-paimon-2.3.3.jar:2.3.3] at org.apache.paimon.data.serializer.InternalRowSerializer.toBinaryRow(InternalRowSerializer.java:155) ~[connector-paimon-2.3.3.jar:2.3.3] at org.apache.paimon.data.serializer.InternalRowSerializer.serializeToPages(InternalRowSerializer.java:170) ~[connector-paimon-2.3.3.jar:2.3.3] at org.apache.paimon.data.serializer.InternalRowSerializer.serializeToPages(InternalRowSerializer.java:39) ~[connector-paimon-2.3.3.jar:2.3.3] at org.apache.paimon.sort.BinaryInMemorySortBuffer.write(BinaryInMemorySortBuffer.java:176) ~[connector-paimon-2.3.3.jar:2.3.3] at org.apache.paimon.mergetree.SortBufferWriteBuffer.put(SortBufferWriteBuffer.java:106) ~[connector-paimon-2.3.3.jar:2.3.3] at org.apache.paimon.mergetree.MergeTreeWriter.write(MergeTreeWriter.java:146) ~[connector-paimon-2.3.3.jar:2.3.3] at org.apache.paimon.mergetree.MergeTreeWriter.write(MergeTreeWriter.java:53) ~[connector-paimon-2.3.3.jar:2.3.3] at org.apache.paimon.operation.AbstractFileStoreWrite.write(AbstractFileStoreWrite.java:93) ~[connector-paimon-2.3.3.jar:2.3.3] at org.apache.paimon.table.sink.TableWriteImpl.writeAndReturn(TableWriteImpl.java:94) ~[connector-paimon-2.3.3.jar:2.3.3] at org.apache.paimon.table.sink.TableWriteImpl.write(TableWriteImpl.java:83) ~[connector-paimon-2.3.3.jar:2.3.3] at org.apache.seatunnel.connectors.seatunnel.paimon.sink.PaimonSinkWriter.write(PaimonSinkWriter.java:109) ~[connector-paimon-2.3.3.jar:2.3.3] at org.apache.seatunnel.connectors.seatunnel.paimon.sink.PaimonSinkWriter.write(PaimonSinkWriter.java:49) ~[connector-paimon-2.3.3.jar:2.3.3] at org.apache.seatunnel.engine.server.task.flow.SinkFlowLifeCycle.received(SinkFlowLifeCycle.java:227) ~[seatunnel-starter.jar:2.3.3] at org.apache.seatunnel.engine.server.task.flow.SinkFlowLifeCycle.received(SinkFlowLifeCycle.java:61) ~[seatunnel-starter.jar:2.3.3] at org.apache.seatunnel.engine.server.task.SeaTunnelTransformCollector.collect(SeaTunnelTransformCollector.java:39) ~[seatunnel-starter.jar:2.3.3] at org.apache.seatunnel.engine.server.task.SeaTunnelTransformCollector.collect(SeaTunnelTransformCollector.java:27) ~[seatunnel-starter.jar:2.3.3] at org.apache.seatunnel.engine.server.task.group.queue.IntermediateBlockingQueue$$Lambda$2035/1935579074.accept(Unknown Source) ~[?:?] at org.apache.seatunnel.engine.server.task.group.queue.IntermediateBlockingQueue.handleRecord(IntermediateBlockingQueue.java:76) ~[seatunnel-starter.jar:2.3.3] at org.apache.seatunnel.engine.server.task.group.queue.IntermediateBlockingQueue.collect(IntermediateBlockingQueue.java:51) ~[seatunnel-starter.jar:2.3.3] at org.apache.seatunnel.engine.server.task.flow.IntermediateQueueFlowLifeCycle.collect(IntermediateQueueFlowLifeCycle.java:52) ~[seatunnel-starter.jar:2.3.3] at org.apache.seatunnel.engine.server.task.TransformSeaTunnelTask.collect(TransformSeaTunnelTask.java:73) ~[seatunnel-starter.jar:2.3.3] at org.apache.seatunnel.engine.server.task.SeaTunnelTask.stateProcess(SeaTunnelTask.java:168) ~[seatunnel-starter.jar:2.3.3] at org.apache.seatunnel.engine.server.task.TransformSeaTunnelTask.call(TransformSeaTunnelTask.java:78) ~[seatunnel-starter.jar:2.3.3] at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:613) ~[seatunnel-starter.jar:2.3.3] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_221] 2023-09-07 11:13:08,694 INFO org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] taskDone, taskId = 70000, taskGroup = TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=50000} 2023-09-07 11:13:08,695 WARN org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] Exception in org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask@292ee6d0 java.lang.RuntimeException: java.lang.InterruptedException at org.apache.seatunnel.engine.server.task.group.queue.IntermediateBlockingQueue.received(IntermediateBlockingQueue.java:41) ~[seatunnel-starter.jar:2.3.3] at org.apache.seatunnel.engine.server.task.flow.IntermediateQueueFlowLifeCycle.received(IntermediateQueueFlowLifeCycle.java:46) ~[seatunnel-starter.jar:2.3.3] at org.apache.seatunnel.engine.server.task.flow.IntermediateQueueFlowLifeCycle.received(IntermediateQueueFlowLifeCycle.java:28) ~[seatunnel-starter.jar:2.3.3] at org.apache.seatunnel.engine.server.task.SeaTunnelSourceCollector.sendRecordToNext(SeaTunnelSourceCollector.java:139) ~[seatunnel-starter.jar:2.3.3] at org.apache.seatunnel.engine.server.task.SeaTunnelSourceCollector.collect(SeaTunnelSourceCollector.java:67) ~[seatunnel-starter.jar:2.3.3] at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSourceReader.pollNext(JdbcSourceReader.java:64) ~[connector-jdbc-2.3.3.jar:2.3.3] at org.apache.seatunnel.engine.server.task.flow.SourceFlowLifeCycle.collect(SourceFlowLifeCycle.java:150) ~[seatunnel-starter.jar:2.3.3] at org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask.collect(SourceSeaTunnelTask.java:95) ~[seatunnel-starter.jar:2.3.3] at org.apache.seatunnel.engine.server.task.SeaTunnelTask.stateProcess(SeaTunnelTask.java:168) ~[seatunnel-starter.jar:2.3.3] at org.apache.seatunnel.engine.server.task.SourceSeaTunnelTask.call(SourceSeaTunnelTask.java:100) ~[seatunnel-starter.jar:2.3.3] at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:613) [seatunnel-starter.jar:2.3.3] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_221] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_221] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_221] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_221] at java.lang.Thread.run(Thread.java:748) [?:1.8.0_221] Caused by: java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) ~[?:1.8.0_221] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2048) ~[?:1.8.0_221] at java.util.concurrent.ArrayBlockingQueue.put(ArrayBlockingQueue.java:353) ~[?:1.8.0_221] at org.apache.seatunnel.engine.server.task.group.queue.IntermediateBlockingQueue.handleRecord(IntermediateBlockingQueue.java:76) ~[seatunnel-starter.jar:2.3.3] at org.apache.seatunnel.engine.server.task.group.queue.IntermediateBlockingQueue.received(IntermediateBlockingQueue.java:39) ~[seatunnel-starter.jar:2.3.3] ... 15 more 2023-09-07 11:13:08,696 INFO org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] taskDone, taskId = 60000, taskGroup = TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=50000} 2023-09-07 11:13:08,696 INFO org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel-748082] [5.1] Task TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=50000} complete with state FAILED 2023-09-07 11:13:08,696 INFO org.apache.seatunnel.engine.server.CoordinatorService - [localhost]:5801 [seatunnel-748082] [5.1] Received task end from execution TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=50000}, state FAILED 2023-09-07 11:13:08,700 INFO org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] turn to end state FAILED. 2023-09-07 11:13:08,700 ERROR org.apache.seatunnel.engine.server.dag.physical.PhysicalVertex - Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], task: [pipeline-1 [Source[0]-Jdbc-default-identifier]-SourceTask (1/1)] end with state FAILED and Exception: java.lang.OutOfMemoryError: Java heap space at java.util.Arrays.copyOf(Arrays.java:3236) at org.apache.paimon.data.AbstractBinaryWriter.grow(AbstractBinaryWriter.java:262) at org.apache.paimon.data.AbstractBinaryWriter.ensureCapacity(AbstractBinaryWriter.java:194) at org.apache.paimon.data.AbstractBinaryWriter.writeSegmentsToVarLenPart(AbstractBinaryWriter.java:203) at org.apache.paimon.data.AbstractBinaryWriter.writeString(AbstractBinaryWriter.java:71) at org.apache.paimon.data.BinaryRowWriter.writeString(BinaryRowWriter.java:25) at org.apache.paimon.data.BinaryWriter.write(BinaryWriter.java:121) at org.apache.paimon.data.serializer.InternalRowSerializer.toBinaryRow(InternalRowSerializer.java:155) at org.apache.paimon.data.serializer.InternalRowSerializer.serializeToPages(InternalRowSerializer.java:170) at org.apache.paimon.data.serializer.InternalRowSerializer.serializeToPages(InternalRowSerializer.java:39) at org.apache.paimon.sort.BinaryInMemorySortBuffer.write(BinaryInMemorySortBuffer.java:176) at org.apache.paimon.mergetree.SortBufferWriteBuffer.put(SortBufferWriteBuffer.java:106) at org.apache.paimon.mergetree.MergeTreeWriter.write(MergeTreeWriter.java:146) at org.apache.paimon.mergetree.MergeTreeWriter.write(MergeTreeWriter.java:53) at org.apache.paimon.operation.AbstractFileStoreWrite.write(AbstractFileStoreWrite.java:93) at org.apache.paimon.table.sink.TableWriteImpl.writeAndReturn(TableWriteImpl.java:94) at org.apache.paimon.table.sink.TableWriteImpl.write(TableWriteImpl.java:83) at org.apache.seatunnel.connectors.seatunnel.paimon.sink.PaimonSinkWriter.write(PaimonSinkWriter.java:109) at org.apache.seatunnel.connectors.seatunnel.paimon.sink.PaimonSinkWriter.write(PaimonSinkWriter.java:49) at org.apache.seatunnel.engine.server.task.flow.SinkFlowLifeCycle.received(SinkFlowLifeCycle.java:227) at org.apache.seatunnel.engine.server.task.flow.SinkFlowLifeCycle.received(SinkFlowLifeCycle.java:61) at org.apache.seatunnel.engine.server.task.SeaTunnelTransformCollector.collect(SeaTunnelTransformCollector.java:39) at org.apache.seatunnel.engine.server.task.SeaTunnelTransformCollector.collect(SeaTunnelTransformCollector.java:27) at org.apache.seatunnel.engine.server.task.group.queue.IntermediateBlockingQueue$$Lambda$2035/1935579074.accept(Unknown Source) at org.apache.seatunnel.engine.server.task.group.queue.IntermediateBlockingQueue.handleRecord(IntermediateBlockingQueue.java:76) at org.apache.seatunnel.engine.server.task.group.queue.IntermediateBlockingQueue.collect(IntermediateBlockingQueue.java:51) at org.apache.seatunnel.engine.server.task.flow.IntermediateQueueFlowLifeCycle.collect(IntermediateQueueFlowLifeCycle.java:52) at org.apache.seatunnel.engine.server.task.TransformSeaTunnelTask.collect(TransformSeaTunnelTask.java:73) at org.apache.seatunnel.engine.server.task.SeaTunnelTask.stateProcess(SeaTunnelTask.java:168) at org.apache.seatunnel.engine.server.task.TransformSeaTunnelTask.call(TransformSeaTunnelTask.java:78) at org.apache.seatunnel.engine.server.TaskExecutionService$BlockingWorker.run(TaskExecutionService.java:613) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 2023-09-07 11:13:08,700 ERROR org.apache.seatunnel.engine.server.dag.physical.SubPlan - Task TaskGroupLocation{jobId=752003406054293505, pipelineId=1, taskGroupId=50000} Failed in Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)], Begin to cancel other tasks in this pipeline. 2023-09-07 11:13:08,700 WARN org.apache.seatunnel.engine.server.dag.physical.SubPlan - start cancel job Job SeaTunnel_Job (752003406054293505), Pipeline: [(1/1)] count = 0 ``` ### Zeta or Flink or Spark Version flink 1.17 ### Java or Scala Version javaversion:1.8 ### Screenshots _No response_ ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
