xiehanghang opened a new issue, #4129: URL: https://github.com/apache/incubator-seatunnel/issues/4129
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened I'm fetching data from S3 with Seatunnel local engine, but I'm facing the following issue, The log is repeatedly reported ↓ ``` 2023-02-15 09:22:23,813 INFO org.apache.seatunnel.engine.server.CoordinatorService - [localhost]:5801 [seatunnel_default_cluster-171793] [5.1] *********************************************** CoordinatorService Thread Pool Status *********************************************** activeCount : 0 corePoolSize : 0 maximumPoolSize : 2147483647 poolSize : 0 completedTaskCount : 0 taskCount : 0 *********************************************** ``` ### SeaTunnel Version 2.3.0 ### SeaTunnel Config ```conf env { execution.parallelism = 1 job.mode = "STREAMING" } source { S3File { path = "/Database/dfs/news_daily_202302021200" type = "parquet" access_key = "xxxx" secret_key = "xxxx" bucket = "s3a://com.xxx.data.prd" } } transform { } sink { Console{} } ``` ### Running Command ```shell ./bin/seatunnel.sh --config ./config/seatunnel.streaming.conf.template -e local ``` ### Error Exception ```log JAVA_OPTS: -Dhazelcast.client.config=/Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/config/hazelcast-client.yaml -Dseatunnel.config=/Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/config/seatunnel.yaml -Dhazelcast.config=/Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/config/hazelcast.yaml -Dlog4j2.configurationFile=/Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/config/log4j2_client.properties -Dseatunnel.logs.path=/Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/logs -Dseatunnel.logs.file_name=seatunnel-starter-client-1676424120000 二月 15, 2023 9:22:02 上午 com.hazelcast.internal.config.AbstractConfigLocator 信息: Loading configuration '/Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/config/seatunnel.yaml' from System property 'seatunnel.config' 二月 15, 2023 9:22:02 上午 com.hazelcast.internal.config.AbstractConfigLocator 信息: Using configuration file at /Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/config/seatunnel.yaml 二月 15, 2023 9:22:02 上午 org.apache.seatunnel.engine.common.config.SeaTunnelConfig 信息: seatunnel.home is /Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0 二月 15, 2023 9:22:02 上午 com.hazelcast.internal.config.AbstractConfigLocator 信息: Loading configuration '/Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/config/hazelcast.yaml' from System property 'hazelcast.config' 二月 15, 2023 9:22:02 上午 com.hazelcast.internal.config.AbstractConfigLocator 信息: Using configuration file at /Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/config/hazelcast.yaml 二月 15, 2023 9:22:02 上午 com.hazelcast.internal.config.AbstractConfigLocator 信息: Loading configuration '/Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/config/seatunnel.yaml' from System property 'seatunnel.config' 二月 15, 2023 9:22:02 上午 com.hazelcast.internal.config.AbstractConfigLocator 信息: Using configuration file at /Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/config/seatunnel.yaml 二月 15, 2023 9:22:02 上午 com.hazelcast.internal.config.AbstractConfigLocator 信息: Loading configuration '/Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/config/hazelcast.yaml' from System property 'hazelcast.config' 二月 15, 2023 9:22:02 上午 com.hazelcast.internal.config.AbstractConfigLocator 信息: Using configuration file at /Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/config/hazelcast.yaml 2023-02-15 09:22:02,989 WARN com.hazelcast.instance.AddressPicker - [LOCAL] [seatunnel_default_cluster-171793] [5.1] You configured your member address as host name. Please be aware of that your dns can be spoofed. Make sure that your dns configurations are correct. 2023-02-15 09:22:02,994 INFO com.hazelcast.instance.AddressPicker - [LOCAL] [seatunnel_default_cluster-171793] [5.1] Resolving domain name 'localhost' to address(es): [127.0.0.1, 0:0:0:0:0:0:0:1] 2023-02-15 09:22:02,994 INFO com.hazelcast.instance.AddressPicker - [LOCAL] [seatunnel_default_cluster-171793] [5.1] Interfaces is disabled, trying to pick one address from TCP-IP config addresses: [localhost/127.0.0.1, localhost/0:0:0:0:0:0:0:1] 2023-02-15 09:22:03,023 INFO org.apache.seatunnel.engine.server.SeaTunnelServer - SeaTunnel server start... 2023-02-15 09:22:03,024 INFO com.hazelcast.system - [localhost]:5801 [seatunnel_default_cluster-171793] [5.1] Based on Hazelcast IMDG version: 5.1.0 (20220228 - 21f20e7) 2023-02-15 09:22:03,024 INFO com.hazelcast.system - [localhost]:5801 [seatunnel_default_cluster-171793] [5.1] Cluster name: seatunnel_default_cluster-171793 2023-02-15 09:22:03,024 INFO com.hazelcast.system - [localhost]:5801 [seatunnel_default_cluster-171793] [5.1] _____ _____ _ / ___| |_ _| | | \ `--. ___ __ _ | | _ _ _ __ _ __ ___ | | `--. \ / _ \ / _` | | | | | | || '_ \ | '_ \ / _ \| | /\__/ /| __/| (_| | | | | |_| || | | || | | || __/| | \____/ \___| \__,_| \_/ \__,_||_| |_||_| |_| \___||_| 2023-02-15 09:22:03,024 INFO com.hazelcast.system - [localhost]:5801 [seatunnel_default_cluster-171793] [5.1] Copyright © 2021-2022 The Apache Software Foundation. Apache SeaTunnel, SeaTunnel, and its feather logo are trademarks of The Apache Software Foundation. 2023-02-15 09:22:03,024 INFO com.hazelcast.system - [localhost]:5801 [seatunnel_default_cluster-171793] [5.1] Integrity Checker is disabled. Fail-fast on corrupted executables will not be performed. To enable integrity checker do one of the following: - Change member config using Java API: config.setIntegrityCheckerEnabled(true); - Change XML/YAML configuration property: Set hazelcast.integrity-checker.enabled to true - Add system property: -Dhz.integritychecker.enabled=true (for Hazelcast embedded, works only when loading config via Config.load) - Add environment variable: HZ_INTEGRITYCHECKER_ENABLED=true (recommended when running container image. For Hazelcast embedded, works only when loading config via Config.load) 2023-02-15 09:22:03,027 INFO com.hazelcast.system - [localhost]:5801 [seatunnel_default_cluster-171793] [5.1] The Jet engine is disabled. To enable the Jet engine on the members, do one of the following: - Change member config using Java API: config.getJetConfig().setEnabled(true) - Change XML/YAML configuration property: Set hazelcast.jet.enabled to true - Add system property: -Dhz.jet.enabled=true (for Hazelcast embedded, works only when loading config via Config.load) - Add environment variable: HZ_JET_ENABLED=true (recommended when running container image. For Hazelcast embedded, works only when loading config via Config.load) 2023-02-15 09:22:03,583 INFO com.hazelcast.system.security - [localhost]:5801 [seatunnel_default_cluster-171793] [5.1] Enable DEBUG/FINE log level for log category com.hazelcast.system.security or use -Dhazelcast.security.recommendations system property to see 🔒 security recommendations and the status of current config. 2023-02-15 09:22:03,639 INFO com.hazelcast.instance.impl.Node - [localhost]:5801 [seatunnel_default_cluster-171793] [5.1] Using TCP/IP discovery 2023-02-15 09:22:03,639 WARN com.hazelcast.cp.CPSubsystem - [localhost]:5801 [seatunnel_default_cluster-171793] [5.1] CP Subsystem is not enabled. CP data structures will operate in UNSAFE mode! Please note that UNSAFE mode will not provide strong consistency guarantees. 2023-02-15 09:22:03,802 INFO org.apache.seatunnel.engine.server.TaskExecutionService - [localhost]:5801 [seatunnel_default_cluster-171793] [5.1] Created new BusWork : 1315908533 2023-02-15 09:22:03,806 WARN org.apache.seatunnel.engine.server.service.slot.DefaultSlotService - failed send heartbeat to resource manager, will retry later. this address: [localhost]:5801 2023-02-15 09:22:03,807 INFO org.apache.seatunnel.engine.server.CoordinatorService - [localhost]:5801 [seatunnel_default_cluster-171793] [5.1] *********************************************** CoordinatorService Thread Pool Status *********************************************** activeCount : 0 corePoolSize : 0 maximumPoolSize : 2147483647 poolSize : 0 completedTaskCount : 0 taskCount : 0 *********************************************** 2023-02-15 09:22:03,814 WARN org.apache.seatunnel.common.utils.RetryUtils - Failed to execute due to null. Retrying attempt (1/20) after backoff of 1000 ms 2023-02-15 09:22:03,855 INFO com.hazelcast.internal.diagnostics.Diagnostics - [localhost]:5801 [seatunnel_default_cluster-171793] [5.1] Diagnostics disabled. To enable add -Dhazelcast.diagnostics.enabled=true to the JVM arguments. 2023-02-15 09:22:03,869 INFO com.hazelcast.core.LifecycleService - [localhost]:5801 [seatunnel_default_cluster-171793] [5.1] [localhost]:5801 is STARTING 2023-02-15 09:22:03,911 INFO com.hazelcast.internal.cluster.ClusterService - [localhost]:5801 [seatunnel_default_cluster-171793] [5.1] Members {size:1, ver:1} [ Member [localhost]:5801 - db486095-d8c6-4073-9a10-d5339a429d4f this ] 2023-02-15 09:22:03,921 INFO com.hazelcast.core.LifecycleService - [localhost]:5801 [seatunnel_default_cluster-171793] [5.1] [localhost]:5801 is STARTED 二月 15, 2023 9:22:03 上午 com.hazelcast.internal.config.AbstractConfigLocator 信息: Loading configuration '/Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/config/hazelcast-client.yaml' from System property 'hazelcast.client.config' 二月 15, 2023 9:22:03 上午 com.hazelcast.internal.config.AbstractConfigLocator 信息: Using configuration file at /Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/config/hazelcast-client.yaml 2023-02-15 09:22:03,997 INFO com.hazelcast.client.impl.spi.ClientInvocationService - hz.client_1 [seatunnel_default_cluster-171793] [5.1] Running with 2 response threads, dynamic=true 2023-02-15 09:22:04,017 INFO com.hazelcast.core.LifecycleService - hz.client_1 [seatunnel_default_cluster-171793] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is STARTING 2023-02-15 09:22:04,017 INFO com.hazelcast.core.LifecycleService - hz.client_1 [seatunnel_default_cluster-171793] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is STARTED 2023-02-15 09:22:04,026 INFO com.hazelcast.client.impl.connection.ClientConnectionManager - hz.client_1 [seatunnel_default_cluster-171793] [5.1] Trying to connect to cluster: seatunnel_default_cluster-171793 2023-02-15 09:22:04,028 INFO com.hazelcast.client.impl.connection.ClientConnectionManager - hz.client_1 [seatunnel_default_cluster-171793] [5.1] Trying to connect to [localhost]:5801 2023-02-15 09:22:04,052 INFO com.hazelcast.client.impl.protocol.task.AuthenticationMessageTask - [localhost]:5801 [seatunnel_default_cluster-171793] [5.1] Received auth from Connection[id=1, /127.0.0.1:5801->/127.0.0.1:54634, qualifier=null, endpoint=[127.0.0.1]:54634, remoteUuid=df25825c-3c65-49a9-9c36-921735b759bd, alive=true, connectionType=JVM, planeIndex=-1], successfully authenticated, clientUuid: df25825c-3c65-49a9-9c36-921735b759bd, client name: hz.client_1, client version: 5.1 2023-02-15 09:22:04,057 INFO com.hazelcast.core.LifecycleService - hz.client_1 [seatunnel_default_cluster-171793] [5.1] HazelcastClient 5.1 (20220228 - 21f20e7) is CLIENT_CONNECTED 2023-02-15 09:22:04,057 INFO com.hazelcast.client.impl.connection.ClientConnectionManager - hz.client_1 [seatunnel_default_cluster-171793] [5.1] Authenticated with server [localhost]:5801:db486095-d8c6-4073-9a10-d5339a429d4f, server version: 5.1, local address: /127.0.0.1:54634 2023-02-15 09:22:04,058 INFO com.hazelcast.internal.diagnostics.Diagnostics - hz.client_1 [seatunnel_default_cluster-171793] [5.1] Diagnostics disabled. To enable add -Dhazelcast.diagnostics.enabled=true to the JVM arguments. 2023-02-15 09:22:04,065 INFO com.hazelcast.client.impl.spi.ClientClusterService - hz.client_1 [seatunnel_default_cluster-171793] [5.1] Members [1] { Member [localhost]:5801 - db486095-d8c6-4073-9a10-d5339a429d4f } 2023-02-15 09:22:04,080 INFO com.hazelcast.client.impl.statistics.ClientStatisticsService - Client statistics is enabled with period 5 seconds. 2023-02-15 09:22:04,213 INFO org.apache.seatunnel.engine.client.job.JobExecutionEnvironment - add common jar in plugins :[file:/Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/plugins/aws-java-sdk-s3-1.11.1000.jar, file:/Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/plugins/aws-java-sdk-bundle-1.12.262.jar, file:/Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/plugins/hadoop-client-2.10.2.jar, file:/Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/plugins/hadoop-aws-3.3.4.jar, file:/Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/plugins/hadoop-aws-2.10.2.jar, file:/Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/plugins/jdbc/lib/postgresql-42.5.2.jar, file:/Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/plugins/hadoop-common-3.3.4.jar, file:/Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/plugins/hadoop-client-3.3.4.jar, file:/Users/xi ehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/plugins/aws-java-sdk-core-1.11.1000.jar, file:/Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/plugins/hadoop-shaded-guava-1.1.1.jar, file:/Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/plugins/hadoop-common-2.10.2.jar] 2023-02-15 09:22:04,215 INFO org.apache.seatunnel.core.starter.config.ConfigBuilder - Loading config file: ./config/seatunnel.streaming.conf.template 2023-02-15 09:22:04,249 INFO org.apache.seatunnel.core.starter.config.ConfigBuilder - parsed config file: { "env" : { "execution.parallelism" : 1, "job.mode" : "STREAMING" }, "source" : [ { "bucket" : "s3a://com.xxxx.data.prd", "hadoop_s3_properties" : { "fs.s3a.aws.credentials.provider" : "org.apache.hadoop.fs.s3a.SimpleAWSCredentialsProvider" }, "path" : "/Database/dfs/news_daily_202302021200", "secret_key" : "3doxxxxxxxxOH3W", "access_key" : "AKxxxxx", "type" : "parquet", "plugin_name" : "S3File" } ], "transform" : [], "sink" : [ { "plugin_name" : "Console" } ] } 2023-02-15 09:22:04,269 INFO org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Load SeaTunnelSource Plugin from /Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/connectors/seatunnel 2023-02-15 09:22:04,286 INFO org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Discovery plugin jar: S3File at: file:/Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/connectors/seatunnel/connector-file-s3-2.3.0.jar 2023-02-15 09:22:04,300 INFO org.apache.seatunnel.plugin.discovery.AbstractPluginDiscovery - Load plugin: PluginIdentifier{engineType='seatunnel', pluginType='source', pluginName='S3File'} from path: file:/Users/xiehang/Desktop/developer/apache-seatunnel-incubating-2.3.0/connectors/seatunnel/connector-file-s3-2.3.0.jar use classloader: sun.misc.Launcher$AppClassLoader 2023-02-15 09:22:04,567 WARN org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-15 09:22:04,820 INFO org.apache.seatunnel.engine.server.CoordinatorService - [localhost]:5801 [seatunnel_default_cluster-171793] [5.1] This node become a new active master node, begin init coordinator service 2023-02-15 09:22:04,841 WARN org.apache.hadoop.metrics2.impl.MetricsConfig - Cannot locate configuration: tried hadoop-metrics2-s3a-file-system.properties,hadoop-metrics2.properties 2023-02-15 09:22:04,875 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl - Scheduled Metric snapshot period at 10 second(s). 2023-02-15 09:22:04,875 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl - s3a-file-system metrics system started 2023-02-15 09:22:05,002 INFO com.hazelcast.internal.partition.impl.PartitionStateManager - [localhost]:5801 [seatunnel_default_cluster-171793] [5.1] Initializing cluster partition table arrangement... 2023-02-15 09:22:05,880 INFO org.apache.seatunnel.engine.server.resourcemanager.AbstractResourceManager - received new worker register: [localhost]:5801 2023-02-15 09:22:13,818 INFO org.apache.seatunnel.engine.server.CoordinatorService - [localhost]:5801 [seatunnel_default_cluster-171793] [5.1] *********************************************** CoordinatorService Thread Pool Status *********************************************** activeCount : 0 corePoolSize : 0 maximumPoolSize : 2147483647 poolSize : 0 completedTaskCount : 0 taskCount : 0 *********************************************** 2023-02-15 09:22:23,813 INFO org.apache.seatunnel.engine.server.CoordinatorService - [localhost]:5801 [seatunnel_default_cluster-171793] [5.1] *********************************************** CoordinatorService Thread Pool Status *********************************************** activeCount : 0 corePoolSize : 0 maximumPoolSize : 2147483647 poolSize : 0 completedTaskCount : 0 taskCount : 0 *********************************************** ``` ### Flink or Spark Version _No response_ ### Java or Scala Version _No response_ ### Screenshots _No response_ ### Are you willing to submit PR? - [X] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
