itsallsame opened a new issue, #4661: URL: https://github.com/apache/incubator-seatunnel/issues/4661
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened When using the Spark engine to import data from HDFS into Doris, if an error occurs during the import, the program will not report an error or stop. ### SeaTunnel Version 2.3.1 ### SeaTunnel Config ```conf { "env": { "job.mode": "BATCH", "spark.yarn.queue": "test", "execution.parallelism": 30 }, "source": [ { "plugin_name": "HdfsFile", "path": "/tmp/data/test_table_20230423", "file_format_type": "text", "fs.defaultFS": "hdfs://hacluster", "hdfs_site_path": "/opt/hadoop/etc/hadoop/hdfs-site.xml" } ], "sink": [ { "plugin_name": "Doris", "fenodes": "xxxx:8030", "username": "test", "password": "password", "table.identifier": "tmp.test_table", "sink.label-prefix": "test_hdfs2doris_004", "doris.config": { "format": "csv", "column_separator":"\\x01" } } ] } ``` ### Running Command ```shell apache-seatunnel-incubating-2.3.1/bin/start-seatunnel-spark-2-connector-v2.sh \ --name test_seatunnle \ --deploy-mode client \ --master local \ --config $config OR apache-seatunnel-incubating-2.3.1/bin/start-seatunnel-spark-2-connector-v2.sh \ --name test_seatunnle \ --deploy-mode cluster \ --master client \ --config $config ``` ### Error Exception ```log 2023-04-24 20:55:53,144 | INFO | [stream-load-upload] | I/O exception (java.net.SocketException) caught when processing request to {}->http://xxxxx:8040: Broken pipe (Write failed) | org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:97) ``` ### Flink or Spark Version spark2.4.5 ### Java or Scala Version jdk1.8 ### Screenshots _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
