EricJoy2048 opened a new issue, #2812: URL: https://github.com/apache/incubator-seatunnel/issues/2812
### Search before asking - [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues. ### What happened I set `execution.parallelism = 3` and I found 3 tasks run, but only one task read the hive data. ### SeaTunnel Version dev ### SeaTunnel Config ```conf env { # You can set flink configuration here execution.parallelism = 3 job.name="test_hive_source_to_console" } source { # This is a example input plugin **only for test and demonstrate the feature input plugin** Hive { table_name = "test_hive.test_hive_source" metastore_uri = "thrift://ctyun7:9083" } # If you would like to get more information about how to configure seatunnel and see full list of input plugins, # please go to https://seatunnel.apache.org/docs/flink/configuration/source-plugins/Fake } transform { } sink { # choose stdout output plugin to output data to console Console { } # If you would like to get more information about how to configure seatunnel and see full list of output plugins, # please go to https://seatunnel.apache.org/docs/flink/configuration/sink-plugins/Console } ``` ### Running Command ```shell sh start-seatunnel-spark-connector-v2.sh --config ../config/spark_hive_to_console.conf --deploy-mode client --master yarn ``` ### Error Exception ```log 2 tasks run in test9 node. [root@test9 application_1660830627671_0128]# ls container_e08_1660830627671_0128_01_000001 container_e08_1660830627671_0128_01_000003 [root@test9 application_1660830627671_0128]# ll -rt ./* ./container_e08_1660830627671_0128_01_000003: total 8 -rw-r--r-- 1 root root 0 Sep 20 17:54 prelaunch.err -rw-r--r-- 1 root root 70 Sep 20 17:54 prelaunch.out -rw-r--r-- 1 root root 0 Sep 20 17:54 stdout -rw-r--r-- 1 root root 3914 Sep 20 17:54 stderr ./container_e08_1660830627671_0128_01_000001: total 16 -rw-r--r-- 1 root root 0 Sep 20 17:54 prelaunch.err -rw-r--r-- 1 root root 70 Sep 20 17:54 prelaunch.out -rw-r--r-- 1 root root 0 Sep 20 17:54 stdout -rw-r--r-- 1 root root 9149 Sep 20 17:54 stderr [root@test9 application_1660830627671_0128]# ``` 1 task run in test7 node ``` [root@test7 application_1660830627671_0128]# ls container_e08_1660830627671_0128_01_000002 [root@test7 application_1660830627671_0128]# ll -rt ./* total 24 -rw-r--r-- 1 root root 0 Sep 20 17:54 prelaunch.err -rw-r--r-- 1 root root 70 Sep 20 17:54 prelaunch.out -rw-r--r-- 1 root root 9279 Sep 20 17:54 stdout -rw-r--r-- 1 root root 6410 Sep 20 17:54 stderr ``` Only the test7 node task output the data read from hive and it have all the 40 rows data. ``` ### Flink or Spark Version SeaTunnel version: dev Hadoop version: Hadoop 2.10.2 Flink version: 1.12.7 Spark version: 2.4.3, scala version 2.11.12 ### Java or Scala Version JDK 1.8 ### Screenshots _No response_ ### Are you willing to submit PR? - [ ] Yes I am willing to submit a PR! ### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
