yidan3166 opened a new issue, #5181:
URL: https://github.com/apache/seatunnel/issues/5181

   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22)
 and found no similar issues.
   
   
   ### What happened
   
   I need to import data from mysql to different tables of hive according 
condtions
   idNoValidator is udf which could be ignore, i test multi jdbc could work, 
hive not .
   
   
   
   ### SeaTunnel Version
   
   seatunnel 2.3.2
   
   ### SeaTunnel Config
   
   ```conf
   `env {
     # You can set flink configuration here
     execution.parallelism = 2
     job.mode = "BATCH"
   }
   source{
       Jdbc {
           url = "jdbc:mysql://xxxx:3306/elt_source_test?serverTimezone=GMT%2b8"
           driver = "com.mysql.cj.jdbc.Driver"
           connection_check_timeout_sec = 100
           user = "root"
           password = "xxxxxx"
           query = "select id,card_no,name,address from mysql_all_source"
        result_table_name=source
       }
   }
   
   transform {
     Sql{
     source_table_name="source"
     result_table_name="dirty_result"
     query="select id,name,card_no from source where idNoValidator(card_no)=0"
     }
   
       Sql{
     source_table_name="source"
     result_table_name="clean_result"
     query="select id,name,card_no from source where idNoValidator(card_no)=0"
   
     }
   }
   
   sink {
        Hive {
        source_table_name="clean_result"
       table_name="dev.mysql_hive_clean"
       metastore_uri="thrift://xxxx"
      hdfs_site_path="/opt/hadoop-3.1.3/etc/hadoop/hdfs-site.xml"
     }
   
    Hive {
        source_table_name="dirty_result"
       table_name="dev_dirty.mysql_hive_dirty"
       metastore_uri="thrift://xxxxxx"
      hdfs_site_path="/opt/hadoop-3.1.3/etc/hadoop/hdfs-site.xml"
     }
   
   
   }
   ```
   
   
   ### Running Command
   
   ```shell
   ./bin/seatunnel.sh --config example/mysql_to_hive.config -m local
   ```
   
   
   ### Error Exception
   
   ```log
   `ERROR org.apache.seatunnel.core.starter.SeaTunnel - Exception 
StackTrace:org.apache.seatunnel.core.starter.exception.CommandExecuteException: 
SeaTunnel job executed failed
        at 
org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:188)
        at org.apache.seatunnel.core.starter.SeaTunnel.run(SeaTunnel.java:40)
        at 
org.apache.seatunnel.core.starter.seatunnel.SeaTunnelClient.main(SeaTunnelClient.java:34)
   Caused by: java.util.concurrent.CompletionException: 
java.lang.IllegalArgumentException: Action name is duplicated
        at 
com.hazelcast.spi.impl.AbstractInvocationFuture.wrapInCompletionException(AbstractInvocationFuture.java:1347)
        at 
com.hazelcast.spi.impl.AbstractInvocationFuture.cascadeException(AbstractInvocationFuture.java:1340)
        at 
com.hazelcast.spi.impl.AbstractInvocationFuture.access$200(AbstractInvocationFuture.java:65)
        at 
com.hazelcast.spi.impl.AbstractInvocationFuture$ApplyNode.execute(AbstractInvocationFuture.java:1478)
        at 
com.hazelcast.spi.impl.AbstractInvocationFuture.unblockOtherNode(AbstractInvocationFuture.java:797)
        at 
com.hazelcast.spi.impl.AbstractInvocationFuture.unblockAll(AbstractInvocationFuture.java:759)
        at 
com.hazelcast.spi.impl.AbstractInvocationFuture.complete0(AbstractInvocationFuture.java:1235)
        at 
com.hazelcast.spi.impl.AbstractInvocationFuture.completeExceptionallyInternal(AbstractInvocationFuture.java:1223)
        at 
com.hazelcast.spi.impl.AbstractInvocationFuture.completeExceptionally(AbstractInvocationFuture.java:709)
        at 
com.hazelcast.client.impl.spi.impl.ClientInvocation.completeExceptionally(ClientInvocation.java:294)
        at 
com.hazelcast.client.impl.spi.impl.ClientInvocation.notifyExceptionWithOwnedPermission(ClientInvocation.java:321)
        at 
com.hazelcast.client.impl.spi.impl.ClientInvocation.notifyException(ClientInvocation.java:304)
        at 
com.hazelcast.client.impl.spi.impl.ClientResponseHandlerSupplier.handleResponse(ClientResponseHandlerSupplier.java:164)
        at 
com.hazelcast.client.impl.spi.impl.ClientResponseHandlerSupplier.process(ClientResponseHandlerSupplier.java:141)
        at 
com.hazelcast.client.impl.spi.impl.ClientResponseHandlerSupplier.access$300(ClientResponseHandlerSupplier.java:60)
        at 
com.hazelcast.client.impl.spi.impl.ClientResponseHandlerSupplier$DynamicResponseHandler.accept(ClientResponseHandlerSupplier.java:251)
        at 
com.hazelcast.client.impl.spi.impl.ClientResponseHandlerSupplier$DynamicResponseHandler.accept(ClientResponseHandlerSupplier.java:243)
        at 
com.hazelcast.client.impl.connection.tcp.TcpClientConnection.handleClientMessage(TcpClientConnection.java:245)
        at 
com.hazelcast.client.impl.protocol.util.ClientMessageDecoder.handleMessage(ClientMessageDecoder.java:135)
        at 
com.hazelcast.client.impl.protocol.util.ClientMessageDecoder.onRead(ClientMessageDecoder.java:89)
        at 
com.hazelcast.internal.networking.nio.NioInboundPipeline.process(NioInboundPipeline.java:136)
        at 
com.hazelcast.internal.networking.nio.NioThread.processSelectionKey(NioThread.java:383)
        at 
com.hazelcast.internal.networking.nio.NioThread.processSelectionKeys(NioThread.java:368)
        at 
com.hazelcast.internal.networking.nio.NioThread.selectLoop(NioThread.java:294)
        at 
com.hazelcast.internal.networking.nio.NioThread.executeRun(NioThread.java:249)
        at 
com.hazelcast.internal.util.executor.HazelcastManagedThread.run(HazelcastManagedThread.java:102)
   Caused by: java.lang.IllegalArgumentException: Action name is duplicated
        at 
com.google.common.base.Preconditions.checkArgument(Preconditions.java:141)
        at 
org.apache.seatunnel.engine.server.dag.execution.ExecutionPlanGenerator.generatePipelines(ExecutionPlanGenerator.java:438)
        at 
org.apache.seatunnel.engine.server.dag.execution.ExecutionPlanGenerator.generate(ExecutionPlanGenerator.java:89)
        at 
org.apache.seatunnel.engine.server.dag.physical.PlanUtils.fromLogicalDAG(PlanUtils.java:52)
        at 
org.apache.seatunnel.engine.server.master.JobMaster.init(JobMaster.java:209)
        at 
org.apache.seatunnel.engine.server.CoordinatorService.lambda$submitJob$5(CoordinatorService.java:438)
        at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)`
   ```
   
   
   ### Zeta or Flink or Spark Version
   
   _No response_
   
   ### Java or Scala Version
   
   _No response_
   
   ### Screenshots
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to