notAprogrammer-0 opened a new issue, #6177:
URL: https://github.com/apache/seatunnel/issues/6177

   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22)
 and found no similar issues.
   
   
   ### What happened
   
   I just wanted to test whether I can connect to hive, but it seems that 
something went wrong.
   
   ### SeaTunnel Version
   
   2.3.3
   
   ### SeaTunnel Config
   
   ```conf
   env {
     parallelism = 1
     job.mode : "BATCH"
     checkpoint.interval : 10000
     job.name="test_hive_source_to_hive"
   }
   
   source {
       Hive {
           table_name = "cc2_l2_data.test_hive"
           metastore_uri = "thrift://xxx:**,thrift://xxx:**"
           hdfs_site_path = 
"/opt/seatunnel/seatunnel-2.3.3/config/hdfs-site.xml"
       }
   }
   
   sink {
     Console{
     }
   }
   ```
   
   
   ### Running Command
   
   ```shell
   ./bin/seatunnel.sh --config ./config/hive.test.config -e local
   ```
   
   
   ### Error Exception
   
   ```log
   2024-01-10 17:00:31,249 ERROR org.apache.seatunnel.core.starter.SeaTunnel - 
Exception 
StackTrace:org.apache.seatunnel.core.starter.exception.CommandExecuteException: 
SeaTunnel job executed failed
        at 
org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:191)
        at org.apache.seatunnel.core.starter.SeaTunnel.run(SeaTunnel.java:40)
        at 
org.apache.seatunnel.core.starter.seatunnel.SeaTunnelClient.main(SeaTunnelClient.java:34)
   Caused by: 
org.apache.seatunnel.connectors.seatunnel.file.exception.FileConnectorException:
 ErrorCode:[FILE-03], ErrorDescription:[Get file list failed] - Get file list 
from this path [/user/hive/warehouse/cc2_l2_data.db/test_hive] failed
        at 
org.apache.seatunnel.connectors.seatunnel.file.hdfs.source.BaseHdfsFileSource.prepare(BaseHdfsFileSource.java:79)
        at 
org.apache.seatunnel.connectors.seatunnel.hive.source.HiveSource.prepare(HiveSource.java:176)
        at 
org.apache.seatunnel.engine.core.parse.JobConfigParser.parseSource(JobConfigParser.java:85)
        at 
org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.parseSource(MultipleTableJobConfigParser.java:317)
        at 
org.apache.seatunnel.engine.core.parse.MultipleTableJobConfigParser.parse(MultipleTableJobConfigParser.java:179)
        at 
org.apache.seatunnel.engine.core.job.AbstractJobEnvironment.getLogicalDag(AbstractJobEnvironment.java:109)
        at 
org.apache.seatunnel.engine.client.job.JobExecutionEnvironment.execute(JobExecutionEnvironment.java:73)
        at 
org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:143)
        ... 2 more
   Caused by: java.io.IOException: Couldn't create proxy provider null
        at 
org.apache.hadoop.hdfs.NameNodeProxiesClient.createFailoverProxyProvider(NameNodeProxiesClient.java:262)
        at 
org.apache.hadoop.hdfs.NameNodeProxiesClient.createFailoverProxyProvider(NameNodeProxiesClient.java:225)
        at 
org.apache.hadoop.hdfs.NameNodeProxiesClient.createProxyWithClientProtocol(NameNodeProxiesClient.java:135)
        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:356)
        at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:290)
        at 
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:172)
        at 
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3303)
        at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:124)
        at 
org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3352)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3320)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:479)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:227)
        at 
org.apache.seatunnel.connectors.seatunnel.file.source.reader.AbstractReadStrategy.getFileNamesByPath(AbstractReadStrategy.java:127)
        at 
org.apache.seatunnel.connectors.seatunnel.file.hdfs.source.BaseHdfsFileSource.prepare(BaseHdfsFileSource.java:76)
        ... 9 more
   Caused by: java.lang.RuntimeException: java.lang.RuntimeException: 
java.lang.ClassNotFoundException: Class 
org.apache.hadoop.hdfs.server.namenode.ha.AdaptiveFailoverProxyProvider not 
found
        at 
org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2670)
        at 
org.apache.hadoop.hdfs.NameNodeProxiesClient.getFailoverProxyProviderClass(NameNodeProxiesClient.java:296)
        at 
org.apache.hadoop.hdfs.NameNodeProxiesClient.createFailoverProxyProvider(NameNodeProxiesClient.java:237)
        ... 22 more
   Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException: 
Class org.apache.hadoop.hdfs.server.namenode.ha.AdaptiveFailoverProxyProvider 
not found
        at 
org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2638)
        at 
org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2662)
        ... 24 more
   Caused by: java.lang.ClassNotFoundException: Class 
org.apache.hadoop.hdfs.server.namenode.ha.AdaptiveFailoverProxyProvider not 
found
        at 
org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2542)
        at 
org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2636)
        ... 25 more
   ```
   
   
   ### Zeta or Flink or Spark Version
   
   Zeta version: 2.3.3
   
   ### Java or Scala Version
   
   Java version: 1.8
   Hive version: 3.1.0
   
   ### Screenshots
   
   
![image](https://github.com/apache/seatunnel/assets/66351499/c3237f0d-8220-4b50-80e7-58adfa5e80e2)
   
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to