bytesid19 commented on issue #11955: URL: https://github.com/apache/hudi/issues/11955#issuecomment-2365191033
Was able to solve for this but still getting other exceptions Steps * git clone https://github.com/apache/hudi.git (master) * built the whole package * installed hadoop 2.10.2 - set HADOOP_HOME and path * installed hive 2.3.4 - set HIVE_HOME and path * ran ./run_sync_tool.sh --sync-mode hms --metastore-uris uri:9083/qbdb --partitioned-by txn_date --base-path s3://abc/bytesid/table --database test --table table Getting exception ``` Exception in thread “main” org.apache.hudi.exception.HoodieException: Unable to create org.apache.hudi.storage.hadoop.HoodieHadoopStorage at org.apache.hudi.storage.HoodieStorageUtils.getStorage(HoodieStorageUtils.java:44) at org.apache.hudi.common.table.HoodieTableMetaClient.getStorage(HoodieTableMetaClient.java:395) at org.apache.hudi.common.table.HoodieTableMetaClient.access$000(HoodieTableMetaClient.java:103) at org.apache.hudi.common.table.HoodieTableMetaClient$Builder.build(HoodieTableMetaClient.java:909) at org.apache.hudi.sync.common.HoodieSyncTool.buildMetaClient(HoodieSyncTool.java:75) at org.apache.hudi.hive.HiveSyncTool.lambda$new$0(HiveSyncTool.java:128) at org.apache.hudi.common.util.Option.orElseGet(Option.java:153) at org.apache.hudi.hive.HiveSyncTool.<init>(HiveSyncTool.java:128) at org.apache.hudi.hive.HiveSyncTool.<init>(HiveSyncTool.java:108) at org.apache.hudi.hive.HiveSyncTool.main(HiveSyncTool.java:547) Caused by: org.apache.hudi.exception.HoodieException: Unable to instantiate class org.apache.hudi.storage.hadoop.HoodieHadoopStorage at org.apache.hudi.common.util.ReflectionUtils.loadClass(ReflectionUtils.java:75) at org.apache.hudi.storage.HoodieStorageUtils.getStorage(HoodieStorageUtils.java:41) ... 9 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hudi.common.util.ReflectionUtils.loadClass(ReflectionUtils.java:73) ... 10 more Caused by: org.apache.hudi.exception.HoodieIOException: Failed to get instance of org.apache.hadoop.fs.FileSystem at org.apache.hudi.hadoop.fs.HadoopFSUtils.getFs(HadoopFSUtils.java:128) at org.apache.hudi.hadoop.fs.HadoopFSUtils.getFs(HadoopFSUtils.java:119) at org.apache.hudi.storage.hadoop.HoodieHadoopStorage.<init>(HoodieHadoopStorage.java:64) ... 15 more Caused by: org.apache.hadoop.fs.UnsupportedFileSystemException: No FileSystem for scheme “s3" at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3239) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3259) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:121) at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3310) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3278) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:475) at org.apache.hadoop.fs.Path.getFileSystem(Path.java:356) at org.apache.hudi.hadoop.fs.HadoopFSUtils.getFs(HadoopFSUtils.java:126) ... 17 more ``` Please help here. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
