CodyPin commented on issue #10262: URL: https://github.com/apache/hudi/issues/10262#issuecomment-1846851837
Having the same issue here, same process as @georgepap9808, took @ad1happy2go recommandation and pulled to lastest. Following the demo process from [hudi docker demo page](https://hudi.apache.org/docs/docker_demo) and when I reached step 2, entering container 'adhoc-2' and type in: ` spark-submit \ --class org.apache.hudi.utilities.streamer.HoodieStreamer $HUDI_UTILITIES_BUNDLE \ --table-type COPY_ON_WRITE \ --source-class org.apache.hudi.utilities.sources.JsonKafkaSource \ --source-ordering-field ts \ --target-base-path /user/hive/warehouse/stock_ticks_cow \ --target-table stock_ticks_cow --props /var/demo/config/kafka-source.properties \ --schemaprovider-class org.apache.hudi.utilities.schema.FilebasedSchemaProvider ` Same error popped up: ` 23/12/08 09:25:10 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 23/12/08 09:25:10 WARN deploy.DependencyUtils: Local jar /var/hoodie/ws/docker/hoodie/hadoop/hive_base/target/hoodie-utilities.jar does not exist, skipping. 23/12/08 09:25:10 WARN deploy.SparkSubmit$$anon$2: Failed to load org.apache.hudi.utilities.streamer.HoodieStreamer. java.lang.ClassNotFoundException: org.apache.hudi.utilities.streamer.HoodieStreamer at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:348) at org.apache.spark.util.Utils$.classForName(Utils.scala:238) at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:806) at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:161) at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:184) at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86) at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:920) at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:929) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) 23/12/08 09:25:10 INFO util.ShutdownHookManager: Shutdown hook called 23/12/08 09:25:10 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-a617d3ad-7ce4-42c5-b952-d3154c15aa4c ` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
