bvaradar commented on issue #681: spark-bundle packaging shades HiveDriver URL: https://github.com/apache/incubator-hudi/issues/681#issuecomment-492899527 @arw357 : The shading process is supposed to regex-replace org.apache.hive.jdbc to com.uber.hoodie.org.apache.hive.jdbc in all call sites. Also , HoodieHiveClient resides in hoodie-hive which does not depend on the bundle directly. It is the other way round. To confirm, you can do this jar tf $HUDI_SPARK_BUNDLE | grep HiveDriver com/uber/hoodie/org/apache/hive/jdbc/HiveDriver.class Now, unzip the jar (mkdir tmp; cd tmp; unzip $HUDI_SPARK_BUNDLE '*.class' ). If you run the disassembler, you will see javap -c com/uber/hoodie/hive/HoodieHiveClient.class | grep HiveDriver 0: ldc_w #819 // class com/uber/hoodie/org/apache/hive/jdbc/HiveDriver This should tell that HiveDriver is indeed shaded. The reason why you are seeing org/apache/hive/jdbc/HiveDriver is because you are likely including some hoodie jar other than hoodie-spark-bundle.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
