vinothchandar commented on issue #894: Getting java.lang.NoSuchMethodError 
while doing Hive sync
URL: https://github.com/apache/incubator-hudi/issues/894#issuecomment-532347935
 
 
   >>Am I supposed to add hudi-hive jars separately?
   No.. its all there in the bundle
   
   Some general context . if you are writing a spark job, its better to just 
depend on `hudi-spark` , which will pull in hudi-hive.  That way you have 
control over what versions to exclude and bring in. With a bundled jar (true 
for any bundled/fat/uber jar), you dont have control to say tell hudi to not 
bring its version of Hive. 
   
   Can you try building a fat jar and running your job once via `spark-submit` 
locally? I imagine you added the spark jars to your IntelliJ module to be able 
to run the program locally. Want to see if the jar conflict is coming from 
that.. Cant understand where `Hive 2.3.2-amzn-2` comes from still from what you 
shared

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Reply via email to