pycoder2000 commented on issue #7555: URL: https://github.com/apache/hudi/issues/7555#issuecomment-1422149102
> # Note > I was able to resolve this by lowering version of hadoop I feel this is bug we need to address it > > ``` > Install > https://dlcdn.apache.org/spark/spark-3.3.1/spark-3.3.1-bin-hadoop2.tgz > > hadoop2.7 > https://github.com/soumilshah1995/winutils/blob/master/hadoop-2.7.7/bin/winutils.exe > > pyspark --packages org.apache.hudi:hudi-spark3.3-bundle_2.12:0.12.1 --conf 'spark.serializer=org.apache.spark.serializer.KryoSerializer' > ``` > > it fails on hadoop 3.0 Thank you so much! Hudi writeout of my local system had been failing for days and yours was the only solution that worked! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
