ashok-workouts commented on issue #1977: URL: https://github.com/apache/hudi/issues/1977#issuecomment-739641662
Hi, I am getting the below error and some other errors also. An error occurred while calling o75.save. : java.lang.NoSuchMethodError: scala.Some.value()Ljava/lang/Object Once run the glue job it creating multiple folders and files in S3 like, .hoodie, Default, hoodie.properties....etc. Could you please share the hudi-glue script what you are using glue job? Thanks in advance Best Regards, Ashok. On Sun, Dec 6, 2020, 1:18 AM kimberlyamandalu <[email protected]> wrote: > @ashok-workouts <https://github.com/ashok-workouts> I have the following > job parameters to ensure Hudi works with glue for my stuff: > > --conf: "spark.serializer=org.apache.spark.serializer.KryoSerializer > --conf spark.sql.hive.convertMetastoreParquet=false" > --extra-jars: > "s3://jar-bucket/spark-avro.jar,s3://jar-bucket/httpclient.jar,s3://jar-bucket/spark-bundle.jar" > > I am using Python 3 and Glue version 2.0 > > Hope this helps. > What error are you getting? > > — > You are receiving this because you were mentioned. > Reply to this email directly, view it on GitHub > <https://github.com/apache/hudi/issues/1977#issuecomment-739369424>, or > unsubscribe > <https://github.com/notifications/unsubscribe-auth/AQPUBJSCXBI7FIFV6A2DXLLSTKFA5ANCNFSM4QDKBVPQ> > . > ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
