bkosuru opened a new issue, #8800:
URL: https://github.com/apache/hudi/issues/8800
Hi All,
I was able to load hudi data in GCP Dataproc Serverless 1.1.3. 1.1.3 is
deprecated and not available to use.
I can load the data in parquet format but not in hudi format in Dataproc
Serverless 1.1.4
spark.read.format("hudi").load(path) - 0 rows
spark.read.format("parquet").load(path) - 6500 rows
I tested with hudi 0.12.12 and 0.13.0. I downloaded jars from
hudi-spark3.3-bundle_2.12
From dataproc release notes
https://cloud.google.com/dataproc/docs/release-notes, the following upgrades
were made to 1.1.4 -
Spark to [3.3.2]
Jackson to 2.13.5
Jetty to 9.4.50.v20221201
ORC to 1.8.2
Protobuf to 3.21.12
RoaringBitmap to 0.9.39
Any of these changes impact Hudi?
Thanks,
Bindu
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
