deepakpanda93 commented on issue #19297:
URL: https://github.com/apache/hudi/issues/19297#issuecomment-5002601815
Hi @rangareddy,
Thanks for the detailed report. I attempted to reproduce this on the master
branch (Hudi 1.3.0-SNAPSHOT) using the same build profile and Spark 3.4 setup,
and the DataFrame write completed successfully — the
```ServiceConfigurationError``` did not surface in my run.
```
>>>
spark.read.format("hudi").load("/tmp/test/Hudi_Table_With_Comments_130").show(truncate=False)
+-------------------+---------------------+------------------+----------------------+------------------------------------------------------------------------+---+----+---+----------+
|_hoodie_commit_time|_hoodie_commit_seqno
|_hoodie_record_key|_hoodie_partition_path|_hoodie_file_name
|id |name|age|date |
+-------------------+---------------------+------------------+----------------------+------------------------------------------------------------------------+---+----+---+----------+
|20260717162936791 |20260717162936791_0_0|1 |2023-01-01
|e53ea9ba-c8a1-4c37-9326-99d7fd6aae40-0_0-21-58_20260717162936791.parquet|1
|John|30 |2023-01-01|
|20260717162936791 |20260717162936791_0_1|2 |2023-01-01
|e53ea9ba-c8a1-4c37-9326-99d7fd6aae40-0_0-21-58_20260717162936791.parquet|2
|Jane|25 |2023-01-01|
|20260717162936791 |20260717162936791_1_0|3 |2023-01-02
|33de3d04-68a0-4aa1-a53f-9d59cd82909a-0_1-21-59_20260717162936791.parquet|3
|Bob |35 |2023-01-02|
+-------------------+---------------------+------------------+----------------------+------------------------------------------------------------------------+---+----+---+----------+
```
The error signature ```Provider org.apache.hudi.Spark32PlusDefaultSource not
found``` raised from ```ServiceLoader``` during
```DataSource.lookupDataSource``` is characteristic of a stale build artifact
rather than a code-level defect.
Could you retry with a clean rebuild from scratch:
```
mvn clean
mvn -T 2C install -DskipTests -Dspark3.4 -Dflink1.20
```
I ran the exact PySpark script from the issue against a clean build on my
machine and it completed the write successfully, so I suspect this will resolve
after a full clean rebuild.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
