lucasmo commented on issue #466:
URL:
https://github.com/apache/incubator-xtable/issues/466#issuecomment-2218415622
Okay, I was able to figure out why this isn't causing an error in
xtable-core but it is causing one in xtable-utilities. Both have
`org.apache.hudi:hudi-common:0.14.0` on the classpath, whereas only xtable-core
has `org.apache.hudi:hudi-spark3.4-bundle_2.12:0.14.0` on the classpath.
Running this sample code:
```java
Schema schema = new
Schema.Parser().parse("{\"type\":\"record\",\"name\":\"HoodieCleanPartitionMetadata\",\"namespace\":\"org.apache.hudi.avro.model\",\"fields\":[{\"name\":\"partitionPath\",\"type\":{\"type\":\"string\",\"avro.java.string\":\"String\"}},{\"name\":\"policy\",\"type\":{\"type\":\"string\",\"avro.java.string\":\"String\"}},{\"name\":\"deletePathPatterns\",\"type\":{\"type\":\"array\",\"items\":{\"type\":\"string\",\"avro.java.string\":\"String\"}}},{\"name\":\"successDeleteFiles\",\"type\":{\"type\":\"array\",\"items\":{\"type\":\"string\",\"avro.java.string\":\"String\"}}},{\"name\":\"failedDeleteFiles\",\"type\":{\"type\":\"array\",\"items\":{\"type\":\"string\",\"avro.java.string\":\"String\"}}},{\"name\":\"isPartitionDeleted\",\"type\":[\"null\",\"boolean\"],\"default\":null}]}");
System.out.println("Class for schema: " +
SpecificData.get().getClass(schema));
```
* With `org.apache.hudi:hudi-common:0.14.0` on the classpath, this results
in the Recursive Update error
* With `org.apache.hudi:hudi-spark3.4-bundle_2.12:0.14.0` on the classpath,
this prints `Class for schema: class
org.apache.hudi.avro.model.HoodieCleanPartitionMetadata`
* With neither on the classpath, this prints `Class for schema: null`
**The issue is that both `hudi-spark3.4-bundle_2.12:0.14.0` and
`hudi-common:0.14.0` have an autogenerated avro class for
`HoodieCleanPartitionMetadata`, _but they are DIFFERENT_.**
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@xtable.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
