sivabalan narayanan created HUDI-8584:
-----------------------------------------
Summary: Unify the unsupported types across SPARK and AVRO record
type
Key: HUDI-8584
URL: https://issues.apache.org/jira/browse/HUDI-8584
Project: Apache Hudi
Issue Type: Improvement
Components: metadata
Reporter: sivabalan narayanan
As of now, here is what our unsupported types look like
{code:java}
private static boolean canCompare(Schema schema, HoodieRecordType recordType) {
// if recordType is SPARK then we cannot compare RECORD and ARRAY types in
addition to MAP type
if (recordType == HoodieRecordType.SPARK) {
return schema.getType() != Schema.Type.RECORD && schema.getType() !=
Schema.Type.ARRAY && schema.getType() != Schema.Type.MAP;
}
return schema.getType() != Schema.Type.MAP;
} {code}
Lets unify the exp here.
we can make MAP, ARRAYS, RECORD as unsupported types across both record types.
Eventually we might move to SPARK record type. So, anyways those are not
supported at the moment.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
