rangareddy commented on issue #16989: URL: https://github.com/apache/hudi/issues/16989#issuecomment-5391440916
This issue was reviewed as part of the JIRA-migrated backlog triage (HUDI-9363). **Findings: needs a reproduction, but there is a clear structural lead worth recording.** On `master`, both `HoodieTableMetadataUtil.isColumnTypeSupportedV1` (`:1514`) and `isColumnTypeSupportedV2` (`:1542`) explicitly exclude `HoodieSchemaType.ARRAY` and `HoodieSchemaType.MAP` from indexable column types. So array and map columns are *expected* to be skipped. The report is that index creation fails when the table merely **contains** such a column - which points at the unsupported-type filter not being applied before something else tries to process it, rather than at the index legitimately refusing that column. That is a promising place to start: check whether the failing path filters through `getColumnsToIndex` (which applies `isColumnTypeSupported`) or reads the schema directly. Related: #17314 (HUDI-8585) asks for unsupported column-stats types to fail fast with a clear message rather than throwing late - the same user-experience problem, and a fix there would likely improve the error here too. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
