deepakpanda93 commented on issue #11918: URL: https://github.com/apache/hudi/issues/11918#issuecomment-4846014620
This is fixed — confirmed by @codope above as resolved by HUDI-8371 / [#12105](https://github.com/apache/hudi/pull/12105) ("Fix column stats index with MDT for a few scenarios"). **Root cause:** with the column-stats index enabled, after an ALTER TABLE … DROP PARTITION the clean plan stored fully-qualified file paths, but the column-stats record generation (FSUtils.getFileName / getColumnStatsRecords) assumed relative paths and computed a substring by the partition-name length — producing StringIndexOutOfBoundsException: String index out of range: -23 and leaving the clean stuck at clean.inflight. (This matches your later observation that the table broke after a DROP PARTITION.) **Fix / releases:** [#12105](https://github.com/apache/hudi/pull/12105) is in 1.0.0 and all later 1.x (1.0.x, 1.1.0, 1.1.1, 1.2.0), and was backported to 0.14.2 and 0.15.1. Your report was on 0.15.0, which predates the 0.15.1 backport — hence the failure there. Please upgrade to 0.15.1 or a 1.x release (with hoodie.metadata.index.column.stats.enable=true). If the table is already stuck, you may need to rebuild the metadata table once on the fixed version. Closing as fixed — if you still hit this on 1.x, please reopen with a repro. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
