Csaba Ringhofer has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/24894 )
Change subject: IMPALA-15361: Read Hive 4 timestamp stats ...................................................................... IMPALA-15361: Read Hive 4 timestamp stats Hive 4 reconstructs persisted TIMESTAMP statistics in the dedicated TimestampColumnStatsData union field based on the column type, regardless of which engine wrote them. Impala also uses LongColumnStatsData when it writes the statistics directly. Read NDV and null counts from both representations and keep low and high values unset. Handle Hive 4 field 8 in Hive3MetastoreShimBase so both Apache and CDP Hive 3 shims use it without referencing the Hive 4 API. Add unit coverage for both representations. The Hive 4 case is skipped when the timestampStats API is unavailable. Testing: - Frontend build and ColumnStatsTest with Hive 4.0.1 (0 skipped) - Frontend build and ColumnStatsTest with Apache Hive 3.1.3 (1 skipped) - Frontend build and ColumnStatsTest with CDP Hive 3 (1 skipped) Change-Id: I0b99acbe65665226938b2e4ac5191063d3925426 Assisted-by: gpt-5.6-sol (OpenAI Codex) Reviewed-on: http://gerrit.cloudera.org:8080/24894 Reviewed-by: Csaba Ringhofer <[email protected]> Tested-by: Csaba Ringhofer <[email protected]> --- M fe/src/compat-apache-hive-2/java/org/apache/impala/compat/MetastoreShim.java M fe/src/main/java/org/apache/impala/catalog/ColumnStats.java M fe/src/main/java/org/apache/impala/catalog/Hive3MetastoreShimBase.java A fe/src/test/java/org/apache/impala/catalog/ColumnStatsTest.java 4 files changed, 123 insertions(+), 6 deletions(-) Approvals: Csaba Ringhofer: Looks good to me, approved; Verified -- To view, visit http://gerrit.cloudera.org:8080/24894 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I0b99acbe65665226938b2e4ac5191063d3925426 Gerrit-Change-Number: 24894 Gerrit-PatchSet: 6 Gerrit-Owner: Aleksandr Efimov <[email protected]> Gerrit-Reviewer: Aleksandr Efimov <[email protected]> Gerrit-Reviewer: Csaba Ringhofer <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
