[
https://issues.apache.org/jira/browse/HUDI-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shuo Cheng updated HUDI-8880:
-----------------------------
Status: In Progress (was: Open)
> Fix hive scan exception after new column is added
> -------------------------------------------------
>
> Key: HUDI-8880
> URL: https://issues.apache.org/jira/browse/HUDI-8880
> Project: Apache Hudi
> Issue Type: Bug
> Components: hive
> Reporter: Shuo Cheng
> Assignee: Shuo Cheng
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.0.1
>
>
> When add a new column in hudi table，execute select * from hudiTable in
> hive，have some exception：Caused by: java.lang.RuntimeException:
> org.apache.hudi.exception.HoodieException:Field ext4 not found in log schema.
>
> {code:java}
> Caused by: java.lang.RuntimeException:
> org.apache.hudi.exception.HoodieException:Field ext4 not found in log schema.
> Query cannot proceed! Derived Schema Fields: [ dzlbdm2, cjrxm, csyxzmbh,
> fqmz, qfjgmc, dz_cj2, dz_sz2, scsj, _hoodie_partition_path, xsecsrqsj,
> _hoodie_commit_seqno, fqsfzjlbdm, qfrq, _hoodie_commit_time, jgmc, scwdcs,
> jlsj, mqxm, lybs, dz_hm2, hzjcsyh, jsryxm, _hoodie_file_name, fqxm, dzqc2,
> lzryxm, mqgj, gxrxm, qfryxm, jgdm, gxsj, dz_xq2, qfjgdm, mqsfzjhm, csyz,
> qfrybh, xsexbdm, dz_xz2, mqnl, pch, mqzz, cstz, scwdbz, fqgj, mqmz, dz_sq2,
> sjzt, yzbm2, wdsyh, cssc, xsexm, mqsfzjlbdm, _hoodie_record_key, fqsfzjhm,
> fqnl, fqzz, jsrybh, plan_id]
> at
> org.apache.hudi.avro.HoodieAvroUtils.generateProjectionSchema(HoodieAvroUtils.java:582)
> at
> org.apache.hudi.hadoop.avro.HoodieAvroParquetReader.(HoodieAvroParquetReader.java:69)
> at
> org.apache.hudi.hadoop.avro.HoodieTimestampAwareParquetInputFormat.createRecordReader(HoodieTimestampAwareParquetInputFormat.java:42)
> at
> org.apache.hadoop.hive.ql.io.parquet.read.ParquetRecordReaderWrapper.(ParquetRecordReaderWrapper.java:94)
> at
> org.apache.hadoop.hive.ql.io.parquet.read.ParquetRecordReaderWrapper.(ParquetRecordReaderWrapper.java:60)
> at
> org.apache.hudi.hadoop.HoodieParquetInputFormat.getRecordReaderInternal(HoodieParquetInputFormat.java:129)
> at
> org.apache.hudi.hadoop.HoodieParquetInputFormat.getRecordReader(HoodieParquetInputFormat.java:121)
> at
> org.apache.hadoop.hive.ql.exec.FetchOperator$FetchInputFormatSplit.getRecordReader(FetchOperator.java:695)
> at
> org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:333)
> at
> org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:459)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
