Shuo Cheng created HUDI-8880:
--------------------------------
Summary: Fix hive scan exception after new column is added
Key: HUDI-8880
URL: https://issues.apache.org/jira/browse/HUDI-8880
Project: Apache Hudi
Issue Type: Bug
Components: hive
Reporter: Shuo Cheng
Fix For: 1.0.1
When add a new column in hudi table，execute select * from hudiTable in
hive，have some exception：Caused by: java.lang.RuntimeException:
org.apache.hudi.exception.HoodieException:Field ext4 not found in log schema.
{code:java}
Caused by: java.lang.RuntimeException:
org.apache.hudi.exception.HoodieException:Field ext4 not found in log schema.
Query cannot proceed! Derived Schema Fields: [ dzlbdm2, cjrxm, csyxzmbh, fqmz,
qfjgmc, dz_cj2, dz_sz2, scsj, _hoodie_partition_path, xsecsrqsj,
_hoodie_commit_seqno, fqsfzjlbdm, qfrq, _hoodie_commit_time, jgmc, scwdcs,
jlsj, mqxm, lybs, dz_hm2, hzjcsyh, jsryxm, _hoodie_file_name, fqxm, dzqc2,
lzryxm, mqgj, gxrxm, qfryxm, jgdm, gxsj, dz_xq2, qfjgdm, mqsfzjhm, csyz,
qfrybh, xsexbdm, dz_xz2, mqnl, pch, mqzz, cstz, scwdbz, fqgj, mqmz, dz_sq2,
sjzt, yzbm2, wdsyh, cssc, xsexm, mqsfzjlbdm, _hoodie_record_key, fqsfzjhm,
fqnl, fqzz, jsrybh, plan_id]
at
org.apache.hudi.avro.HoodieAvroUtils.generateProjectionSchema(HoodieAvroUtils.java:582)
at
org.apache.hudi.hadoop.avro.HoodieAvroParquetReader.(HoodieAvroParquetReader.java:69)
at
org.apache.hudi.hadoop.avro.HoodieTimestampAwareParquetInputFormat.createRecordReader(HoodieTimestampAwareParquetInputFormat.java:42)
at
org.apache.hadoop.hive.ql.io.parquet.read.ParquetRecordReaderWrapper.(ParquetRecordReaderWrapper.java:94)
at
org.apache.hadoop.hive.ql.io.parquet.read.ParquetRecordReaderWrapper.(ParquetRecordReaderWrapper.java:60)
at
org.apache.hudi.hadoop.HoodieParquetInputFormat.getRecordReaderInternal(HoodieParquetInputFormat.java:129)
at
org.apache.hudi.hadoop.HoodieParquetInputFormat.getRecordReader(HoodieParquetInputFormat.java:121)
at
org.apache.hadoop.hive.ql.exec.FetchOperator$FetchInputFormatSplit.getRecordReader(FetchOperator.java:695)
at
org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:333)
at
org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:459)
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
