[
https://issues.apache.org/jira/browse/HUDI-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
voon resolved HUDI-9215.
------------------------
> 0.x spark reader fails for 1.x hudi hive style and url encoded partitioned
> tables
> ---------------------------------------------------------------------------------
>
> Key: HUDI-9215
> URL: https://issues.apache.org/jira/browse/HUDI-9215
> Project: Apache Hudi
> Issue Type: Bug
> Components: spark, spark-sql
> Reporter: Vinish Reddy
> Assignee: Vinish Reddy
> Priority: Major
> Labels: pull-request-available
>
> Caused by: java.lang.IllegalArgumentException: Cannot find columns:
> 'country:simple' in the
> schema[StructField(_hoodie_commit_time,StringType,true),StructField(_hoodie_commit_seqno,StringType,true),StructField(_hoodie_record_key,StringType,true),StructField(_hoodie_partition_path,StringType,true),StructField(_hoodie_file_name,StringType,true),StructField(key,StringType,true),StructField(country,StringType,true),StructField(ts,LongType,true),StructField(nested_record,StructType(StructField(nested_int,IntegerType,true)),true),StructField(record_map,MapType(StringType,StructType(StructField(nested_int,IntegerType,true)),true),true),StructField(primitive_map,MapType(StringType,StringType,true),true),StructField(primitive_array,ArrayType(IntegerType,true),true),StructField(int_date,DateType,true),StructField(long_timestamp_millis,TimestampType,true),StructField(long_timestamp_micros,TimestampType,true),StructField(long_timestamp_millis_local,LongType,true),StructField(long_timestamp_micros_local,LongType,true),StructField(bytes_decimal,DecimalType(4,2),true)]
>
> org.apache.hudi.SparkHoodieTableFileIndex._partitionSchemaFromProperties$lzycompute(SparkHoodieTableFileIndex.scala:136)
>
> org.apache.hudi.SparkHoodieTableFileIndex._partitionSchemaFromProperties(SparkHoodieTableFileIndex.scala:110)
>
> org.apache.hudi.SparkHoodieTableFileIndex.partitionSchema(SparkHoodieTableFileIndex.scala:170
> For hive-style partitioned tables written with 1.x + table version 6, 0.x
> spark reader fails to read the table.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
