trushev commented on code in PR #5830:
URL: https://github.com/apache/hudi/pull/5830#discussion_r927284257
##########
hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/format/mor/MergeOnReadInputFormat.java:
##########
@@ -135,6 +139,12 @@
*/
private boolean closed = true;
+ private final Option<SchemaEvolutionContext> schemaEvolutionContext;
+ private List<String> actualFieldNames;
+ private List<DataType> actualFieldTypes;
+ private InternalSchema actualSchema;
+ private InternalSchema querySchema;
Review Comment:
There is no correct schema at moment of contraction `MergeOnReadInputFormat`:
baseFile1 with schema1 {id: int, value: int}
baseFile2 with schema2 {id: int, value: long} -- read schema
both files will be passed to the same `MergeOnReadInputFormat#open` as
`MergeOnReadInputSplit`
we need to read baseFile1 with schema1 then cast `value: int` to `value:
long` using `CastMap`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
