[GitHub] [hudi] jiangjin-f commented on issue #5911: [SUPPORT] delta streamer init Parquet file then flink incremental data , Data not updated

Fri, 24 Jun 2022 05:06:35 -0700 


jiangjin-f commented on issue #5911:
URL: https://github.com/apache/hudi/issues/5911#issuecomment-1165507833

   I found hudi table exist one record ,then Consume the same recordKey data 
from Kafka , The only difference is 'last_ update_time' is before the existing 
record 'last_ update_time' field value. then hudi update record.  
   Whether there are parameter settings to keep the records up to date.
   
   kafka Consume data 
   
![02dd5eac-ec19-46d9-b619-94d63fcbea78](https://user-images.githubusercontent.com/46118864/175530492-083ee1cf-89e9-4a78-bc6b-b4e07ce3b04a.png)
   
   upsert data image
   
![cc94a750-3a25-4d25-bf39-2b5b394d3687](https://user-images.githubusercontent.com/46118864/175530533-38ff8470-8ca4-475a-b211-d62d08f3c598.png)
   
   `public static GenericRecord stitchRecords(GenericRecord left, GenericRecord 
right, Schema stitchedSchema) {
       GenericRecord result = new Record(stitchedSchema);
       for (Schema.Field f : left.getSchema().getFields()) {
         result.put(f.name(), left.get(f.name()));
       }
       for (Schema.Field f : right.getSchema().getFields()) {
         result.put(f.name(), right.get(f.name()));
       }
       return result;
     }`
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to