Jonathan Vexler created HUDI-5099:
-------------------------------------

             Summary: Update stock data so that new records are added in batch_2
                 Key: HUDI-5099
                 URL: https://issues.apache.org/jira/browse/HUDI-5099
             Project: Apache Hudi
          Issue Type: Test
            Reporter: Jonathan Vexler
            Assignee: Jonathan Vexler


The record key isĀ  "\{stock name}_\{date} \{hour}". We have the data from 
9:30-10:29 in batch_1 and batch_2 contains data from 10:30-10:59. This means 
that no new records are introduced, and therefore, only updates occur when 
ingesting batch_2. This makes validation of the data take too long for our 
testing. Proposed solution is to move the data from 10:00-10:29 into batch_2 so 
that we will have updates and inserts in both files



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to