smdahmed commented on issue #859: Hudi upsert after a delete in partition will cause valid records inserted to disappear. URL: https://github.com/apache/incubator-hudi/issues/859#issuecomment-529186093 Just to bring a closure to the cause of the bug, the sequence of events in the code that led to the bug were as below: 1. Insert and Upsert write the data with table column set. 2. Delete operation did need to generate temporary composite key to delete valid records but made an error of writing the additional column into the parquet. 3. Querying after delete did show valid records. 4. Insert or Upsert after delete would write a parquet that wouldnt have missing column written in step 2. 5. When queried the old records in the table wouldnt appear at all. So this would seem that insert or upsert after delete is not working. Very simple bug. It is a shame I couldnt catch it earlier as I was looking everywhere else but not into the code step by step. Vinoth - Thanks again for all the help.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
