bvaradar commented on issue #715: [Bug]Hudi 0.4.7 HoodieTable not found
URL: https://github.com/apache/incubator-hudi/issues/715#issuecomment-499350032
 
 
   @garyli1019 : Yes, Hudi will generate a new version first and then cleaner 
will delete old version.  If the reader doesn't recognize Hudi format (if using 
Parquet format directly), then there is no snapshot isolation guarantee to 
reader. 
   
   Hudi writer will first create new version of parquet files in place before 
committing and running cleaner.  When you run a query around this time treating 
the dataset as raw parquet one, then the query could see partially written 
parquet files or duplicate data. Hudi's reader side integration 
(HoodieInputFormat/ Hudi-DataSource (for Spark)) ensures snapshot isolation. 
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to