rawataaryan9 opened a new pull request #3696:
URL: https://github.com/apache/iceberg/pull/3696


   In the existing implementation for generating `CreateSnapshotEvent` for 
listeners, the summary of `CreateSnapshotEvent` only contains information about 
the updates that happened. Ex: added-records, deleted-records, added-files, 
deleted-files etc. 
   As part of this PR, the aim is to get the total stats info as well in the 
`CreateSnapshotEvent`. Ex: total-records, total-files etc. 
   
   The possible use case here is a streaming application which wants to track 
the updates stats as well as the current total stats for an iceberg table for 
every insert/update/delete commit that happens in a micro-batch in the 
application. 
   Other way to get total stats would be to identify the latest written 
snapshot by this application and read the stats from summary, which is 
cumbersome. 
   
   @rdblue @jackye1995 @RussellSpitzer 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to