Zouxxyy opened a new issue, #2898:
URL: https://github.com/apache/incubator-paimon/issues/2898

   ### Search before asking
   
   - [X] I searched in the 
[issues](https://github.com/apache/incubator-paimon/issues) and found nothing 
similar.
   
   
   ### Motivation
   
   Position delete is a solution to implement the Merge-On-Read (MOR) 
structure, which has been adopted by other formats such as Iceberg and Delta. 
By combining with Paimon's LSM tree, we can create a new position deletion mode 
unique to Paimon.
   
   Under this mode, extra overhead (lookup and write delete file) will be 
introduced during writing, but during reading, data can be directly retrieved 
using "data + filter with position delete", avoiding additional merge costs 
between different files. Furthermore, this mode can be easily integrated into 
native engine solutions like Spark + Gluten in the future, thereby 
significantly enhancing read performance.
   
   PIP: https://cwiki.apache.org/confluence/x/Tws4EQ
   
   ### Solution
   
   _No response_
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [X] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@paimon.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to