tsreaper opened a new pull request, #1845: URL: https://github.com/apache/incubator-paimon/pull/1845
### Purpose Local merge aims to resolve data skew on primary keys. If your job suffers from primary key data skew (for example, you want to count the number of views for each pages in a website, and some particular pages are very popular among the users), you can use local merge so that input records will be buffered and merged before they're shuffled by bucket and written into sink. This is particularly useful when the same primary key is updated frequently between snapshots. This PR implements local merge operator for Flink. ### Tests * `ChangelogWithKeyFileStoreTableITCase` now randomly runs with local merge. ### API and Format No. ### Documentation Yes. Document is also updated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
