JingsongLi opened a new pull request, #178: URL: https://github.com/apache/flink-table-store/pull/178
When using TableStore to support stream consumption, there are two requirements. - Downstream gets all changelogs - The order of stream consumption is the order of input For append only table, it is easy to meet both. But for the primary key table, Its files are all sorted and de-duplicated by pk, making it impossible to meet the above expectations. We can output another ChangelogFile when the DataFile flush, and the stream reads it directly. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
