huyuanfeng2018 opened a new pull request, #5956:
URL: https://github.com/apache/paimon/pull/5956

   ## Purpose
   from #5955 
   
   ### What is the purpose of the change
   Optimize SyncDatabaseAction performance by removing expensive listTables 
operations during initialization, improving scalability for databases with many 
tables.
   
   ### Brief change log
   - Remove `listTables()` call from `RichCdcMultiplexRecordEventParser`
   - Implement lazy table creation in 
`CdcDynamicTableParsingProcessFunction#processElement`
   - Remove `createdTables` Set to reduce memory usage
   
   ### Verifying this change
   - Verified existing functionality remains intact
   
   ### Testing
   This optimization does not require additional test cases as the existing 
functionality is already covered by:
   - `SyncDatabaseActionBaseTest.testSyncTablesWithoutDbLists()` - validates 
table filtering logic
   - `SyncDatabaseActionBaseTest.testSyncTablesWithDbList()` - validates 
database filtering logic  
   - `SyncDatabaseActionBaseTest.testSycTablesCrossDB()` - validates 
cross-database filtering scenarios
   
   All these tests create and use RichCdcMultiplexRecordEventParser, ensuring 
the optimization doesn't break existing functionality.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@paimon.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to