thswlsqls opened a new pull request, #9291:
URL: https://github.com/apache/paimon/pull/9291

   
   ### Purpose
   
   fix #9290
   
   `QueryFileMonitor.Reader.pollNext()` sleeps on the mailbox thread and 
returns `MORE_AVAILABLE` when a scan finds nothing, and it never overrides 
`isAvailable()`, so Flink always sees a completed future. The source is 
measured as 100% busy and shown as a permanent bottleneck in the Web UI, and 
checkpoint triggering waits for the sleeping mailbox.
   
   Await the discovery interval asynchronously and return `NOTHING_AVAILABLE` 
instead, so idle polls are measured as idle. This is the change #6396 made to 
`MonitorSource`, applied to the remaining instance of that pattern.
   
   ### Tests
   
   - Added 
`QueryFileMonitorTest#testPollWithoutNewFilesReportsNothingAvailable` and 
`#testPollWithNewFilesReportsMoreAvailable`; no test covered this reader 
before. The first fails on master with `expected: NOTHING_AVAILABLE`.
   - `mvn -pl paimon-flink/paimon-flink-common -Pflink1 clean install`: 2303 
tests, 0 failures, 0 errors. Both new tests also pass with `-Pflink2`.
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to