ahmedabu98 opened a new pull request, #41460:
URL: https://github.com/apache/beam/pull/41460

   Follow-up to #41408.
   
   The live view takes over the whole terminal, but pipelines keep logging to 
that same terminal while it's open. The Iceberg CDC source logs at INFO on 
every poll, so a streaming `CHANGES()` query buries the view under log lines 
within seconds.
   
   This PR makes two changes:
   
   * While the live view is open, the shell holds back console logging. 
Warnings and errors print once the view closes, and the closing line says how 
many other messages were hidden, for example "Live view closed after 3 rows in 
00:32. Hid 9 log messages while it was open."
   * The Iceberg CDC source logs its per-poll messages at DEBUG instead of 
INFO: "Skipping scan: nothing new since last poll", "Sitting idle... Bumping 
watermark", and the full "Collected snapshots" dump. "Emitted snapshot" stays 
at INFO.
   
   I tried it by streaming `CHANGES()` from an Iceberg table in a real terminal 
while another process committed rows. No log lines landed on the view, and the 
new rows showed up within two seconds.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to