ahmedabu98 opened a new pull request, #41460: URL: https://github.com/apache/beam/pull/41460
Follow-up to #41408. The live view takes over the whole terminal, but pipelines keep logging to that same terminal while it's open. The Iceberg CDC source logs at INFO on every poll, so a streaming `CHANGES()` query buries the view under log lines within seconds. This PR makes two changes: * While the live view is open, the shell holds back console logging. Warnings and errors print once the view closes, and the closing line says how many other messages were hidden, for example "Live view closed after 3 rows in 00:32. Hid 9 log messages while it was open." * The Iceberg CDC source logs its per-poll messages at DEBUG instead of INFO: "Skipping scan: nothing new since last poll", "Sitting idle... Bumping watermark", and the full "Collected snapshots" dump. "Emitted snapshot" stays at INFO. I tried it by streaming `CHANGES()` from an Iceberg table in a real terminal while another process committed rows. No log lines landed on the view, and the new rows showed up within two seconds. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
