shahar1 commented on code in PR #74926:
URL: https://github.com/apache/airflow/pull/74926#discussion_r4306437306
##########
providers/google/src/airflow/providers/google/cloud/log/cloud_logging_task_handler.py:
##########
@@ -167,7 +167,15 @@ def transport(self) -> Transport:
def processors(self) -> tuple[structlog.typing.Processor, ...]:
import structlog.stdlib
- from airflow.sdk.log import relative_path_from_logger
+ from airflow.sdk.log import relative_path_from_logger as
_relative_path_from_logger
+
+ def relative_path_from_logger(logger) -> Path | None:
+ try:
+ return _relative_path_from_logger(logger)
+ except ValueError:
+ # Skip log files outside ``base_log_folder``, such as a Dag
processor log directory
+ # configured elsewhere, as ``upload_to_remote`` does.
Review Comment:
This processor runs in the Dag processor manager for every log line
forwarded from every Dag file parse. A debug line here fires once per log line,
so turning on `DEBUG` would roughly double the manager's own output with the
same message.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]