nirutgupta edited a comment on issue #20779: URL: https://github.com/apache/airflow/issues/20779#issuecomment-1011786738
k8s task handler.py which we can use https://gist.github.com/szeevs/938ad3cf96e732d4b1b55a74015aed5b log_config.py will look like ``` from copy import deepcopy from airflow.config_templates.airflow_local_settings import DEFAULT_LOGGING_CONFIG from airflow.configuration import conf import os import sys sys.path.append('/opt/airflow/custom_log') BASE_LOG_FOLDER: str = conf.get('logging', 'BASE_LOG_FOLDER') FILENAME_TEMPLATE: str = conf.get('logging', 'LOG_FILENAME_TEMPLATE') LOGGING_CONFIG = deepcopy(DEFAULT_LOGGING_CONFIG) LOGGING_CONFIG['handlers']['k8stask'] = { 'class': 'k8s_task_handler.KubernetesTaskHandler', 'formatter': 'airflow', 'base_log_folder': os.path.expanduser(BASE_LOG_FOLDER), 'filename_template': FILENAME_TEMPLATE } LOGGING_CONFIG['loggers']['airflow.task']['handlers'].append('k8stask') ``` Make sure while deploying configure this env - name: AIRFLOW__LOGGING__LOGGING_CONFIG_CLASS value: "log_config.LOGGING_CONFIG" This will do the job. :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org