rjtshrm commented on issue #52501:
URL: https://github.com/apache/airflow/issues/52501#issuecomment-3044357930
Hi, I compared the airflow info for our stable and upgrade release to 3.0.2.
I can see that in 3.0.2, `task_logging_handler` is set as
`airflow.utils.log.file_task_handler.FileTaskHandler` even my
`remote_base_log_folder` is `cloudwatch` ARN.
```
Apache Airflow
version | 2.10.5
executor | KubernetesExecutor
task_logging_handler | airflow.providers.amazon.aws.log.cloudwatch_task_
| handler.CloudwatchTaskHandler
sql_alchemy_conn | postgresql://xxx.xxx.xxx
dags_folder | /opt/airflow/dags
plugins_folder | /opt/airflow/plugins
base_log_folder | /opt/airflow/logs
remote_base_log_folder | cloudwatch://arn:aws:logs:xxx
```
```
Apache Airflow
version | 3.0.2
executor | KubernetesExecutor
task_logging_handler | airflow.utils.log.file_task_handler.FileTaskHandler
sql_alchemy_conn | postgresql://xxx.xxx.xxx
dags_folder | /opt/airflow/dags
plugins_folder | /opt/airflow/plugins
base_log_folder | /opt/airflow/logs
remote_base_log_folder | cloudwatch://arn:aws:logs:xxx
```
In helm, I have enabled the logging like this and is same in both 2.10 and
3.0.2 except `auth_manager` addition.
```
config:
core:
lazy_load_plugins: 'False'
max_active_tasks_per_dag: 64
max_active_runs_per_dag: 10
parallelism: 64
auth_manager:
'airflow.providers.fab.auth_manager.fab_auth_manager.FabAuthManager'
remote_logging: 'True'
kubernetes_executor:
worker_pods_creation_batch_size: 30
logging:
remote_logging: 'True'
remote_base_log_folder:
cloudwatch://arn:aws:logs:eu-central-1:386220377733:log-group:hc-airflow-dev-logs
remote_log_conn_id: MyCloudwatchConn
```
Are there any specific changes in logging related to Airflow 3.x that need
to be taken care of externally?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
