GitHub user V-S-N-VARMA-PENMETSA closed a discussion: We are facing below error
while uploading airflow logs to COS using kubernetes Executer
We are facing below error while uploading airflow logs to COS using kubernetes
Executer, Please find the error below
{"timestamp":"2025-06-17T03:27:07.919199Z","level":"info","event":"Connecting
to server:","server":"http://******:8080/execution","logger":"__main__"}
{"timestamp":"2025-06-17T03:27:07.953560Z","level":"info","event":"Secrets
backends loaded for
worker","count":1,"backend_classes":["EnvironmentVariablesBackend"],"logger":"supervisor"}
{"timestamp":"2025-06-17T03:27:08.508808","level":"info","event":"DAG bundles
loaded:
dags-folder","logger":"airflow.dag_processing.bundles.manager.DagBundlesManager"}
{"timestamp":"2025-06-17T03:27:08.509330","level":"info","event":"Filling up
the DagBag from
/opt/airflow/dags/hello_test.py","logger":"airflow.models.dagbag.DagBag"}
{"timestamp":"2025-06-17T03:27:09.340742Z","level":"info","event":"","chan":"stdout","logger":"supervisor"}
{"timestamp":"2025-06-17T03:27:09.340993Z","level":"info","event":" Inside
Task-1 sum_function function..........","chan":"stdout","logger":"supervisor"}
{"timestamp":"2025-06-17T03:27:09.513397","level":"info","event":"Connection
Retrieved 'cos-airflow-config'","logger":"airflow.hooks.base"}
{"timestamp":"2025-06-17T03:27:09.513661","level":"info","event":"AWS
Connection (conn_id='cos-airflow-config', conn_type='aws') credentials
retrieved from login and
password.","logger":"airflow.providers.amazon.aws.utils.connection_wrapper.AwsConnectionWrapper"}
{"timestamp":"2025-06-17T03:27:10.108110","level":"info","event":"Done.
Returned value was:
None","logger":"airflow.task.operators.airflow.providers.standard.operators.python.PythonOperator"}
{"event":"Unable to find AWS Connection ID 'cos-airflow-config', switching to
empty.","level":"warning","logger":"airflow.task.hooks.airflow.providers.amazon.aws.hooks.s3.S3Hook","timestamp":"2025-06-17T03:27:10.187075Z"}
{"event":"No connection ID provided. Fallback on boto3 credential strategy
(region_name=None). See:
https://boto3.amazonaws.com/v1/documentation/api/latest/guide/configuration.html","level":"info","logger":"airflow.providers.amazon.aws.hooks.base_aws.BaseSessionFactory","timestamp":"2025-06-17T03:27:10.187735Z"}
Logs from Jun 17, 2025 to Jun 17, 2025 UTC
GitHub link: https://github.com/apache/airflow/discussions/51830
----
This is an automatically sent email for [email protected].
To unsubscribe, please send an email to: [email protected]
