karakanb commented on issue #23950:
URL: https://github.com/apache/airflow/issues/23950#issuecomment-1155506386
I am seeing the issue much rarer than before, but it still happens after the
upgrade. Here's one that has failed:
```
*** Reading local file:
/opt/airflow/logs/dag_id=company/run_id=scheduled__2022-06-13T01:00:00+00:00/task_id=my_task_id/attempt=1.log
[2022-06-14, 04:10:00 ] {taskinstance.py:1159} INFO - Dependencies all met
for <TaskInstance: company.my_task_id scheduled__2022-06-13T01:00:00+00:00
[queued]>
[2022-06-14, 04:10:00 ] {taskinstance.py:1159} INFO - Dependencies all met
for <TaskInstance: company.my_task_id scheduled__2022-06-13T01:00:00+00:00
[queued]>
[2022-06-14, 04:10:00 ] {taskinstance.py:1356} INFO -
--------------------------------------------------------------------------------
[2022-06-14, 04:10:00 ] {taskinstance.py:1357} INFO - Starting attempt 1 of 4
[2022-06-14, 04:10:00 ] {taskinstance.py:1358} INFO -
--------------------------------------------------------------------------------
[2022-06-14, 04:10:00 ] {taskinstance.py:1377} INFO - Executing
<Task(SnowflakeOperator): my_task_id> on 2022-06-13 01:00:00+00:00
[2022-06-14, 04:10:00 ] {standard_task_runner.py:52} INFO - Started process
982 to run task
[2022-06-14, 04:10:00 ] {standard_task_runner.py:79} INFO - Running:
['airflow', 'tasks', 'run', 'company', 'my_task_id',
'scheduled__2022-06-13T01:00:00+00:00', '--job-id', '182516', '--raw',
'--subdir', 'DAGS_FOLDER/dag_v3.py', '--cfg-path', '/tmp/tmpckf3rysy',
'--error-file', '/tmp/tmpzqc4fc0m']
[2022-06-14, 04:10:00 ] {standard_task_runner.py:80} INFO - Job 182516:
Subtask my_task_id
[2022-06-14, 04:10:00 ] {warnings.py:109} WARNING -
/home/airflow/.local/lib/python3.8/site-packages/airflow/configuration.py:525:
DeprecationWarning: The sql_alchemy_conn option in [core] has been moved to the
sql_alchemy_conn option in [database] - the old setting has been used, but
please update your config.
option = self._get_environment_variables(deprecated_key,
deprecated_section, key, section)
[2022-06-14, 04:10:01 ] {warnings.py:109} WARNING -
/home/airflow/.local/lib/python3.8/site-packages/airflow/configuration.py:525:
DeprecationWarning: The sql_alchemy_conn option in [core] has been moved to the
sql_alchemy_conn option in [database] - the old setting has been used, but
please update your config.
option = self._get_environment_variables(deprecated_key,
deprecated_section, key, section)
[2022-06-14, 04:10:01 ] {task_command.py:370} INFO - Running <TaskInstance:
company.my_task_id scheduled__2022-06-13T01:00:00+00:00 [running]> on host
airflow-v2-worker-5.airflow-v2-worker.airflow.svc.cluster.local
[2022-06-14, 04:10:01 ] {taskinstance.py:1569} INFO - Exporting the
following env vars:
AIRFLOW_CTX_DAG_OWNER=airflow
AIRFLOW_CTX_DAG_ID=company
AIRFLOW_CTX_TASK_ID=my_task_id
AIRFLOW_CTX_EXECUTION_DATE=2022-06-13T01:00:00+00:00
AIRFLOW_CTX_TRY_NUMBER=1
AIRFLOW_CTX_DAG_RUN_ID=scheduled__2022-06-13T01:00:00+00:00
[2022-06-14, 04:10:01 ] {snowflake.py:118} INFO - Executing: <some sql
statement here>
[2022-06-14, 04:10:01 ] {base.py:68} INFO - Using connection ID
'my-connection-id' for task execution.
[2022-06-14, 04:10:01 ] {connection.py:257} INFO - Snowflake Connector for
Python Version: 2.7.8, Python Version: 3.8.13, Platform:
Linux-5.10.0-0.bpo.9-amd64-x86_64-with-glibc2.2.5
[2022-06-14, 04:10:01 ] {connection.py:876} INFO - This connection is in
OCSP Fail Open Mode. TLS Certificates would be checked for validity and
revocation status. Any other Certificate Revocation related exceptions or OCSP
Responder failures would be disregarded in favor of connectivity.
[2022-06-14, 04:10:01 ] {connection.py:894} INFO - Setting use_openssl_only
mode to False
[2022-06-14, 04:10:02 ] {cursor.py:710} INFO - query: [<some sql statement
here>]
[2022-06-14, 04:10:02 ] {cursor.py:734} INFO - query execution done
[2022-06-14, 04:10:02 ] {snowflake.py:324} INFO - Running statement: <some
sql statement here>
[2022-06-14, 04:10:02 ] {cursor.py:710} INFO - query: [<some sql statement
here>]
[2022-06-14, 04:10:02 ] {cursor.py:734} INFO - query execution done
[2022-06-14, 04:10:02 ] {snowflake.py:334} INFO - Statement execution info -
{'status': 'Statement executed successfully.'}
[2022-06-14, 04:10:02 ] {snowflake.py:338} INFO - Rows affected: 1
[2022-06-14, 04:10:02 ] {snowflake.py:339} INFO - Snowflake query id:
<some-uuid-here>
[2022-06-14, 04:10:02 ] {snowflake.py:324} INFO - Running statement: <some
sql statement here>
[2022-06-14, 04:10:02 ] {cursor.py:710} INFO - query: [<some sql statement
here>]
[2022-06-14, 04:10:03 ] {cursor.py:734} INFO - query execution done
[2022-06-14, 04:10:03 ] {snowflake.py:334} INFO - Statement execution info -
{'status': 'some_table already exists, statement succeeded.'}
[2022-06-14, 04:10:03 ] {snowflake.py:338} INFO - Rows affected: 1
[2022-06-14, 04:10:03 ] {snowflake.py:339} INFO - Snowflake query id:
<some-uuid-here>
[2022-06-14, 04:10:03 ] {snowflake.py:324} INFO - Running statement: <some
sql statement here>
[2022-06-14, 04:10:03 ] {cursor.py:710} INFO - query: [<some sql statement
here>]
[2022-06-14, 04:10:08 ] {cursor.py:734} INFO - query execution done
[2022-06-14, 04:10:08 ] {snowflake.py:334} INFO - Statement execution info -
{'number of rows deleted': 562}
[2022-06-14, 04:10:08 ] {snowflake.py:338} INFO - Rows affected: 562
[2022-06-14, 04:10:08 ] {snowflake.py:339} INFO - Snowflake query id:
<some-uuid-here>
[2022-06-14, 04:10:08 ] {snowflake.py:324} INFO - Running statement: <some
sql statement here>
[2022-06-14, 04:10:08 ] {cursor.py:710} INFO - query: [<some sql statement
here>]
[2022-06-14, 04:16:29 ] {taskinstance.py:1149} INFO - Dependencies not met
for <TaskInstance: company.my_task_id scheduled__2022-06-13T01:00:00+00:00
[running]>, dependency 'Task Instance Not Running' FAILED: Task is in the
running state
[2022-06-14, 04:16:29 ] {taskinstance.py:1149} INFO - Dependencies not met
for <TaskInstance: company.my_task_id scheduled__2022-06-13T01:00:00+00:00
[running]>, dependency 'Task Instance State' FAILED: Task is in the 'running'
state.
[2022-06-14, 04:16:29 ] {local_task_job.py:101} INFO - Task is not able to
be run
```
Interestingly, this one has failed only after 6 minutes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
