aprettyloner commented on issue #28751: URL: https://github.com/apache/airflow/issues/28751#issuecomment-1380965609
@uranusjr Also experiencing this with `BigQueryExecuteQueryOperator`. Interestingly, the task pod fails but then ### Environment Airflow 2.4.3 Python 3.8.15 KubernetesExecutor GKE Version 1.23.13-gke.900 ### Error Encountered Interestingly, there is no indication of the failed task from Airflow UI. It seems to succeed...  However there are failed task pods in GKE.  With the following errors: ``` Traceback (most recent call last): File "/home/airflow/.local/bin/airflow", line 8, in <module> sys.exit(main()) File "/home/airflow/.local/lib/python3.8/site-packages/airflow/__main__.py", line 39, in main args.func(args) File "/home/airflow/.local/lib/python3.8/site-packages/airflow/cli/cli_parser.py", line 52, in command return func(*args, **kwargs) File "/home/airflow/.local/lib/python3.8/site-packages/airflow/utils/cli.py", line 103, in wrapper return f(*args, **kwargs) File "/home/airflow/.local/lib/python3.8/site-packages/airflow/cli/commands/task_command.py", line 382, in task_run _run_task_by_selected_method(args, dag, ti) File "/home/airflow/.local/lib/python3.8/site-packages/airflow/cli/commands/task_command.py", line 189, in _run_task_by_selected_method _run_task_by_local_task_job(args, ti) File "/home/airflow/.local/lib/python3.8/site-packages/airflow/cli/commands/task_command.py", line 247, in _run_task_by_local_task_job run_job.run() File "/home/airflow/.local/lib/p ython3.8/site-packages/airflow/jobs/base_job.py", line 247, in run self._execute() File "/home/airflow/.local/lib/python3.8/site-packages/airflow/jobs/local_task_job.py", line 132, in _execute self.handle_task_exit(return_code) File "/home/airflow/.local/lib/python3.8/site-packages/airflow/jobs/local_task_job.py", line 163, in handle_task_exit self.task_instance.schedule_downstream_tasks() File "/home/airflow/.local/lib/python3.8/site-packages/airflow/utils/session.py", line 75, in wrapper return func(*args, session=session, **kwargs) File "/home/airflow/.local/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 2603, in schedule_downstream_tasks partial_dag = task.dag.partial_subset( File "/home/airflow/.local/lib/python3.8/site-packages/airflow/models/dag.py", line 2188, in partial_subset dag.task_dict = { File "/home/airflow/.local/lib/python3.8/site-packages/airflow/models/dag.py", line 2189, in <dictcomp> t.task_id: _deepcopy_task(t) File "/home/airflow/.local/lib /python3.8/site-packages/airflow/models/dag.py", line 2186, in _deepcopy_task return copy.deepcopy(t, memo) File "/usr/local/lib/python3.8/copy.py", line 153, in deepcopy y = copier(memo) File "/home/airflow/.local/lib/python3.8/site-packages/airflow/models/baseoperator.py", line 1163, in __deepcopy__ setattr(result, k, copy.deepcopy(v, memo)) File "/usr/local/lib/python3.8/copy.py", line 172, in deepcopy y = _reconstruct(x, memo, *rv) File "/usr/local/lib/python3.8/copy.py", line 270, in _reconstruct state = deepcopy(state, memo) File "/usr/local/lib/python3.8/copy.py", line 146, in deepcopy y = copier(x, memo) File "/usr/local/lib/python3.8/copy.py", line 230, in _deepcopy_dict y[deepcopy(key, memo)] = deepcopy(value, memo) File "/usr/local/lib/python3.8/copy.py", line 172, in deepcopy y = _reconstruct(x, memo, *rv) File "/usr/local/lib/python3.8/copy.py", line 264, in _reconstruct y = func(*args) File "/usr/local/lib/python3.8/copy.py", line 263, in <genexpr> args = (deepcopy(arg , memo) for arg in args) File "/usr/local/lib/python3.8/copy.py", line 172, in deepcopy y = _reconstruct(x, memo, *rv) File "/usr/local/lib/python3.8/copy.py", line 264, in _reconstruct y = func(*args) File "/usr/local/lib/python3.8/enum.py", line 339, in __call__ return cls.__new__(cls, value) File "/usr/local/lib/python3.8/enum.py", line 663, in __new__ raise ve_exc ValueError: <object object at 0x7f80e0221810> is not a valid _MethodDefault ``` ### Providers ``` apache-airflow 2.4.3 apache-airflow-providers-amazon 6.0.0 apache-airflow-providers-celery 3.0.0 apache-airflow-providers-cncf-kubernetes 4.4.0 apache-airflow-providers-common-sql 1.3.1 apache-airflow-providers-docker 3.2.0 apache-airflow-providers-elasticsearch 4.2.1 apache-airflow-providers-ftp 3.2.0 apache-airflow-providers-google 8.4.0 apache-airflow-providers-grpc 3.0.0 apache-airflow-providers-hashicorp 3.1.0 apache-airflow-providers-http 4.1.0 apache-airflow-providers-imap 3.1.0 apache-airflow-providers-microsoft-azure 4.3.0 apache-airflow-providers-mysql 3.2.1 apache-airflow-providers-odbc 3.1.2 apache-airflow-providers-pagerduty 3.1.0 apache-airflow-providers-postgres 5.2.2 apache-airflow-providers-redis 3.0.0 apache-airflow-providers-salesforce 5.2.0 apache-airflow-providers-sendgrid 3.0.0 apache-airflow-providers-sftp 4.1.0 apache-airflow-providers-slack 6.0.0 apache-airflow-providers-sqlite 3.3.1 apache-airflow-providers-ssh 3.2.0 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
