zhbdesign commented on issue #9826:
URL: https://github.com/apache/airflow/issues/9826#issuecomment-658612309
> I use a cluster of four machine components. When I execute the task, the
task has been distributed, but there will be errors for each machine. The log
is as follows:
[2020-07-15 11:25:46,471: ERROR/ForkPoolWorker-1] None
[2020-07-15 11:25:46,582: ERROR/ForkPoolWorker-2] Task
airflow.executors.celery_executor.execute_command[c29ab0dd-7049-4aeb-9023-cda45b9d3462]
raised unexpected: AirflowException('Celery command failed',)
Traceback (most recent call last):
File
"/usr/local/lib/python3.6/site-packages/airflow/executors/celery_executor.py",
line 78, in execute_command
close_fds=True, env=env)
File "/usr/local/lib/python3.6/subprocess.py", line 291, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['airflow', 'run',
'user_MySql_2_ClickHouse_increment_srt_Activity',
'm2ctask_Homework_SubmitActivity_Member_inc',
'2020-07-15T11:25:35.177616+00:00', '--local', '--pool', 'default_pool', '-sd',
'/opt/airflow/dags/MySql_2_ClickHouse_srt_Activity.py']' returned non-zero exit
status 1.
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/celery/app/trace.py", line 412,
in trace_task
R = retval = fun(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/celery/app/trace.py", line 704,
in protected_call
return self.run(*args, **kwargs)
File
"/usr/local/lib/python3.6/site-packages/sentry_sdk/integrations/celery.py",
line 171, in _inner
reraise(*exc_info)
File "/usr/local/lib/python3.6/site-packages/sentry_sdk/_compat.py", line
57, in reraise
raise value
File
"/usr/local/lib/python3.6/site-packages/sentry_sdk/integrations/celery.py",
line 166, in _inner
return f(*args, **kwargs)
File
"/usr/local/lib/python3.6/site-packages/airflow/executors/celery_executor.py",
line 83, in execute_command
raise AirflowException('Celery command failed')
airflow.exceptions.AirflowException: Celery command failed
[2020-07-15 11:25:46,705: ERROR/ForkPoolWorker-1] Task
airflow.executors.celery_executor.execute_command[efcd61c3-bae5-43a6-a2ba-ff584ee5a9e9]
raised unexpected: AirflowException('Celery command failed',)
Traceback (most recent call last):
File
"/usr/local/lib/python3.6/site-packages/airflow/executors/celery_executor.py",
line 78, in execute_command
close_fds=True, env=env)
File "/usr/local/lib/python3.6/subprocess.py", line 291, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['airflow', 'run',
'user_MySql_2_ClickHouse_increment_srt_Activity',
'MySql_2_ClickHouse_Activity_Category_inc', '2020-07-15T11:25:35.177616+00:00',
'--local', '--pool', 'default_pool', '-sd',
'/opt/airflow/dags/MySql_2_ClickHouse_srt_Activity.py']' returned non-zero exit
status 1.
<sub>[View in
Slack](https://apache-airflow.slack.com/archives/CCQ7EGB1P/p1594796735217400)</sub>
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
