Rixkz opened a new issue, #28360:
URL: https://github.com/apache/airflow/issues/28360

   ### Apache Airflow version
   
   Other Airflow 2 version (please specify below)
   
   ### What happened
   
   I used TriggerDagRunOperator for a while, it's wok fine, but now I need to 
use parameter "queue" to make my trigger task sending message to queue name 
"submit_dag_queue", when I used it, I've got some strange error.
   
   ```
   [2022-12-14 13:25:00,729: INFO/ForkPoolWorker-15] [***] Executing command in 
Celery: ['airflow', 'tasks', 'run', '***', '***', 
'manual__2022-12-14T13:24:56.989463+00:00', '--local', '--subdir', 
'DAGS_FOLDER/dags/contoller_dag/***.py']
   [2022-12-14 13:25:02,930: ERROR/ForkPoolWorker-15] Task 
airflow.executors.celery_executor.execute_command[***] raised unexpected: 
AirflowException('Celery command failed on host: ip-*** with celery_task_id 
***')
   Traceback (most recent call last):
   File 
"/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 
451, in trace_task
   R = retval = fun(*args, **kwargs)
   File 
"/home/airflow/.local/lib/python3.10/site-packages/celery/app/trace.py", line 
734, in __protected_call__
   return self.run(*args, **kwargs)
   File 
"/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py",
 line 96, in execute_command
   _execute_in_fork(command_to_exec, celery_task_id)
   File 
"/home/airflow/.local/lib/python3.10/site-packages/airflow/executors/celery_executor.py",
 line 111, in _execute_in_fork
   raise AirflowException(msg)
   airflow.exceptions.AirflowException: Celery command failed on host: ip-*** 
with celery_task_id ***
   ```
   
   Here, my code example.
   ```
   trigger_fact_xxx = TriggerDagRunOperator(
       task_id="trigger_xxx_dag",
       trigger_dag_id="fact_xxx",
       wait_for_completion=True,
       conf=conf,
       pre_execute=check_runnable_status,
       pool=trigger_pool_name,
       queue="submit_dag_queue",
       trigger_rule="none_failed",
   )
   ```
   
   Let me know if I understand wrong about how to use it.
   
   ### What you think should happen instead
   
   _No response_
   
   ### How to reproduce
   
   _No response_
   
   ### Operating System
   
   I used docker image : apache/airflow:2.4.0-python3.10
   
   ### Versions of Apache Airflow Providers
   
   _No response_
   
   ### Deployment
   
   Docker-Compose
   
   ### Deployment details
   
   I used redis as a message broker.
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to