devdattakulkarni commented on issue #27358: URL: https://github.com/apache/airflow/issues/27358#issuecomment-1570991556
@jedcunningham Ack on using Slack or discussions for asking questions. Next time will do that. Thanks a lot for the detailed answers. They are helpful and confirm the solution that I stumbled upon just an hour ago via trial and error. So now I am creating my custom image by inheriting from the Airflow Worker image. Then in the executor_config, I am not defining any command. Instead, in my_task, I am using context to get the dag_run parameters and then using Python subprocess to invoke the actual command. This setup is working now. Hopefully, this explanation can help someone else who runs into this issue. Thank you for the quick reply 💯 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
