adamcunnington-gdt commented on issue #13653: URL: https://github.com/apache/airflow/issues/13653#issuecomment-763139336
Ok, so let me zoom out a second to make sure that what we're asking for is going to give us what we need. When a DAG is defined, arbitrary parameters can be set. We then want to discover those parameters by asking Airflow for the DAG details. We then want to execute a dag passing in values for these parameters to drive the behaviour of the DAG. Are we going to be able to achieve this? *Adam Cunnington* Director of Data Engineering Architect, Analytics Tribe On Tue, Jan 19, 2021 at 6:21 PM Vladimir Mikhaylov <[email protected]> wrote: > Can I clarify my understanding? When you run a dag and pass config: {}, > these are values that should be passed to the corresponding parameter keys, > yes? > > If I understand it correctly, you mean here the -c, --conf argument > <https://airflow.apache.org/docs/apache-airflow/stable/cli-and-env-variables-ref.html#Named%20Arguments_repeat19> > (see example there > <https://github.com/apache/airflow/blob/master/airflow/example_dags/example_trigger_target_dag.py#L62>), > which is accessed through dag_run.conf. It can be set up dynamically for > each DAG run and is not specified in any way. > > It seems to me that params and conf are two separate different things. > > — > You are receiving this because you commented. > Reply to this email directly, view it on GitHub > <https://github.com/apache/airflow/issues/13653#issuecomment-763031076>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/AJ3JUF3TPBOIVYCC6SUH4S3S2XESJANCNFSM4WA4CLMA> > . > -- Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not copy or deliver this message to anyone. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer does not consent to email for messages of this kind. Opinions, conclusions and other information in this message that do not relate to the official business of Group M Worldwide LLC and/or other members of the GroupM group of companies shall be understood as neither given nor endorsed by it. GroupM is the global media investment management arm of WPP. For more information on our business ethical standards and Corporate Responsibility policies please refer to WPP's website at http://www.wpp.com/WPP/About/ <https://urldefense.proofpoint.com/v2/url?u=http-3A__www.wpp.com_WPP_About_&d=DwMFaQ&c=N-xPqDyeLJg5V3gLll2thA&r=aMkvY63z6j7EsF4XIb9BQM9Vg_NPq0Tyq_c4qEjSGuI&m=KGmvFRgWqLXTGN-0TqwJrXtnIjxRssANR2E_1vsPHZg&s=CtJil6FZbGrYDvuuovO87MZKGQbQYXhR41-kweAs1C0&e=> ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
