potiuk commented on issue #23020: URL: https://github.com/apache/airflow/issues/23020#issuecomment-1204329535
I think you can forget about this. You've just hit reality train. Look there: https://cwiki.apache.org/confluence/display/AIRFLOW/AIP-42+Dynamic+Task+Mapping - see this part: "Rather than overloading the task_id argument to `airflow tasks run` (i.e. having a task_id of `run_after_loop[0]`) we will add a new `--mapping-id` argument to `airflow tasks run` -- this value will be a ~JSON-encoded~ an integer specifying the index/position of the mapping." We have to support MySQL and the problem with MySQL is that index size is limited. VERY limited. Depending on the type of encooding it might be even 720 characters. And task-id + dag_id + task_index already exceed the limit. And there is no way around it - and this was the main reason (I believe) we had to use integer, even if originally we planned not even a name but JSON-encoded list of parameters( which was far better for uniqueness - because it was automated). But this is just what I saw - by observing it being implemented, so I might be wrong on that account -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
