uranusjr opened a new pull request, #24317: URL: https://github.com/apache/airflow/pull/24317
Alternative approach to add dict content metadata for `expand_kwargs(xcom_arg)`. ----- Copying https://github.com/apache/airflow/pull/24101#issuecomment-1149537574 When we do ```python xcom_arg # Say this is {"a": [1, 2], "b": [3, 4, 5], "c": [6, 7]} foo.expand_kwargs(xcom_arg) ``` we can only expand the task to either 2 or 3 instances (depending whether we implement the `zip` or `zip_longest` semantic). We don’t actually need three additional entries storing the length of each value, but only need to record the zipped value is 2 (or 3—I think we should store both values). This means we only need to add two additional column on TaskMap (without changing the primary key), `zip=2` and `zig_longest=3`. Both values would be NULL if the content is not kwarg-expandable. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
