uranusjr opened a new pull request, #24101:
URL: https://github.com/apache/airflow/pull/24101
To support expanding tasks against a dict's *content* at runtime (e.g. when
given `{"a": [1, 2]}`, expand against 1 and 2), the scheduler must be able to
know how long each value is. This means we need to extend the TaskMap metadata
store a bit, so it can not only store information on the dict itself, but also
on the values, and at the same time.
A new field "item" is thus added. When it's set to an empty string (the
default), the row stores information on the upstream's XCom push itself.
Information about a dict's content is stored in separate rows, where "item" is
set to the corresponding key (which must be str since that's required by
Python's keyword argument unpacking).
First step toward #24021.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
