perry2of5 commented on issue #41577:
URL: https://github.com/apache/airflow/issues/41577#issuecomment-2302383194
41142 passes test, but:
I did some more testing and multiple_outputs=True fails with 2.9.2 with
microsoft-azure providers 10.1.2. This actually makes sense because the
operator returns a single value, not a dictionary so I think this wasn't
actually an issue.
Another thing I noticed is that starting with 2.9.3 with microsoft-azure
providers 10.3.0 the return value quits being put into XCOM (it is blank in the
UI). Then with airflow 2.10.0 with microsoft-azure providers 10.3.0 the key
shows up in XCOM but it says "No value found for XCom key". So something broke
between 2.9.2 / 10.1.2 and 2.10.0/10.3.0.
With all that said, my actual change to put the last line (or all lines) of
the logs into XCOM worked. So, I think we need a new defect logged to see why
return value isn't showing up correctly any more.
Here is my operator. I'd been testing my changes with do_xcom_push=False
since I didn't care about the normal return_value...obscured the fact something
else broke :(
```
aciOperator = AzureContainerInstancesOperator(
ci_conn_id="azure-container-instance-conn-id",
registry_conn_id="acr-conn-id",
resource_group="redacted",
name="http2blob{{ ds }}",
image='redacted',
region="WestUS2",
environment_variables={
redacted
},
volumes=[],
memory_in_gb=1.0,
cpu=1.0,
task_id="start-download-aci",
retries=0,
do_xcom_push=True,
# xcom_all=True,
post_execute=_post_execute,
)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
