TJaniF opened a new issue, #47832:
URL: https://github.com/apache/airflow/issues/47832

   ### Apache Airflow version
   
   3.0.0
   
   ### If "Other Airflow 2 version" selected, which one?
   
   3.0.0b3
   
   ### What happened?
   
   I was attempting to pass data between @asset decorated tasks with the 
following code:
   
   ```python
   from airflow.sdk.definitions.asset.decorators import (
       asset,  # A
   )
   
   @asset(schedule="@daily")  # C
   def raw_quotes():  # D
       """
       Extracts a random set of quotes.
       """
       import requests  # E
   
       quotes = "Hello"
   
       return quotes  # F
   
   
   @asset(schedule=raw_quotes)  # A
   def selected_quotes(quotes=raw_quotes):  # B
       """
       Transforms the extracted quotes.
       """
   
       print(quotes)
   ```
   
   After unpausing both generated dags I ran the raw_quotes dag, which 
completes successfully, then triggers the selected_quotes dag. 
   
   This dag gets stuck in running state because the scheduler crashes with:
   
   ```
   scheduler  | File 
"/Users/tamara.fingerlin/.pyenv/versions/3.12.8/lib/python3.12/multiprocessing/queues.py",
 line 389, in get
   scheduler  | return _ForkingPickler.loads(res)
   scheduler  | ^^^^^^^^^^^^^^^^^^^^^^^^^^
   scheduler  | TypeError: ServerResponseError.__init__() missing 2 required 
keyword-only arguments: 'request' and 'response'
   scheduler  | [2025-03-16 18:02:03 +0100] [74940] [INFO] Shutting down: Master
   ```
   
   Full error log: 
   
   
[scheduler_logs.txt](https://github.com/user-attachments/files/19273718/scheduler_logs.txt)
   
   ### What you think should happen instead?
   
   Ideally the downstream asset should fetch the XCom returned from the 
upstream asset. If I got the syntax wrong, the downstream asset should fail 
with an error, without crashing the scheduler.
   
   ### How to reproduce
   
   1. Add the code provided above
   2. unpause both dags that are created
   3. run the raw_quotes dag
   4. see the error appear in the scheduler logs 
   
   ### Operating System
   
   Apple M1 Pro 15.3.1 
   
   ### Versions of Apache Airflow Providers
   
   None.
   
   ### Deployment
   
   Other
   
   ### Deployment details
   
   Standalone beta3.0.0 installed with this:
   
   ```
   uv pip install --find-links \
   https://dist.apache.org/repos/dist/dev/airflow/3.0.0b3/ \
      apache-airflow==3.0.0b3 \
      apache-airflow-task-sdk==1.0.0b3 \
      apache-airflow-providers-celery==3.10.4b3 \
      apache-airflow-providers-cncf-kubernetes==10.4.0b3 \
      apache-airflow-providers-common-compat==1.5.2b3 \
      apache-airflow-providers-fab==2.0.0b3 \
      apache-airflow-providers-openlineage==2.1.2b3 \
      apache-airflow-providers-standard==0.1.2b3
   ```
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to