josh-fell commented on issue #29202:
URL: https://github.com/apache/airflow/issues/29202#issuecomment-1407067718
Hi @rubenbriones!
Do you have another reproducible case? I'm unable to observe the same
behavior.
```py
import pendulum
from airflow.decorators import dag, task
@dag(
schedule="0 0 * * MON-FRI",
start_date=pendulum.datetime(2023, 1, 1, tz="UTC"),
catchup=False,
max_active_runs=1,
)
def etl():
@task
def get_symbols():
res = [('A', 1, 111), ('B', 2, 222)]
return res
@task
def extract(symbol_info, data_interval_end=None):
# Do some work...
return symbol_info
@task(trigger_rule="one_success")
def transform(symbol_info, data_interval_end=None):
# Do some work...
return symbol_info
@task(trigger_rule="one_success")
def load(symbol_info, data_interval_end=None):
# Do some work...
return symbol_info
# DAG
symbols = get_symbols()
raw_symbols_data = extract.expand(symbol_info=symbols)
clean_symbols_data = transform.expand(symbol_info=raw_symbols_data)
load.expand(symbol_info=clean_symbols_data)
etl() # <- only updated the call here.
```
<img width="1440" alt="image"
src="https://user-images.githubusercontent.com/48934154/215195938-41e0d484-f771-4785-b2f1-27cfe1c26f67.png">
In the code from the screenshot, can you confirm that nothing reduces the
number of mapped tasks from 32 to 1 between the `extract` and `transform` tasks?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]