erdos2n opened a new issue, #23833:
URL: https://github.com/apache/airflow/issues/23833

   ### Apache Airflow version
   
   2.3.0 (latest released)
   
   ### What happened
   
   The following DAG was written and expected to generate 3 tasks (one for each 
string in the list)
   
   **dag_code**
   ```python
   import logging
   from airflow.decorators import dag, task
   from airflow.operators.python import PythonOperator
   
   from airflow.utils.dates import datetime
   
   
   def log_strings_operator(string, *args, **kwargs):
       logging.info("we've made it into the method")
       logging.info(f"operator log - {string}")
   
   
   @dag(
       dag_id='dynamic_dag_test',
       schedule_interval=None,
       start_date=datetime(2021, 1, 1),
       catchup=False,
       tags=['example', 'dynamic_tasks']
   )
   def tutorial_taskflow_api_etl():
       op2 = (PythonOperator
              .partial(task_id="logging_with_operator_task",
                       python_callable=log_strings_operator)
              .expand(op_kwargs=[{"string": "a"}, {"string": "b"}, {"string": 
"c"}]))
   
       return op2
   
   
   tutorial_etl_dag = tutorial_taskflow_api_etl()
   ```
   
   **error message**
   ```python
   Broken DAG: [/usr/local/airflow/dags/dynamic_dag_test.py] Traceback (most 
recent call last):
     File 
"/usr/local/lib/python3.9/site-packages/airflow/serialization/serialized_objects.py",
 line 343, in _serialize
       return SerializedBaseOperator.serialize_mapped_operator(var)
     File 
"/usr/local/lib/python3.9/site-packages/airflow/serialization/serialized_objects.py",
 line 608, in serialize_mapped_operator
       assert op_kwargs[Encoding.TYPE] == DAT.DICT
   TypeError: list indices must be integers or slices, not Encoding
   
   During handling of the above exception, another exception occurred:
   
   Traceback (most recent call last):
     File 
"/usr/local/lib/python3.9/site-packages/airflow/serialization/serialized_objects.py",
 line 1105, in to_dict
       json_dict = {"__version": cls.SERIALIZER_VERSION, "dag": 
cls.serialize_dag(var)}
     File 
"/usr/local/lib/python3.9/site-packages/airflow/serialization/serialized_objects.py",
 line 1013, in serialize_dag
       raise SerializationError(f'Failed to serialize DAG {dag.dag_id!r}: {e}')
   airflow.exceptions.SerializationError: Failed to serialize DAG 
'dynamic_dag_test': list indices must be integers or slices, not Encoding
   ```
   
   ### What you think should happen instead
   
   Dag should contain 1 task `logging_with_operator_task` that contains 3 
indices
   
   ### How to reproduce
   
   copy/paste dag code into a dag file and run on airflow 2.3.0. Airflow UI 
will flag the error
   
   ### Operating System
   
   Debian
   
   ### Versions of Apache Airflow Providers
   
   _No response_
   
   ### Deployment
   
   Astronomer
   
   ### Deployment details
   
   _No response_
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to