1fanwang commented on issue #70953:
URL: https://github.com/apache/airflow/issues/70953#issuecomment-5186658950

   Verified [Move template-field checks out of `__init__` in Hive 
sensors](https://github.com/apache/airflow/pull/70334) on `apache-hive 
9.6.1rc1`. Works as intended.
   
   Airflow 3.3.0, two identical virtualenvs: one with the RC providers, one 
with the previous stable release. Same Dag, same command, run through the real 
task runner. The external transport is stubbed, and the stub asserts the value 
that actually reaches it.
   
   A `NamedHivePartitionSensor` with a templated partition name. 
`HiveMetastoreHook` is stubbed and asserts the schema, table and partition it 
is asked about.
   
   ```bash
   # apache-hive 9.6.1rc1
   AIRFLOW_HOME=$PWD/airflow_home \
   AIRFLOW__CORE__DAGS_FOLDER=$PWD/dags_e2e/rc_70334_hive_partitions \
     .venv/bin/airflow dags test rc_70334_hive_partitions
   
   # apache-hive 9.6.0, identical Dag
   AIRFLOW_HOME=$PWD/airflow_home_prev \
   AIRFLOW__CORE__DAGS_FOLDER=$PWD/dags_e2e/rc_70334_hive_partitions \
     .venv-prev/bin/airflow dags test rc_70334_hive_partitions
   ```
   
   ```
   # apache-hive 9.6.1rc1
   RC_CHECK_OK metastore queried schema='airflow' 
table='static_babynames_partitioned' partition='ds=2020-01-01'
   state=success
   
   # apache-hive 9.6.0, no task ever runs because the Dag does not import
   Error loading DAG from rc_70334_hive_partitions.py:
   TypeError: partition_names must be an array of strings
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to