1fanwang commented on issue #70953: URL: https://github.com/apache/airflow/issues/70953#issuecomment-5186653785
Verified [Strip GlueDataQualityOperator ruleset after rendering](https://github.com/apache/airflow/pull/70331) on `amazon 9.34.0rc1`. Works as intended. Airflow 3.3.0, two identical virtualenvs: one with the RC providers, one with the previous stable release. Same Dag, same command, run through the real task runner. The external transport is stubbed, and the stub asserts the value that actually reaches it. A `GlueDataQualityOperator` whose `rule_set` comes from a param, so the leading and trailing whitespace only exists after rendering. The stubbed `boto3` client asserts the ruleset string it is handed. ```bash # amazon 9.34.0rc1 AIRFLOW_HOME=$PWD/airflow_home \ AIRFLOW__CORE__DAGS_FOLDER=$PWD/dags_e2e/rc_70331_glue_ruleset \ .venv/bin/airflow dags test rc_70331_glue_ruleset # amazon 9.33.0, identical Dag AIRFLOW_HOME=$PWD/airflow_home_prev \ AIRFLOW__CORE__DAGS_FOLDER=$PWD/dags_e2e/rc_70331_glue_ruleset \ .venv-prev/bin/airflow dags test rc_70331_glue_ruleset ``` ``` # amazon 9.34.0rc1 RC_CHECK_OK ruleset sent to AWS = 'Rules = [ ColumnLength "review_id" = 9 ]' state=success # amazon 9.33.0 AttributeError: RuleSet must starts with Rules = [ and ends with ] state=failed ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
