john-jac commented on issue #18638: URL: https://github.com/apache/airflow/issues/18638#issuecomment-934571359
#17609 works as expected From: Jarek Potiuk ***@***.***> Reply-To: apache/airflow ***@***.***> Date: Thursday, September 30, 2021 at 6:26 AM To: apache/airflow ***@***.***> Cc: "Jackson, John" ***@***.***>, Mention ***@***.***> Subject: [apache/airflow] Status of testing Providers that were prepared on September 30, 2021 (#18638) Body I have a kind request for all the contributors to the latest provider packages release. Could you help us to test the RC versions of the providers and let us know in the comment, if the issue is addressed there. Providers that need testing Those are providers that require testing as there were some substantial changes introduced: Provider amazon: 2.3.0rc1<https://pypi.org/project/apache-airflow-providers-amazon/2.3.0rc1> * Add IAM Role Credentials to S3ToRedshiftTransfer and RedshiftToS3Transfer (#18156)<https://github.com/apache/airflow/pull/18156>: @john-jac<https://github.com/john-jac> * Adding missing replace param directive in docstring of SalesforceToS3Operator (#18241)<https://github.com/apache/airflow/pull/18241>: @josh-fell<https://github.com/josh-fell> * Added upsert method on S3ToRedshift operator (#18027)<https://github.com/apache/airflow/pull/18027>: @mariotaddeucci<https://github.com/mariotaddeucci> * Add Spark to the EMR cluster for the job flow examples (#17563)<https://github.com/apache/airflow/pull/17563>: @snolan-amount<https://github.com/snolan-amount> * Update s3_list.py (#18561)<https://github.com/apache/airflow/pull/18561>: @Xilorole<https://github.com/Xilorole> * ECSOperator realtime logging (#17626)<https://github.com/apache/airflow/pull/17626>: @codenamestif<https://github.com/codenamestif> * Deprecate default pod name in EKSPodOperator (#18036)<https://github.com/apache/airflow/pull/18036>: @mik-laj<https://github.com/mik-laj> * Aws secrets manager backend (#17448)<https://github.com/apache/airflow/pull/17448>: @JavierLopezT<https://github.com/JavierLopezT> * sftp_to_s3 stream file option (#17609)<https://github.com/apache/airflow/pull/17609>: @john-jac<https://github.com/john-jac> * AwsBaseHook make client_type & resource_type optional params for get_client_type & get_resource_type (#17987)<https://github.com/apache/airflow/pull/17987>: @eladkal<https://github.com/eladkal> * Delete unnecessary parameters in EKSPodOperator (#17960)<https://github.com/apache/airflow/pull/17960>: @mik-laj<https://github.com/mik-laj> * ECSOperator returns last logs when ECS task fails (#17209)<https://github.com/apache/airflow/pull/17209>: @pmalafosse<https://github.com/pmalafosse> * Refresh credentials for long-running pods on EKS (#17951)<https://github.com/apache/airflow/pull/17951>: @mik-laj<https://github.com/mik-laj> Provider apache.cassandra: 2.1.0rc1<https://pypi.org/project/apache-airflow-providers-apache-cassandra/2.1.0rc1> * Adding a default conn ID value for Apache Cassandra sensors (#18620)<https://github.com/apache/airflow/pull/18620>: @josh-fell<https://github.com/josh-fell> Provider apache.hdfs: 2.1.1rc1<https://pypi.org/project/apache-airflow-providers-apache-hdfs/2.1.1rc1> * hdfs provider: fix deprecation warning in WebHDFSHook (#18331)<https://github.com/apache/airflow/pull/18331>: @Aakcht<https://github.com/Aakcht> Provider apache.hive: 2.0.2rc1<https://pypi.org/project/apache-airflow-providers-apache-hive/2.0.2rc1> * HiveHook fix get_pandas_df() failure when it tries to read an empty table (#17777)<https://github.com/apache/airflow/pull/17777>: @iblaine<https://github.com/iblaine> Provider apache.livy: 2.1.0rc1<https://pypi.org/project/apache-airflow-providers-apache-livy/2.1.0rc1> * Fetching and logging Livy session logs for LivyOperator (#17393)<https://github.com/apache/airflow/pull/17393>: @sreenath-kamath<https://github.com/sreenath-kamath> Provider asana: 1.1.0rc1<https://pypi.org/project/apache-airflow-providers-asana/1.1.0rc1> * Use built-in cached_property on Python 3.8 for Asana provider (#17597)<https://github.com/apache/airflow/pull/17597>: @kaxil<https://github.com/kaxil> Provider cncf.kubernetes: 2.0.3rc1<https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/2.0.3rc1> * Fix KubernetesPodOperator reattach when not deleting pods (#18070)<https://github.com/apache/airflow/pull/18070>: @jedcunningham<https://github.com/jedcunningham> * Make Kubernetes job description fit on one log line (#18377)<https://github.com/apache/airflow/pull/18377>: @collinmcnulty<https://github.com/collinmcnulty> * Do not fail KubernetesPodOperator tasks if log following fails (#17649)<https://github.com/apache/airflow/pull/17649>: @baryluk<https://github.com/baryluk> Provider databricks: 2.0.2rc1<https://pypi.org/project/apache-airflow-providers-databricks/2.0.2rc1> * Move DB call out of DatabricksHook.__init__ (#18339)<https://github.com/apache/airflow/pull/18339>: @kaxil<https://github.com/kaxil> Provider docker: 2.2.0rc1<https://pypi.org/project/apache-airflow-providers-docker/2.2.0rc1> * Add a Docker Taskflow decorator (#15330)<https://github.com/apache/airflow/pull/15330>: @dimberman<https://github.com/dimberman> Provider elasticsearch: 2.0.3rc1<https://pypi.org/project/apache-airflow-providers-elasticsearch/2.0.3rc1> * Fix Invalid log order in ElasticsearchTaskHandler (#17551)<https://github.com/apache/airflow/pull/17551>: @suhanovv<https://github.com/suhanovv> * Adds secret backend and logging information to provider yaml (#17625)<https://github.com/apache/airflow/pull/17625>: @potiuk<https://github.com/potiuk> Provider exasol: 2.0.1rc1<https://pypi.org/project/apache-airflow-providers-exasol/2.0.1rc1> * ExasolHook get_pandas_df does not return pandas dataframe but None (#17850)<https://github.com/apache/airflow/pull/17850>: @Goodkat<https://github.com/Goodkat> Provider google: 6.0.0rc1<https://pypi.org/project/apache-airflow-providers-google/6.0.0rc1> * Migrate Google Cloud Build from Discovery API to Python SDK (#18184)<https://github.com/apache/airflow/pull/18184>: @ryanyuan<https://github.com/ryanyuan> * Add index to the dataset name to have separate dataset for each DAG (#18459)<https://github.com/apache/airflow/pull/18459>: @deedmitrij<https://github.com/deedmitrij> * Add missing init.py files for some test packages (#18142)<https://github.com/apache/airflow/pull/18142>: @potiuk<https://github.com/potiuk> * Add possibility to run DAGs from system tests and see DAGs logs (#17868)<https://github.com/apache/airflow/pull/17868>: @deedmitrij<https://github.com/deedmitrij> * Rename AzureDataLakeStorage to ADLS (#18493)<https://github.com/apache/airflow/pull/18493>: @eladkal<https://github.com/eladkal> * Make next_dagrun_info take a data interval (#18088)<https://github.com/apache/airflow/pull/18088>: @uranusjr<https://github.com/uranusjr> * Use parameters instead of params (#18143)<https://github.com/apache/airflow/pull/18143>: @msumit<https://github.com/msumit> * New google operator: SQLToGoogleSheetsOperator (#17887)<https://github.com/apache/airflow/pull/17887>: @mariotaddeucci<https://github.com/mariotaddeucci> * Fix part of Google system tests (#18494)<https://github.com/apache/airflow/pull/18494>: @mnojek<https://github.com/mnojek> * Fix kubernetes engine system test (#18548)<https://github.com/apache/airflow/pull/18548>: @deedmitrij<https://github.com/deedmitrij> * Fix BigQuery system test (#18373)<https://github.com/apache/airflow/pull/18373>: @deedmitrij<https://github.com/deedmitrij> * Fix error when create external table using table resource (#17998)<https://github.com/apache/airflow/pull/17998>: @tnyz<https://github.com/tnyz> * Fix BigQuery data extraction in BigQueryToMySqlOperator (#18073)<https://github.com/apache/airflow/pull/18073>: @wolfier<https://github.com/wolfier> * Fix providers tests in main branch with eager upgrades (#18040)<https://github.com/apache/airflow/pull/18040>: @potiuk<https://github.com/potiuk> * fix(CloudSqlProxyRunner): don't query connections from Airflow DB (#18006)<https://github.com/apache/airflow/pull/18006>: @m1racoli<https://github.com/m1racoli> * Remove check for at least one schema in GCSToBigquery (#18150)<https://github.com/apache/airflow/pull/18150>: @c-nuro<https://github.com/c-nuro> * deduplicate running jobs on BigQueryInsertJobOperator (#17496)<https://github.com/apache/airflow/pull/17496>: @blcksrx<https://github.com/blcksrx> Provider hashicorp: 2.1.1rc1<https://pypi.org/project/apache-airflow-providers-hashicorp/2.1.1rc1> * Fixing Vault AppRole authentication with CONN_URI (#18064)<https://github.com/apache/airflow/pull/18064>: @nathadfield<https://github.com/nathadfield> Provider jdbc: 2.0.1rc1<https://pypi.org/project/apache-airflow-providers-jdbc/2.0.1rc1> * Fix type annotations in OracleOperator, JdbcOperator, SqliteOperator (#17406)<https://github.com/apache/airflow/pull/17406>: @shadrus<https://github.com/shadrus> Provider microsoft.azure: 3.2.0rc1<https://pypi.org/project/apache-airflow-providers-microsoft-azure/3.2.0rc1> * Rename AzureDataLakeStorage to ADLS (#18493)<https://github.com/apache/airflow/pull/18493>: @eladkal<https://github.com/eladkal> * Creating ADF pipeline run operator, sensor + ADF custom conn fields (#17885)<https://github.com/apache/airflow/pull/17885>: @josh-fell<https://github.com/josh-fell> * Rename LocalToAzureDataLakeStorageOperator to LocalFilesystemToADLSOperator (#18168)<https://github.com/apache/airflow/pull/18168>: @eladkal<https://github.com/eladkal> * Rename FileToWasbOperator to LocalFilesystemToWasbOperator (#18109)<https://github.com/apache/airflow/pull/18109>: @eladkal<https://github.com/eladkal> * Fixed wasb hook attempting to create container when getting a blob client (#18287)<https://github.com/apache/airflow/pull/18287>: @ignaski<https://github.com/ignaski> * Removing redundant relabeling of ADX conn field (#18386)<https://github.com/apache/airflow/pull/18386>: @josh-fell<https://github.com/josh-fell> * Proper handling of Account URL custom conn field in AzureBatchHook (#18456)<https://github.com/apache/airflow/pull/18456>: @josh-fell<https://github.com/josh-fell> Provider microsoft.psrp: 1.0.1rc1<https://pypi.org/project/apache-airflow-providers-microsoft-psrp/1.0.1rc1> * Fix unexpected bug in exiting PSRPHook.client context manager (#18014)<https://github.com/apache/airflow/pull/18014>: @malthe<https://github.com/malthe> Provider mongo: 2.1.0rc1<https://pypi.org/project/apache-airflow-providers-mongo/2.1.0rc1> * Add Mongo projections to hook and transfer (#17379)<https://github.com/apache/airflow/pull/17379>: @JavierLopezT<https://github.com/JavierLopezT> * Import Hooks lazily individually in providers manager (#17682)<https://github.com/apache/airflow/pull/17682>: @potiuk<https://github.com/potiuk> Provider neo4j: 2.0.2rc1<https://pypi.org/project/apache-airflow-providers-neo4j/2.0.2rc1> * fix Neo4jHook to get the query response (#18007)<https://github.com/apache/airflow/pull/18007>: @minu7<https://github.com/minu7> Provider openfaas: 2.0.0rc1<https://pypi.org/project/apache-airflow-providers-openfaas/2.0.0rc1> * Auto-apply apply_default decorator (#15667)<https://github.com/apache/airflow/pull/15667>: @ashb<https://github.com/ashb> Provider papermill: 2.1.0rc1<https://pypi.org/project/apache-airflow-providers-papermill/2.1.0rc1> * Add support for templated fields in PapermillOperator (#18357)<https://github.com/apache/airflow/pull/18357>: @eladkal<https://github.com/eladkal> * Fix usage of range(len()) to enumerate (#18174)<https://github.com/apache/airflow/pull/18174>: @kaxil<https://github.com/kaxil> Provider postgres: 2.3.0rc1<https://pypi.org/project/apache-airflow-providers-postgres/2.3.0rc1> * Added upsert method on S3ToRedshift operator (#18027)<https://github.com/apache/airflow/pull/18027>: @mariotaddeucci<https://github.com/mariotaddeucci> * Fix example dag of PostgresOperator (#18236)<https://github.com/apache/airflow/pull/18236>: @eladkal<https://github.com/eladkal> Provider salesforce: 3.2.0rc1<https://pypi.org/project/apache-airflow-providers-salesforce/3.2.0rc1> * Adding JWT, IP filtering, and direct session login support for SalesforceHook (#17399)<https://github.com/apache/airflow/pull/17399>: @josh-fell<https://github.com/josh-fell> Provider samba: 3.0.0rc1<https://pypi.org/project/apache-airflow-providers-samba/3.0.0rc1> * Switch to 'smbprotocol' library (#17273)<https://github.com/apache/airflow/pull/17273>: @malthe<https://github.com/malthe> Provider slack: 4.1.0rc1<https://pypi.org/project/apache-airflow-providers-slack/4.1.0rc1> * Restore 'filename' to template_fields of SlackAPIFileOperator (#18466)<https://github.com/apache/airflow/pull/18466>: @SayTen<https://github.com/SayTen> Provider snowflake: 2.2.0rc1<https://pypi.org/project/apache-airflow-providers-snowflake/2.2.0rc1> * Add Snowflake DQ Operators (#17741)<https://github.com/apache/airflow/pull/17741>: @denimalpaca<https://github.com/denimalpaca> Provider sqlite: 2.0.1rc1<https://pypi.org/project/apache-airflow-providers-sqlite/2.0.1rc1> * Fix sqlite hook - insert and replace functions (#17695)<https://github.com/apache/airflow/pull/17695>: @subkanthi<https://github.com/subkanthi> Provider ssh: 2.2.0rc1<https://pypi.org/project/apache-airflow-providers-ssh/2.2.0rc1> * [Airflow 16364] Add conn_timeout and cmd_timeout params to SSHOperator; add conn_timeout param to SSHHook (#17236)<https://github.com/apache/airflow/pull/17236>: @fatmumuhomer<https://github.com/fatmumuhomer> Provider yandex: 2.1.0rc1<https://pypi.org/project/apache-airflow-providers-yandex/2.1.0rc1> * Add autoscaling subcluster support and remove defaults (#17033)<https://github.com/apache/airflow/pull/17033>: @peter-volkov<https://github.com/peter-volkov> Providers that do not need testing We have a number of providers that had doc-only changes so they are not released. Committer * I acknowledge that I am a maintainer/committer of the Apache Airflow project. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub<https://github.com/apache/airflow/issues/18638>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AR7SQOMM3YGGUHNSX5ZPBM3UERQOBANCNFSM5FCKXUEA>. Triage notifications on the go with GitHub Mobile for iOS<https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android<https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
