denimalpaca commented on issue #18638: URL: https://github.com/apache/airflow/issues/18638#issuecomment-933663115
I've tested 17741 running tests and seeing the operators work in a breeze environment and Snowflake backend. -Benji On Thu, Sep 30, 2021 at 9:25 AM Jarek Potiuk ***@***.***> wrote: > Body > > I have a kind request for all the contributors to the latest provider > packages release. > Could you help us to test the RC versions of the providers and let us know > in the comment, > if the issue is addressed there. > Providers that need testing > > Those are providers that require testing as there were some substantial > changes introduced: > Provider amazon: 2.3.0rc1 > <https://pypi.org/project/apache-airflow-providers-amazon/2.3.0rc1> > > - Add IAM Role Credentials to S3ToRedshiftTransfer and > RedshiftToS3Transfer (#18156) > <https://github.com/apache/airflow/pull/18156>: @john-jac > <https://github.com/john-jac> > - Adding missing replace param directive in docstring of > SalesforceToS3Operator (#18241) > <https://github.com/apache/airflow/pull/18241>: @josh-fell > <https://github.com/josh-fell> > - Added upsert method on S3ToRedshift operator (#18027) > <https://github.com/apache/airflow/pull/18027>: @mariotaddeucci > <https://github.com/mariotaddeucci> > - Add Spark to the EMR cluster for the job flow examples (#17563) > <https://github.com/apache/airflow/pull/17563>: @snolan-amount > <https://github.com/snolan-amount> > - Update s3_list.py (#18561) > <https://github.com/apache/airflow/pull/18561>: @Xilorole > <https://github.com/Xilorole> > - ECSOperator realtime logging (#17626) > <https://github.com/apache/airflow/pull/17626>: @codenamestif > <https://github.com/codenamestif> > - Deprecate default pod name in EKSPodOperator (#18036) > <https://github.com/apache/airflow/pull/18036>: @mik-laj > <https://github.com/mik-laj> > - Aws secrets manager backend (#17448) > <https://github.com/apache/airflow/pull/17448>: @JavierLopezT > <https://github.com/JavierLopezT> > - sftp_to_s3 stream file option (#17609) > <https://github.com/apache/airflow/pull/17609>: @john-jac > <https://github.com/john-jac> > - AwsBaseHook make client_type & resource_type optional params for > get_client_type & get_resource_type (#17987) > <https://github.com/apache/airflow/pull/17987>: @eladkal > <https://github.com/eladkal> > - Delete unnecessary parameters in EKSPodOperator (#17960) > <https://github.com/apache/airflow/pull/17960>: @mik-laj > <https://github.com/mik-laj> > - ECSOperator returns last logs when ECS task fails (#17209) > <https://github.com/apache/airflow/pull/17209>: @pmalafosse > <https://github.com/pmalafosse> > - Refresh credentials for long-running pods on EKS (#17951) > <https://github.com/apache/airflow/pull/17951>: @mik-laj > <https://github.com/mik-laj> > > Provider apache.cassandra: 2.1.0rc1 > <https://pypi.org/project/apache-airflow-providers-apache-cassandra/2.1.0rc1> > > - Adding a default conn ID value for Apache Cassandra sensors (#18620) > <https://github.com/apache/airflow/pull/18620>: @josh-fell > <https://github.com/josh-fell> > > Provider apache.hdfs: 2.1.1rc1 > <https://pypi.org/project/apache-airflow-providers-apache-hdfs/2.1.1rc1> > > - hdfs provider: fix deprecation warning in WebHDFSHook (#18331) > <https://github.com/apache/airflow/pull/18331>: @Aakcht > <https://github.com/Aakcht> > > Provider apache.hive: 2.0.2rc1 > <https://pypi.org/project/apache-airflow-providers-apache-hive/2.0.2rc1> > > - HiveHook fix get_pandas_df() failure when it tries to read an empty > table (#17777) <https://github.com/apache/airflow/pull/17777>: @iblaine > <https://github.com/iblaine> > > Provider apache.livy: 2.1.0rc1 > <https://pypi.org/project/apache-airflow-providers-apache-livy/2.1.0rc1> > > - Fetching and logging Livy session logs for LivyOperator (#17393) > <https://github.com/apache/airflow/pull/17393>: @sreenath-kamath > <https://github.com/sreenath-kamath> > > Provider asana: 1.1.0rc1 > <https://pypi.org/project/apache-airflow-providers-asana/1.1.0rc1> > > - Use built-in cached_property on Python 3.8 for Asana provider > (#17597) <https://github.com/apache/airflow/pull/17597>: @kaxil > <https://github.com/kaxil> > > Provider cncf.kubernetes: 2.0.3rc1 > <https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/2.0.3rc1> > > - Fix KubernetesPodOperator reattach when not deleting pods (#18070) > <https://github.com/apache/airflow/pull/18070>: @jedcunningham > <https://github.com/jedcunningham> > - Make Kubernetes job description fit on one log line (#18377) > <https://github.com/apache/airflow/pull/18377>: @collinmcnulty > <https://github.com/collinmcnulty> > - Do not fail KubernetesPodOperator tasks if log following fails > (#17649) <https://github.com/apache/airflow/pull/17649>: @baryluk > <https://github.com/baryluk> > > Provider databricks: 2.0.2rc1 > <https://pypi.org/project/apache-airflow-providers-databricks/2.0.2rc1> > > - Move DB call out of DatabricksHook.__init__ (#18339) > <https://github.com/apache/airflow/pull/18339>: @kaxil > <https://github.com/kaxil> > > Provider docker: 2.2.0rc1 > <https://pypi.org/project/apache-airflow-providers-docker/2.2.0rc1> > > - Add a Docker Taskflow decorator (#15330) > <https://github.com/apache/airflow/pull/15330>: @dimberman > <https://github.com/dimberman> > > Provider elasticsearch: 2.0.3rc1 > <https://pypi.org/project/apache-airflow-providers-elasticsearch/2.0.3rc1> > > - Fix Invalid log order in ElasticsearchTaskHandler (#17551) > <https://github.com/apache/airflow/pull/17551>: @suhanovv > <https://github.com/suhanovv> > - Adds secret backend and logging information to provider yaml (#17625) > <https://github.com/apache/airflow/pull/17625>: @potiuk > <https://github.com/potiuk> > > Provider exasol: 2.0.1rc1 > <https://pypi.org/project/apache-airflow-providers-exasol/2.0.1rc1> > > - ExasolHook get_pandas_df does not return pandas dataframe but None > (#17850) <https://github.com/apache/airflow/pull/17850>: @Goodkat > <https://github.com/Goodkat> > > Provider google: 6.0.0rc1 > <https://pypi.org/project/apache-airflow-providers-google/6.0.0rc1> > > - Migrate Google Cloud Build from Discovery API to Python SDK (#18184) > <https://github.com/apache/airflow/pull/18184>: @ryanyuan > <https://github.com/ryanyuan> > - Add index to the dataset name to have separate dataset for each DAG > (#18459) <https://github.com/apache/airflow/pull/18459>: @deedmitrij > <https://github.com/deedmitrij> > - Add missing *init*.py files for some test packages (#18142) > <https://github.com/apache/airflow/pull/18142>: @potiuk > <https://github.com/potiuk> > - Add possibility to run DAGs from system tests and see DAGs logs > (#17868) <https://github.com/apache/airflow/pull/17868>: @deedmitrij > <https://github.com/deedmitrij> > - Rename AzureDataLakeStorage to ADLS (#18493) > <https://github.com/apache/airflow/pull/18493>: @eladkal > <https://github.com/eladkal> > - Make next_dagrun_info take a data interval (#18088) > <https://github.com/apache/airflow/pull/18088>: @uranusjr > <https://github.com/uranusjr> > - Use parameters instead of params (#18143) > <https://github.com/apache/airflow/pull/18143>: @msumit > <https://github.com/msumit> > - New google operator: SQLToGoogleSheetsOperator (#17887) > <https://github.com/apache/airflow/pull/17887>: @mariotaddeucci > <https://github.com/mariotaddeucci> > - Fix part of Google system tests (#18494) > <https://github.com/apache/airflow/pull/18494>: @mnojek > <https://github.com/mnojek> > - Fix kubernetes engine system test (#18548) > <https://github.com/apache/airflow/pull/18548>: @deedmitrij > <https://github.com/deedmitrij> > - Fix BigQuery system test (#18373) > <https://github.com/apache/airflow/pull/18373>: @deedmitrij > <https://github.com/deedmitrij> > - Fix error when create external table using table resource (#17998) > <https://github.com/apache/airflow/pull/17998>: @tnyz > <https://github.com/tnyz> > - Fix BigQuery data extraction in BigQueryToMySqlOperator (#18073) > <https://github.com/apache/airflow/pull/18073>: @wolfier > <https://github.com/wolfier> > - Fix providers tests in main branch with eager upgrades (#18040) > <https://github.com/apache/airflow/pull/18040>: @potiuk > <https://github.com/potiuk> > - fix(CloudSqlProxyRunner): don't query connections from Airflow DB > (#18006) <https://github.com/apache/airflow/pull/18006>: @m1racoli > <https://github.com/m1racoli> > - Remove check for at least one schema in GCSToBigquery (#18150) > <https://github.com/apache/airflow/pull/18150>: @c-nuro > <https://github.com/c-nuro> > - deduplicate running jobs on BigQueryInsertJobOperator (#17496) > <https://github.com/apache/airflow/pull/17496>: @blcksrx > <https://github.com/blcksrx> > > Provider hashicorp: 2.1.1rc1 > <https://pypi.org/project/apache-airflow-providers-hashicorp/2.1.1rc1> > > - Fixing Vault AppRole authentication with CONN_URI (#18064) > <https://github.com/apache/airflow/pull/18064>: @nathadfield > <https://github.com/nathadfield> > > Provider jdbc: 2.0.1rc1 > <https://pypi.org/project/apache-airflow-providers-jdbc/2.0.1rc1> > > - Fix type annotations in OracleOperator, JdbcOperator, SqliteOperator > (#17406) <https://github.com/apache/airflow/pull/17406>: @shadrus > <https://github.com/shadrus> > > Provider microsoft.azure: 3.2.0rc1 > <https://pypi.org/project/apache-airflow-providers-microsoft-azure/3.2.0rc1> > > - Rename AzureDataLakeStorage to ADLS (#18493) > <https://github.com/apache/airflow/pull/18493>: @eladkal > <https://github.com/eladkal> > - Creating ADF pipeline run operator, sensor + ADF custom conn fields > (#17885) <https://github.com/apache/airflow/pull/17885>: @josh-fell > <https://github.com/josh-fell> > - Rename LocalToAzureDataLakeStorageOperator to > LocalFilesystemToADLSOperator (#18168) > <https://github.com/apache/airflow/pull/18168>: @eladkal > <https://github.com/eladkal> > - Rename FileToWasbOperator to LocalFilesystemToWasbOperator (#18109) > <https://github.com/apache/airflow/pull/18109>: @eladkal > <https://github.com/eladkal> > - Fixed wasb hook attempting to create container when getting a blob > client (#18287) <https://github.com/apache/airflow/pull/18287>: > @ignaski <https://github.com/ignaski> > - Removing redundant relabeling of ADX conn field (#18386) > <https://github.com/apache/airflow/pull/18386>: @josh-fell > <https://github.com/josh-fell> > - Proper handling of Account URL custom conn field in AzureBatchHook > (#18456) <https://github.com/apache/airflow/pull/18456>: @josh-fell > <https://github.com/josh-fell> > > Provider microsoft.psrp: 1.0.1rc1 > <https://pypi.org/project/apache-airflow-providers-microsoft-psrp/1.0.1rc1> > > - Fix unexpected bug in exiting PSRPHook.client context manager > (#18014) <https://github.com/apache/airflow/pull/18014>: @malthe > <https://github.com/malthe> > > Provider mongo: 2.1.0rc1 > <https://pypi.org/project/apache-airflow-providers-mongo/2.1.0rc1> > > - Add Mongo projections to hook and transfer (#17379) > <https://github.com/apache/airflow/pull/17379>: @JavierLopezT > <https://github.com/JavierLopezT> > - Import Hooks lazily individually in providers manager (#17682) > <https://github.com/apache/airflow/pull/17682>: @potiuk > <https://github.com/potiuk> > > Provider neo4j: 2.0.2rc1 > <https://pypi.org/project/apache-airflow-providers-neo4j/2.0.2rc1> > > - fix Neo4jHook to get the query response (#18007) > <https://github.com/apache/airflow/pull/18007>: @minu7 > <https://github.com/minu7> > > Provider openfaas: 2.0.0rc1 > <https://pypi.org/project/apache-airflow-providers-openfaas/2.0.0rc1> > > - Auto-apply apply_default decorator (#15667) > <https://github.com/apache/airflow/pull/15667>: @ashb > <https://github.com/ashb> > > Provider papermill: 2.1.0rc1 > <https://pypi.org/project/apache-airflow-providers-papermill/2.1.0rc1> > > - Add support for templated fields in PapermillOperator (#18357) > <https://github.com/apache/airflow/pull/18357>: @eladkal > <https://github.com/eladkal> > - Fix usage of range(len()) to enumerate (#18174) > <https://github.com/apache/airflow/pull/18174>: @kaxil > <https://github.com/kaxil> > > Provider postgres: 2.3.0rc1 > <https://pypi.org/project/apache-airflow-providers-postgres/2.3.0rc1> > > - Added upsert method on S3ToRedshift operator (#18027) > <https://github.com/apache/airflow/pull/18027>: @mariotaddeucci > <https://github.com/mariotaddeucci> > - Fix example dag of PostgresOperator (#18236) > <https://github.com/apache/airflow/pull/18236>: @eladkal > <https://github.com/eladkal> > > Provider salesforce: 3.2.0rc1 > <https://pypi.org/project/apache-airflow-providers-salesforce/3.2.0rc1> > > - Adding JWT, IP filtering, and direct session login support for > SalesforceHook (#17399) <https://github.com/apache/airflow/pull/17399>: > @josh-fell <https://github.com/josh-fell> > > Provider samba: 3.0.0rc1 > <https://pypi.org/project/apache-airflow-providers-samba/3.0.0rc1> > > - Switch to 'smbprotocol' library (#17273) > <https://github.com/apache/airflow/pull/17273>: @malthe > <https://github.com/malthe> > > Provider slack: 4.1.0rc1 > <https://pypi.org/project/apache-airflow-providers-slack/4.1.0rc1> > > - Restore 'filename' to template_fields of SlackAPIFileOperator > (#18466) <https://github.com/apache/airflow/pull/18466>: @SayTen > <https://github.com/SayTen> > > Provider snowflake: 2.2.0rc1 > <https://pypi.org/project/apache-airflow-providers-snowflake/2.2.0rc1> > > - Add Snowflake DQ Operators (#17741) > <https://github.com/apache/airflow/pull/17741>: @denimalpaca > <https://github.com/denimalpaca> > > Provider sqlite: 2.0.1rc1 > <https://pypi.org/project/apache-airflow-providers-sqlite/2.0.1rc1> > > - Fix sqlite hook - insert and replace functions (#17695) > <https://github.com/apache/airflow/pull/17695>: @subkanthi > <https://github.com/subkanthi> > > Provider ssh: 2.2.0rc1 > <https://pypi.org/project/apache-airflow-providers-ssh/2.2.0rc1> > > - [Airflow 16364] Add conn_timeout and cmd_timeout params to > SSHOperator; add conn_timeout param to SSHHook (#17236) > <https://github.com/apache/airflow/pull/17236>: @fatmumuhomer > <https://github.com/fatmumuhomer> > > Provider yandex: 2.1.0rc1 > <https://pypi.org/project/apache-airflow-providers-yandex/2.1.0rc1> > > - Add autoscaling subcluster support and remove defaults (#17033) > <https://github.com/apache/airflow/pull/17033>: @peter-volkov > <https://github.com/peter-volkov> > > Providers that do not need testing > > We have a number of providers that had doc-only changes so they are not > released. > Committer > > - I acknowledge that I am a maintainer/committer of the Apache Airflow > project. > > — > You are receiving this because you were mentioned. > Reply to this email directly, view it on GitHub > <https://github.com/apache/airflow/issues/18638>, or unsubscribe > <https://github.com/notifications/unsubscribe-auth/AAUH2372VWWXUZNIXO6C2TDUERQNRANCNFSM5FCKXUEA> > . > Triage notifications on the go with GitHub Mobile for iOS > <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> > or Android > <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>. > > -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
