potiuk edited a comment on issue #11660: URL: https://github.com/apache/airflow/issues/11660#issuecomment-724588604
@muscovitebob 0 I believe indeed it is a dependency problem that is very likely to be addressed in the last version of composer image. From what we know the Composer team keeps the images updated with the releases of Apache Airlfow and the providers and the next image will even include the latest google providers baked, but you should try to install the latest provider there. Note that there is a new version of google provider as a release candidate (voting on it finishes on Thursday) so you might even try to install this version instead https://pypi.org/project/apache-airflow-backport-providers-google/2020.11.13rc1/ It has even more fixes: Commit | Committed | Subject -- | -- | -- b2a28d159 | 2020-11-09 | Moves provider packages scripts to dev (#12082) fcb6b00ef | 2020-11-08 | Add authentication to AWS with Google credentials (#12079) 2ef3b7ef8 | 2020-11-08 | Fix ERROR - Object of type 'bytes' is not JSON serializable when using store_to_xcom_key parameter (#12172) 0caec9fd3 | 2020-11-06 | Dataflow - add waiting for successful job cancel (#11501) cf9437d79 | 2020-11-06 | Simplify string expressions (#12123) 91a64db50 | 2020-11-04 | Format all files (without excepions) by black (#12091) fd3db778e | 2020-11-04 | Add server side cursor support for postgres to GCS operator (#11793) f1f194026 | 2020-11-04 | Add DataflowStartSQLQuery operator (#8553) 41bf172c1 | 2020-11-04 | Simplify string expressions (#12093) 5f5244b74 | 2020-11-04 | Add template fields renderers to Biguery and Dataproc operators (#12067) 4e8f9cc8d | 2020-11-03 | Enable Black - Python Auto Formmatter (#9550) 8c42cf1b0 | 2020-11-03 | Use PyUpgrade to use Python 3.6 features (#11447) 45ae145c2 | 2020-11-03 | Log BigQuery job id in insert method of BigQueryHook (#12056) e324b37a6 | 2020-11-03 | Add job name and progress logs to Cloud Storage Transfer Hook (#12014) 6071fdd58 | 2020-11-02 | Improve handling server errors in DataprocSubmitJobOperator (#11947) 2f703df12 | 2020-10-30 | Add SalesforceToGcsOperator (#10760) e5713e00b | 2020-10-29 | Add drain option when canceling Dataflow pipelines (#11374) 37eaac3c5 | 2020-10-29 | The PRs which are not approved run subset of tests (#11828) 79cb77199 | 2020-10-28 | Fixing re pattern and changing to use a single character class. (#11857) 5a439e84e | 2020-10-26 | Prepare providers release 0.0.2a1 (#11855) 240c7d4d7 | 2020-10-26 | Google Memcached hooks - improve protobuf messages handling (#11743) 8afdb6ac6 | 2020-10-26 | Fix spellings (#11825) 872b1566a | 2020-10-25 | Generated backport providers readmes/setup for 2020.10.29 (#11826) b680bbc0b | 2020-10-24 | Generated backport providers readmes/setup for 2020.10.29 ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
