kaxil commented on a change in pull request #4541: [AIRFLOW-3713] Updated documentation for GCP optional project_id URL: https://github.com/apache/airflow/pull/4541#discussion_r248448674
########## File path: UPDATING.md ########## @@ -24,10 +24,73 @@ assists users migrating to a new version. ## Airflow Master +## Changes in Google Cloud Platform related operators + +Most GCP-related operators have now optional `PROJECT_ID` parameter. In case you do not specify it, +the project id configured in +[GCP Connection](https://airflow.apache.org/howto/manage-connections.html#connection-type-gcp) is used. +There will be an `AifrlowException` thrown in case `PROJECT_ID` parameter is not specified and the +connection used has no project id defined. This change should be backwards compatible as earlier version +of the operators had `PROJECT_ID` mandatory. + +Operators involved: + + * GCP Bigtable Operators + * BigtableInstanceCreateOperator + * BigtableInstanceDeleteOperator + * BigtableTableCreateOperator + * BigtableTableDeleteOperator + * BigtableClusterUpdateOperator + * BigtableTableWaitForReplicationSensor + * GCP Compute Operators + * GceInstanceStartOperator + * GceInstanceStopOperator + * GceSetMachineTypeOperator + * GceInstanceTemplateCopyOperator + * GceInstanceGroupManagerUpdateTemplateOperator + * GCP Function Operators + * GcfFunctionDeployOperator + * GCP Spanner Operators + * CloudSpannerInstanceDeployOperator + * CloudSpannerInstanceDeleteOperator + * CloudSpannerInstanceDatabaseQueryOperator + * CloudSpannerInstanceDatabaseDeployOperator + * CloudSpannerInstanceDatabaseUpdateOperator + * CloudSpannerInstanceDatabaseDeleteOperator + * GCP Cloud SQL Operators + * CloudSqlInstanceCreateOperator + * CloudSqlInstancePatchOperator + * CloudSqlInstanceDeleteOperator + * CloudSqlInstanceDatabaseCreateOperator + * CloudSqlInstanceDatabasePatchOperator + * CloudSqlInstanceDatabaseDeleteOperator + * CloudSqlInstanceExportOperator + * CloudSqlInstanceImportOperator + * CloudSqlQueryOperator (project_id might be omitted from the extras of cloudsql URL) + +Other GCP operators are unaffected. + +## Changes in Google Cloud Platform related hooks + +The change in GCP operatorsimplies that GCP Hooks for those operators require now keyword parameters rather +than positional ones in all methods where `project_id` is used. The methods throw an explanatory exception +in case they are called using positional parameters. + +Hooks involved: + + * BigtableHook + * GceHook + * GcfHook + * CloudSpannerHook + * CloudSqlHook + * CloudSqlProxyRunner (not technically a hook) + Review comment: The same comment. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
