[
https://issues.apache.org/jira/browse/AIRFLOW-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16141894#comment-16141894
]
Daryl Erwin edited comment on AIRFLOW-1506 at 8/25/17 6:53 PM:
---------------------------------------------------------------
This appears to be needed to be able to enable the sql-admin scope to allow
access to the sql-cloud-proxy from the dataproc cluster.
I hardcoded in what I needed for now..
{code:java}
cluster_data = {
'projectId': self.project_id,
'clusterName': self.cluster_name,
'config': {
'gceClusterConfig': {
'zoneUri': zone_uri,
>>> This line 'serviceAccountScopes':
>>> ['https://www.googleapis.com/auth/sqlservice.admin'],
},
{code}
was (Author: derwin):
This appears to be needed to be able to enable the sql-admin scope to allow
access to the sql-cloud-proxy from the dataproc cluster.
> Improve DataprocClusterCreateOperator
> -------------------------------------
>
> Key: AIRFLOW-1506
> URL: https://issues.apache.org/jira/browse/AIRFLOW-1506
> Project: Apache Airflow
> Issue Type: Improvement
> Components: contrib, operators
> Reporter: Yu Ishikawa
>
> h2. Goals
> {{DataprocClusterCreateOperator}} should support {{$.
> gceClusterConfig.serviceAccountScopes}} to specify scopes for a Dataproc
> cluster.
> For example, I guess some users would like to store the result to Google
> Datastore and like this. In such a case, we have to put additional scopes to
> access to the produces from the Dataproc cluster.
> https://cloud.google.com/dataproc/docs/reference/rest/v1/projects.regions.clusters#gceclusterconfig
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
