Luke Cwik created BEAM-2264:
-------------------------------
Summary: Re-use credential instead of generating a new one one
each GCS call
Key: BEAM-2264
URL: https://issues.apache.org/jira/browse/BEAM-2264
Project: Beam
Issue Type: Improvement
Components: sdk-py
Reporter: Luke Cwik
Assignee: Ahmet Altay
Priority: Minor
We should cache the credential used within a Pipeline and re-use it instead of
generating a new one on each GCS call.
{code}
super(GcsIO, cls).__new__(cls, storage_client))
INFO:root:Starting the size estimation of the input
INFO:oauth2client.transport:Attempting refresh to obtain initial access_token
INFO:oauth2client.client:Refreshing access_token
INFO:root:Finished the size estimation of the input at 1 files. Estimation took
0.286200046539 seconds
INFO:root:Running pipeline with DirectRunner.
INFO:root:Starting the size estimation of the input
INFO:oauth2client.transport:Attempting refresh to obtain initial access_token
INFO:oauth2client.client:Refreshing access_token
INFO:root:Finished the size estimation of the input at 43 files. Estimation
took 0.205624818802 seconds
INFO:oauth2client.transport:Attempting refresh to obtain initial access_token
INFO:oauth2client.client:Refreshing access_token
INFO:oauth2client.transport:Attempting refresh to obtain initial access_token
INFO:oauth2client.client:Refreshing access_token
INFO:oauth2client.transport:Attempting refresh to obtain initial access_token
INFO:oauth2client.client:Refreshing access_token
INFO:oauth2client.transport:Attempting refresh to obtain initial access_token
INFO:oauth2client.client:Refreshing access_token
INFO:oauth2client.transport:Attempting refresh to obtain initial access_token
... many more times ...
{code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
