[ 
https://issues.apache.org/jira/browse/BEAM-8195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16926861#comment-16926861
 ] 

yifan zou commented on BEAM-8195:
---------------------------------

We already set the quota of CreateRequestsPerMinutePerUser to its maximum 
number 60. Couldn't add more on it. 
[https://pantheon.corp.google.com/apis/api/dataflow.googleapis.com/quotas?project=apache-beam-testing&duration=PT6H]

I guess all jobs were created by the user "jenkins". We need consider to apply 
different users when creating the job (Job creation requests per minute is 
unlimited), or reduce the concurrent tests running on workers.

> Quota exceeded for create requests
> ----------------------------------
>
>                 Key: BEAM-8195
>                 URL: https://issues.apache.org/jira/browse/BEAM-8195
>             Project: Beam
>          Issue Type: Sub-task
>          Components: sdk-py-core, testing
>            Reporter: Ahmet Altay
>            Assignee: yifan zou
>            Priority: Critical
>
> Post commits failied with the following error:
> HttpError accessing 
> <https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json>:
>  response: <{'server': 'ESF', '-content-encoding': 'gzip', 'content-type': 
> 'application/json; charset=UTF-8', 'content-length': '598', 
> 'transfer-encoding': 'chunked', 'cache-control': 'private', 
> 'x-xss-protection': '0', 'date': 'Tue, 10 Sep 2019 12:02:24 GMT', 'vary': 
> 'Origin, X-Origin, Referer', 'x-frame-options': 'SAMEORIGIN', 'status': 
> '429', 'x-content-type-options': 'nosniff'}>, content <{
>   "error": {
>     "code": 429,
>     "message": "Quota exceeded for quota metric 
> 'dataflow.googleapis.com/create_requests' and limit 
> 'CreateRequestsPerMinutePerUser' of service 'dataflow.googleapis.com' for 
> consumer 'project_number:844138762903'.",
>     "status": "RESOURCE_EXHAUSTED",
>     "details": [
>       {
> Could we increase the quota?
> /cc [~alanmyrvold] [~kenn]



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

Reply via email to