See <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/168/display/redirect>
------------------------------------------ [...truncated 158.95 KB...] root: DEBUG: Retrying request to url https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json after exception HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json>: response: <{'x-content-type-options': 'nosniff', 'content-type': 'application/json; charset=UTF-8', 'date': 'Thu, 27 Jun 2019 00:53:10 GMT', 'status': '503', 'server': 'ESF', 'x-xss-protection': '0', 'vary': 'Origin, X-Origin, Referer', 'cache-control': 'private', 'content-length': '122', 'x-frame-options': 'SAMEORIGIN', '-content-encoding': 'gzip', 'transfer-encoding': 'chunked'}>, content <{ "error": { "code": 503, "message": "The service is currently unavailable.", "status": "UNAVAILABLE" } } > root: DEBUG: Response returned status 503, retrying root: DEBUG: Retrying request to url https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json after exception HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json>: response: <{'x-content-type-options': 'nosniff', 'content-type': 'application/json; charset=UTF-8', 'date': 'Thu, 27 Jun 2019 00:53:45 GMT', 'status': '503', 'server': 'ESF', 'x-xss-protection': '0', 'vary': 'Origin, X-Origin, Referer', 'cache-control': 'private', 'content-length': '122', 'x-frame-options': 'SAMEORIGIN', '-content-encoding': 'gzip', 'transfer-encoding': 'chunked'}>, content <{ "error": { "code": 503, "message": "The service is currently unavailable.", "status": "UNAVAILABLE" } } > root: DEBUG: Response returned status 503, retrying root: DEBUG: Retrying request to url https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json after exception HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json>: response: <{'x-content-type-options': 'nosniff', 'content-type': 'application/json; charset=UTF-8', 'date': 'Thu, 27 Jun 2019 00:54:23 GMT', 'status': '503', 'server': 'ESF', 'x-xss-protection': '0', 'vary': 'Origin, X-Origin, Referer', 'cache-control': 'private', 'content-length': '122', 'x-frame-options': 'SAMEORIGIN', '-content-encoding': 'gzip', 'transfer-encoding': 'chunked'}>, content <{ "error": { "code": 503, "message": "The service is currently unavailable.", "status": "UNAVAILABLE" } } > root: ERROR: HTTP status 503 trying to create job at dataflow service endpoint https://dataflow.googleapis.com root: CRITICAL: details of server error: HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json>: response: <{'x-content-type-options': 'nosniff', 'content-type': 'application/json; charset=UTF-8', 'date': 'Thu, 27 Jun 2019 00:55:08 GMT', 'status': '503', 'server': 'ESF', 'x-xss-protection': '0', 'vary': 'Origin, X-Origin, Referer', 'cache-control': 'private', 'content-length': '122', 'x-frame-options': 'SAMEORIGIN', '-content-encoding': 'gzip', 'transfer-encoding': 'chunked'}>, content <{ "error": { "code": 503, "message": "The service is currently unavailable.", "status": "UNAVAILABLE" } } > root: WARNING: Retry with exponential backoff: waiting for 6.762469181253059 seconds before retrying submit_job_description because we caught exception: apitools.base.py.exceptions.BadStatusCodeError: HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json>: response: <{'x-content-type-options': 'nosniff', 'content-type': 'application/json; charset=UTF-8', 'date': 'Thu, 27 Jun 2019 00:55:08 GMT', 'status': '503', 'server': 'ESF', 'x-xss-protection': '0', 'vary': 'Origin, X-Origin, Referer', 'cache-control': 'private', 'content-length': '122', 'x-frame-options': 'SAMEORIGIN', '-content-encoding': 'gzip', 'transfer-encoding': 'chunked'}>, content <{ "error": { "code": 503, "message": "The service is currently unavailable.", "status": "UNAVAILABLE" } } > Traceback for above exception (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/src/sdks/python/apache_beam/utils/retry.py";,> line 197, in wrapper return fun(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py";,> line 585, in submit_job_description response = self._client.projects_locations_jobs.Create(request) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/src/sdks/python/apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py";,> line 657, in Create config, request, global_params=global_params) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/apitools/base/py/base_api.py";,> line 729, in _RunMethod http, http_request, **opts) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/apitools/base/py/http_wrapper.py";,> line 346, in MakeRequest check_response_func=check_response_func) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/apitools/base/py/http_wrapper.py";,> line 402, in _MakeRequestNoRetry check_response_func(response) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/apitools/base/py/http_wrapper.py";,> line 223, in CheckResponse raise exceptions.BadStatusCodeError.FromResponse(response) root: DEBUG: Response returned status 503, retrying root: DEBUG: Retrying request to url https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json after exception HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json>: response: <{'x-content-type-options': 'nosniff', 'content-type': 'application/json; charset=UTF-8', 'date': 'Thu, 27 Jun 2019 00:55:45 GMT', 'status': '503', 'server': 'ESF', 'x-xss-protection': '0', 'vary': 'Origin, X-Origin, Referer', 'cache-control': 'private', 'content-length': '122', 'x-frame-options': 'SAMEORIGIN', '-content-encoding': 'gzip', 'transfer-encoding': 'chunked'}>, content <{ "error": { "code": 503, "message": "The service is currently unavailable.", "status": "UNAVAILABLE" } } > root: DEBUG: Response returned status 429, retrying root: DEBUG: Retrying request to url https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json after exception HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json>: response: <{'x-content-type-options': 'nosniff', 'content-type': 'application/json; charset=UTF-8', 'date': 'Thu, 27 Jun 2019 00:55:47 GMT', 'status': '429', 'server': 'ESF', 'x-xss-protection': '0', 'vary': 'Origin, X-Origin, Referer', 'cache-control': 'private', 'content-length': '598', 'x-frame-options': 'SAMEORIGIN', '-content-encoding': 'gzip', 'transfer-encoding': 'chunked'}>, content <{ "error": { "code": 429, "message": "Quota exceeded for quota metric 'dataflow.googleapis.com/create_requests' and limit 'CreateRequestsPerMinutePerUser' of service 'dataflow.googleapis.com' for consumer 'project_number:844138762903'.", "status": "RESOURCE_EXHAUSTED", "details": [ { "@type": "type.googleapis.com/google.rpc.Help", "links": [ { "description": "Google developer console API key", "url": "https://console.developers.google.com/project/844138762903/apiui/credential"; } ] } ] } } > root: DEBUG: Response returned status 503, retrying root: DEBUG: Retrying request to url https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json after exception HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json>: response: <{'x-content-type-options': 'nosniff', 'content-type': 'application/json; charset=UTF-8', 'date': 'Thu, 27 Jun 2019 00:56:21 GMT', 'status': '503', 'server': 'ESF', 'x-xss-protection': '0', 'vary': 'Origin, X-Origin, Referer', 'cache-control': 'private', 'content-length': '122', 'x-frame-options': 'SAMEORIGIN', '-content-encoding': 'gzip', 'transfer-encoding': 'chunked'}>, content <{ "error": { "code": 503, "message": "The service is currently unavailable.", "status": "UNAVAILABLE" } } > root: DEBUG: Response returned status 503, retrying root: DEBUG: Retrying request to url https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json after exception HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json>: response: <{'x-content-type-options': 'nosniff', 'content-type': 'application/json; charset=UTF-8', 'date': 'Thu, 27 Jun 2019 00:57:00 GMT', 'status': '503', 'server': 'ESF', 'x-xss-protection': '0', 'vary': 'Origin, X-Origin, Referer', 'cache-control': 'private', 'content-length': '122', 'x-frame-options': 'SAMEORIGIN', '-content-encoding': 'gzip', 'transfer-encoding': 'chunked'}>, content <{ "error": { "code": 503, "message": "The service is currently unavailable.", "status": "UNAVAILABLE" } } > root: ERROR: HTTP status 503 trying to create job at dataflow service endpoint https://dataflow.googleapis.com root: CRITICAL: details of server error: HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json>: response: <{'x-content-type-options': 'nosniff', 'content-type': 'application/json; charset=UTF-8', 'date': 'Thu, 27 Jun 2019 00:57:43 GMT', 'status': '503', 'server': 'ESF', 'x-xss-protection': '0', 'vary': 'Origin, X-Origin, Referer', 'cache-control': 'private', 'content-length': '122', 'x-frame-options': 'SAMEORIGIN', '-content-encoding': 'gzip', 'transfer-encoding': 'chunked'}>, content <{ "error": { "code": 503, "message": "The service is currently unavailable.", "status": "UNAVAILABLE" } } > root: WARNING: Retry with exponential backoff: waiting for 11.675061428908474 seconds before retrying submit_job_description because we caught exception: apitools.base.py.exceptions.BadStatusCodeError: HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json>: response: <{'x-content-type-options': 'nosniff', 'content-type': 'application/json; charset=UTF-8', 'date': 'Thu, 27 Jun 2019 00:57:43 GMT', 'status': '503', 'server': 'ESF', 'x-xss-protection': '0', 'vary': 'Origin, X-Origin, Referer', 'cache-control': 'private', 'content-length': '122', 'x-frame-options': 'SAMEORIGIN', '-content-encoding': 'gzip', 'transfer-encoding': 'chunked'}>, content <{ "error": { "code": 503, "message": "The service is currently unavailable.", "status": "UNAVAILABLE" } } > Traceback for above exception (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/src/sdks/python/apache_beam/utils/retry.py";,> line 197, in wrapper return fun(*args, **kwargs) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py";,> line 585, in submit_job_description response = self._client.projects_locations_jobs.Create(request) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/src/sdks/python/apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py";,> line 657, in Create config, request, global_params=global_params) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/apitools/base/py/base_api.py";,> line 729, in _RunMethod http, http_request, **opts) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/apitools/base/py/http_wrapper.py";,> line 346, in MakeRequest check_response_func=check_response_func) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/apitools/base/py/http_wrapper.py";,> line 402, in _MakeRequestNoRetry check_response_func(response) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/apitools/base/py/http_wrapper.py";,> line 223, in CheckResponse raise exceptions.BadStatusCodeError.FromResponse(response) root: DEBUG: Response returned status 503, retrying root: DEBUG: Retrying request to url https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json after exception HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json>: response: <{'x-content-type-options': 'nosniff', 'content-type': 'application/json; charset=UTF-8', 'date': 'Thu, 27 Jun 2019 00:58:25 GMT', 'status': '503', 'server': 'ESF', 'x-xss-protection': '0', 'vary': 'Origin, X-Origin, Referer', 'cache-control': 'private', 'content-length': '122', 'x-frame-options': 'SAMEORIGIN', '-content-encoding': 'gzip', 'transfer-encoding': 'chunked'}>, content <{ "error": { "code": 503, "message": "The service is currently unavailable.", "status": "UNAVAILABLE" } } > root: DEBUG: Response returned status 503, retrying root: DEBUG: Retrying request to url https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json after exception HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json>: response: <{'x-content-type-options': 'nosniff', 'content-type': 'application/json; charset=UTF-8', 'date': 'Thu, 27 Jun 2019 00:58:57 GMT', 'status': '503', 'server': 'ESF', 'x-xss-protection': '0', 'vary': 'Origin, X-Origin, Referer', 'cache-control': 'private', 'content-length': '122', 'x-frame-options': 'SAMEORIGIN', '-content-encoding': 'gzip', 'transfer-encoding': 'chunked'}>, content <{ "error": { "code": 503, "message": "The service is currently unavailable.", "status": "UNAVAILABLE" } } > root: DEBUG: Response returned status 503, retrying root: DEBUG: Retrying request to url https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json after exception HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json>: response: <{'x-content-type-options': 'nosniff', 'content-type': 'application/json; charset=UTF-8', 'date': 'Thu, 27 Jun 2019 00:59:31 GMT', 'status': '503', 'server': 'ESF', 'x-xss-protection': '0', 'vary': 'Origin, X-Origin, Referer', 'cache-control': 'private', 'content-length': '122', 'x-frame-options': 'SAMEORIGIN', '-content-encoding': 'gzip', 'transfer-encoding': 'chunked'}>, content <{ "error": { "code": 503, "message": "The service is currently unavailable.", "status": "UNAVAILABLE" } } > root: DEBUG: Response returned status 503, retrying root: DEBUG: Retrying request to url https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json after exception HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json>: response: <{'x-content-type-options': 'nosniff', 'content-type': 'application/json; charset=UTF-8', 'date': 'Thu, 27 Jun 2019 01:00:10 GMT', 'status': '503', 'server': 'ESF', 'x-xss-protection': '0', 'vary': 'Origin, X-Origin, Referer', 'cache-control': 'private', 'content-length': '122', 'x-frame-options': 'SAMEORIGIN', '-content-encoding': 'gzip', 'transfer-encoding': 'chunked'}>, content <{ "error": { "code": 503, "message": "The service is currently unavailable.", "status": "UNAVAILABLE" } } > root: ERROR: HTTP status 503 trying to create job at dataflow service endpoint https://dataflow.googleapis.com root: CRITICAL: details of server error: HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs?alt=json>: response: <{'x-content-type-options': 'nosniff', 'content-type': 'application/json; charset=UTF-8', 'date': 'Thu, 27 Jun 2019 01:01:00 GMT', 'status': '503', 'server': 'ESF', 'x-xss-protection': '0', 'vary': 'Origin, X-Origin, Referer', 'cache-control': 'private', 'content-length': '122', 'x-frame-options': 'SAMEORIGIN', '-content-encoding': 'gzip', 'transfer-encoding': 'chunked'}>, content <{ "error": { "code": 503, "message": "The service is currently unavailable.", "status": "UNAVAILABLE" } } > apache_beam.io.filesystem: DEBUG: Listing files in 'gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1561596571083/results' apache_beam.io.filesystem: DEBUG: translate_pattern: 'gs://temp-storage-for-end-to-end-tests/py-it-cloud/output/1561596571083/results*' -> 'gs\\:\\/\\/temp\\-storage\\-for\\-end\\-to\\-end\\-tests\\/py\\-it\\-cloud\\/output\\/1561596571083\\/results[^/\\\\]*' root: DEBUG: Connecting using Google Application Default Credentials. root: INFO: Starting the size estimation of the input oauth2client.transport: INFO: Attempting refresh to obtain initial access_token root: INFO: Finished listing 0 files in 0.06815052032470703 seconds. root: DEBUG: Connecting using Google Application Default Credentials. --------------------- >> end captured logging << --------------------- ---------------------------------------------------------------------- XML: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 1 test in 689.293s FAILED (errors=1) FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py35:integrationTest'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org BUILD FAILED in 12m 26s 2019-06-27 01:01:02,128 9e2f1b07 MainThread beam_integration_benchmark(1/1) ERROR Error during benchmark beam_integration_benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 760, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 609, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,> line 160, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,> line 90, in SubmitJob assert retcode == 0, "Integration Test Failed." AssertionError: Integration Test Failed. 2019-06-27 01:01:02,130 9e2f1b07 MainThread beam_integration_benchmark(1/1) INFO Cleaning up benchmark beam_integration_benchmark 2019-06-27 01:01:02,132 9e2f1b07 MainThread beam_integration_benchmark(1/1) ERROR Exception running benchmark Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 903, in RunBenchmarkTask RunBenchmark(spec, collector) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 760, in RunBenchmark DoRunPhase(spec, collector, detailed_timer) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,> line 609, in DoRunPhase samples = spec.BenchmarkRun(spec) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,> line 160, in Run job_type=job_type) File "<https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,> line 90, in SubmitJob assert retcode == 0, "Integration Test Failed." AssertionError: Integration Test Failed. 2019-06-27 01:01:02,133 9e2f1b07 MainThread beam_integration_benchmark(1/1) ERROR Benchmark 1/1 beam_integration_benchmark (UID: beam_integration_benchmark0) failed. Execution will continue. 2019-06-27 01:01:02,133 9e2f1b07 MainThread beam_integration_benchmark(1/1) INFO Benchmark run statuses: --------------------------------------------------------------------------------- Name UID Status Failed Substatus --------------------------------------------------------------------------------- beam_integration_benchmark beam_integration_benchmark0 FAILED --------------------------------------------------------------------------------- Success rate: 0.00% (0/1) 2019-06-27 01:01:02,134 9e2f1b07 MainThread beam_integration_benchmark(1/1) INFO Complete logs can be found at: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/runs/9e2f1b07/pkb.log> 2019-06-27 01:01:02,134 9e2f1b07 MainThread beam_integration_benchmark(1/1) INFO Completion statuses can be found at: <https://builds.apache.org/job/beam_PerformanceTests_WordCountIT_Py35/ws/runs/9e2f1b07/completion_statuses.json> Build step 'Execute shell' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
