See
<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/988/display/redirect?page=changes>
Changes:
[lcwik] [BEAM-3204] Clean-up Coder to only contain FunctionSpec removing
[lukecwik] [BEAM-3204] Clean-up Go code related to removing SdkFunctionSpec
layer
[lukecwik] [BEAM-3204] Update Python SDK Coder to only use FunctionSpec instead
of
[lukecwik] fixup! Fix missed Python coder change
[robert] [BEAM-5354] Add side input nodes to their consumer's parent-scope.
------------------------------------------
[...truncated 472.18 KB...]
],
"is_wrapper": true
},
"output_name": "out",
"user_name": "assert_that/Match.out"
}
],
"parallel_input": {
"@type": "OutputReference",
"output_name": "out",
"step_name": "s14"
},
"serialized_fn":
"eNq9VGtz3DQUlXeTNnUTaFMoLeWR8igO0DVtedMHZdMXSzfBDY2ABCHb2pWJbflaMmlmYgam453+Sf4L195N00DSj8zO7uoeSUfn3nOlP9tOwDMeSMF8wZOOyXmqBypPdCdQubC7PI65H4u1nGeZyJfU7dQGsvgXWCW0HNomhLBBCu0gjOK4w+pfmwW54EawQZEGJlK4YcrZNx8rHjKznQkbpukMUnRVKFYxhiMVHPVgxulZPYLfVu9Ud+4JITuEPLbI0CIP4Fi/AnuRWrjrERyvYJZqHLpSJcL9TaSbUap3/y/qmP8u3C2Vb2pMUbh1hmxFadNVSRIZtrJtpEqvsIcijwbbrs4DV4eb2s0a3H2mLu5eXdy6Lp1sG+Ya6Vdjnvghvw4v3J+d7hJ4kbYQxZKcqODkooF5D07tS34oDOPG5Da81BD4RRQbVAsv06MY4nQ9C6dH8IoHZ/ZtjZJM5YYlKixirN1Zeg43PMc9eLWCcx681pzDkCQwjMHrI3jDgzfpNIIJN4GEhf5B9gUCAzgvpxw5MWSq10ZDKLqxbpH1NiktUrZI2SaGEHQJ/UGXdqzJwKrR3WCndSDa3kVDgt6+hd6+3YgVUPCYGQXvVPCuQ4/UeQYGMbhAjz8NmIhFAu/Rk3uIjtJhLIxKL4FzIH4Z0JT36R//c9PoKBRRmhVGMyO0qfvnA7nQ+7s7Q6x56zR+4EM6V2f+KBOBEeE4t4t0/lnsaRbQGYGLiXzkwSV5Rp6lFw7vhH8dDZcruOLBxxL74BMPPpULfXm+Z1XwmQef46hVwRcefDmCr0q42hS7uapMRqnRcG3/a4ETDd4JBTYcNyrX9r3l+irfrWEbruNTcaNfwtdOQ9XoaPg03OzTWYRUYfawb/rFCLo+qlzy4FYFtz24U8HdEu458pqsyb5Fsp4jb/Zls/Y7fyyR50ONRarfovvyVmGg78Fyc6GyXAVCa1iRy//J5vuG0kPKB3uUq37hb8APJTzcgLXnPo5rURqqLfTEBoo8P5bwk0OP4Rkmj4ZDkaOYnw8jmCyxl8SAF7FZnYSwjkQbk84NiqSIef2E1ndewC89a5xCpFk43gfsSdMiJkrQW55kLFCJH6Uih19xdX2XthqVqIUfpmW8wr4TK5/H46TQOh+VBIVvIOz8A4/lAQ0=",
"user_name": "assert_that/Match"
}
}
],
"type": "JOB_TYPE_BATCH"
}
root: INFO: Create job: <Job
createTime: '2019-05-29T19:16:19.295698Z'
currentStateTime: '1970-01-01T00:00:00Z'
id: '2019-05-29_12_16_18-4593600653703936420'
location: 'us-central1'
name: 'beamapp-jenkins-0529191550-861646'
projectId: 'apache-beam-testing'
stageStates: []
startTime: '2019-05-29T19:16:19.295698Z'
steps: []
tempFiles: []
type: TypeValueValuesEnum(JOB_TYPE_BATCH, 1)>
root: INFO: Created job with id: [2019-05-29_12_16_18-4593600653703936420]
root: INFO: To access the Dataflow monitoring console, please navigate to
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-05-29_12_16_18-4593600653703936420?project=apache-beam-testing
root: INFO: Job 2019-05-29_12_16_18-4593600653703936420 is in state
JOB_STATE_RUNNING
root: INFO: 2019-05-29T19:16:18.262Z: JOB_MESSAGE_DETAILED: Autoscaling is
enabled for job 2019-05-29_12_16_18-4593600653703936420. The number of workers
will be between 1 and 1000.
root: INFO: 2019-05-29T19:16:18.308Z: JOB_MESSAGE_DETAILED: Autoscaling was
automatically enabled for job 2019-05-29_12_16_18-4593600653703936420.
root: INFO: 2019-05-29T19:16:21.327Z: JOB_MESSAGE_DETAILED: Checking
permissions granted to controller Service Account.
root: INFO: 2019-05-29T19:16:21.930Z: JOB_MESSAGE_BASIC: Worker configuration:
n1-standard-1 in us-central1-a.
root: INFO: 2019-05-29T19:16:22.530Z: JOB_MESSAGE_DETAILED: Expanding
CoGroupByKey operations into optimizable parts.
root: INFO: 2019-05-29T19:16:22.579Z: JOB_MESSAGE_DEBUG: Combiner lifting
skipped for step assert_that/Group/GroupByKey: GroupByKey not followed by a
combiner.
root: INFO: 2019-05-29T19:16:22.627Z: JOB_MESSAGE_DETAILED: Expanding
GroupByKey operations into optimizable parts.
root: INFO: 2019-05-29T19:16:22.674Z: JOB_MESSAGE_DETAILED: Lifting
ValueCombiningMappingFns into MergeBucketsMappingFns
root: INFO: 2019-05-29T19:16:22.763Z: JOB_MESSAGE_DEBUG: Annotating graph with
Autotuner information.
root: INFO: 2019-05-29T19:16:22.811Z: JOB_MESSAGE_DETAILED: Fusing adjacent
ParDo, Read, Write, and Flatten operations
root: INFO: 2019-05-29T19:16:22.851Z: JOB_MESSAGE_DETAILED: Unzipping flatten
s11 for input s10.out
root: INFO: 2019-05-29T19:16:22.891Z: JOB_MESSAGE_DETAILED: Fusing unzipped
copy of assert_that/Group/GroupByKey/Reify, through flatten
assert_that/Group/Flatten, into producer assert_that/Group/pair_with_1
root: INFO: 2019-05-29T19:16:22.940Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Group/Map(_merge_tagged_vals_under_key) into
assert_that/Group/GroupByKey/GroupByWindow
root: INFO: 2019-05-29T19:16:22.968Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Match into assert_that/Unkey
root: INFO: 2019-05-29T19:16:23.003Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Unkey into assert_that/Group/Map(_merge_tagged_vals_under_key)
root: INFO: 2019-05-29T19:16:23.051Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Group/GroupByKey/GroupByWindow into
assert_that/Group/GroupByKey/Read
root: INFO: 2019-05-29T19:16:23.094Z: JOB_MESSAGE_DETAILED: Unzipping flatten
s11-u13 for input s12-reify-value0-c11
root: INFO: 2019-05-29T19:16:23.142Z: JOB_MESSAGE_DETAILED: Fusing unzipped
copy of assert_that/Group/GroupByKey/Write, through flatten
assert_that/Group/Flatten/Unzipped-1, into producer
assert_that/Group/GroupByKey/Reify
root: INFO: 2019-05-29T19:16:23.182Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Group/GroupByKey/Reify into assert_that/Group/pair_with_0
root: INFO: 2019-05-29T19:16:23.252Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Group/GroupByKey/Write into assert_that/Group/GroupByKey/Reify
root: INFO: 2019-05-29T19:16:23.303Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Group/pair_with_0 into assert_that/Create/Read
root: INFO: 2019-05-29T19:16:23.353Z: JOB_MESSAGE_DETAILED: Fusing consumer
Map(<lambda at sideinputs_test.py:217>)/Map(<lambda at sideinputs_test.py:217>)
into main input/Read
root: INFO: 2019-05-29T19:16:23.394Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/WindowInto(WindowIntoFn) into Map(<lambda at
sideinputs_test.py:217>)/Map(<lambda at sideinputs_test.py:217>)
root: INFO: 2019-05-29T19:16:23.443Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/Group/pair_with_1 into assert_that/ToVoidKey
root: INFO: 2019-05-29T19:16:23.494Z: JOB_MESSAGE_DETAILED: Fusing consumer
assert_that/ToVoidKey into assert_that/WindowInto(WindowIntoFn)
root: INFO: 2019-05-29T19:16:23.546Z: JOB_MESSAGE_DEBUG: Workflow config is
missing a default resource spec.
root: INFO: 2019-05-29T19:16:23.608Z: JOB_MESSAGE_DEBUG: Adding StepResource
setup and teardown to workflow graph.
root: INFO: 2019-05-29T19:16:23.650Z: JOB_MESSAGE_DEBUG: Adding workflow start
and stop steps.
root: INFO: 2019-05-29T19:16:23.696Z: JOB_MESSAGE_DEBUG: Assigning stage ids.
root: INFO: 2019-05-29T19:16:23.874Z: JOB_MESSAGE_DEBUG: Executing wait step
start21
root: INFO: 2019-05-29T19:16:23.971Z: JOB_MESSAGE_BASIC: Executing operation
assert_that/Group/GroupByKey/Create
root: INFO: 2019-05-29T19:16:24.015Z: JOB_MESSAGE_BASIC: Executing operation
side list/Read
root: INFO: 2019-05-29T19:16:24.027Z: JOB_MESSAGE_DEBUG: Starting worker pool
setup.
root: INFO: 2019-05-29T19:16:24.078Z: JOB_MESSAGE_BASIC: Starting 1 workers in
us-central1-a...
root: INFO: 2019-05-29T19:16:24.106Z: JOB_MESSAGE_DEBUG: Value "side
list/Read.out" materialized.
root: INFO: 2019-05-29T19:16:24.153Z: JOB_MESSAGE_DEBUG: Value
"assert_that/Group/GroupByKey/Session" materialized.
root: INFO: 2019-05-29T19:16:24.202Z: JOB_MESSAGE_BASIC: Executing operation
Map(<lambda at sideinputs_test.py:217>)/_UnpickledSideInput(Read.out.0)
root: INFO: 2019-05-29T19:16:24.250Z: JOB_MESSAGE_BASIC: Executing operation
Map(<lambda at sideinputs_test.py:217>)/_UnpickledSideInput(Read.out.1)
root: INFO: 2019-05-29T19:16:24.297Z: JOB_MESSAGE_BASIC: Executing operation
assert_that/Create/Read+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write
root: INFO: 2019-05-29T19:16:24.330Z: JOB_MESSAGE_DEBUG: Value "Map(<lambda at
sideinputs_test.py:217>)/_UnpickledSideInput(Read.out.0).output" materialized.
root: INFO: 2019-05-29T19:16:24.369Z: JOB_MESSAGE_DEBUG: Value "Map(<lambda at
sideinputs_test.py:217>)/_UnpickledSideInput(Read.out.1).output" materialized.
root: INFO: 2019-05-29T19:16:24.468Z: JOB_MESSAGE_BASIC: Executing operation
main input/Read+Map(<lambda at sideinputs_test.py:217>)/Map(<lambda at
sideinputs_test.py:217>)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write
root: INFO: 2019-05-29T19:17:20.667Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised
the number of workers to 1 based on the rate of progress in the currently
running step(s).
root: INFO: 2019-05-29T19:18:21.933Z: JOB_MESSAGE_DETAILED: Workers have
started successfully.
root: INFO: 2019-05-29T19:18:21.977Z: JOB_MESSAGE_DETAILED: Workers have
started successfully.
--------------------- >> end captured logging << ---------------------
Exception in thread Thread-2:
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-05-29_12_08_12-9388572627413738546?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-05-29_12_18_21-9223901293701320729?project=apache-beam-testing.
Traceback (most recent call last):
File "/usr/lib/python3.5/threading.py", line 914, in _bootstrap_inner
self.run()
File "/usr/lib/python3.5/threading.py", line 862, in run
self._target(*self._args, **self._kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 152, in poll_for_job_completion
response = runner.dataflow_client.get_job(job_id)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/utils/retry.py";,>
line 197, in wrapper
return fun(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py";,>
line 661, in get_job
response = self._client.projects_locations_jobs.Get(request)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py";,>
line 689, in Get
config, request, global_params=global_params)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/apitools/base/py/base_api.py";,>
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/apitools/base/py/base_api.py";,>
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/apitools/base/py/base_api.py";,>
line 604, in __ProcessHttpResponse
http_response, method_config=method_config, request=request)
apitools.base.py.exceptions.HttpNotFoundError: HttpError accessing
<https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs/2019-05-29_12_18_21-9223901293701320729?alt=json>:
response: <{'server': 'ESF', 'vary': 'Origin, X-Origin, Referer',
'content-type': 'application/json; charset=UTF-8', 'transfer-encoding':
'chunked', '-content-encoding': 'gzip', 'x-frame-options': 'SAMEORIGIN',
'x-xss-protection': '0', 'content-length': '279', 'x-content-type-options':
'nosniff', 'date': 'Wed, 29 May 2019 19:20:48 GMT', 'status': '404',
'cache-control': 'private'}>, content <{
"error": {
"code": 404,
"message": "(66995d5abad3e006): Information about job
2019-05-29_12_18_21-9223901293701320729 could not be found in our system.
Please double check the id is correct. If it is please contact customer
support.",
"status": "NOT_FOUND"
}
}
>
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-05-29_12_08_14-16668095939983600544?project=apache-beam-testing.
Exception in thread Thread-2:
Traceback (most recent call last):
File "/usr/lib/python3.5/threading.py", line 914, in _bootstrap_inner
self.run()
File "/usr/lib/python3.5/threading.py", line 862, in run
self._target(*self._args, **self._kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 185, in poll_for_job_completion
job_id, page_token=page_token, start_time=last_message_time)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/utils/retry.py";,>
line 197, in wrapper
return fun(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py";,>
line 746, in list_messages
response = self._client.projects_locations_jobs_messages.List(request)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py";,>
line 553, in List
config, request, global_params=global_params)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/apitools/base/py/base_api.py";,>
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-05-29_12_17_08-13909471296089984896?project=apache-beam-testing.
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/apitools/base/py/base_api.py";,>
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/apitools/base/py/base_api.py";,>
line 604, in __ProcessHttpResponse
http_response, method_config=method_config, request=request)
apitools.base.py.exceptions.HttpNotFoundError: HttpError accessing
<https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs/2019-05-29_12_17_08-13909471296089984896/messages?alt=json&startTime=2019-05-29T19%3A19%3A18.369Z>:
response: <{'server': 'ESF', 'vary': 'Origin, X-Origin, Referer',
'content-type': 'application/json; charset=UTF-8', 'transfer-encoding':
'chunked', '-content-encoding': 'gzip', 'x-frame-options': 'SAMEORIGIN',
'x-xss-protection': '0', 'content-length': '280', 'x-content-type-options':
'nosniff', 'date': 'Wed, 29 May 2019 19:20:57 GMT', 'status': '404',
'cache-control': 'private'}>, content <{
"error": {
"code": 404,
"message": "(6b8e870b33c47e95): Information about job
2019-05-29_12_17_08-13909471296089984896 could not be found in our system.
Please double check the id is correct. If it is please contact customer
support.",
"status": "NOT_FOUND"
}
}
>
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-05-29_12_08_13-14767897581253758442?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-05-29_12_16_10-13501443515577175283?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-05-29_12_08_13-1410265096058859653?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-05-29_12_16_03-9496784585225656375?project=apache-beam-testing.
Exception in thread Thread-2:
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-05-29_12_08_13-11689588869859229603?project=apache-beam-testing.
Traceback (most recent call last):
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-05-29_12_16_31-9167884780058556737?project=apache-beam-testing.
File "/usr/lib/python3.5/threading.py", line 914, in _bootstrap_inner
self.run()
File "/usr/lib/python3.5/threading.py", line 862, in run
self._target(*self._args, **self._kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 185, in poll_for_job_completion
job_id, page_token=page_token, start_time=last_message_time)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/utils/retry.py";,>
line 197, in wrapper
return fun(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py";,>
line 746, in list_messages
response = self._client.projects_locations_jobs_messages.List(request)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py";,>
line 553, in List
config, request, global_params=global_params)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/apitools/base/py/base_api.py";,>
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/apitools/base/py/base_api.py";,>
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/apitools/base/py/base_api.py";,>
line 604, in __ProcessHttpResponse
http_response, method_config=method_config, request=request)
apitools.base.py.exceptions.HttpNotFoundError: HttpError accessing
<https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs/2019-05-29_12_16_31-9167884780058556737/messages?alt=json&startTime=2019-05-29T19%3A19%3A16.032Z>:
response: <{'server': 'ESF', 'vary': 'Origin, X-Origin, Referer',
'content-type': 'application/json; charset=UTF-8', 'transfer-encoding':
'chunked', '-content-encoding': 'gzip', 'x-frame-options': 'SAMEORIGIN',
'x-xss-protection': '0', 'content-length': '279', 'x-content-type-options':
'nosniff', 'date': 'Wed, 29 May 2019 19:20:50 GMT', 'status': '404',
'cache-control': 'private'}>, content <{
"error": {
"code": 404,
"message": "(1815a49bd89c4bff): Information about job
2019-05-29_12_16_31-9167884780058556737 could not be found in our system.
Please double check the id is correct. If it is please contact customer
support.",
"status": "NOT_FOUND"
}
}
>
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-05-29_12_08_11-13333661859565762582?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-05-29_12_15_20-10852191677616549707?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-05-29_12_22_42-7689694865951568543?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-05-29_12_08_13-3300279267817906485?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-05-29_12_16_18-4593600653703936420?project=apache-beam-testing.
Exception in thread Thread-2:
Traceback (most recent call last):
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-05-29_12_08_12-13487604287398081086?project=apache-beam-testing.
Found:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-05-29_12_17_45-8409378655036447412?project=apache-beam-testing.
File "/usr/lib/python3.5/threading.py", line 914, in _bootstrap_inner
self.run()
File "/usr/lib/python3.5/threading.py", line 862, in run
self._target(*self._args, **self._kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 185, in poll_for_job_completion
job_id, page_token=page_token, start_time=last_message_time)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/utils/retry.py";,>
line 197, in wrapper
return fun(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py";,>
line 746, in list_messages
response = self._client.projects_locations_jobs_messages.List(request)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py";,>
line 553, in List
config, request, global_params=global_params)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/apitools/base/py/base_api.py";,>
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/apitools/base/py/base_api.py";,>
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
File
"<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/build/gradleenv/-1734967054/lib/python3.5/site-packages/apitools/base/py/base_api.py";,>
line 604, in __ProcessHttpResponse
http_response, method_config=method_config, request=request)
apitools.base.py.exceptions.HttpNotFoundError: HttpError accessing
<https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs/2019-05-29_12_16_18-4593600653703936420/messages?alt=json&startTime=2019-05-29T19%3A18%3A21.977Z>:
response: <{'server': 'ESF', 'vary': 'Origin, X-Origin, Referer',
'content-type': 'application/json; charset=UTF-8', 'transfer-encoding':
'chunked', '-content-encoding': 'gzip', 'x-frame-options': 'SAMEORIGIN',
'x-xss-protection': '0', 'content-length': '279', 'x-content-type-options':
'nosniff', 'date': 'Wed, 29 May 2019 19:20:58 GMT', 'status': '404',
'cache-control': 'private'}>, content <{
"error": {
"code": 404,
"message": "(49dc7b754431bd40): Information about job
2019-05-29_12_16_18-4593600653703936420 could not be found in our system.
Please double check the id is correct. If it is please contact customer
support.",
"status": "NOT_FOUND"
}
}
>
----------------------------------------------------------------------
XML:
<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 17 tests in 1370.561s
FAILED (failures=4)
> Task :sdks:python:test-suites:dataflow:py35:validatesRunnerBatchTests FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_PostCommit_Python3_Verify/ws/src/sdks/python/test-suites/dataflow/py35/build.gradle'>
line: 67
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py35:validatesRunnerBatchTests'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 13m 53s
78 actionable tasks: 65 executed, 13 from cache
Publishing build scan...
https://gradle.com/s/ke2zzl6iknecw
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
