See
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/4430/display/redirect>
------------------------------------------
[...truncated 399.09 KB...]
copying apache_beam/typehints/typehints.py ->
apache-beam-2.17.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints_test.py ->
apache-beam-2.17.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints_test_py3.py ->
apache-beam-2.17.0.dev0/apache_beam/typehints
copying apache_beam/utils/__init__.py ->
apache-beam-2.17.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations.py ->
apache-beam-2.17.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations_test.py ->
apache-beam-2.17.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.pxd ->
apache-beam-2.17.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.py ->
apache-beam-2.17.0.dev0/apache_beam/utils
copying apache_beam/utils/counters_test.py ->
apache-beam-2.17.0.dev0/apache_beam/utils
copying apache_beam/utils/plugin.py -> apache-beam-2.17.0.dev0/apache_beam/utils
copying apache_beam/utils/processes.py ->
apache-beam-2.17.0.dev0/apache_beam/utils
copying apache_beam/utils/processes_test.py ->
apache-beam-2.17.0.dev0/apache_beam/utils
copying apache_beam/utils/profiler.py ->
apache-beam-2.17.0.dev0/apache_beam/utils
copying apache_beam/utils/proto_utils.py ->
apache-beam-2.17.0.dev0/apache_beam/utils
copying apache_beam/utils/retry.py -> apache-beam-2.17.0.dev0/apache_beam/utils
copying apache_beam/utils/retry_test.py ->
apache-beam-2.17.0.dev0/apache_beam/utils
copying apache_beam/utils/subprocess_server.py ->
apache-beam-2.17.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp.py ->
apache-beam-2.17.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp_test.py ->
apache-beam-2.17.0.dev0/apache_beam/utils
copying apache_beam/utils/urns.py -> apache-beam-2.17.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.pxd ->
apache-beam-2.17.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.py ->
apache-beam-2.17.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value_test.py ->
apache-beam-2.17.0.dev0/apache_beam/utils
Writing apache-beam-2.17.0.dev0/setup.cfg
Creating tar archive
removing 'apache-beam-2.17.0.dev0' (and everything under it)
SDK_LOCATION=$(find dist/apache-beam-*.tar.gz)
find dist/apache-beam-*.tar.gz
# Run ValidatesRunner tests on Google Cloud Dataflow service
echo ">>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST"
>>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST
python setup.py nosetests \
--attr ValidatesContainer \
--nologcapture \
--processes=1 \
--process-timeout=900 \
--with-xunitmp \
--xunitmp-file=$XUNIT_FILE \
--ignore-files '.*py3\d?\.py$' \
--test-pipeline-options=" \
--runner=TestDataflowRunner \
--project=$PROJECT \
--worker_harness_container_image=$CONTAINER:$TAG \
--staging_location=$GCS_LOCATION/staging-validatesrunner-test \
--temp_location=$GCS_LOCATION/temp-validatesrunner-test \
--output=$GCS_LOCATION/output \
--sdk_location=$SDK_LOCATION \
--num_workers=1"
running nosetests
running egg_info
writing apache_beam.egg-info/PKG-INFO
writing dependency_links to apache_beam.egg-info/dependency_links.txt
writing top-level names to apache_beam.egg-info/top_level.txt
writing entry points to apache_beam.egg-info/entry_points.txt
writing requirements to apache_beam.egg-info/requires.txt
reading manifest file 'apache_beam.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/setuptools/dist.py>:474:
UserWarning: Normalizing '2.17.0.dev' to '2.17.0.dev0'
normalized_version,
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/gen_protos.py>:57:
UserWarning: Installing grpcio-tools is recommended for development.
warnings.warn('Installing grpcio-tools is recommended for development.')
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
writing manifest file 'apache_beam.egg-info/SOURCES.txt'
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/io/gcp/datastore/v1/datastoreio.py>:59:
UserWarning: Datastore IO will support Python 3 after replacing
googledatastore by google-cloud-datastore, see: BEAM-4543.
warnings.warn('Datastore IO will support Python 3 after replacing '
WARNING:root:python-snappy is not installed; some tests will be skipped.
WARNING:root:Tensorflow is not installed, so skipping some tests.
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/io/vcfio.py>:47:
UserWarning: VCF IO will support Python 3 after migration to Nucleus, see:
BEAM-5628.
warnings.warn("VCF IO will support Python 3 after migration to Nucleus, "
WARNING:root:Make sure that locally built Python SDK docker image has Python
3.5 interpreter.
WARNING:root:--region not set; will default to us-central1. Future releases of
Beam will require the user to set the region explicitly.
https://cloud.google.com/compute/docs/regions-zones/regions-zones
WARNING:root:--region not set; will default to us-central1. Future releases of
Beam will require the user to set the region explicitly.
https://cloud.google.com/compute/docs/regions-zones/regions-zones
WARNING:root:--region not set; will default to us-central1. Future releases of
Beam will require the user to set the region explicitly.
https://cloud.google.com/compute/docs/regions-zones/regions-zones
WARNING:root:--region not set; will default to us-central1. Future releases of
Beam will require the user to set the region explicitly.
https://cloud.google.com/compute/docs/regions-zones/regions-zones
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT)
... ERROR
test_metrics_fnapi_it
(apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest)
... ERROR
======================================================================
ERROR: test_wordcount_fnapi_it
(apache_beam.examples.wordcount_it_test.WordCountIT)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/nose/plugins/multiprocess.py";,>
line 812, in run
test(orig)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/nose/case.py";,>
line 46, in __call__
return self.run(*arg, **kwarg)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/nose/case.py";,>
line 134, in run
self.runTest(result)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/nose/case.py";,>
line 152, in runTest
test(result)
File "/usr/lib/python3.5/unittest/case.py", line 648, in __call__
return self.run(*args, **kwds)
File "/usr/lib/python3.5/unittest/case.py", line 600, in run
testMethod()
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount_it_test.py";,>
line 52, in test_wordcount_fnapi_it
self._run_wordcount_it(wordcount.run, experiment='beam_fn_api')
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount_it_test.py";,>
line 84, in _run_wordcount_it
run_wordcount(test_pipeline.get_full_options_as_args(**extra_opts))
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount.py";,>
line 117, in run
result = p.run()
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 407, in run
self._options).run(False)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 420, in run
return self.runner.run_pipeline(self, self._options)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py";,>
line 71, in run_pipeline
self.result.cancel()
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 1387, in cancel
return self.state
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 1327, in state
self._update_job()
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,>
line 1283, in _update_job
self._job = self._runner.dataflow_client.get_job(self.job_id())
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/utils/retry.py";,>
line 206, in wrapper
return fun(*args, **kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py";,>
line 671, in get_job
response = self._client.projects_locations_jobs.Get(request)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py";,>
line 661, in Get
config, request, global_params=global_params)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/apitools/base/py/base_api.py";,>
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/apitools/base/py/base_api.py";,>
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/apitools/base/py/base_api.py";,>
line 620, in __ProcessHttpResponse
return self.__client.DeserializeMessage(response_type, content)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/apitools/base/py/base_api.py";,>
line 446, in DeserializeMessage
message = encoding.JsonToMessage(response_type, data)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/apitools/base/py/encoding_helper.py";,>
line 123, in JsonToMessage
return _ProtoJsonApiTools.Get().decode_message(message_type, message)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/apitools/base/py/encoding_helper.py";,>
line 309, in decode_message
message_type, result)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/apitools/base/protorpclite/protojson.py";,>
line 214, in decode_message
message = self.__decode_dictionary(message_type, dictionary)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/apitools/base/protorpclite/protojson.py";,>
line 294, in __decode_dictionary
setattr(message, field.name, self.decode_field(field, value))
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/apitools/base/py/encoding_helper.py";,>
line 331, in decode_field
field.message_type, json.dumps(value))
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/apitools/base/py/encoding_helper.py";,>
line 309, in decode_message
message_type, result)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/apitools/base/protorpclite/protojson.py";,>
line 215, in decode_message
message.check_initialized()
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/apitools/base/protorpclite/messages.py";,>
line 824, in check_initialized
message_value = field.value_to_message(value)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/apitools/base/protorpclite/messages.py";,>
line 1697, in value_to_message
def value_to_message(self, value):
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/nose/plugins/multiprocess.py";,>
line 276, in signalhandler
raise TimedOutException()
nose.plugins.multiprocess.TimedOutException: 'test_wordcount_fnapi_it
(apache_beam.examples.wordcount_it_test.WordCountIT)'
======================================================================
ERROR: test_metrics_fnapi_it
(apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/nose/plugins/multiprocess.py";,>
line 812, in run
test(orig)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/nose/case.py";,>
line 46, in __call__
return self.run(*arg, **kwarg)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/nose/case.py";,>
line 134, in run
self.runTest(result)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/nose/case.py";,>
line 152, in runTest
test(result)
File "/usr/lib/python3.5/unittest/case.py", line 648, in __call__
return self.run(*args, **kwds)
File "/usr/lib/python3.5/unittest/case.py", line 600, in run
testMethod()
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py";,>
line 60, in test_metrics_fnapi_it
result = self.run_pipeline(experiment='beam_fn_api')
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py";,>
line 48, in run_pipeline
return dataflow_exercise_metrics_pipeline.apply_and_run(p)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline.py";,>
line 174, in apply_and_run
| 'm_out' >> beam.FlatMap(lambda x: [
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/transforms/core.py";,>
line 1327, in FlatMap
pardo = ParDo(CallableWrapperDoFn(fn), *args, **kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/transforms/core.py";,>
line 1117, in __init__
super(ParDo, self).__init__(fn, *args, **kwargs)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/transforms/ptransform.py";,>
line 702, in __init__
self.fn = pickler.loads(pickler.dumps(self.fn))
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/internal/pickler.py";,>
line 233, in dumps
s = dill.dumps(o)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/dill/_dill.py";,>
line 265, in dumps
dump(obj, file, protocol, byref, fmode, recurse, **kwds)#, strictio)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/dill/_dill.py";,>
line 259, in dump
Pickler(file, protocol, **_kwds).dump(obj)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/dill/_dill.py";,>
line 445, in dump
StockPickler.dump(self, obj)
File "/usr/lib/python3.5/pickle.py", line 408, in dump
self.save(obj)
File "/usr/lib/python3.5/pickle.py", line 520, in save
self.save_reduce(obj=obj, *rv)
File "/usr/lib/python3.5/pickle.py", line 623, in save_reduce
save(state)
File "/usr/lib/python3.5/pickle.py", line 475, in save
f(self, obj) # Call unbound method with explicit self
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/internal/pickler.py";,>
line 198, in new_save_module_dict
return old_save_module_dict(pickler, obj)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/dill/_dill.py";,>
line 912, in save_module_dict
StockPickler.save_dict(pickler, obj)
File "/usr/lib/python3.5/pickle.py", line 810, in save_dict
self._batch_setitems(obj.items())
File "/usr/lib/python3.5/pickle.py", line 836, in _batch_setitems
save(v)
File "/usr/lib/python3.5/pickle.py", line 475, in save
f(self, obj) # Call unbound method with explicit self
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/dill/_dill.py";,>
line 1413, in save_function
obj.__dict__, fkwdefaults), obj=obj)
File "/usr/lib/python3.5/pickle.py", line 599, in save_reduce
save(args)
File "/usr/lib/python3.5/pickle.py", line 456, in save
def save(self, obj, save_persistent_id=True):
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/nose/plugins/multiprocess.py";,>
line 276, in signalhandler
raise TimedOutException()
nose.plugins.multiprocess.TimedOutException: 'test_metrics_fnapi_it
(apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest)'
----------------------------------------------------------------------
XML: nosetests-python3.5_sdk.xml
----------------------------------------------------------------------
XML:
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 2 tests in 904.107s
FAILED (errors=2)
cleanup_container
Untagged: us.gcr.io/apache-beam-testing/jenkins/python3.5_sdk:20190929-062546
Untagged:
us.gcr.io/apache-beam-testing/jenkins/python3.5_sdk@sha256:ef9b9c72af0e1f38cf405905afeef3ffad4d9ff12bc535eca65c02e00b8436a2
Deleted: sha256:c8a491de51068242ff11dadc38bd87301438608455977f853c8751b3df70e06d
Deleted: sha256:b253f992fefd041929e7404758a3788106191d4fc3bc6355d77fca1e002de601
Deleted: sha256:67c7be04c5e36167d204766c5400c07fa28dc2b006ef32fb927561fc4cdfa7a8
Deleted: sha256:012118afc81bfb620bec4bca5766763ae77cc2b93f2c4b38da2a2410e270d521
Deleted: sha256:aec2f029eba2012e8e09526e8d02bd8f71ec00564c565316fafa26b22ca78ca7
Deleted: sha256:acec4be765650e12aca0211613f38cb00924631548dfedabc67df2451448be25
Deleted: sha256:86ecbb5397f3ba82200a0a975dcad9280790a88e728b4c3bd995b29a807b6ca6
Deleted: sha256:dc518d302e707e32ef2219105b72b8e92524a0bd025c0ca92d3e8375c0592953
Deleted: sha256:3148f763ae09f16cdc6a6be7d1178a256e45176bcaed7fb9c80595e38f148297
Deleted: sha256:a2c12b016bb1d473f53d84050abe370a98c313b893e43c4b86018a87e47785b3
Deleted: sha256:24915993498c3db1263ddecd7f7468962d8db1a493a26f46d9bf680714c22419
Deleted: sha256:b927fea469585cc59a79352b23ac4005b374c692721f3a021d617068e58c8c44
Deleted: sha256:3e2f8ef6b6ee03ffa1a6a5b398dd05cc01494d7e256f76752a879ae28279e28d
Deleted: sha256:e7f398e5d43a2703d92c6657ecefa67d43f3f720e7d2cf5425188bf044c2b8a8
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/python3.5_sdk@sha256:ef9b9c72af0e1f38cf405905afeef3ffad4d9ff12bc535eca65c02e00b8436a2
Associated tags:
- 20190929-062546
Tags:
- us.gcr.io/apache-beam-testing/jenkins/python3.5_sdk:20190929-062546
Deleted [us.gcr.io/apache-beam-testing/jenkins/python3.5_sdk:20190929-062546].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/python3.5_sdk@sha256:ef9b9c72af0e1f38cf405905afeef3ffad4d9ff12bc535eca65c02e00b8436a2].
Removed the container
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
