See
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/4996/display/redirect?page=changes>
Changes:
[kcweaver] Version Flink job server container images
[kcweaver] [BEAM-8337] publish Flink job server container images
[ningk] [BEAM-7926] Data-centric Interactive Part1
[kcweaver] Get Flink version numbers from subdirectories
[kcweaver] Warn if Flink versions can't be listed.
------------------------------------------
[...truncated 1.12 MB...]
copying apache_beam/testing/benchmarks/nexmark/models/__init__.py ->
apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/models
copying apache_beam/testing/benchmarks/nexmark/models/nexmark_model.py ->
apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/models
copying apache_beam/testing/benchmarks/nexmark/queries/__init__.py ->
apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/queries
copying apache_beam/testing/benchmarks/nexmark/queries/query0.py ->
apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/queries
copying apache_beam/testing/benchmarks/nexmark/queries/query1.py ->
apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/queries
copying apache_beam/testing/benchmarks/nexmark/queries/query2.py ->
apache-beam-2.19.0.dev0/apache_beam/testing/benchmarks/nexmark/queries
copying apache_beam/testing/data/trigger_transcripts.yaml ->
apache-beam-2.19.0.dev0/apache_beam/testing/data
copying apache_beam/testing/load_tests/__init__.py ->
apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/co_group_by_key_test.py ->
apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/combine_test.py ->
apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/group_by_key_test.py ->
apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/load_test.py ->
apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/load_test_metrics_utils.py ->
apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/pardo_test.py ->
apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/sideinput_test.py ->
apache-beam-2.19.0.dev0/apache_beam/testing/load_tests
copying apache_beam/testing/load_tests/streaming/__init__.py ->
apache-beam-2.19.0.dev0/apache_beam/testing/load_tests/streaming
copying
apache_beam/testing/load_tests/streaming/group_by_key_streaming_pipeline.py ->
apache-beam-2.19.0.dev0/apache_beam/testing/load_tests/streaming
copying apache_beam/testing/load_tests/streaming/group_by_key_streaming_test.py
-> apache-beam-2.19.0.dev0/apache_beam/testing/load_tests/streaming
copying apache_beam/tools/__init__.py ->
apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/coders_microbenchmark.py ->
apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/distribution_counter_microbenchmark.py ->
apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/fn_api_runner_microbenchmark.py ->
apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/map_fn_microbenchmark.py ->
apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/microbenchmarks_test.py ->
apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/sideinput_microbenchmark.py ->
apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/tools/utils.py -> apache-beam-2.19.0.dev0/apache_beam/tools
copying apache_beam/transforms/__init__.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/combiners.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/combiners_test.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/core.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/core_test.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/create_source.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/create_test.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners.pxd ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_combiners.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_dataflow_distribution_counter.pxd ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/cy_dataflow_distribution_counter.pyx ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/dataflow_distribution_counter_test.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/display.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/display_test.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/dofn_lifecycle_test.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/environments.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/environments_test.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test_it.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test_py3.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/external_test_py37.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/ptransform_test.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/py_dataflow_distribution_counter.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/sideinputs_test.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/stats.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/stats_test.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/timeutil.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/transforms_keyword_only_args_test_py3.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/trigger_test.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/userstate.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/userstate_test.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/util_test.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/window_test.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/transforms/write_ptransform_test.py ->
apache-beam-2.19.0.dev0/apache_beam/transforms
copying apache_beam/typehints/__init__.py ->
apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators.py ->
apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators_test.py ->
apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/decorators_test_py3.py ->
apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility.py ->
apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/native_type_compatibility_test.py ->
apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/opcodes.py ->
apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/schemas.py ->
apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/schemas_test.py ->
apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference.py ->
apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference_test.py ->
apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/trivial_inference_test_py3.py ->
apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typecheck.py ->
apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typed_pipeline_test.py ->
apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typed_pipeline_test_py3.py ->
apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints.py ->
apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints_test.py ->
apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/typehints/typehints_test_py3.py ->
apache-beam-2.19.0.dev0/apache_beam/typehints
copying apache_beam/utils/__init__.py ->
apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations.py ->
apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/annotations_test.py ->
apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.pxd ->
apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/counters.py ->
apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/counters_test.py ->
apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/interactive_utils.py ->
apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/plugin.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/processes.py ->
apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/processes_test.py ->
apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/profiler.py ->
apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/proto_utils.py ->
apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/retry.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/retry_test.py ->
apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/subprocess_server.py ->
apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/thread_pool_executor.py ->
apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/thread_pool_executor_test.py ->
apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp.py ->
apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/timestamp_test.py ->
apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/urns.py -> apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.pxd ->
apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value.py ->
apache-beam-2.19.0.dev0/apache_beam/utils
copying apache_beam/utils/windowed_value_test.py ->
apache-beam-2.19.0.dev0/apache_beam/utils
Writing apache-beam-2.19.0.dev0/setup.cfg
Creating tar archive
removing 'apache-beam-2.19.0.dev0' (and everything under it)
SDK_LOCATION=$(find dist/apache-beam-*.tar.gz)
find dist/apache-beam-*.tar.gz
# Run ValidatesRunner tests on Google Cloud Dataflow service
echo ">>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST"
>>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST
python setup.py nosetests \
--attr ValidatesContainer \
--nologcapture \
--processes=1 \
--process-timeout=900 \
--with-xunitmp \
--xunitmp-file=$XUNIT_FILE \
--ignore-files '.*py3\d?\.py$' \
--test-pipeline-options=" \
--runner=TestDataflowRunner \
--project=$PROJECT \
--worker_harness_container_image=$CONTAINER:$TAG \
--staging_location=$GCS_LOCATION/staging-validatesrunner-test \
--temp_location=$GCS_LOCATION/temp-validatesrunner-test \
--output=$GCS_LOCATION/output \
--sdk_location=$SDK_LOCATION \
--num_workers=1"
running nosetests
running egg_info
writing dependency_links to apache_beam.egg-info/dependency_links.txt
writing entry points to apache_beam.egg-info/entry_points.txt
writing requirements to apache_beam.egg-info/requires.txt
writing apache_beam.egg-info/PKG-INFO
writing top-level names to apache_beam.egg-info/top_level.txt
reading manifest file 'apache_beam.egg-info/SOURCES.txt'
reading manifest template 'MANIFEST.in'
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/container/venv/python3.5/lib/python3.5/site-packages/setuptools/dist.py>:476:
UserWarning: Normalizing '2.19.0.dev' to '2.19.0.dev0'
normalized_version,
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/gen_protos.py>:58:
UserWarning: Installing grpcio-tools is recommended for development.
warnings.warn('Installing grpcio-tools is recommended for development.')
warning: no files found matching 'README.md'
warning: no files found matching 'NOTICE'
warning: no files found matching 'LICENSE'
writing manifest file 'apache_beam.egg-info/SOURCES.txt'
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/io/gcp/datastore/v1/datastoreio.py>:62:
UserWarning: Datastore IO will support Python 3 after replacing
googledatastore by google-cloud-datastore, see: BEAM-4543.
warnings.warn('Datastore IO will support Python 3 after replacing '
WARNING:root:python-snappy is not installed; some tests will be skipped.
WARNING:root:Tensorflow is not installed, so skipping some tests.
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/io/vcfio.py>:47:
UserWarning: VCF IO will support Python 3 after migration to Nucleus, see:
BEAM-5628.
warnings.warn("VCF IO will support Python 3 after migration to Nucleus, "
WARNING:apache_beam.runners.interactive.interactive_environment:Interactive
Beam requires Python 3.5.3+.
WARNING:apache_beam.runners.interactive.interactive_environment:Dependencies
required for Interactive Beam PCollection visualization are not available,
please use: `pip install apache-beam[interactive]` to install necessary
dependencies to enable all data visualization features.
WARNING:apache_beam.runners.interactive.interactive_environment:You cannot use
Interactive Beam features when you are not in an interactive environment such
as a Jupyter notebook or ipython terminal.
WARNING:root:Make sure that locally built Python SDK docker image has Python
3.5 interpreter.
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/transforms/trigger_test.py>:520:
YAMLLoadWarning: calling yaml.load_all() without Loader=... is deprecated, as
the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full
details.
for spec in yaml.load_all(open(transcript_filename)):
WARNING:apache_beam.options.pipeline_options:--region not set; will default to
us-central1. Future releases of Beam will require the user to set --region
explicitly, or else have a default set via the gcloud tool.
https://cloud.google.com/compute/docs/regions-zones
WARNING:apache_beam.options.pipeline_options:--region not set; will default to
us-central1. Future releases of Beam will require the user to set --region
explicitly, or else have a default set via the gcloud tool.
https://cloud.google.com/compute/docs/regions-zones
WARNING:apache_beam.options.pipeline_options:--region not set; will default to
us-central1. Future releases of Beam will require the user to set --region
explicitly, or else have a default set via the gcloud tool.
https://cloud.google.com/compute/docs/regions-zones
WARNING:apache_beam.options.pipeline_options:--region not set; will default to
us-central1. Future releases of Beam will require the user to set --region
explicitly, or else have a default set via the gcloud tool.
https://cloud.google.com/compute/docs/regions-zones
test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT)
... FAIL
test_metrics_fnapi_it
(apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest)
... FAIL
======================================================================
FAIL: test_wordcount_fnapi_it
(apache_beam.examples.wordcount_it_test.WordCountIT)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount_it_test.py";,>
line 52, in test_wordcount_fnapi_it
self._run_wordcount_it(wordcount.run, experiment='beam_fn_api')
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount_it_test.py";,>
line 85, in _run_wordcount_it
save_main_session=False)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/examples/wordcount.py";,>
line 117, in run
result = p.run()
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 417, in run
self._options).run(False)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 430, in run
return self.runner.run_pipeline(self, self._options)
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/test_dataflow_runner.py";,>
line 70, in run_pipeline
hc_assert_that(self.result, pickler.loads(on_success_matcher))
AssertionError:
Expected: (Test pipeline expected terminated in state: DONE and Expected
checksum is 33535a832b7db6d78389759577d4ff495980b9c0)
but: Test pipeline expected terminated in state: DONE Test pipeline job
terminated in state: FAILED
-------------------- >> begin captured stdout << ---------------------
Worker logs:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-12-09_17_11_29-4856174748223217177?project=apache-beam-testing
--------------------- >> end captured stdout << ----------------------
======================================================================
FAIL: test_metrics_fnapi_it
(apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline_test.ExerciseMetricsPipelineTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py";,>
line 60, in test_metrics_fnapi_it
self.assertFalse(errors, str(errors))
AssertionError: "Unable to match metrics for matcher namespace:
'apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline.UserMetricsDoFn'
name: 'total_values' step: 'metrics' attempted: <100> committed: <100>Unable
to match metrics for matcher name: 'ExecutionTime_StartBundle' step: 'metrics'
attempted: a value greater than <0> committed: a value greater than <0>Unable
to match metrics for matcher name: 'ExecutionTime_ProcessElement' step:
'metrics' attempted: a value greater than <0> committed: a value greater than
<0>Unable to match metrics for matcher name: 'ExecutionTime_FinishBundle'
step: 'metrics' attempted: a value greater than <0> committed: a value greater
than <0>Unable to match metrics for matcher namespace:
'apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline.UserMetricsDoFn'
name: 'distribution_values' step: 'metrics' attempted: sum_value: <100>
count_value: <4> min_value: <0> max_value: <100> committed: sum_value: <100>
count_value: <4> min_value: <0> max_value: <100>Unable to match metrics for
matcher name: 'ElementCount' (label_key: 'output_user_name' label_value:
'metrics-out0'). (label_key: 'original_name' label_value:
'metrics-out0-ElementCount'). attempted: a value greater than <0> committed: a
value greater than <0>Unable to match metrics for matcher name:
'MeanByteCount' (label_key: 'output_user_name' label_value: 'metrics-out0').
(label_key: 'original_name' label_value: 'metrics-out0-MeanByteCount').
attempted: a value greater than <0> committed: a value greater than <0>Unable
to match metrics for matcher name: 'ElementCount' (label_key:
'output_user_name' label_value: 'GroupByKey/Reify-out0'). (label_key:
'original_name' label_value: 'GroupByKey/Reify-out0-ElementCount'). attempted:
a value greater than <0> committed: a value greater than <0>Unable to match
metrics for matcher name: 'MeanByteCount' (label_key: 'output_user_name'
label_value: 'GroupByKey/Reify-out0'). (label_key: 'original_name'
label_value: 'GroupByKey/Reify-out0-MeanByteCount'). attempted: a value
greater than <0> committed: a value greater than <0>Unable to match metrics for
matcher name: 'ElementCount' (label_key: 'output_user_name' label_value:
'GroupByKey/Read-out0'). (label_key: 'original_name' label_value:
'GroupByKey/Read-out0-ElementCount'). attempted: a value greater than <0>
committed: a value greater than <0>Unable to match metrics for matcher name:
'MeanByteCount' (label_key: 'output_user_name' label_value:
'GroupByKey/Read-out0'). (label_key: 'original_name' label_value:
'GroupByKey/Read-out0-MeanByteCount'). attempted: a value greater than <0>
committed: a value greater than <0>Unable to match metrics for matcher name:
'ElementCount' (label_key: 'output_user_name' label_value:
'map_to_common_key-out0'). (label_key: 'original_name' label_value:
'map_to_common_key-out0-ElementCount'). attempted: a value greater than <0>
committed: a value greater than <0>Unable to match metrics for matcher name:
'MeanByteCount' (label_key: 'output_user_name' label_value:
'map_to_common_key-out0'). (label_key: 'original_name' label_value:
'map_to_common_key-out0-MeanByteCount'). attempted: a value greater than <0>
committed: a value greater than <0>Unable to match metrics for matcher name:
'ElementCount' (label_key: 'original_name' label_value:
'GroupByKey/GroupByWindow-out0-ElementCount'). (label_key: 'output_user_name'
label_value: 'GroupByKey/GroupByWindow-out0'). attempted: a value greater than
<0> committed: a value greater than <0>Unable to match metrics for matcher
name: 'MeanByteCount' (label_key: 'original_name' label_value:
'GroupByKey/GroupByWindow-out0-MeanByteCount'). (label_key: 'output_user_name'
label_value: 'GroupByKey/GroupByWindow-out0'). attempted: a value greater than
<0> committed: a value greater than <0>Unable to match metrics for matcher
name: 'ElementCount' (label_key: 'original_name' label_value:
'GroupByKey/Read-out0-ElementCount'). (label_key: 'output_user_name'
label_value: 'GroupByKey/Read-out0'). attempted: a value greater than <0>
committed: a value greater than <0>Unable to match metrics for matcher name:
'MeanByteCount' (label_key: 'original_name' label_value:
'GroupByKey/Read-out0-MeanByteCount'). (label_key: 'output_user_name'
label_value: 'GroupByKey/Read-out0'). attempted: a value greater than <0>
committed: a value greater than <0>Unable to match metrics for matcher name:
'ElementCount' (label_key: 'output_user_name' label_value:
'GroupByKey/Reify-out0'). (label_key: 'original_name' label_value:
'GroupByKey/Reify-out0-ElementCount'). attempted: a value greater than <0>
committed: a value greater than <0>Unable to match metrics for matcher name:
'MeanByteCount' (label_key: 'output_user_name' label_value:
'GroupByKey/Reify-out0'). (label_key: 'original_name' label_value:
'GroupByKey/Reify-out0-MeanByteCount'). attempted: a value greater than <0>
committed: a value greater than <0>\nActual MetricResults:\n" is not false :
Unable to match metrics for matcher namespace:
'apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline.UserMetricsDoFn'
name: 'total_values' step: 'metrics' attempted: <100> committed: <100>Unable
to match metrics for matcher name: 'ExecutionTime_StartBundle' step: 'metrics'
attempted: a value greater than <0> committed: a value greater than <0>Unable
to match metrics for matcher name: 'ExecutionTime_ProcessElement' step:
'metrics' attempted: a value greater than <0> committed: a value greater than
<0>Unable to match metrics for matcher name: 'ExecutionTime_FinishBundle'
step: 'metrics' attempted: a value greater than <0> committed: a value greater
than <0>Unable to match metrics for matcher namespace:
'apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline.UserMetricsDoFn'
name: 'distribution_values' step: 'metrics' attempted: sum_value: <100>
count_value: <4> min_value: <0> max_value: <100> committed: sum_value: <100>
count_value: <4> min_value: <0> max_value: <100>Unable to match metrics for
matcher name: 'ElementCount' (label_key: 'output_user_name' label_value:
'metrics-out0'). (label_key: 'original_name' label_value:
'metrics-out0-ElementCount'). attempted: a value greater than <0> committed: a
value greater than <0>Unable to match metrics for matcher name:
'MeanByteCount' (label_key: 'output_user_name' label_value: 'metrics-out0').
(label_key: 'original_name' label_value: 'metrics-out0-MeanByteCount').
attempted: a value greater than <0> committed: a value greater than <0>Unable
to match metrics for matcher name: 'ElementCount' (label_key:
'output_user_name' label_value: 'GroupByKey/Reify-out0'). (label_key:
'original_name' label_value: 'GroupByKey/Reify-out0-ElementCount'). attempted:
a value greater than <0> committed: a value greater than <0>Unable to match
metrics for matcher name: 'MeanByteCount' (label_key: 'output_user_name'
label_value: 'GroupByKey/Reify-out0'). (label_key: 'original_name'
label_value: 'GroupByKey/Reify-out0-MeanByteCount'). attempted: a value
greater than <0> committed: a value greater than <0>Unable to match metrics for
matcher name: 'ElementCount' (label_key: 'output_user_name' label_value:
'GroupByKey/Read-out0'). (label_key: 'original_name' label_value:
'GroupByKey/Read-out0-ElementCount'). attempted: a value greater than <0>
committed: a value greater than <0>Unable to match metrics for matcher name:
'MeanByteCount' (label_key: 'output_user_name' label_value:
'GroupByKey/Read-out0'). (label_key: 'original_name' label_value:
'GroupByKey/Read-out0-MeanByteCount'). attempted: a value greater than <0>
committed: a value greater than <0>Unable to match metrics for matcher name:
'ElementCount' (label_key: 'output_user_name' label_value:
'map_to_common_key-out0'). (label_key: 'original_name' label_value:
'map_to_common_key-out0-ElementCount'). attempted: a value greater than <0>
committed: a value greater than <0>Unable to match metrics for matcher name:
'MeanByteCount' (label_key: 'output_user_name' label_value:
'map_to_common_key-out0'). (label_key: 'original_name' label_value:
'map_to_common_key-out0-MeanByteCount'). attempted: a value greater than <0>
committed: a value greater than <0>Unable to match metrics for matcher name:
'ElementCount' (label_key: 'original_name' label_value:
'GroupByKey/GroupByWindow-out0-ElementCount'). (label_key: 'output_user_name'
label_value: 'GroupByKey/GroupByWindow-out0'). attempted: a value greater than
<0> committed: a value greater than <0>Unable to match metrics for matcher
name: 'MeanByteCount' (label_key: 'original_name' label_value:
'GroupByKey/GroupByWindow-out0-MeanByteCount'). (label_key: 'output_user_name'
label_value: 'GroupByKey/GroupByWindow-out0'). attempted: a value greater than
<0> committed: a value greater than <0>Unable to match metrics for matcher
name: 'ElementCount' (label_key: 'original_name' label_value:
'GroupByKey/Read-out0-ElementCount'). (label_key: 'output_user_name'
label_value: 'GroupByKey/Read-out0'). attempted: a value greater than <0>
committed: a value greater than <0>Unable to match metrics for matcher name:
'MeanByteCount' (label_key: 'original_name' label_value:
'GroupByKey/Read-out0-MeanByteCount'). (label_key: 'output_user_name'
label_value: 'GroupByKey/Read-out0'). attempted: a value greater than <0>
committed: a value greater than <0>Unable to match metrics for matcher name:
'ElementCount' (label_key: 'output_user_name' label_value:
'GroupByKey/Reify-out0'). (label_key: 'original_name' label_value:
'GroupByKey/Reify-out0-ElementCount'). attempted: a value greater than <0>
committed: a value greater than <0>Unable to match metrics for matcher name:
'MeanByteCount' (label_key: 'output_user_name' label_value:
'GroupByKey/Reify-out0'). (label_key: 'original_name' label_value:
'GroupByKey/Reify-out0-MeanByteCount'). attempted: a value greater than <0>
committed: a value greater than <0>
Actual MetricResults:
-------------------- >> begin captured stdout << ---------------------
Worker logs:
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-12-09_17_11_43-14319220273595477865?project=apache-beam-testing
--------------------- >> end captured stdout << ----------------------
----------------------------------------------------------------------
XML: nosetests-python3.5_sdk.xml
----------------------------------------------------------------------
XML:
<https://builds.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 2 tests in 33.274s
FAILED (failures=2)
cleanup_container
Untagged: us.gcr.io/apache-beam-testing/jenkins/python3.5_sdk:20191210-010513
Untagged:
us.gcr.io/apache-beam-testing/jenkins/python3.5_sdk@sha256:a2743e8992ff9d5d67d58338fe11676b9a42727b19a5f53652413fc92c410015
Deleted: sha256:06e18c5a6d009b6d180e0456d7228a7a7472707ff25ecd60d045f52da39b45b1
Deleted: sha256:005c6ed6c804e53c2d230b6d61c59ac8d9b18ca263a025878a7dc1d9bcf13750
Deleted: sha256:a59d2cfa15502f4cfb234b7574fa2fcfb52eeaf496d5979aa52eb9ad98b15c2e
Deleted: sha256:254857887edfad182d5c52d151b7b7f144425253233cf9f67a98a031478e2b15
Deleted: sha256:10a293794a0c26aafd08b7135067a3ea14e594f279c131172a0bd3449e9fb99a
Deleted: sha256:8a6231421f995d2cd37a49996b1ae959d924f0e65d6675a49ed17a3cd17c5b29
Deleted: sha256:047b42adeca2b87ba9e2bf1be09637c7bf93f09a121fda91c63dfcf7abde2497
Deleted: sha256:6686bc3615c14802d22f2e396a3901a85670bcd12842f611af449e774163cbd7
Deleted: sha256:7256922d2d4ae72126446cefcd5d14dc23762391c4c4c4d6942d1ca39e463f5d
Deleted: sha256:cb3a329ac81a513957fecd9d6ef156186af3bd05b1e87b970de7c0fe732536a0
Deleted: sha256:6f6844437444d174afbd1a24b9d94c068feb3ae374cc7cd171de107ccc330f23
Deleted: sha256:7f9cbc30a90701233903a2c1ec6a4d03f66cdd24b4c0042302fd22a6635792ea
Deleted: sha256:b9868c870657e07b41aa9d5429b7bfe426171ba22344f34f4eb38abfc2fd9f22
Deleted: sha256:d3f1da7f76e61291bd58e47c19ea1f12ccbdfe8aa28c572c4ee063ca9558de72
Deleted: sha256:fb7822680b34870762c74d60cbc911ca889d6e5f6967aed8436aa332e8d4b177
Deleted: sha256:10b5e5f7bc26695101cdd7cfd81a40cc14f6b6d8474a41781f304dd1278603e9
Deleted: sha256:33ee4aac11114d9c88150499b59bf489db031df2f97be3b626cdb68b70028e39
Deleted: sha256:c88b8e34261a5e0b84f9ab2093ec29529c5bbdfed0fdc1e7ca71efed60f29b64
Deleted: sha256:da3b898b07d82719f524e4ead58d3bea6b53cec22ca2c3e3a527ce1df4711077
Deleted: sha256:e7b1bd97547affc0602636072191d79bffcbbf0d890c2b990e1d15574a8ebd2e
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/python3.5_sdk@sha256:a2743e8992ff9d5d67d58338fe11676b9a42727b19a5f53652413fc92c410015
Associated tags:
- 20191210-010513
Tags:
- us.gcr.io/apache-beam-testing/jenkins/python3.5_sdk:20191210-010513
Deleted [us.gcr.io/apache-beam-testing/jenkins/python3.5_sdk:20191210-010513].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/python3.5_sdk@sha256:a2743e8992ff9d5d67d58338fe11676b9a42727b19a5f53652413fc92c410015].
Removed the container
Build step 'Execute shell' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
