See
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/10053/display/redirect>
Changes:
------------------------------------------
[...truncated 2.08 MB...]
E MetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionStepProgress),
labels={'original_name':
'dax_workflow_stage_progress_/workflows/wf-2022-12-13_03_39_51-13045768417156153586/phases/graph_runner/step-invocations/F15-invoke-16717086098877288771/map-tasks-completion/map-tasks',
'execution_step': 'F15'}), committed=1, attempted=1)
E MetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ElementCount),
labels={'output_user_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read-out0',
'original_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read-out0-ElementCount'}),
committed=4, attempted=4)
E MetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=MeanByteCount),
labels={'output_user_name':
'Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys-out0', 'original_name':
'Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys-out0-MeanByteCount'}),
committed=14, attempted=14)
E MetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=MeanByteCount),
labels={'original_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)-out0-MeanByteCount',
'output_user_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)-out0'}),
committed=18, attempted=18)
E MetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ElementCount),
labels={'output_user_name':
'Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys-out0', 'original_name':
'Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys-out0-ElementCount'}),
committed=4, attempted=4)
E MetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ElementCount),
labels={'output_user_name': 'metrics-out0', 'original_name':
'metrics-out0-ElementCount'}), committed=4, attempted=4)
E MetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=MeanByteCount),
labels={'original_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read-out0-MeanByteCount',
'output_user_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read-out0'}),
committed=48, attempted=48)
E MetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=MeanByteCount),
labels={'original_name': 'map_to_common_key-out0-MeanByteCount',
'output_user_name': 'map_to_common_key-out0'}), committed=18, attempted=18)
E MetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=MeanByteCount),
labels={'output_user_name': 'metrics-out0', 'original_name':
'metrics-out0-MeanByteCount'}), committed=14, attempted=14)
E MetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=MeanByteCount),
labels={'output_user_name': 'Create/Map(decode)-out0', 'original_name':
'Create/Map(decode)-out0-MeanByteCount'}), committed=14, attempted=14)
E MetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ElementCount),
labels={'output_user_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)-out0',
'original_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)-out0-ElementCount'}),
committed=4, attempted=4)
E MetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ElementCount),
labels={'original_name': 'map_to_common_key-out0-ElementCount',
'output_user_name': 'map_to_common_key-out0'}), committed=4, attempted=4)
E MetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ElementCount),
labels={'original_name': 'Create/Map(decode)-out0-ElementCount',
'output_user_name': 'Create/Map(decode)-out0'}), committed=4, attempted=4)
E MetricResult(key=MetricKey(step=Create/Map(decode),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_ProcessElement),
labels={}), committed=0, attempted=0)
E MetricResult(key=MetricKey(step=map_to_common_key,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_FinishBundle),
labels={}), committed=0, attempted=0)
E
MetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_ProcessElement),
labels={}), committed=0, attempted=0)
E
MetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_StartBundle),
labels={}), committed=0, attempted=0)
E
MetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_FinishBundle),
labels={}), committed=0, attempted=0)
E MetricResult(key=MetricKey(step=Create/Map(decode),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_StartBundle),
labels={}), committed=0, attempted=0)
E
MetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_FinishBundle),
labels={}), committed=0, attempted=0)
E MetricResult(key=MetricKey(step=Create/Map(decode),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_FinishBundle),
labels={}), committed=0, attempted=0)
E MetricResult(key=MetricKey(step=metrics,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_StartBundle),
labels={}), committed=946, attempted=946)
E MetricResult(key=MetricKey(step=map_to_common_key,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_StartBundle),
labels={}), committed=0, attempted=0)
E MetricResult(key=MetricKey(step=map_to_common_key,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_ProcessElement),
labels={}), committed=0, attempted=0)
E MetricResult(key=MetricKey(step=metrics,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_ProcessElement),
labels={}), committed=3993, attempted=3993)
E
MetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_ProcessElement),
labels={}), committed=0, attempted=0)
E
MetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_StartBundle),
labels={}), committed=0, attempted=0)
E MetricResult(key=MetricKey(step=metrics,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_FinishBundle),
labels={}), committed=1000, attempted=1000)
E MetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionStepProgress),
labels={'original_name':
'dax_workflow_stage_progress_/workflows/wf-2022-12-13_03_39_51-13045768417156153586/phases/graph_runner/step-invocations/F14-invoke-16717086098877289519/map-tasks-completion/map-tasks',
'execution_step': 'F14'}), committed=1, attempted=1)
E MetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=MeanByteCount),
labels={'output_user_name': 'm_out-out0', 'original_name':
'm_out-out0-MeanByteCount'}), committed=15, attempted=15)
E MetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ElementCount),
labels={'output_user_name': 'GroupByKey/Read-out0', 'original_name':
'GroupByKey/Read-out0-ElementCount'}), committed=1, attempted=1)
E MetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=MeanByteCount),
labels={'output_user_name': 'GroupByKey/Read-out0', 'original_name':
'GroupByKey/Read-out0-MeanByteCount'}), committed=28, attempted=28)
E MetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ElementCount),
labels={'original_name': 'm_out-out0-ElementCount', 'output_user_name':
'm_out-out0'}), committed=5, attempted=5)
E MetricResult(key=MetricKey(step=m_out,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_ProcessElement),
labels={}), committed=0, attempted=0)
E MetricResult(key=MetricKey(step=m_out,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_StartBundle),
labels={}), committed=0, attempted=0)
E MetricResult(key=MetricKey(step=m_out,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_FinishBundle),
labels={}), committed=0, attempted=0)
apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py:61:
AssertionError
=============================== warnings summary ===============================
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/hdfs/config.py>:15:
DeprecationWarning: the imp module is deprecated in favour of importlib; see
the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/build/gradleenv/-1734967051/lib/python3.8/site-packages/tenacity/_asyncio.py>:42:
DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use
"async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/typehints/pandas_type_compatibility_test.py:67
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:67:
FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas
in a future version. Use pandas.Index with the appropriate dtype instead.
}).set_index(pd.Int64Index(range(123, 223), name='an_index')),
apache_beam/typehints/pandas_type_compatibility_test.py:90
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90:
FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas
in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(123, 223), name='an_index'),
apache_beam/typehints/pandas_type_compatibility_test.py:91
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:91:
FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas
in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(475, 575), name='another_index'),
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/pytest-beam_python3.8_sdk.xml>
-
=========================== short test summary info ============================
FAILED
apache_beam/runners/dataflow/dataflow_exercise_metrics_pipeline_test.py::ExerciseMetricsPipelineTest::test_metrics_fnapi_it
- AssertionError: "Unable to match metrics for matcher name: 'ElementCount'
(label_key: 'output_user_name' label_value: 'GroupByKey/Reify-out0').
(label_key: 'original_name' label_value: 'GroupByKey/Reify-out0-ElementCount').
attempted: a value greater than <0> committed: a value greater than <0>Unable
to match metrics for matcher name: 'MeanByteCount' (label_key:
'output_user_name' label_value: 'GroupByKey/Reify-out0'). (label_key:
'original_name' label_value: 'GroupByKey/Reify-out0-MeanByteCount').
attempted: a value greater than <0> committed: a value greater than <0>Unable
to match metrics for matcher name: 'ElementCount' (label_key:
'output_user_name' label_value: 'GroupByKey/GroupByWindow-out0'). (label_key:
'original_name' label_value: 'GroupByKey/GroupByWindow-out0-ElementCount').
attempted: a value greater than <0> committed: a value greater than <0>Unable
to match metrics for matcher name: 'MeanByteCount' (label_key:
'output_user_name' label_value: 'GroupByKey/GroupByWindow-out0'). (label_key:
'original_name' label_value: 'GroupByKey/GroupByWindow-out0-MeanByteCount').
attempted: a value greater than <0> committed: a value greater than <0>Unable
to match metrics for matcher name: 'ElementCount' (label_key:
'output_user_name' label_value: 'GroupByKey/Reify-out0'). (label_key:
'original_name' label_value: 'GroupByKey/Reify-out0-ElementCount'). attempted:
a value greater than <0> committed: a value greater than <0>Unable to match
metrics for matcher name: 'MeanByteCount' (label_key: 'output_user_name'
label_value: 'GroupByKey/Reify-out0'). (label_key: 'original_name'
label_value: 'GroupByKey/Reify-out0-MeanByteCount'). attempted: a value
greater than <0> committed: a value greater than <0>\nActual
MetricResults:\nMetricResult(key=MetricKey(step=metrics,
metric=MetricName(namespace=apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline.UserMetricsDoFn,
name=total_values), labels={}), committed=100,
attempted=100)\nMetricResult(key=MetricKey(step=metrics,
metric=MetricName(namespace=apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline.UserMetricsDoFn,
name=distribution_values), labels={}), committed=DistributionResult(sum=100,
count=4, min=0, max=100, mean=25.0), attempted=DistributionResult(sum=100,
count=4, min=0, max=100, mean=25.0))\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=TotalVcpuTime),
labels={'original_name': 'Service-cpu_num_seconds'}), committed=581,
attempted=581)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=TotalMemoryUsage),
labels={'original_name': 'Service-mem_mb_seconds'}), committed=2379913,
attempted=2379913)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=TotalPdUsage),
labels={'original_name': 'Service-pd_gb_seconds'}), committed=7262,
attempted=7262)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=TotalSsdUsage),
labels={'original_name': 'Service-pd_ssd_gb_seconds'}), committed=0,
attempted=0)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=TotalShuffleDataProcessed),
labels={'original_name': 'Service-shuffle_service_actual_gb'}), committed=None,
attempted=None)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=BillableShuffleDataProcessed),
labels={'original_name': 'Service-shuffle_service_chargeable_gb'}),
committed=None, attempted=None)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=TotalStreamingDataProcessed),
labels={'original_name': 'Service-streaming_service_gb'}), committed=0,
attempted=0)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=TotalGpuTime),
labels={'original_name': 'Service-gpu_num_seconds'}), committed=0,
attempted=0)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=CurrentShuffleSlotCount),
labels={'original_name': 'dax-shuffle-current-shuffle-slots'}), committed=0,
attempted=0)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=CurrentVcpuCount),
labels={'original_name': 'Service-cpu_num'}), committed=2,
attempted=2)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=CurrentMemoryUsage),
labels={'original_name': 'Service-mem_mb'}), committed=8192,
attempted=8192)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=CurrentPdUsage),
labels={'original_name': 'Service-pd_gb'}), committed=25,
attempted=25)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=CurrentSsdUsage),
labels={'original_name': 'Service-pd_ssd_gb'}), committed=0,
attempted=0)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=CurrentGpuCount),
labels={'original_name': 'Service-gpu_num'}), committed=0,
attempted=0)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=PeakShuffleSlotCount),
labels={'original_name': 'dax-shuffle-peak-shuffle-slots'}), committed=0,
attempted=0)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionStepProgress),
labels={'execution_step': 'F16', 'original_name':
'dax_workflow_stage_progress_/workflows/wf-2022-12-13_03_39_51-13045768417156153586/phases/graph_runner/step-invocations/F16-invoke-16717086098877291371/map-tasks-completion/map-tasks'}),
committed=1, attempted=1)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ElementCount),
labels={'original_name': 'Create/Impulse-out0-ElementCount',
'output_user_name': 'Create/Impulse-out0'}), committed=1,
attempted=1)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=MeanByteCount),
labels={'original_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify-out0-MeanByteCount',
'output_user_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify-out0'}),
committed=45, attempted=45)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ElementCount),
labels={'output_user_name':
'Create/MaybeReshuffle/Reshuffle/AddRandomKeys-out0', 'original_name':
'Create/MaybeReshuffle/Reshuffle/AddRandomKeys-out0-ElementCount'}),
committed=4, attempted=4)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=MeanByteCount),
labels={'output_user_name':
'Create/MaybeReshuffle/Reshuffle/AddRandomKeys-out0', 'original_name':
'Create/MaybeReshuffle/Reshuffle/AddRandomKeys-out0-MeanByteCount'}),
committed=18, attempted=18)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ElementCount),
labels={'original_name': 'Create/FlatMap(<lambda at
core.py:3507>)-out0-ElementCount', 'output_user_name': 'Create/FlatMap(<lambda
at core.py:3507>)-out0'}), committed=4,
attempted=4)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ElementCount),
labels={'original_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)-out0-ElementCount',
'output_user_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)-out0'}),
committed=4, attempted=4)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=MeanByteCount),
labels={'output_user_name': 'Create/Impulse-out0', 'original_name':
'Create/Impulse-out0-MeanByteCount'}), committed=13,
attempted=13)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ElementCount),
labels={'output_user_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify-out0',
'original_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify-out0-ElementCount'}),
committed=4, attempted=4)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=MeanByteCount),
labels={'output_user_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)-out0',
'original_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)-out0-MeanByteCount'}),
committed=26, attempted=26)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=MeanByteCount),
labels={'original_name': 'Create/FlatMap(<lambda at
core.py:3507>)-out0-MeanByteCount', 'output_user_name': 'Create/FlatMap(<lambda
at core.py:3507>)-out0'}), committed=14,
attempted=14)\nMetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/AddRandomKeys,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_FinishBundle),
labels={}), committed=0,
attempted=0)\nMetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/AddRandomKeys,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_StartBundle),
labels={}), committed=0,
attempted=0)\nMetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_ProcessElement),
labels={}), committed=0,
attempted=0)\nMetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_StartBundle),
labels={}), committed=0,
attempted=0)\nMetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/AddRandomKeys,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_ProcessElement),
labels={}), committed=0,
attempted=0)\nMetricResult(key=MetricKey(step=Create/FlatMap(<lambda at
core.py:3507>), metric=MetricName(namespace=dataflow/v1b3,
name=ExecutionTime_FinishBundle), labels={}), committed=0,
attempted=0)\nMetricResult(key=MetricKey(step=Create/FlatMap(<lambda at
core.py:3507>), metric=MetricName(namespace=dataflow/v1b3,
name=ExecutionTime_ProcessElement), labels={}), committed=0,
attempted=0)\nMetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_FinishBundle),
labels={}), committed=0,
attempted=0)\nMetricResult(key=MetricKey(step=Create/FlatMap(<lambda at
core.py:3507>), metric=MetricName(namespace=dataflow/v1b3,
name=ExecutionTime_StartBundle), labels={}), committed=0,
attempted=0)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionStepProgress),
labels={'original_name':
'dax_workflow_stage_progress_/workflows/wf-2022-12-13_03_39_51-13045768417156153586/phases/graph_runner/step-invocations/F15-invoke-16717086098877288771/map-tasks-completion/map-tasks',
'execution_step': 'F15'}), committed=1,
attempted=1)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ElementCount),
labels={'output_user_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read-out0',
'original_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read-out0-ElementCount'}),
committed=4, attempted=4)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=MeanByteCount),
labels={'output_user_name':
'Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys-out0', 'original_name':
'Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys-out0-MeanByteCount'}),
committed=14, attempted=14)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=MeanByteCount),
labels={'original_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)-out0-MeanByteCount',
'output_user_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)-out0'}),
committed=18, attempted=18)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ElementCount),
labels={'output_user_name':
'Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys-out0', 'original_name':
'Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys-out0-ElementCount'}),
committed=4, attempted=4)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ElementCount),
labels={'output_user_name': 'metrics-out0', 'original_name':
'metrics-out0-ElementCount'}), committed=4,
attempted=4)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=MeanByteCount),
labels={'original_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read-out0-MeanByteCount',
'output_user_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read-out0'}),
committed=48, attempted=48)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=MeanByteCount),
labels={'original_name': 'map_to_common_key-out0-MeanByteCount',
'output_user_name': 'map_to_common_key-out0'}), committed=18,
attempted=18)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=MeanByteCount),
labels={'output_user_name': 'metrics-out0', 'original_name':
'metrics-out0-MeanByteCount'}), committed=14,
attempted=14)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=MeanByteCount),
labels={'output_user_name': 'Create/Map(decode)-out0', 'original_name':
'Create/Map(decode)-out0-MeanByteCount'}), committed=14,
attempted=14)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ElementCount),
labels={'output_user_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)-out0',
'original_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)-out0-ElementCount'}),
committed=4, attempted=4)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ElementCount),
labels={'original_name': 'map_to_common_key-out0-ElementCount',
'output_user_name': 'map_to_common_key-out0'}), committed=4,
attempted=4)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ElementCount),
labels={'original_name': 'Create/Map(decode)-out0-ElementCount',
'output_user_name': 'Create/Map(decode)-out0'}), committed=4,
attempted=4)\nMetricResult(key=MetricKey(step=Create/Map(decode),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_ProcessElement),
labels={}), committed=0,
attempted=0)\nMetricResult(key=MetricKey(step=map_to_common_key,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_FinishBundle),
labels={}), committed=0,
attempted=0)\nMetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_ProcessElement),
labels={}), committed=0,
attempted=0)\nMetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_StartBundle),
labels={}), committed=0,
attempted=0)\nMetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_FinishBundle),
labels={}), committed=0,
attempted=0)\nMetricResult(key=MetricKey(step=Create/Map(decode),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_StartBundle),
labels={}), committed=0,
attempted=0)\nMetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_FinishBundle),
labels={}), committed=0,
attempted=0)\nMetricResult(key=MetricKey(step=Create/Map(decode),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_FinishBundle),
labels={}), committed=0, attempted=0)\nMetricResult(key=MetricKey(step=metrics,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_StartBundle),
labels={}), committed=946,
attempted=946)\nMetricResult(key=MetricKey(step=map_to_common_key,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_StartBundle),
labels={}), committed=0,
attempted=0)\nMetricResult(key=MetricKey(step=map_to_common_key,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_ProcessElement),
labels={}), committed=0, attempted=0)\nMetricResult(key=MetricKey(step=metrics,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_ProcessElement),
labels={}), committed=3993,
attempted=3993)\nMetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_ProcessElement),
labels={}), committed=0,
attempted=0)\nMetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_StartBundle),
labels={}), committed=0, attempted=0)\nMetricResult(key=MetricKey(step=metrics,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_FinishBundle),
labels={}), committed=1000, attempted=1000)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionStepProgress),
labels={'original_name':
'dax_workflow_stage_progress_/workflows/wf-2022-12-13_03_39_51-13045768417156153586/phases/graph_runner/step-invocations/F14-invoke-16717086098877289519/map-tasks-completion/map-tasks',
'execution_step': 'F14'}), committed=1,
attempted=1)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=MeanByteCount),
labels={'output_user_name': 'm_out-out0', 'original_name':
'm_out-out0-MeanByteCount'}), committed=15,
attempted=15)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ElementCount),
labels={'output_user_name': 'GroupByKey/Read-out0', 'original_name':
'GroupByKey/Read-out0-ElementCount'}), committed=1,
attempted=1)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=MeanByteCount),
labels={'output_user_name': 'GroupByKey/Read-out0', 'original_name':
'GroupByKey/Read-out0-MeanByteCount'}), committed=28,
attempted=28)\nMetricResult(key=MetricKey(step=,
metric=MetricName(namespace=dataflow/v1b3, name=ElementCount),
labels={'original_name': 'm_out-out0-ElementCount', 'output_user_name':
'm_out-out0'}), committed=5,
attempted=5)\nMetricResult(key=MetricKey(step=m_out,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_ProcessElement),
labels={}), committed=0, attempted=0)\nMetricResult(key=MetricKey(step=m_out,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_StartBundle),
labels={}), committed=0, attempted=0)\nMetricResult(key=MetricKey(step=m_out,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_FinishBundle),
labels={}), committed=0, attempted=0)" is not false : Unable to match metrics
for matcher name: 'ElementCount' (label_key: 'output_user_name' label_value:
'GroupByKey/Reify-out0'). (label_key: 'original_name' label_value:
'GroupByKey/Reify-out0-ElementCount'). attempted: a value greater than <0>
committed: a value greater than <0>Unable to match metrics for matcher name:
'MeanByteCount' (label_key: 'output_user_name' label_value:
'GroupByKey/Reify-out0'). (label_key: 'original_name' label_value:
'GroupByKey/Reify-out0-MeanByteCount'). attempted: a value greater than <0>
committed: a value greater than <0>Unable to match metrics for matcher name:
'ElementCount' (label_key: 'output_user_name' label_value:
'GroupByKey/GroupByWindow-out0'). (label_key: 'original_name' label_value:
'GroupByKey/GroupByWindow-out0-ElementCount'). attempted: a value greater than
<0> committed: a value greater than <0>Unable to match metrics for matcher
name: 'MeanByteCount' (label_key: 'output_user_name' label_value:
'GroupByKey/GroupByWindow-out0'). (label_key: 'original_name' label_value:
'GroupByKey/GroupByWindow-out0-MeanByteCount'). attempted: a value greater
than <0> committed: a value greater than <0>Unable to match metrics for matcher
name: 'ElementCount' (label_key: 'output_user_name' label_value:
'GroupByKey/Reify-out0'). (label_key: 'original_name' label_value:
'GroupByKey/Reify-out0-ElementCount'). attempted: a value greater than <0>
committed: a value greater than <0>Unable to match metrics for matcher name:
'MeanByteCount' (label_key: 'output_user_name' label_value:
'GroupByKey/Reify-out0'). (label_key: 'original_name' label_value:
'GroupByKey/Reify-out0-MeanByteCount'). attempted: a value greater than <0>
committed: a value greater than <0>
Actual MetricResults:
MetricResult(key=MetricKey(step=metrics,
metric=MetricName(namespace=apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline.UserMetricsDoFn,
name=total_values), labels={}), committed=100, attempted=100)
MetricResult(key=MetricKey(step=metrics,
metric=MetricName(namespace=apache_beam.runners.dataflow.dataflow_exercise_metrics_pipeline.UserMetricsDoFn,
name=distribution_values), labels={}), committed=DistributionResult(sum=100,
count=4, min=0, max=100, mean=25.0), attempted=DistributionResult(sum=100,
count=4, min=0, max=100, mean=25.0))
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=TotalVcpuTime), labels={'original_name': 'Service-cpu_num_seconds'}),
committed=581, attempted=581)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=TotalMemoryUsage), labels={'original_name': 'Service-mem_mb_seconds'}),
committed=2379913, attempted=2379913)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=TotalPdUsage), labels={'original_name': 'Service-pd_gb_seconds'}),
committed=7262, attempted=7262)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=TotalSsdUsage), labels={'original_name': 'Service-pd_ssd_gb_seconds'}),
committed=0, attempted=0)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=TotalShuffleDataProcessed), labels={'original_name':
'Service-shuffle_service_actual_gb'}), committed=None, attempted=None)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=BillableShuffleDataProcessed), labels={'original_name':
'Service-shuffle_service_chargeable_gb'}), committed=None, attempted=None)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=TotalStreamingDataProcessed), labels={'original_name':
'Service-streaming_service_gb'}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=TotalGpuTime), labels={'original_name': 'Service-gpu_num_seconds'}),
committed=0, attempted=0)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=CurrentShuffleSlotCount), labels={'original_name':
'dax-shuffle-current-shuffle-slots'}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=CurrentVcpuCount), labels={'original_name': 'Service-cpu_num'}),
committed=2, attempted=2)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=CurrentMemoryUsage), labels={'original_name': 'Service-mem_mb'}),
committed=8192, attempted=8192)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=CurrentPdUsage), labels={'original_name': 'Service-pd_gb'}), committed=25,
attempted=25)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=CurrentSsdUsage), labels={'original_name': 'Service-pd_ssd_gb'}),
committed=0, attempted=0)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=CurrentGpuCount), labels={'original_name': 'Service-gpu_num'}),
committed=0, attempted=0)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=PeakShuffleSlotCount), labels={'original_name':
'dax-shuffle-peak-shuffle-slots'}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=ExecutionStepProgress), labels={'execution_step': 'F16', 'original_name':
'dax_workflow_stage_progress_/workflows/wf-2022-12-13_03_39_51-13045768417156153586/phases/graph_runner/step-invocations/F16-invoke-16717086098877291371/map-tasks-completion/map-tasks'}),
committed=1, attempted=1)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=ElementCount), labels={'original_name':
'Create/Impulse-out0-ElementCount', 'output_user_name':
'Create/Impulse-out0'}), committed=1, attempted=1)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=MeanByteCount), labels={'original_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify-out0-MeanByteCount',
'output_user_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify-out0'}),
committed=45, attempted=45)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=ElementCount), labels={'output_user_name':
'Create/MaybeReshuffle/Reshuffle/AddRandomKeys-out0', 'original_name':
'Create/MaybeReshuffle/Reshuffle/AddRandomKeys-out0-ElementCount'}),
committed=4, attempted=4)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=MeanByteCount), labels={'output_user_name':
'Create/MaybeReshuffle/Reshuffle/AddRandomKeys-out0', 'original_name':
'Create/MaybeReshuffle/Reshuffle/AddRandomKeys-out0-MeanByteCount'}),
committed=18, attempted=18)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=ElementCount), labels={'original_name': 'Create/FlatMap(<lambda at
core.py:3507>)-out0-ElementCount', 'output_user_name': 'Create/FlatMap(<lambda
at core.py:3507>)-out0'}), committed=4, attempted=4)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=ElementCount), labels={'original_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)-out0-ElementCount',
'output_user_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)-out0'}),
committed=4, attempted=4)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=MeanByteCount), labels={'output_user_name': 'Create/Impulse-out0',
'original_name': 'Create/Impulse-out0-MeanByteCount'}), committed=13,
attempted=13)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=ElementCount), labels={'output_user_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify-out0',
'original_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify-out0-ElementCount'}),
committed=4, attempted=4)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=MeanByteCount), labels={'output_user_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)-out0',
'original_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)-out0-MeanByteCount'}),
committed=26, attempted=26)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=MeanByteCount), labels={'original_name': 'Create/FlatMap(<lambda at
core.py:3507>)-out0-MeanByteCount', 'output_user_name': 'Create/FlatMap(<lambda
at core.py:3507>)-out0'}), committed=14, attempted=14)
MetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/AddRandomKeys,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_FinishBundle),
labels={}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/AddRandomKeys,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_StartBundle),
labels={}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_ProcessElement),
labels={}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_StartBundle),
labels={}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/AddRandomKeys,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_ProcessElement),
labels={}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=Create/FlatMap(<lambda at core.py:3507>),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_FinishBundle),
labels={}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=Create/FlatMap(<lambda at core.py:3507>),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_ProcessElement),
labels={}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_FinishBundle),
labels={}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=Create/FlatMap(<lambda at core.py:3507>),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_StartBundle),
labels={}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=ExecutionStepProgress), labels={'original_name':
'dax_workflow_stage_progress_/workflows/wf-2022-12-13_03_39_51-13045768417156153586/phases/graph_runner/step-invocations/F15-invoke-16717086098877288771/map-tasks-completion/map-tasks',
'execution_step': 'F15'}), committed=1, attempted=1)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=ElementCount), labels={'output_user_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read-out0',
'original_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read-out0-ElementCount'}),
committed=4, attempted=4)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=MeanByteCount), labels={'output_user_name':
'Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys-out0', 'original_name':
'Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys-out0-MeanByteCount'}),
committed=14, attempted=14)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=MeanByteCount), labels={'original_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)-out0-MeanByteCount',
'output_user_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)-out0'}),
committed=18, attempted=18)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=ElementCount), labels={'output_user_name':
'Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys-out0', 'original_name':
'Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys-out0-ElementCount'}),
committed=4, attempted=4)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=ElementCount), labels={'output_user_name': 'metrics-out0',
'original_name': 'metrics-out0-ElementCount'}), committed=4, attempted=4)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=MeanByteCount), labels={'original_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read-out0-MeanByteCount',
'output_user_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read-out0'}),
committed=48, attempted=48)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=MeanByteCount), labels={'original_name':
'map_to_common_key-out0-MeanByteCount', 'output_user_name':
'map_to_common_key-out0'}), committed=18, attempted=18)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=MeanByteCount), labels={'output_user_name': 'metrics-out0',
'original_name': 'metrics-out0-MeanByteCount'}), committed=14, attempted=14)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=MeanByteCount), labels={'output_user_name': 'Create/Map(decode)-out0',
'original_name': 'Create/Map(decode)-out0-MeanByteCount'}), committed=14,
attempted=14)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=ElementCount), labels={'output_user_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)-out0',
'original_name':
'Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)-out0-ElementCount'}),
committed=4, attempted=4)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=ElementCount), labels={'original_name':
'map_to_common_key-out0-ElementCount', 'output_user_name':
'map_to_common_key-out0'}), committed=4, attempted=4)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=ElementCount), labels={'original_name':
'Create/Map(decode)-out0-ElementCount', 'output_user_name':
'Create/Map(decode)-out0'}), committed=4, attempted=4)
MetricResult(key=MetricKey(step=Create/Map(decode),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_ProcessElement),
labels={}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=map_to_common_key,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_FinishBundle),
labels={}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_ProcessElement),
labels={}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_StartBundle),
labels={}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_FinishBundle),
labels={}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=Create/Map(decode),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_StartBundle),
labels={}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_FinishBundle),
labels={}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=Create/Map(decode),
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_FinishBundle),
labels={}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=metrics,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_StartBundle),
labels={}), committed=946, attempted=946)
MetricResult(key=MetricKey(step=map_to_common_key,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_StartBundle),
labels={}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=map_to_common_key,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_ProcessElement),
labels={}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=metrics,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_ProcessElement),
labels={}), committed=3993, attempted=3993)
MetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_ProcessElement),
labels={}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_StartBundle),
labels={}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=metrics,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_FinishBundle),
labels={}), committed=1000, attempted=1000)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=ExecutionStepProgress), labels={'original_name':
'dax_workflow_stage_progress_/workflows/wf-2022-12-13_03_39_51-13045768417156153586/phases/graph_runner/step-invocations/F14-invoke-16717086098877289519/map-tasks-completion/map-tasks',
'execution_step': 'F14'}), committed=1, attempted=1)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=MeanByteCount), labels={'output_user_name': 'm_out-out0', 'original_name':
'm_out-out0-MeanByteCount'}), committed=15, attempted=15)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=ElementCount), labels={'output_user_name': 'GroupByKey/Read-out0',
'original_name': 'GroupByKey/Read-out0-ElementCount'}), committed=1,
attempted=1)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=MeanByteCount), labels={'output_user_name': 'GroupByKey/Read-out0',
'original_name': 'GroupByKey/Read-out0-MeanByteCount'}), committed=28,
attempted=28)
MetricResult(key=MetricKey(step=, metric=MetricName(namespace=dataflow/v1b3,
name=ElementCount), labels={'original_name': 'm_out-out0-ElementCount',
'output_user_name': 'm_out-out0'}), committed=5, attempted=5)
MetricResult(key=MetricKey(step=m_out,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_ProcessElement),
labels={}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=m_out,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_StartBundle),
labels={}), committed=0, attempted=0)
MetricResult(key=MetricKey(step=m_out,
metric=MetricName(namespace=dataflow/v1b3, name=ExecutionTime_FinishBundle),
labels={}), committed=0, attempted=0)
======= 1 failed, 4 passed, 5 skipped, 6 warnings in 2817.92s (0:46:57) ========
cleanup_container
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20221213-105720922524486
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:d9427f0451bb7920740b1a6b2cf8776bd469f4a6ded02ce03c5df3786d9df71b
Untagged:
us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:a6b84054-6d21-4177-b8e9-017b974633dd
Untagged:
us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:f073f581a51d27efa1c6acba0c7c8e54b97751b9a21d25f7d701a682b62a6ce6
Deleted: sha256:671382930f0cefb38b6c9296c2d45a71b047e3317e730af06c700e8782fe24ab
Deleted: sha256:424e535bd48768fe34fdd4c159a63a88db20cfcdc1ab60a01e86ed5dfa578941
Deleted: sha256:0893d92cc6508e1d45b2daa78b5b4813731c2287e15e1c619292eba98345a015
Deleted: sha256:3eac35c0a0a9ce0ad984078568171ed4e0c276dd0b18942219026e6af61d23e7
Deleted: sha256:9fe18174e257ac89b169fe0b475f471871b7901a4277c4ad13b71836f81ac7a2
Deleted: sha256:21df37bccc67057217edce5a12a3728ca88b122ce123aac8be7432487426f217
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:d9427f0451bb7920740b1a6b2cf8776bd469f4a6ded02ce03c5df3786d9df71b
Associated tags:
- 20221213-105720922524486
Tags:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20221213-105720922524486
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20221213-105720922524486].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:d9427f0451bb7920740b1a6b2cf8776bd469f4a6ded02ce03c5df3786d9df71b].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:f073f581a51d27efa1c6acba0c7c8e54b97751b9a21d25f7d701a682b62a6ce6
Associated tags:
- a6b84054-6d21-4177-b8e9-017b974633dd
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:a6b84054-6d21-4177-b8e9-017b974633dd].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:f073f581a51d27efa1c6acba0c7c8e54b97751b9a21d25f7d701a682b62a6ce6].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:ce06a60b217e46a6fe49ea3b110d27710aa766d9d562d69276e86bb37a3553bb
Associated tags:
- 2d163278-7c3a-4ab1-8adc-c66c4a3329e8
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:2d163278-7c3a-4ab1-8adc-c66c4a3329e8].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:ce06a60b217e46a6fe49ea3b110d27710aa766d9d562d69276e86bb37a3553bb].
Removed the container
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer FAILED
FAILURE: Build completed with 4 failures.
1: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 331
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py310:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 331
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py39:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
3: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 331
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py37:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
4: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 331
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py38:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 7m 31s
62 actionable tasks: 51 executed, 4 from cache, 7 up-to-date
Publishing build scan...
https://gradle.com/s/vjh2ke64gzrfa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
