See <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/124/display/redirect?page=changes>
Changes: [noreply] fixup (#26657) ------------------------------------------ [...truncated 1.54 MB...] [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:55.486Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:55.498Z: JOB_MESSAGE_DEBUG: Value "Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_14#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Session" materialized. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:55.514Z: JOB_MESSAGE_DEBUG: Value "Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_14#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Session" materialized. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:55.600Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_17#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:55.613Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/OrderElements/View-python_side_input0-Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/OrderElements [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:55.633Z: JOB_MESSAGE_DEBUG: Value "Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Session" materialized. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:55.650Z: JOB_MESSAGE_DEBUG: Value "Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Session" materialized. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:55.658Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/OrderElements/View-python_side_input0-Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/OrderElements [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:55.667Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_14#vocabulary]/MergeCountPerToken/GroupByKey/Read+Analyze/VocabularyMerge[compute_and_apply_vocabulary_14#vocabulary]/MergeCountPerToken/Combine+Analyze/VocabularyMerge[compute_and_apply_vocabulary_14#vocabulary]/MergeCountPerToken/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_14#vocabulary]/SwapTokensAndCounts/KvSwap+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_14#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyPrune[compute_and_apply_vocabulary_14#vocabulary]/ApplyThresholdsAndTopK/FilterByThresholds(5.0)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_14#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_14#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_14#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyPrune[compute_and_apply_vocabulary_14#vocabulary]/ApplyThresholdsAndTopK/FlattenToSingleMetric+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_14#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_14#vocabulary]/BatchAndPreSort/BatchVocabulary/ParDo(_GlobalWindowsBatchingDoFn)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_14#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_14#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_14#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_14#vocabulary]/BatchAndPreSort/SortBatches [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:55.682Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_17#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_17#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_17#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_17#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/UnKey [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:55.701Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_13#vocabulary]/MergeCountPerToken/GroupByKey/Read+Analyze/VocabularyMerge[compute_and_apply_vocabulary_13#vocabulary]/MergeCountPerToken/Combine+Analyze/VocabularyMerge[compute_and_apply_vocabulary_13#vocabulary]/MergeCountPerToken/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_13#vocabulary]/SwapTokensAndCounts/KvSwap+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyPrune[compute_and_apply_vocabulary_13#vocabulary]/ApplyThresholdsAndTopK/FilterByThresholds(5.0)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyPrune[compute_and_apply_vocabulary_13#vocabulary]/ApplyThresholdsAndTopK/FlattenToSingleMetric+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_13#vocabulary]/BatchAndPreSort/BatchVocabulary/ParDo(_GlobalWindowsBatchingDoFn)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_13#vocabulary]/BatchAndPreSort/SortBatches [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:55.720Z: JOB_MESSAGE_DEBUG: Value "Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/OrderElements/View-python_side_input0-Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/OrderElements.out" materialized. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:55.757Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:55.873Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:55.910Z: JOB_MESSAGE_DEBUG: Value "Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Session" materialized. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:55.950Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/Prepare/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/Prepare/FlatMap(<lambda at core.py:3634>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/Prepare/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/OrderElements+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/WriteToText/Write/WriteImpl/Map(<lambda at iobase.py:1140>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/WriteToText/Write/WriteImpl/WindowInto(WindowIntoFn)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Write [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:56.239Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_17#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:56.262Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_1#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/GroupByKey/Read+Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_1#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/Combine+Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_1#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_1#vocabulary]/MergeCountPerToken/GroupByKey+Analyze/VocabularyMerge[compute_and_apply_vocabulary_1#vocabulary]/MergeCountPerToken/Combine/Partial+Analyze/VocabularyMerge[compute_and_apply_vocabulary_1#vocabulary]/MergeCountPerToken/GroupByKey/Write [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:56.293Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_17#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_17#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_17#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_17#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/UnKey [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:56.314Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_1#vocabulary]/MergeCountPerToken/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:57.545Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_1#vocabulary]/MergeCountPerToken/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:57.579Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:57.595Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:57.697Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:57.727Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:57.728Z: JOB_MESSAGE_DEBUG: Value "Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Session" materialized. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:57.763Z: JOB_MESSAGE_DEBUG: Value "Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Session" materialized. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:50:57.799Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_1#vocabulary]/MergeCountPerToken/GroupByKey/Read+Analyze/VocabularyMerge[compute_and_apply_vocabulary_1#vocabulary]/MergeCountPerToken/Combine+Analyze/VocabularyMerge[compute_and_apply_vocabulary_1#vocabulary]/MergeCountPerToken/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_1#vocabulary]/SwapTokensAndCounts/KvSwap+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyPrune[compute_and_apply_vocabulary_1#vocabulary]/ApplyThresholdsAndTopK/FilterByThresholds(5.0)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyPrune[compute_and_apply_vocabulary_1#vocabulary]/ApplyThresholdsAndTopK/FlattenToSingleMetric+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/BatchAndPreSort/BatchVocabulary/ParDo(_GlobalWindowsBatchingDoFn)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/BatchAndPreSort/SortBatches [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:05.899Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_9#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/GroupByKey/Read+Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_9#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/Combine+Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_9#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_9#vocabulary]/MergeCountPerToken/GroupByKey+Analyze/VocabularyMerge[compute_and_apply_vocabulary_9#vocabulary]/MergeCountPerToken/Combine/Partial+Analyze/VocabularyMerge[compute_and_apply_vocabulary_9#vocabulary]/MergeCountPerToken/GroupByKey/Write [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:05.954Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_9#vocabulary]/MergeCountPerToken/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:06.879Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_1#vocabulary]/MergeCountPerToken/GroupByKey/Read+Analyze/VocabularyMerge[compute_and_apply_vocabulary_1#vocabulary]/MergeCountPerToken/Combine+Analyze/VocabularyMerge[compute_and_apply_vocabulary_1#vocabulary]/MergeCountPerToken/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_1#vocabulary]/SwapTokensAndCounts/KvSwap+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyPrune[compute_and_apply_vocabulary_1#vocabulary]/ApplyThresholdsAndTopK/FilterByThresholds(5.0)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyPrune[compute_and_apply_vocabulary_1#vocabulary]/ApplyThresholdsAndTopK/FlattenToSingleMetric+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/BatchAndPreSort/BatchVocabulary/ParDo(_GlobalWindowsBatchingDoFn)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/BatchAndPreSort/SortBatches [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:06.935Z: JOB_MESSAGE_DEBUG: Value "Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/BatchAndPreSort/SortBatches.None" materialized. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:06.961Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:06.988Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:06.995Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_9#vocabulary]/MergeCountPerToken/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.011Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/OrderElements/View-python_side_input0-Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/OrderElements [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.046Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_9#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.057Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/OrderElements/View-python_side_input0-Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/OrderElements [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.072Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_9#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.107Z: JOB_MESSAGE_DEBUG: Value "Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/OrderElements/View-python_side_input0-Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/OrderElements.out" materialized. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.153Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.185Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_9#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.202Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_9#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.238Z: JOB_MESSAGE_DEBUG: Value "Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_9#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Session" materialized. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.256Z: JOB_MESSAGE_DEBUG: Value "Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_9#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Session" materialized. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.280Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.305Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_9#vocabulary]/MergeCountPerToken/GroupByKey/Read+Analyze/VocabularyMerge[compute_and_apply_vocabulary_9#vocabulary]/MergeCountPerToken/Combine+Analyze/VocabularyMerge[compute_and_apply_vocabulary_9#vocabulary]/MergeCountPerToken/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_9#vocabulary]/SwapTokensAndCounts/KvSwap+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_9#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyPrune[compute_and_apply_vocabulary_9#vocabulary]/ApplyThresholdsAndTopK/FilterByThresholds(5.0)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_9#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_9#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_9#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyPrune[compute_and_apply_vocabulary_9#vocabulary]/ApplyThresholdsAndTopK/FlattenToSingleMetric+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_9#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_9#vocabulary]/BatchAndPreSort/BatchVocabulary/ParDo(_GlobalWindowsBatchingDoFn)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_9#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_9#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_9#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_9#vocabulary]/BatchAndPreSort/SortBatches [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.326Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.331Z: JOB_MESSAGE_DEBUG: Value "Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Session" materialized. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.369Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/UnKey [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.397Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/Prepare/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/Prepare/FlatMap(<lambda at core.py:3634>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/Prepare/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/OrderElements+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/WriteToText/Write/WriteImpl/Map(<lambda at iobase.py:1140>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/WriteToText/Write/WriteImpl/WindowInto(WindowIntoFn)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Write [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.504Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_13#vocabulary]/MergeCountPerToken/GroupByKey/Read+Analyze/VocabularyMerge[compute_and_apply_vocabulary_13#vocabulary]/MergeCountPerToken/Combine+Analyze/VocabularyMerge[compute_and_apply_vocabulary_13#vocabulary]/MergeCountPerToken/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_13#vocabulary]/SwapTokensAndCounts/KvSwap+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyPrune[compute_and_apply_vocabulary_13#vocabulary]/ApplyThresholdsAndTopK/FilterByThresholds(5.0)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyPrune[compute_and_apply_vocabulary_13#vocabulary]/ApplyThresholdsAndTopK/FlattenToSingleMetric+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_13#vocabulary]/BatchAndPreSort/BatchVocabulary/ParDo(_GlobalWindowsBatchingDoFn)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_13#vocabulary]/BatchAndPreSort/SortBatches [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.550Z: JOB_MESSAGE_DEBUG: Value "Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_13#vocabulary]/BatchAndPreSort/SortBatches.None" materialized. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.577Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.593Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.617Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_13#vocabulary]/OrderElements/View-python_side_input0-Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_13#vocabulary]/OrderElements [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.661Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_13#vocabulary]/OrderElements/View-python_side_input0-Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_13#vocabulary]/OrderElements [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.712Z: JOB_MESSAGE_DEBUG: Value "Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_13#vocabulary]/OrderElements/View-python_side_input0-Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_13#vocabulary]/OrderElements.out" materialized. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.762Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_13#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.801Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.867Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/UnKey [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.902Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_13#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.920Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.963Z: JOB_MESSAGE_DEBUG: Value "Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_13#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Session" materialized. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:07.989Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/UnKey [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:08.014Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_13#vocabulary]/Prepare/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_13#vocabulary]/Prepare/FlatMap(<lambda at core.py:3634>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_13#vocabulary]/Prepare/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_13#vocabulary]/OrderElements+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_13#vocabulary]/WriteToText/Write/WriteImpl/Map(<lambda at iobase.py:1140>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_13#vocabulary]/WriteToText/Write/WriteImpl/WindowInto(WindowIntoFn)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_13#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Write [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:08.860Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:51:08.908Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_13#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/UnKey [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:57:01.079Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 2 based on the rate of progress in the currently running stage(s). [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:57:45.195Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/UnKey [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:57:45.232Z: JOB_MESSAGE_DEBUG: Value "Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/UnKey.None" materialized. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:57:45.272Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault/View-python_side_input0-Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:57:45.312Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault/View-python_side_input0-Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:57:45.347Z: JOB_MESSAGE_DEBUG: Value "Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault/View-python_side_input0-Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault.out" materialized. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:57:45.385Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Impulse+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/FlatMap(<lambda at core.py:3634>)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Map(decode)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_1#vocabulary]/FormatCount+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_1#vocabulary#temporary_analyzer_output_1#vocab_compute_and_apply_vocabulary_1_vocabulary_pruned_vocab_size]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:57:51.878Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/Prepare/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/Prepare/FlatMap(<lambda at core.py:3634>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/Prepare/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/OrderElements+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/WriteToText/Write/WriteImpl/Map(<lambda at iobase.py:1140>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/WriteToText/Write/WriteImpl/WindowInto(WindowIntoFn)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Write [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:57:51.934Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:57:53.079Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:238 2023-05-11T01:57:53.133Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Read+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_1#vocabulary]/WriteToText/Write/WriteImpl/WriteBundles [33m=============================== warnings summary ===============================[0m ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:15 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:15 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:15 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:15 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:15 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:15 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:15 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:15 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:15 <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses from imp import load_source ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:121 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:121 <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py>:121: DeprecationWarning: pkg_resources is deprecated as an API warnings.warn("pkg_resources is deprecated as an API", DeprecationWarning) ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:2870: 162 warnings <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py>:2870: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(pkg) ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:2870: 117 warnings <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py>:2870: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.cloud')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(pkg) ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:2349: 36 warnings <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py>:2349: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(parent) ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:2870 <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py>:2870: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.logging')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(pkg) ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:2870 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py:2870 <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/pkg_resources/__init__.py>:2870: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.iam')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages declare_namespace(pkg) ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/rpc/__init__.py:20 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/google/rpc/__init__.py:20 <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/rpc/__init__.py>:20: DeprecationWarning: Deprecated call to `pkg_resources.declare_namespace('google.rpc')`. Implementing implicit namespace packages (as specified in PEP 420) is preferred to `pkg_resources.declare_namespace`. See https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages pkg_resources.declare_namespace(__name__) apache_beam/typehints/pandas_type_compatibility_test.py:67 apache_beam/typehints/pandas_type_compatibility_test.py:67 apache_beam/typehints/pandas_type_compatibility_test.py:67 apache_beam/typehints/pandas_type_compatibility_test.py:67 apache_beam/typehints/pandas_type_compatibility_test.py:67 apache_beam/typehints/pandas_type_compatibility_test.py:67 apache_beam/typehints/pandas_type_compatibility_test.py:67 apache_beam/typehints/pandas_type_compatibility_test.py:67 <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:67: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. }).set_index(pd.Int64Index(range(123, 223), name='an_index')), apache_beam/typehints/pandas_type_compatibility_test.py:90 apache_beam/typehints/pandas_type_compatibility_test.py:90 apache_beam/typehints/pandas_type_compatibility_test.py:90 apache_beam/typehints/pandas_type_compatibility_test.py:90 apache_beam/typehints/pandas_type_compatibility_test.py:90 apache_beam/typehints/pandas_type_compatibility_test.py:90 apache_beam/typehints/pandas_type_compatibility_test.py:90 apache_beam/typehints/pandas_type_compatibility_test.py:90 <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. pd.Int64Index(range(123, 223), name='an_index'), apache_beam/typehints/pandas_type_compatibility_test.py:91 apache_beam/typehints/pandas_type_compatibility_test.py:91 apache_beam/typehints/pandas_type_compatibility_test.py:91 apache_beam/typehints/pandas_type_compatibility_test.py:91 apache_beam/typehints/pandas_type_compatibility_test.py:91 apache_beam/typehints/pandas_type_compatibility_test.py:91 apache_beam/typehints/pandas_type_compatibility_test.py:91 apache_beam/typehints/pandas_type_compatibility_test.py:91 <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:91: FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas in a future version. Use pandas.Index with the appropriate dtype instead. pd.Int64Index(range(475, 575), name='another_index'), apache_beam/testing/benchmarks/cloudml/cloudml_benchmark_test.py::CloudMLTFTBenchmarkTest::test_cloudml_benchmark_criteo_10GB apache_beam/testing/benchmarks/cloudml/cloudml_benchmark_test.py::CloudMLTFTBenchmarkTest::test_cloudml_benchmark_criteo_small <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/apache_beam/testing/load_tests/load_test_metrics_utils.py>:484: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead. bq_dataset_ref = self._client.dataset(dataset_name) -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/pytest_TFTransformTests-df-py39.xml> - [36m[1m=========================== short test summary info ============================[0m [31mFAILED[0m apache_beam/testing/benchmarks/cloudml/cloudml_benchmark_test.py::[1mCloudMLTFTBenchmarkTest::test_cloudml_benchmark_cirteo_no_shuffle_10GB[0m - Failed: Timeout >4500.0s [31m====== [31m[1m1 failed[0m, [32m2 passed[0m, [33m8 skipped[0m, [33m386 warnings[0m[31m in 8625.75s (2:23:45)[0m[31m =======[0m > Task :sdks:python:test-suites:dataflow:py39:tftTests FAILED FAILURE: Build failed with an exception. * Where: Script '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 428 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py39:tftTests'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 2h 26m 39s 16 actionable tasks: 10 executed, 4 from cache, 2 up-to-date Build scan background action failed. java.lang.IllegalArgumentException: com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590) at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557) at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230) at java.lang.reflect.WeakCache.get(WeakCache.java:127) at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419) at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719) at com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:66) at com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:61) at com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Publishing build scan... https://ge.apache.org/s/bb5nzule6qvr4 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
