See <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/285/display/redirect>
Changes: ------------------------------------------ [...truncated 1.03 MB...] [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:15:08.461Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_11#vocabulary]/MergeCountPerToken/GroupByKey/Read+Analyze/VocabularyMerge[compute_and_apply_vocabulary_11#vocabulary]/MergeCountPerToken/Combine+Analyze/VocabularyMerge[compute_and_apply_vocabulary_11#vocabulary]/MergeCountPerToken/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_11#vocabulary]/SwapTokensAndCounts/KvSwap+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_11#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyPrune[compute_and_apply_vocabulary_11#vocabulary]/ApplyThresholdsAndTopK/FilterByThresholds(5.0)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_11#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_11#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_11#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyPrune[compute_and_apply_vocabulary_11#vocabulary]/ApplyThresholdsAndTopK/FlattenToSingleMetric+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_11#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_11#vocabulary]/BatchAndPreSort/BatchVocabulary/ParDo(_GlobalWindowsBatchingDoFn)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_11#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_11#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_11#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_11#vocabulary]/BatchAndPreSort/SortBatches [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:15:13.342Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_2#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/GroupByKey/Read+Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_2#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/Combine+Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_2#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/GroupByKey+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/Combine/Partial+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/GroupByKey/Write [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:15:13.380Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:15:13.425Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:15:13.466Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:15:13.486Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:15:13.576Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:15:13.601Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:15:13.679Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/GroupByKey/Read+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/Combine+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/SwapTokensAndCounts/KvSwap+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyPrune[compute_and_apply_vocabulary_2#vocabulary]/ApplyThresholdsAndTopK/FilterByThresholds(5.0)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyPrune[compute_and_apply_vocabulary_2#vocabulary]/ApplyThresholdsAndTopK/FlattenToSingleMetric+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_2#vocabulary]/BatchAndPreSort/BatchVocabulary/ParDo(_GlobalWindowsBatchingDoFn)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_2#vocabulary]/BatchAndPreSort/SortBatches [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:24.889Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_20#vocabulary]/MergeCountPerToken/GroupByKey/Read+Analyze/VocabularyMerge[compute_and_apply_vocabulary_20#vocabulary]/MergeCountPerToken/Combine+Analyze/VocabularyMerge[compute_and_apply_vocabulary_20#vocabulary]/MergeCountPerToken/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_20#vocabulary]/SwapTokensAndCounts/KvSwap+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyPrune[compute_and_apply_vocabulary_20#vocabulary]/ApplyThresholdsAndTopK/FilterByThresholds(5.0)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyPrune[compute_and_apply_vocabulary_20#vocabulary]/ApplyThresholdsAndTopK/FlattenToSingleMetric+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/BatchAndPreSort/BatchVocabulary/ParDo(_GlobalWindowsBatchingDoFn)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/BatchAndPreSort/SortBatches [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:24.954Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:24.975Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:24.992Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/OrderElements/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:25.002Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:25.040Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/OrderElements/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:25.041Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/UnKey [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:25.123Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:25.246Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:25.330Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/Prepare/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/Prepare/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/Prepare/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/OrderElements+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/Map(<lambda at iobase.py:1144>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/WindowInto(WindowIntoFn)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Write [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:25.601Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:25.641Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/UnKey [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:36.658Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/UnKey [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:36.763Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:36.811Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:36.914Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Impulse+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Map(decode)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/FormatCount+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_20#vocabulary#temporary_analyzer_output_1#vocab_compute_and_apply_vocabulary_20_vocabulary_pruned_vocab_size]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:37.311Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/UnKey [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:37.397Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:37.463Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:37.566Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Impulse+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Map(decode)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/FormatCount+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_20#vocabulary#temporary_analyzer_output#vocab_compute_and_apply_vocabulary_20_vocabulary_unpruned_vocab_size]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:48.771Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/Prepare/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/Prepare/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/Prepare/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/OrderElements+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/Map(<lambda at iobase.py:1144>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/WindowInto(WindowIntoFn)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Write [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:48.926Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:49.496Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Impulse+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Map(decode)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/FormatCount+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_20#vocabulary#temporary_analyzer_output_1#vocab_compute_and_apply_vocabulary_20_vocabulary_pruned_vocab_size]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:49.611Z: JOB_MESSAGE_BASIC: Executing operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input62 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:49.662Z: JOB_MESSAGE_BASIC: Finished operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input62 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:49.932Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:49.972Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Read+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/WriteBundles [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:49.981Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Impulse+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Map(decode)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/FormatCount+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_20#vocabulary#temporary_analyzer_output#vocab_compute_and_apply_vocabulary_20_vocabulary_unpruned_vocab_size]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:50.071Z: JOB_MESSAGE_BASIC: Executing operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input61 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:50.116Z: JOB_MESSAGE_BASIC: Finished operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input61 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:58.518Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_15#vocabulary]/MergeCountPerToken/GroupByKey/Read+Analyze/VocabularyMerge[compute_and_apply_vocabulary_15#vocabulary]/MergeCountPerToken/Combine+Analyze/VocabularyMerge[compute_and_apply_vocabulary_15#vocabulary]/MergeCountPerToken/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_15#vocabulary]/SwapTokensAndCounts/KvSwap+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyPrune[compute_and_apply_vocabulary_15#vocabulary]/ApplyThresholdsAndTopK/FilterByThresholds(5.0)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyPrune[compute_and_apply_vocabulary_15#vocabulary]/ApplyThresholdsAndTopK/FlattenToSingleMetric+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/BatchAndPreSort/BatchVocabulary/ParDo(_GlobalWindowsBatchingDoFn)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/BatchAndPreSort/SortBatches [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:58.596Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:58.621Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:58.641Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/OrderElements/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:58.645Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:58.672Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:58.685Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/OrderElements/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:58.687Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/UnKey [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:58.724Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/UnKey [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:58.790Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:58.925Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:59.020Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/Prepare/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/Prepare/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/Prepare/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/OrderElements+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WriteToText/Write/WriteImpl/Map(<lambda at iobase.py:1144>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WriteToText/Write/WriteImpl/WindowInto(WindowIntoFn)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Write [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:27:59.900Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Read+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/WriteBundles [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:00.007Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite/View-python_side_input1 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:00.013Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/PreFinalize/View-python_side_input1 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:00.050Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite/View-python_side_input1 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:00.076Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/PreFinalize/View-python_side_input1 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:00.165Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/PreFinalize [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:00.415Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/UnKey [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:00.521Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:00.565Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:00.655Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Impulse+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Map(decode)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/FormatCount+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_15#vocabulary#temporary_analyzer_output#vocab_compute_and_apply_vocabulary_15_vocabulary_unpruned_vocab_size]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:00.913Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/UnKey [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:00.996Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:01.050Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:01.133Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Impulse+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Map(decode)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/FormatCount+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_15#vocabulary#temporary_analyzer_output_1#vocab_compute_and_apply_vocabulary_15_vocabulary_pruned_vocab_size]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:03.806Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_3#vocabulary]/MergeCountPerToken/GroupByKey/Read+Analyze/VocabularyMerge[compute_and_apply_vocabulary_3#vocabulary]/MergeCountPerToken/Combine+Analyze/VocabularyMerge[compute_and_apply_vocabulary_3#vocabulary]/MergeCountPerToken/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_3#vocabulary]/SwapTokensAndCounts/KvSwap+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyPrune[compute_and_apply_vocabulary_3#vocabulary]/ApplyThresholdsAndTopK/FilterByThresholds(5.0)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyPrune[compute_and_apply_vocabulary_3#vocabulary]/ApplyThresholdsAndTopK/FlattenToSingleMetric+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/BatchAndPreSort/BatchVocabulary/ParDo(_GlobalWindowsBatchingDoFn)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/BatchAndPreSort/SortBatches [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:03.864Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:03.884Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:03.904Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/OrderElements/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:03.910Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:03.933Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:03.960Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/OrderElements/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:03.964Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/UnKey [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:03.984Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/UnKey [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:04.052Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:04.191Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:04.279Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/Prepare/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/Prepare/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/Prepare/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/OrderElements+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WriteToText/Write/WriteImpl/Map(<lambda at iobase.py:1144>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WriteToText/Write/WriteImpl/WindowInto(WindowIntoFn)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Write [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:04.620Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/PreFinalize [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:04.711Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite/View-python_side_input2 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:04.761Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite/View-python_side_input2 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:04.855Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:05.183Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Impulse+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Map(decode)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/FormatCount+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_15#vocabulary#temporary_analyzer_output_1#vocab_compute_and_apply_vocabulary_15_vocabulary_pruned_vocab_size]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:05.288Z: JOB_MESSAGE_BASIC: Executing operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input47 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:05.329Z: JOB_MESSAGE_BASIC: Finished operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input47 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:05.628Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/UnKey [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:05.717Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:05.761Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:05.837Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Impulse+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Map(decode)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/FormatCount+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_3#vocabulary#temporary_analyzer_output#vocab_compute_and_apply_vocabulary_3_vocabulary_unpruned_vocab_size]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:13.342Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/Prepare/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/Prepare/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/Prepare/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/OrderElements+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WriteToText/Write/WriteImpl/Map(<lambda at iobase.py:1144>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WriteToText/Write/WriteImpl/WindowInto(WindowIntoFn)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Write [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:13.384Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:13.895Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:13.932Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Read+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WriteToText/Write/WriteImpl/WriteBundles [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:14.778Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:14.895Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WaitForVocabularyFile/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:14.942Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WaitForVocabularyFile/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:14.943Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/Prepare/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/Prepare/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/Prepare/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/OrderElements+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WriteToText/Write/WriteImpl/Map(<lambda at iobase.py:1144>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WriteToText/Write/WriteImpl/WindowInto(WindowIntoFn)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Write [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:15.015Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:15.042Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/CreatePath/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/CreatePath/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/CreatePath/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WaitForVocabularyFile+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_20#vocabulary#temporary_analyzer_output_2#Const]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:15.308Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Impulse+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Map(decode)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_3#vocabulary]/FormatCount+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_3#vocabulary#temporary_analyzer_output#vocab_compute_and_apply_vocabulary_3_vocabulary_unpruned_vocab_size]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:15.415Z: JOB_MESSAGE_BASIC: Executing operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input10 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:15.454Z: JOB_MESSAGE_BASIC: Finished operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input10 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:15.725Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/UnKey [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:15.836Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:15.887Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:15.989Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Impulse+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Map(decode)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/FormatCount+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_3#vocabulary#temporary_analyzer_output_1#vocab_compute_and_apply_vocabulary_3_vocabulary_pruned_vocab_size]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:16.129Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Impulse+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Map(decode)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/FormatCount+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_15#vocabulary#temporary_analyzer_output#vocab_compute_and_apply_vocabulary_15_vocabulary_unpruned_vocab_size]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:16.259Z: JOB_MESSAGE_BASIC: Executing operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input46 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:16.299Z: JOB_MESSAGE_BASIC: Finished operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input46 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:16.312Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:16.370Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Read+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WriteToText/Write/WriteImpl/WriteBundles [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:16.386Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/CreatePath/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/CreatePath/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/CreatePath/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WaitForVocabularyFile+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_20#vocabulary#temporary_analyzer_output_2#Const]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:16.501Z: JOB_MESSAGE_BASIC: Executing operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input63 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:16.543Z: JOB_MESSAGE_BASIC: Finished operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input63 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:16.807Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Read+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WriteToText/Write/WriteImpl/WriteBundles [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:16.903Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite/View-python_side_input1 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:16.923Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WriteToText/Write/WriteImpl/PreFinalize/View-python_side_input1 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:16.951Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite/View-python_side_input1 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:16.969Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WriteToText/Write/WriteImpl/PreFinalize/View-python_side_input1 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:17.055Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WriteToText/Write/WriteImpl/PreFinalize [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:17.421Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Impulse+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Map(decode)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_3#vocabulary]/FormatCount+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_3#vocabulary#temporary_analyzer_output_1#vocab_compute_and_apply_vocabulary_3_vocabulary_pruned_vocab_size]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:17.527Z: JOB_MESSAGE_BASIC: Executing operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input11 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:17.577Z: JOB_MESSAGE_BASIC: Finished operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input11 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:19.859Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Read+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WriteToText/Write/WriteImpl/WriteBundles [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:19.967Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite/View-python_side_input1 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:20.009Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WriteToText/Write/WriteImpl/PreFinalize/View-python_side_input1 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:20.011Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite/View-python_side_input1 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:20.047Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WriteToText/Write/WriteImpl/PreFinalize/View-python_side_input1 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:20.176Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WriteToText/Write/WriteImpl/PreFinalize [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:20.443Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WriteToText/Write/WriteImpl/PreFinalize [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:20.547Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite/View-python_side_input2 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:20.589Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite/View-python_side_input2 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:28:20.690Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:38:05.982Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WriteToText/Write/WriteImpl/PreFinalize [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:38:06.067Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite/View-python_side_input2 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:38:06.113Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite/View-python_side_input2 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:38:06.209Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:38:06.793Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:38:06.884Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WaitForVocabularyFile/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:38:06.932Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WaitForVocabularyFile/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:38:07.020Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/CreatePath/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/CreatePath/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/CreatePath/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WaitForVocabularyFile+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_15#vocabulary#temporary_analyzer_output_2#Const]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:43:36.157Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/CreatePath/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/CreatePath/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/CreatePath/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/WaitForVocabularyFile+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_15#vocabulary#temporary_analyzer_output_2#Const]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:43:36.243Z: JOB_MESSAGE_BASIC: Executing operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input48 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:43:36.287Z: JOB_MESSAGE_BASIC: Finished operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input48 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:47:56.548Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:47:56.623Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WaitForVocabularyFile/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:47:56.668Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WaitForVocabularyFile/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:47:56.752Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/CreatePath/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/CreatePath/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/CreatePath/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WaitForVocabularyFile+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_3#vocabulary#temporary_analyzer_output_2#Const]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:50:14.763Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/GroupByKey/Read+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/Combine+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/SwapTokensAndCounts/KvSwap+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyPrune[compute_and_apply_vocabulary_2#vocabulary]/ApplyThresholdsAndTopK/FilterByThresholds(5.0)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyPrune[compute_and_apply_vocabulary_2#vocabulary]/ApplyThresholdsAndTopK/FlattenToSingleMetric+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_2#vocabulary]/BatchAndPreSort/BatchVocabulary/ParDo(_GlobalWindowsBatchingDoFn)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_2#vocabulary]/BatchAndPreSort/SortBatches [31m[1mERROR [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204 2023-10-19T01:50:14.828Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: S751:Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/GroupByKey/Read+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/Combine+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/SwapTokensAndCounts/KvSwap+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyPrune[compute_and_apply_vocabulary_2#vocabulary]/ApplyThresholdsAndTopK/FilterByThresholds(5.0)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyPrune[compute_and_apply_vocabulary_2#vocabulary]/ApplyThresholdsAndTopK/FlattenToSingleMetric+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_2#vocabulary]/BatchAndPreSort/BatchVocabulary/ParDo(_GlobalWindowsBatchingDoFn)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_2#vocabulary]/BatchAndPreSort/SortBatches failed., The job failed because a work item has failed 4 times. Look in previous log entries for the cause of each one of the 4 failures. If the logs only contain generic timeout errors related to accessing external resources, such as MongoDB, verify that the worker service account has permission to access the resource's subnetwork. For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors. The work item was attempted on these workers: Root cause: Timed out waiting for an update from the worker. For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors#worker-lost-contact. Worker ID: beamapp-jenkins-101900532-10181755-zqzg-harness-mfrm, Root cause: Timed out waiting for an update from the worker. For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors#worker-lost-contact. Worker ID: beamapp-jenkins-101900532-10181755-zqzg-harness-ncq2, Root cause: Timed out waiting for an update from the worker. For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors#worker-lost-contact. Worker ID: beamapp-jenkins-101900532-10181755-zqzg-harness-6p7p, Root cause: Timed out waiting for an update from the worker. For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors#worker-lost-contact. Worker ID: beamapp-jenkins-101900532-10181755-zqzg-harness-wjg6 [33mWARNING [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:202 2023-10-19T01:50:14.968Z: JOB_MESSAGE_WARNING: Unable to delete temp files: "gs://temp-storage-for-perf-tests/loadtests/beamapp-jenkins-1019005323-340128-zxz6xnth.1697676803.340343/dax-tmp-2023-10-18_17_55_13-9656559928275428243-S62-0-1d6b5c4da9000ef4/[email protected]." [33mWARNING [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:202 2023-10-19T01:50:14.988Z: JOB_MESSAGE_WARNING: S62:Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/CreatePath/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/CreatePath/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/CreatePath/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WaitForVocabularyFile+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_3#vocabulary#temporary_analyzer_output_2#Const]/ToTensorBinding failed. [33mWARNING [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:202 2023-10-19T01:50:15.001Z: JOB_MESSAGE_WARNING: Unable to delete temp files: "gs://temp-storage-for-perf-tests/loadtests/beamapp-jenkins-1019005323-340128-zxz6xnth.1697676803.340343/dax-tmp-2023-10-18_17_55_13-9656559928275428243-S322-0-877cc4fab0f0f0aa/[email protected]." [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:50:15.010Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/CreatePath/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/CreatePath/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/CreatePath/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_3#vocabulary]/WaitForVocabularyFile+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_3#vocabulary#temporary_analyzer_output_2#Const]/ToTensorBinding [33mWARNING [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:202 2023-10-19T01:50:15.020Z: JOB_MESSAGE_WARNING: S322:Analyze/VocabularyMerge[compute_and_apply_vocabulary_11#vocabulary]/MergeCountPerToken/GroupByKey/Read+Analyze/VocabularyMerge[compute_and_apply_vocabulary_11#vocabulary]/MergeCountPerToken/Combine+Analyze/VocabularyMerge[compute_and_apply_vocabulary_11#vocabulary]/MergeCountPerToken/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_11#vocabulary]/SwapTokensAndCounts/KvSwap+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_11#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyPrune[compute_and_apply_vocabulary_11#vocabulary]/ApplyThresholdsAndTopK/FilterByThresholds(5.0)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_11#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_11#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_11#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyPrune[compute_and_apply_vocabulary_11#vocabulary]/ApplyThresholdsAndTopK/FlattenToSingleMetric+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_11#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_11#vocabulary]/BatchAndPreSort/BatchVocabulary/ParDo(_GlobalWindowsBatchingDoFn)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_11#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_11#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_11#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_11#vocabulary]/BatchAndPreSort/SortBatches failed. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:50:15.040Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_11#vocabulary]/MergeCountPerToken/GroupByKey/Read+Analyze/VocabularyMerge[compute_and_apply_vocabulary_11#vocabulary]/MergeCountPerToken/Combine+Analyze/VocabularyMerge[compute_and_apply_vocabulary_11#vocabulary]/MergeCountPerToken/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_11#vocabulary]/SwapTokensAndCounts/KvSwap+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_11#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyPrune[compute_and_apply_vocabulary_11#vocabulary]/ApplyThresholdsAndTopK/FilterByThresholds(5.0)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_11#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_11#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_11#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyPrune[compute_and_apply_vocabulary_11#vocabulary]/ApplyThresholdsAndTopK/FlattenToSingleMetric+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_11#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_11#vocabulary]/BatchAndPreSort/BatchVocabulary/ParDo(_GlobalWindowsBatchingDoFn)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_11#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_11#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_11#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_11#vocabulary]/BatchAndPreSort/SortBatches [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:50:15.616Z: JOB_MESSAGE_BASIC: Stopping worker pool... [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-19T01:53:08.981Z: JOB_MESSAGE_BASIC: Worker pool stopped. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:150 Job 2023-10-18_17_55_13-9656559928275428243 is in state JOB_STATE_FAILED [31m[1mERROR [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:770 Console URL: https://console.cloud.google.com/dataflow/jobs/<RegionId>/2023-10-18_17_55_13-9656559928275428243?project=<ProjectId> [33m=============================== warnings summary ===============================[0m ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tensorflow/python/framework/dtypes.py:35 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tensorflow/python/framework/dtypes.py:35 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tensorflow/python/framework/dtypes.py:35 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tensorflow/python/framework/dtypes.py:35 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tensorflow/python/framework/dtypes.py:35 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tensorflow/python/framework/dtypes.py:35 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tensorflow/python/framework/dtypes.py:35 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tensorflow/python/framework/dtypes.py:35 <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/tensorflow/python/framework/dtypes.py>:35: DeprecationWarning: ml_dtypes.float8_e4m3b11 is deprecated. Use ml_dtypes.float8_e4m3b11fnuz from tensorflow.tsl.python.lib.core import pywrap_ml_dtypes apache_beam/ml/inference/vertex_ai_inference_it_test.py:68 apache_beam/ml/inference/vertex_ai_inference_it_test.py:68 apache_beam/ml/inference/vertex_ai_inference_it_test.py:68 apache_beam/ml/inference/vertex_ai_inference_it_test.py:68 apache_beam/ml/inference/vertex_ai_inference_it_test.py:68 apache_beam/ml/inference/vertex_ai_inference_it_test.py:68 apache_beam/ml/inference/vertex_ai_inference_it_test.py:68 apache_beam/ml/inference/vertex_ai_inference_it_test.py:68 <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/apache_beam/ml/inference/vertex_ai_inference_it_test.py>:68: PytestUnknownMarkWarning: Unknown pytest.mark.uses_vertex_ai - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html @pytest.mark.uses_vertex_ai apache_beam/examples/ml_transform/ml_transform_it_test.py::LargeMovieReviewDatasetProcessTest::test_process_large_movie_review_dataset apache_beam/testing/benchmarks/cloudml/cloudml_benchmark_test.py::CloudMLTFTBenchmarkTest::test_cloudml_benchmark_criteo_10GB apache_beam/testing/benchmarks/cloudml/cloudml_benchmark_test.py::CloudMLTFTBenchmarkTest::test_cloudml_benchmark_criteo_small <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/apache_beam/testing/load_tests/load_test_metrics_utils.py>:483: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead. bq_dataset_ref = self._client.dataset(dataset_name) -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/pytest_TFTransformTests-df-py39.xml> - [36m[1m=========================== short test summary info ============================[0m [31mFAILED[0m apache_beam/testing/benchmarks/cloudml/cloudml_benchmark_test.py::[1mCloudMLTFTBenchmarkTest::test_cloudml_benchmark_cirteo_no_shuffle_10GB[0m - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Workflow failed. Causes: S751:Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/GroupByKey/Read+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/Combine+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/SwapTokensAndCounts/KvSwap+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyPrune[compute_and_apply_vocabulary_2#vocabulary]/ApplyThresholdsAndTopK/FilterByThresholds(5.0)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyPrune[compute_and_apply_vocabulary_2#vocabulary]/ApplyThresholdsAndTopK/FlattenToSingleMetric+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_2#vocabulary]/BatchAndPreSort/BatchVocabulary/ParDo(_GlobalWindowsBatchingDoFn)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_2#vocabulary]/BatchAndPreSort/SortBatches failed., The job failed because a work item has failed 4 times. Look in previous log entries for the cause of each one of the 4 failures. If the logs only contain generic timeout errors related to accessing external resources, such as MongoDB, verify that the worker service account has permission to access the resource's subnetwork. For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors. The work item was attempted on these workers: Root cause: Timed out waiting for an update from the worker. For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors#worker-lost-contact. Worker ID: beamapp-jenkins-101900532-10181755-zqzg-harness-mfrm, Root cause: Timed out waiting for an update from the worker. For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors#worker-lost-contact. Worker ID: beamapp-jenkins-101900532-10181755-zqzg-harness-ncq2, Root cause: Timed out waiting for an update from the worker. For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors#worker-lost-contact. Worker ID: beamapp-jenkins-101900532-10181755-zqzg-harness-6p7p, Root cause: Timed out waiting for an update from the worker. For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors#worker-lost-contact. Worker ID: beamapp-jenkins-101900532-10181755-zqzg-harness-wjg6 [31m====== [31m[1m1 failed[0m, [32m3 passed[0m, [33m11 skipped[0m, [33m19 warnings[0m[31m in 7194.67s (1:59:54)[0m[31m =======[0m > Task :sdks:python:test-suites:dataflow:py39:tftTests FAILED FAILURE: Build failed with an exception. * Where: Script '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 483 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py39:tftTests'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Get more help at https://help.gradle.org. Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation. BUILD FAILED in 2h 6m 14s 10 actionable tasks: 9 executed, 1 from cache Publishing build scan... https://ge.apache.org/s/p3kfl3wdi3qnc Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
