See <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/273/display/redirect?page=changes>
Changes: [noreply] Fix interactive tests for Beam Notebooks release (#28880) ------------------------------------------ [...truncated 912.24 KB...] [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:05.439Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_14#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite/View-python_side_input1 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:05.468Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_14#vocabulary]/WriteToText/Write/WriteImpl/PreFinalize/View-python_side_input1 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:05.496Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_14#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Impulse+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_14#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_14#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Map(decode)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_14#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_14#vocabulary]/FormatCount+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_14#vocabulary#temporary_analyzer_output_1#vocab_compute_and_apply_vocabulary_14_vocabulary_pruned_vocab_size]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:05.567Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_14#vocabulary]/WriteToText/Write/WriteImpl/PreFinalize [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:05.587Z: JOB_MESSAGE_BASIC: Executing operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input44 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:05.633Z: JOB_MESSAGE_BASIC: Finished operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input44 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:05.885Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_14#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Impulse+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_14#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_14#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Map(decode)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_14#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_14#vocabulary]/FormatCount+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_14#vocabulary#temporary_analyzer_output#vocab_compute_and_apply_vocabulary_14_vocabulary_unpruned_vocab_size]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:05.900Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_19#vocabulary]/WriteToText/Write/WriteImpl/PreFinalize [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:05.967Z: JOB_MESSAGE_BASIC: Executing operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input43 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:05.991Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_19#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite/View-python_side_input2 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:06.026Z: JOB_MESSAGE_BASIC: Finished operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input43 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:06.042Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_19#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite/View-python_side_input2 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:06.127Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_19#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:06.319Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_7#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Impulse+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_7#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_7#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Map(decode)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_7#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_7#vocabulary]/FormatCount+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_7#vocabulary#temporary_analyzer_output#vocab_compute_and_apply_vocabulary_7_vocabulary_unpruned_vocab_size]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:06.406Z: JOB_MESSAGE_BASIC: Executing operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input22 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:06.450Z: JOB_MESSAGE_BASIC: Finished operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input22 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:06.555Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/WriteToText/Write/WriteImpl/PreFinalize [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:06.606Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_17#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_17#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_17#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_17#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/UnKey [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:06.640Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite/View-python_side_input2 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:06.680Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite/View-python_side_input2 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:06.741Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_17#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:06.816Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_17#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:06.816Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:06.936Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_17#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Impulse+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_17#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_17#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Map(decode)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_17#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_17#vocabulary]/FormatCount+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_17#vocabulary#temporary_analyzer_output#vocab_compute_and_apply_vocabulary_17_vocabulary_unpruned_vocab_size]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:07.211Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_23#vocabulary]/WriteToText/Write/WriteImpl/PreFinalize [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:07.247Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_14#vocabulary]/WriteToText/Write/WriteImpl/PreFinalize [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:07.314Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_23#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite/View-python_side_input2 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:07.331Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_14#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite/View-python_side_input2 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:07.354Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_23#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite/View-python_side_input2 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:07.376Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_14#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite/View-python_side_input2 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:07.433Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_23#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:07.468Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_14#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:07.623Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Impulse+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Map(decode)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary#vocabulary]/FormatCount+Analyze/CreateTensorBinding[compute_and_apply_vocabulary#vocabulary#temporary_analyzer_output_1#vocab_compute_and_apply_vocabulary_vocabulary_pruned_vocab_size]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:07.711Z: JOB_MESSAGE_BASIC: Executing operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input2 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:07.760Z: JOB_MESSAGE_BASIC: Finished operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input2 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:07.995Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Impulse+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Map(decode)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_1#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_1#vocabulary]/FormatCount+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_1#vocabulary#temporary_analyzer_output#vocab_compute_and_apply_vocabulary_1_vocabulary_unpruned_vocab_size]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:08.086Z: JOB_MESSAGE_BASIC: Executing operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input4 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:08.138Z: JOB_MESSAGE_BASIC: Finished operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input4 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:08.347Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_17#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Impulse+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_17#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_17#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Map(decode)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_17#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_17#vocabulary]/FormatCount+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_17#vocabulary#temporary_analyzer_output#vocab_compute_and_apply_vocabulary_17_vocabulary_unpruned_vocab_size]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:08.440Z: JOB_MESSAGE_BASIC: Executing operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input52 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:08.499Z: JOB_MESSAGE_BASIC: Finished operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input52 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:08.533Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_19#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:08.620Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_19#vocabulary]/WaitForVocabularyFile/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:08.664Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_19#vocabulary]/WaitForVocabularyFile/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:08.742Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_19#vocabulary]/CreatePath/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_19#vocabulary]/CreatePath/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_19#vocabulary]/CreatePath/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_19#vocabulary]/WaitForVocabularyFile+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_19#vocabulary#temporary_analyzer_output_2#Const]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:08.847Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_12#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Impulse+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_12#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_12#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Map(decode)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_12#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_12#vocabulary]/FormatCount+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_12#vocabulary#temporary_analyzer_output_1#vocab_compute_and_apply_vocabulary_12_vocabulary_pruned_vocab_size]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:08.930Z: JOB_MESSAGE_BASIC: Executing operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input38 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:08.969Z: JOB_MESSAGE_BASIC: Finished operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input38 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:09.395Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:09.480Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/WaitForVocabularyFile/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:09.530Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/WaitForVocabularyFile/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:09.612Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/CreatePath/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/CreatePath/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/CreatePath/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/WaitForVocabularyFile+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_17#vocabulary#temporary_analyzer_output_2#Const]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:10.162Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_23#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:10.253Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_23#vocabulary]/WaitForVocabularyFile/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:10.311Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_23#vocabulary]/WaitForVocabularyFile/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:10.397Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_23#vocabulary]/CreatePath/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_23#vocabulary]/CreatePath/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_23#vocabulary]/CreatePath/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_23#vocabulary]/WaitForVocabularyFile+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_23#vocabulary#temporary_analyzer_output_2#Const]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:10.406Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_19#vocabulary]/CreatePath/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_19#vocabulary]/CreatePath/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_19#vocabulary]/CreatePath/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_19#vocabulary]/WaitForVocabularyFile+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_19#vocabulary#temporary_analyzer_output_2#Const]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:10.497Z: JOB_MESSAGE_BASIC: Executing operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input60 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:10.559Z: JOB_MESSAGE_BASIC: Finished operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input60 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:10.677Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_14#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:10.764Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_14#vocabulary]/WaitForVocabularyFile/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:10.813Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_14#vocabulary]/WaitForVocabularyFile/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:10.893Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_14#vocabulary]/CreatePath/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_14#vocabulary]/CreatePath/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_14#vocabulary]/CreatePath/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_14#vocabulary]/WaitForVocabularyFile+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_14#vocabulary#temporary_analyzer_output_2#Const]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:10.934Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/CreatePath/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/CreatePath/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/CreatePath/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_17#vocabulary]/WaitForVocabularyFile+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_17#vocabulary#temporary_analyzer_output_2#Const]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:11.018Z: JOB_MESSAGE_BASIC: Executing operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input54 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:11.063Z: JOB_MESSAGE_BASIC: Finished operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input54 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:32.320Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_23#vocabulary]/CreatePath/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_23#vocabulary]/CreatePath/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_23#vocabulary]/CreatePath/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_23#vocabulary]/WaitForVocabularyFile+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_23#vocabulary#temporary_analyzer_output_2#Const]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:32.415Z: JOB_MESSAGE_BASIC: Executing operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input72 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:32.459Z: JOB_MESSAGE_BASIC: Finished operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input72 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:32.662Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_14#vocabulary]/CreatePath/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_14#vocabulary]/CreatePath/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_14#vocabulary]/CreatePath/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_14#vocabulary]/WaitForVocabularyFile+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_14#vocabulary#temporary_analyzer_output_2#Const]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:32.756Z: JOB_MESSAGE_BASIC: Executing operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input45 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:54:32.808Z: JOB_MESSAGE_BASIC: Finished operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input45 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:55:15.882Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_20#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/GroupByKey/Read+Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_20#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/Combine+Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_20#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_20#vocabulary]/MergeCountPerToken/GroupByKey+Analyze/VocabularyMerge[compute_and_apply_vocabulary_20#vocabulary]/MergeCountPerToken/Combine/Partial+Analyze/VocabularyMerge[compute_and_apply_vocabulary_20#vocabulary]/MergeCountPerToken/GroupByKey/Write [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:55:15.932Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_20#vocabulary]/MergeCountPerToken/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:55:15.978Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_20#vocabulary]/MergeCountPerToken/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:55:16.095Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:55:16.110Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:55:16.209Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:55:16.227Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T01:55:16.303Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_20#vocabulary]/MergeCountPerToken/GroupByKey/Read+Analyze/VocabularyMerge[compute_and_apply_vocabulary_20#vocabulary]/MergeCountPerToken/Combine+Analyze/VocabularyMerge[compute_and_apply_vocabulary_20#vocabulary]/MergeCountPerToken/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_20#vocabulary]/SwapTokensAndCounts/KvSwap+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyPrune[compute_and_apply_vocabulary_20#vocabulary]/ApplyThresholdsAndTopK/FilterByThresholds(5.0)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyPrune[compute_and_apply_vocabulary_20#vocabulary]/ApplyThresholdsAndTopK/FlattenToSingleMetric+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/BatchAndPreSort/BatchVocabulary/ParDo(_GlobalWindowsBatchingDoFn)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/BatchAndPreSort/SortBatches [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:09:55.179Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_20#vocabulary]/MergeCountPerToken/GroupByKey/Read+Analyze/VocabularyMerge[compute_and_apply_vocabulary_20#vocabulary]/MergeCountPerToken/Combine+Analyze/VocabularyMerge[compute_and_apply_vocabulary_20#vocabulary]/MergeCountPerToken/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_20#vocabulary]/SwapTokensAndCounts/KvSwap+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyPrune[compute_and_apply_vocabulary_20#vocabulary]/ApplyThresholdsAndTopK/FilterByThresholds(5.0)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyPrune[compute_and_apply_vocabulary_20#vocabulary]/ApplyThresholdsAndTopK/FlattenToSingleMetric+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/BatchAndPreSort/BatchVocabulary/ParDo(_GlobalWindowsBatchingDoFn)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/BatchAndPreSort/SortBatches [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:09:55.245Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:09:55.265Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:09:55.285Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/OrderElements/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:09:55.289Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:09:55.309Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:09:55.325Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/UnKey [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:09:55.333Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/OrderElements/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:09:55.345Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/UnKey [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:09:55.496Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:09:55.606Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:09:55.697Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/Prepare/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/Prepare/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/Prepare/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/OrderElements+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/Map(<lambda at iobase.py:1144>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/WindowInto(WindowIntoFn)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Write [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:15.330Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/UnKey [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:15.414Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:15.457Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:15.545Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Impulse+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Map(decode)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/FormatCount+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_20#vocabulary#temporary_analyzer_output#vocab_compute_and_apply_vocabulary_20_vocabulary_unpruned_vocab_size]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:16.018Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Read+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Extract+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/UnKey [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:16.114Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:16.169Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault/View-python_side_input0 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:16.259Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Impulse+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Map(decode)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/FormatCount+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_20#vocabulary#temporary_analyzer_output_1#vocab_compute_and_apply_vocabulary_20_vocabulary_pruned_vocab_size]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:17.940Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Impulse+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Map(decode)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_20#vocabulary]/FormatCount+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_20#vocabulary#temporary_analyzer_output#vocab_compute_and_apply_vocabulary_20_vocabulary_unpruned_vocab_size]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:18.031Z: JOB_MESSAGE_BASIC: Executing operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input61 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:18.079Z: JOB_MESSAGE_BASIC: Finished operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input61 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:18.638Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Impulse+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/DoOnce/Map(decode)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/InjectDefault+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_20#vocabulary]/FormatCount+Analyze/CreateTensorBinding[compute_and_apply_vocabulary_20#vocabulary#temporary_analyzer_output_1#vocab_compute_and_apply_vocabulary_20_vocabulary_pruned_vocab_size]/ToTensorBinding [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:18.735Z: JOB_MESSAGE_BASIC: Executing operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input62 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:18.779Z: JOB_MESSAGE_BASIC: Finished operation Analyze/CreateSavedModel[tf_v2_only]/ReplaceWithConstants/View-python_side_input62 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:26.675Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_2#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/GroupByKey/Read+Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_2#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/Combine+Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_2#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/GroupByKey+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/Combine/Partial+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/GroupByKey/Write [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:26.725Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:26.882Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:26.923Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:26.942Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:27.047Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:27.064Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:27.157Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/GroupByKey/Read+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/Combine+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/SwapTokensAndCounts/KvSwap+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyPrune[compute_and_apply_vocabulary_2#vocabulary]/ApplyThresholdsAndTopK/FilterByThresholds(5.0)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyPrune[compute_and_apply_vocabulary_2#vocabulary]/ApplyThresholdsAndTopK/FlattenToSingleMetric+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_2#vocabulary]/BatchAndPreSort/BatchVocabulary/ParDo(_GlobalWindowsBatchingDoFn)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_2#vocabulary]/BatchAndPreSort/SortBatches [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:43.389Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/Prepare/Impulse+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/Prepare/FlatMap(<lambda at core.py:3759>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/Prepare/Map(decode)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/OrderElements+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/Map(<lambda at iobase.py:1144>)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/WindowInto(WindowIntoFn)+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Write [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:43.437Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:44.502Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:10:44.549Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Read+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/WriteBundles [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:11:59.260Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_15#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/GroupByKey/Read+Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_15#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/Combine+Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_15#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_15#vocabulary]/MergeCountPerToken/GroupByKey+Analyze/VocabularyMerge[compute_and_apply_vocabulary_15#vocabulary]/MergeCountPerToken/Combine/Partial+Analyze/VocabularyMerge[compute_and_apply_vocabulary_15#vocabulary]/MergeCountPerToken/GroupByKey/Write [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:11:59.305Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_15#vocabulary]/MergeCountPerToken/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:11:59.919Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_15#vocabulary]/MergeCountPerToken/GroupByKey/Close [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:11:59.959Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:11:59.979Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:12:00.065Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:12:00.085Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Create [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:12:00.172Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_15#vocabulary]/MergeCountPerToken/GroupByKey/Read+Analyze/VocabularyMerge[compute_and_apply_vocabulary_15#vocabulary]/MergeCountPerToken/Combine+Analyze/VocabularyMerge[compute_and_apply_vocabulary_15#vocabulary]/MergeCountPerToken/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_15#vocabulary]/SwapTokensAndCounts/KvSwap+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyPrune[compute_and_apply_vocabulary_15#vocabulary]/ApplyThresholdsAndTopK/FilterByThresholds(5.0)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyPrune[compute_and_apply_vocabulary_15#vocabulary]/ApplyThresholdsAndTopK/FlattenToSingleMetric+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/BatchAndPreSort/BatchVocabulary/ParDo(_GlobalWindowsBatchingDoFn)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/BatchAndPreSort/SortBatches [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:12:25.914Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/GroupByKey/Read+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/WriteBundles [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:12:26.001Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite/View-python_side_input1 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:12:26.021Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/PreFinalize/View-python_side_input1 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:12:26.051Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/FinalizeWrite/View-python_side_input1 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:12:26.071Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/PreFinalize/View-python_side_input1 [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:12:26.166Z: JOB_MESSAGE_BASIC: Executing operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/PreFinalize [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:14:07.125Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_11#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/GroupByKey/Read+Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_11#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/Combine+Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_11#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_11#vocabulary]/MergeCountPerToken/GroupByKey+Analyze/VocabularyMerge[compute_and_apply_vocabulary_11#vocabulary]/MergeCountPerToken/Combine/Partial+Analyze/VocabularyMerge[compute_and_apply_vocabulary_11#vocabulary]/MergeCountPerToken/GroupByKey/Write [31m[1mERROR [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:204 2023-10-07T02:14:07.206Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: S318:Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_11#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/GroupByKey/Read+Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_11#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/Combine+Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_11#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_11#vocabulary]/MergeCountPerToken/GroupByKey+Analyze/VocabularyMerge[compute_and_apply_vocabulary_11#vocabulary]/MergeCountPerToken/Combine/Partial+Analyze/VocabularyMerge[compute_and_apply_vocabulary_11#vocabulary]/MergeCountPerToken/GroupByKey/Write failed., The job failed because a work item has failed 4 times. Look in previous log entries for the cause of each one of the 4 failures. If the logs only contain generic timeout errors related to accessing external resources, such as MongoDB, verify that the worker service account has permission to access the resource's subnetwork. For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors. The work item was attempted on these workers: Root cause: Timed out waiting for an update from the worker. For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors#worker-lost-contact. Worker ID: beamapp-jenkins-100701232-10061824-imvq-harness-1g9w, Root cause: Timed out waiting for an update from the worker. For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors#worker-lost-contact. Worker ID: beamapp-jenkins-100701232-10061824-imvq-harness-1g9w, Root cause: Timed out waiting for an update from the worker. For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors#worker-lost-contact. Worker ID: beamapp-jenkins-100701232-10061824-imvq-harness-xkw3, Root cause: Timed out waiting for an update from the worker. For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors#worker-lost-contact. Worker ID: beamapp-jenkins-100701232-10061824-imvq-harness-8dt2 [33mWARNING [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:202 2023-10-07T02:14:07.426Z: JOB_MESSAGE_WARNING: Unable to delete temp files: "gs://temp-storage-for-perf-tests/loadtests/beamapp-jenkins-1007012329-295728-gscolod6.1696641809.295931/dax-tmp-2023-10-06_18_24_25-7629049022789493026-S674-0-8dffeba39c44a1f8/[email protected]." [33mWARNING [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:202 2023-10-07T02:14:07.434Z: JOB_MESSAGE_WARNING: Unable to delete temp files: "gs://temp-storage-for-perf-tests/loadtests/beamapp-jenkins-1007012329-295728-gscolod6.1696641809.295931/dax-tmp-2023-10-06_18_24_25-7629049022789493026-S751-0-5fe50f0846c4122b/[email protected]." [33mWARNING [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:202 2023-10-07T02:14:07.435Z: JOB_MESSAGE_WARNING: Unable to delete temp files: "gs://temp-storage-for-perf-tests/loadtests/beamapp-jenkins-1007012329-295728-gscolod6.1696641809.295931/dax-tmp-2023-10-06_18_24_25-7629049022789493026-S465-0-b245b7c6d28ecfc9/[email protected]." [33mWARNING [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:202 2023-10-07T02:14:07.443Z: JOB_MESSAGE_WARNING: S674:Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/PreFinalize failed. [33mWARNING [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:202 2023-10-07T02:14:07.453Z: JOB_MESSAGE_WARNING: S751:Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/GroupByKey/Read+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/Combine+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/SwapTokensAndCounts/KvSwap+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyPrune[compute_and_apply_vocabulary_2#vocabulary]/ApplyThresholdsAndTopK/FilterByThresholds(5.0)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyPrune[compute_and_apply_vocabulary_2#vocabulary]/ApplyThresholdsAndTopK/FlattenToSingleMetric+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_2#vocabulary]/BatchAndPreSort/BatchVocabulary/ParDo(_GlobalWindowsBatchingDoFn)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_2#vocabulary]/BatchAndPreSort/SortBatches failed. [33mWARNING [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:202 2023-10-07T02:14:07.453Z: JOB_MESSAGE_WARNING: S465:Analyze/VocabularyMerge[compute_and_apply_vocabulary_15#vocabulary]/MergeCountPerToken/GroupByKey/Read+Analyze/VocabularyMerge[compute_and_apply_vocabulary_15#vocabulary]/MergeCountPerToken/Combine+Analyze/VocabularyMerge[compute_and_apply_vocabulary_15#vocabulary]/MergeCountPerToken/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_15#vocabulary]/SwapTokensAndCounts/KvSwap+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyPrune[compute_and_apply_vocabulary_15#vocabulary]/ApplyThresholdsAndTopK/FilterByThresholds(5.0)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyPrune[compute_and_apply_vocabulary_15#vocabulary]/ApplyThresholdsAndTopK/FlattenToSingleMetric+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/BatchAndPreSort/BatchVocabulary/ParDo(_GlobalWindowsBatchingDoFn)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/BatchAndPreSort/SortBatches failed. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:14:07.466Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_20#vocabulary]/WriteToText/Write/WriteImpl/PreFinalize [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:14:07.475Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_15#vocabulary]/MergeCountPerToken/GroupByKey/Read+Analyze/VocabularyMerge[compute_and_apply_vocabulary_15#vocabulary]/MergeCountPerToken/Combine+Analyze/VocabularyMerge[compute_and_apply_vocabulary_15#vocabulary]/MergeCountPerToken/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_15#vocabulary]/SwapTokensAndCounts/KvSwap+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyPrune[compute_and_apply_vocabulary_15#vocabulary]/ApplyThresholdsAndTopK/FilterByThresholds(5.0)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyPrune[compute_and_apply_vocabulary_15#vocabulary]/ApplyThresholdsAndTopK/FlattenToSingleMetric+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/BatchAndPreSort/BatchVocabulary/ParDo(_GlobalWindowsBatchingDoFn)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_15#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_15#vocabulary]/BatchAndPreSort/SortBatches [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:14:07.475Z: JOB_MESSAGE_BASIC: Finished operation Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/GroupByKey/Read+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/Combine+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/MergeCountPerToken/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_2#vocabulary]/SwapTokensAndCounts/KvSwap+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyPrune[compute_and_apply_vocabulary_2#vocabulary]/ApplyThresholdsAndTopK/FilterByThresholds(5.0)+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountUnfiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyPrune[compute_and_apply_vocabulary_2#vocabulary]/ApplyThresholdsAndTopK/FlattenToSingleMetric+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/KeyWithVoid+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_2#vocabulary]/BatchAndPreSort/BatchVocabulary/ParDo(_GlobalWindowsBatchingDoFn)+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/Combine/Partial+Analyze/VocabularyCountFiltered[compute_and_apply_vocabulary_2#vocabulary]/TotalVocabSize/CombineGlobally(CountCombineFn)/CombinePerKey/GroupByKey/Write+Analyze/VocabularyOrderAndWrite[compute_and_apply_vocabulary_2#vocabulary]/BatchAndPreSort/SortBatches [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:14:08.105Z: JOB_MESSAGE_BASIC: Stopping worker pool... [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 2023-10-07T02:16:51.765Z: JOB_MESSAGE_BASIC: Worker pool stopped. [32mINFO [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:150 Job 2023-10-06_18_24_25-7629049022789493026 is in state JOB_STATE_FAILED [31m[1mERROR [0m apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:770 Console URL: https://console.cloud.google.com/dataflow/jobs/<RegionId>/2023-10-06_18_24_25-7629049022789493026?project=<ProjectId> [33m=============================== warnings summary ===============================[0m ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:28 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:28 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:28 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:28 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:28 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:28 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:28 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:28 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py:28 <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/hdfs/config.py>:28: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses from imp import load_source ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tensorflow/python/framework/dtypes.py:35 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tensorflow/python/framework/dtypes.py:35 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tensorflow/python/framework/dtypes.py:35 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tensorflow/python/framework/dtypes.py:35 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tensorflow/python/framework/dtypes.py:35 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tensorflow/python/framework/dtypes.py:35 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tensorflow/python/framework/dtypes.py:35 ../../build/gradleenv/-1734967050/lib/python3.9/site-packages/tensorflow/python/framework/dtypes.py:35 <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/tensorflow/python/framework/dtypes.py>:35: DeprecationWarning: ml_dtypes.float8_e4m3b11 is deprecated. Use ml_dtypes.float8_e4m3b11fnuz from tensorflow.tsl.python.lib.core import pywrap_ml_dtypes apache_beam/ml/inference/vertex_ai_inference_it_test.py:68 apache_beam/ml/inference/vertex_ai_inference_it_test.py:68 apache_beam/ml/inference/vertex_ai_inference_it_test.py:68 apache_beam/ml/inference/vertex_ai_inference_it_test.py:68 apache_beam/ml/inference/vertex_ai_inference_it_test.py:68 apache_beam/ml/inference/vertex_ai_inference_it_test.py:68 apache_beam/ml/inference/vertex_ai_inference_it_test.py:68 apache_beam/ml/inference/vertex_ai_inference_it_test.py:68 <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/apache_beam/ml/inference/vertex_ai_inference_it_test.py>:68: PytestUnknownMarkWarning: Unknown pytest.mark.uses_vertex_ai - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html @pytest.mark.uses_vertex_ai apache_beam/examples/ml_transform/ml_transform_it_test.py::LargeMovieReviewDatasetProcessTest::test_process_large_movie_review_dataset apache_beam/testing/benchmarks/cloudml/cloudml_benchmark_test.py::CloudMLTFTBenchmarkTest::test_cloudml_benchmark_cirteo_no_shuffle_10GB apache_beam/testing/benchmarks/cloudml/cloudml_benchmark_test.py::CloudMLTFTBenchmarkTest::test_cloudml_benchmark_criteo_small <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/apache_beam/testing/load_tests/load_test_metrics_utils.py>:483: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead. bq_dataset_ref = self._client.dataset(dataset_name) -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/pytest_TFTransformTests-df-py39.xml> - [36m[1m=========================== short test summary info ============================[0m [31mFAILED[0m apache_beam/testing/benchmarks/cloudml/cloudml_benchmark_test.py::[1mCloudMLTFTBenchmarkTest::test_cloudml_benchmark_criteo_10GB[0m - apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: Workflow failed. Causes: S318:Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_11#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/GroupByKey/Read+Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_11#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/Combine+Analyze/VocabularyAccumulate[compute_and_apply_vocabulary_11#vocabulary]/CountPerToken/CombinePerKey(CountCombineFn)/Combine/Extract+Analyze/VocabularyMerge[compute_and_apply_vocabulary_11#vocabulary]/MergeCountPerToken/GroupByKey+Analyze/VocabularyMerge[compute_and_apply_vocabulary_11#vocabulary]/MergeCountPerToken/Combine/Partial+Analyze/VocabularyMerge[compute_and_apply_vocabulary_11#vocabulary]/MergeCountPerToken/GroupByKey/Write failed., The job failed because a work item has failed 4 times. Look in previous log entries for the cause of each one of the 4 failures. If the logs only contain generic timeout errors related to accessing external resources, such as MongoDB, verify that the worker service account has permission to access the resource's subnetwork. For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors. The work item was attempted on these workers: Root cause: Timed out waiting for an update from the worker. For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors#worker-lost-contact. Worker ID: beamapp-jenkins-100701232-10061824-imvq-harness-1g9w, Root cause: Timed out waiting for an update from the worker. For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors#worker-lost-contact. Worker ID: beamapp-jenkins-100701232-10061824-imvq-harness-1g9w, Root cause: Timed out waiting for an update from the worker. For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors#worker-lost-contact. Worker ID: beamapp-jenkins-100701232-10061824-imvq-harness-xkw3, Root cause: Timed out waiting for an update from the worker. For more information, see https://cloud.google.com/dataflow/docs/guides/common-errors#worker-lost-contact. Worker ID: beamapp-jenkins-100701232-10061824-imvq-harness-8dt2 [31m====== [31m[1m1 failed[0m, [32m3 passed[0m, [33m11 skipped[0m, [33m28 warnings[0m[31m in 6330.69s (1:45:30)[0m[31m =======[0m > Task :sdks:python:test-suites:dataflow:py39:tftTests FAILED FAILURE: Build failed with an exception. * Where: Script '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 483 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py39:tftTests'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Get more help at https://help.gradle.org. Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. For more on this, please refer to https://docs.gradle.org/8.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation. BUILD FAILED in 1h 47m 59s 10 actionable tasks: 9 executed, 1 from cache Publishing build scan... https://ge.apache.org/s/a6brbtfcc5dlq Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
