See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/1281/display/redirect?page=changes>
Changes: [noreply] [BEAM-11988] added a fix for missing sample.txt (#14889) [noreply] [BEAM-621] Add MapKeys, MapValues transforms (#14273) ------------------------------------------ [...truncated 1.10 MB...] DEBUG:root:Unhandled type_constraint: Union[] DEBUG:root:Unhandled type_constraint: Union[] DEBUG:root:Unhandled type_constraint: Union[] WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter. INFO:root:Default Python SDK image for environment is apache/beam_python3.6_sdk:2.31.0.dev INFO:root:No image given, using default Python SDK image WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter. INFO:root:Default Python SDK image for environment is apache/beam_python3.6_sdk:2.31.0.dev INFO:root:Python SDK container image set to "apache/beam_python3.6_sdk:2.31.0.dev" for Docker environment INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7fb4d4a99598> ==================== DEBUG:apache_beam.runners.portability.fn_api_runner.translations:39 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1] DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['ref_AppliedPTransform_Main1-Impulse_3\n Main1/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Main1-FlatMap-lambda-at-core-py-2962-_4\n Main1/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Main1-Map-decode-_6\n Main1/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Main2-Impulse_8\n Main2/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Main2-FlatMap-lambda-at-core-py-2962-_9\n Main2/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Main2-Map-decode-_11\n Main2/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Side-Impulse_13\n Side/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Side-FlatMap-lambda-at-core-py-2962-_14\n Side/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Side-Map-decode-_16\n Side/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8ExternalTransform-beam-transforms-xlang-test-multi--View-AsSingleton-Combine-GloballyAsSingletonView\n ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/WithKeys/AddKeys/Map/ParMultiDo(Anonymous):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8ExternalTransform-beam-transforms-xlang-test-multi--View-AsSingleton-Combine-GloballyAsSingletonView8\n ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton):beam:transform:combine_per_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8ExternalTransform-beam-transforms-xlang-test-multi--View-AsSingleton-Combine-GloballyAsSingletonView9\n ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Values/Values/Map/ParMultiDo(Anonymous):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8ExternalTransform-beam-transforms-xlang-test-multi--Flatten-PCollections\n ExternalTransform(beam:transforms:xlang:test:multi)/Flatten.PCollections:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8ExternalTransform-beam-transforms-xlang-test-multi--ParDo-Anonymous--ParMultiDo-Anonymous-\n ExternalTransform(beam:transforms:xlang:test:multi)/ParDo(Anonymous)/ParMultiDo(Anonymous):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8ExternalTransform-beam-transforms-xlang-test-multi--MapElements-Map-ParMultiDo-Anonymous-\n ExternalTransform(beam:transforms:xlang:test:multi)/MapElements/Map/ParMultiDo(Anonymous):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Impulse_20\n assert_that/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2962-_21\n assert_that/Create/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Map-decode-_23\n assert_that/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_24\n assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-ToVoidKey_25\n assert_that/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_0_27\n assert_that/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_1_28\n assert_that/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Flatten_29\n assert_that/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-GroupByKey_30\n assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_31\n assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Unkey_32\n assert_that/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Match_33\n assert_that/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Create-Impulse_36\n CheckSide/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Create-FlatMap-lambda-at-core-py-2962-_37\n CheckSide/Create/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Create-Map-decode-_39\n CheckSide/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-WindowInto-WindowIntoFn-_40\n CheckSide/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-ToVoidKey_41\n CheckSide/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Group-pair_with_0_43\n CheckSide/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Group-pair_with_1_44\n CheckSide/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Group-Flatten_45\n CheckSide/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Group-GroupByKey_46\n CheckSide/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Group-Map-_merge_tagged_vals_under_key-_47\n CheckSide/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Unkey_48\n CheckSide/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Match_49\n CheckSide/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>'] INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7fb4d4a99620> ==================== DEBUG:apache_beam.runners.portability.fn_api_runner.translations:42 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1] DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['ref_AppliedPTransform_Main1-Impulse_3\n Main1/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Main1-FlatMap-lambda-at-core-py-2962-_4\n Main1/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Main1-Map-decode-_6\n Main1/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Main2-Impulse_8\n Main2/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Main2-FlatMap-lambda-at-core-py-2962-_9\n Main2/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Main2-Map-decode-_11\n Main2/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Side-Impulse_13\n Side/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Side-FlatMap-lambda-at-core-py-2962-_14\n Side/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Side-Map-decode-_16\n Side/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8ExternalTransform-beam-transforms-xlang-test-multi--View-AsSingleton-Combine-GloballyAsSingletonView\n ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/WithKeys/AddKeys/Map/ParMultiDo(Anonymous):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/Precombine\n ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/Precombine:beam:transform:combine_per_key_precombine:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/Group\n ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/Group:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/Merge\n ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/Merge:beam:transform:combine_per_key_merge_accumulators:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/ExtractOutputs\n ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/ExtractOutputs:beam:transform:combine_per_key_extract_outputs:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8ExternalTransform-beam-transforms-xlang-test-multi--View-AsSingleton-Combine-GloballyAsSingletonView9\n ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Values/Values/Map/ParMultiDo(Anonymous):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8ExternalTransform-beam-transforms-xlang-test-multi--Flatten-PCollections\n ExternalTransform(beam:transforms:xlang:test:multi)/Flatten.PCollections:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8ExternalTransform-beam-transforms-xlang-test-multi--ParDo-Anonymous--ParMultiDo-Anonymous-\n ExternalTransform(beam:transforms:xlang:test:multi)/ParDo(Anonymous)/ParMultiDo(Anonymous):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8ExternalTransform-beam-transforms-xlang-test-multi--MapElements-Map-ParMultiDo-Anonymous-\n ExternalTransform(beam:transforms:xlang:test:multi)/MapElements/Map/ParMultiDo(Anonymous):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Impulse_20\n assert_that/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2962-_21\n assert_that/Create/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Map-decode-_23\n assert_that/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_24\n assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-ToVoidKey_25\n assert_that/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_0_27\n assert_that/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_1_28\n assert_that/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Flatten_29\n assert_that/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-GroupByKey_30\n assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_31\n assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Unkey_32\n assert_that/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Match_33\n assert_that/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Create-Impulse_36\n CheckSide/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Create-FlatMap-lambda-at-core-py-2962-_37\n CheckSide/Create/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Create-Map-decode-_39\n CheckSide/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-WindowInto-WindowIntoFn-_40\n CheckSide/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-ToVoidKey_41\n CheckSide/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Group-pair_with_0_43\n CheckSide/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Group-pair_with_1_44\n CheckSide/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Group-Flatten_45\n CheckSide/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Group-GroupByKey_46\n CheckSide/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Group-Map-_merge_tagged_vals_under_key-_47\n CheckSide/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Unkey_48\n CheckSide/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Match_49\n CheckSide/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>'] INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7fb4d4a99d08> ==================== DEBUG:apache_beam.runners.portability.fn_api_runner.translations:42 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1] DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['ref_AppliedPTransform_Main1-Impulse_3\n Main1/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Main1-FlatMap-lambda-at-core-py-2962-_4\n Main1/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Main1-Map-decode-_6\n Main1/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Main2-Impulse_8\n Main2/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Main2-FlatMap-lambda-at-core-py-2962-_9\n Main2/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Main2-Map-decode-_11\n Main2/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Side-Impulse_13\n Side/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Side-FlatMap-lambda-at-core-py-2962-_14\n Side/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Side-Map-decode-_16\n Side/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8ExternalTransform-beam-transforms-xlang-test-multi--View-AsSingleton-Combine-GloballyAsSingletonView\n ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/WithKeys/AddKeys/Map/ParMultiDo(Anonymous):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/Precombine\n ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/Precombine:beam:transform:combine_per_key_precombine:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/Group\n ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/Group:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/Merge\n ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/Merge:beam:transform:combine_per_key_merge_accumulators:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/ExtractOutputs\n ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/ExtractOutputs:beam:transform:combine_per_key_extract_outputs:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8ExternalTransform-beam-transforms-xlang-test-multi--View-AsSingleton-Combine-GloballyAsSingletonView9\n ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Values/Values/Map/ParMultiDo(Anonymous):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8ExternalTransform-beam-transforms-xlang-test-multi--Flatten-PCollections\n ExternalTransform(beam:transforms:xlang:test:multi)/Flatten.PCollections:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8ExternalTransform-beam-transforms-xlang-test-multi--ParDo-Anonymous--ParMultiDo-Anonymous-\n ExternalTransform(beam:transforms:xlang:test:multi)/ParDo(Anonymous)/ParMultiDo(Anonymous):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_8ExternalTransform-beam-transforms-xlang-test-multi--MapElements-Map-ParMultiDo-Anonymous-\n ExternalTransform(beam:transforms:xlang:test:multi)/MapElements/Map/ParMultiDo(Anonymous):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Impulse_20\n assert_that/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2962-_21\n assert_that/Create/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Map-decode-_23\n assert_that/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_24\n assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-ToVoidKey_25\n assert_that/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_0_27\n assert_that/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_1_28\n assert_that/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Flatten_29\n assert_that/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-GroupByKey_30\n assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_31\n assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Unkey_32\n assert_that/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Match_33\n assert_that/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Create-Impulse_36\n CheckSide/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Create-FlatMap-lambda-at-core-py-2962-_37\n CheckSide/Create/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Create-Map-decode-_39\n CheckSide/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-WindowInto-WindowIntoFn-_40\n CheckSide/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-ToVoidKey_41\n CheckSide/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Group-pair_with_0_43\n CheckSide/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Group-pair_with_1_44\n CheckSide/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Group-Flatten_45\n CheckSide/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Group-GroupByKey_46\n CheckSide/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Group-Map-_merge_tagged_vals_under_key-_47\n CheckSide/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Unkey_48\n CheckSide/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_CheckSide-Match_49\n CheckSide/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>'] INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter. INFO:root:Default Python SDK image for environment is apache/beam_python3.6_sdk:2.31.0.dev INFO:root:==================== <function annotate_downstream_side_inputs at 0x7fc83f292268> ==================== INFO:root:==================== <function fix_side_input_pcoll_coders at 0x7fc83f292378> ==================== INFO:root:==================== <function pack_combiners at 0x7fc83f2927b8> ==================== INFO:root:==================== <function lift_combiners at 0x7fc83f292840> ==================== INFO:root:==================== <function expand_sdf at 0x7fc83f2929d8> ==================== INFO:root:==================== <function expand_gbk at 0x7fc83f292a60> ==================== INFO:root:==================== <function sink_flattens at 0x7fc83f292b70> ==================== INFO:root:==================== <function greedily_fuse at 0x7fc83f292bf8> ==================== INFO:root:==================== <function read_to_impulse at 0x7fc83f292c80> ==================== INFO:root:==================== <function impulse_to_input at 0x7fc83f292d08> ==================== INFO:root:==================== <function sort_stages at 0x7fc83f292f28> ==================== INFO:root:==================== <function setup_timer_mapping at 0x7fc83f292ea0> ==================== INFO:root:==================== <function populate_data_channel_coders at 0x7fc83f293048> ==================== INFO:root:starting control server on port 40751 INFO:root:starting data server on port 40043 INFO:root:starting state server on port 35629 INFO:root:starting logging server on port 42659 INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fc83ec4bf28> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.6_sdk:2.31.0.dev') INFO:root:Attempting to pull image apache/beam_python3.6_sdk:2.31.0.dev INFO:root:Unable to pull image apache/beam_python3.6_sdk:2.31.0.dev, defaulting to local image if it exists INFO:root:Waiting for docker to start up. Current status is running INFO:root:Docker container is running. container_id = b'd71f91ac6a12ef6a5b7aab2cf0c21e8fde05e0a309d382de92b8a7899d88ed50', worker_id = worker_43 INFO:root:Running (((ref_AppliedPTransform_Side-Impulse_13)+(ref_AppliedPTransform_Side-FlatMap-lambda-at-core-py-2962-_14))+(ref_AppliedPTransform_Side-Map-decode-_16))+(ref_PCollection_PCollection_3/Write) INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fc83ec4b550> for environment external_8beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.31.0.dev') INFO:root:Attempting to pull image apache/beam_java8_sdk:2.31.0.dev INFO:root:Unable to pull image apache/beam_java8_sdk:2.31.0.dev, defaulting to local image if it exists INFO:root:Waiting for docker to start up. Current status is running INFO:root:Docker container is running. container_id = b'86b694cfd4e658237243663690c2263358b9c29fed5e567257c932f9d781e326', worker_id = worker_44 INFO:root:Running ((ref_PCollection_PCollection_3/Read)+(external_8ExternalTransform-beam-transforms-xlang-test-multi--MapElements-Map-ParMultiDo-Anonymous-))+(ref_PCollection_PCollection_11/Write) INFO:root:Running (((((ref_AppliedPTransform_CheckSide-Create-Impulse_36)+(ref_AppliedPTransform_CheckSide-Create-FlatMap-lambda-at-core-py-2962-_37))+(ref_AppliedPTransform_CheckSide-Create-Map-decode-_39))+(ref_AppliedPTransform_CheckSide-Group-pair_with_0_43))+(CheckSide/Group/Flatten/Transcode/0))+(CheckSide/Group/Flatten/Write/0) INFO:root:Running (((ref_AppliedPTransform_Main2-Impulse_8)+(ref_AppliedPTransform_Main2-FlatMap-lambda-at-core-py-2962-_9))+(ref_AppliedPTransform_Main2-Map-decode-_11))+(ref_PCollection_PCollection_2/Write) INFO:root:Running (((((ref_PCollection_PCollection_11/Read)+(ref_AppliedPTransform_CheckSide-WindowInto-WindowIntoFn-_40))+(ref_AppliedPTransform_CheckSide-ToVoidKey_41))+(ref_AppliedPTransform_CheckSide-Group-pair_with_1_44))+(CheckSide/Group/Flatten/Transcode/1))+(CheckSide/Group/Flatten/Write/1) INFO:root:Running (CheckSide/Group/Flatten/Read)+(CheckSide/Group/GroupByKey/Write) INFO:root:Running (((ref_AppliedPTransform_Main1-Impulse_3)+(ref_AppliedPTransform_Main1-FlatMap-lambda-at-core-py-2962-_4))+(ref_AppliedPTransform_Main1-Map-decode-_6))+(ref_PCollection_PCollection_1/Write) INFO:root:Running (ref_PCollection_PCollection_1/Read)+(ExternalTransform(beam:transforms:xlang:test:multi)/Flatten.PCollections/Write/0) INFO:root:Running (((ref_PCollection_PCollection_3/Read)+(external_8ExternalTransform-beam-transforms-xlang-test-multi--View-AsSingleton-Combine-GloballyAsSingletonView))+(ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/Precombine))+(ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/Group/Write) INFO:root:Running ((((ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/Group/Read)+(ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/Merge))+(ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Combine.perKey(Singleton)/ExtractOutputs))+(external_8ExternalTransform-beam-transforms-xlang-test-multi--View-AsSingleton-Combine-GloballyAsSingletonView9))+(external_8ExternalTransform(beam:transforms:xlang:test:multi)/View.AsSingleton/Combine.GloballyAsSingletonView/CombineValues/Values/Values/Map/ParMultiDo(Anonymous).output/Write) INFO:root:Running (ref_PCollection_PCollection_2/Read)+(ExternalTransform(beam:transforms:xlang:test:multi)/Flatten.PCollections/Write/1) INFO:root:Running ((ExternalTransform(beam:transforms:xlang:test:multi)/Flatten.PCollections/Read)+(external_8ExternalTransform-beam-transforms-xlang-test-multi--ParDo-Anonymous--ParMultiDo-Anonymous-))+(ref_PCollection_PCollection_10/Write) INFO:root:Running (((((ref_PCollection_PCollection_10/Read)+(ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_24))+(ref_AppliedPTransform_assert_that-ToVoidKey_25))+(ref_AppliedPTransform_assert_that-Group-pair_with_1_28))+(assert_that/Group/Flatten/Transcode/1))+(assert_that/Group/Flatten/Write/1) INFO:root:Running (((((ref_AppliedPTransform_assert_that-Create-Impulse_20)+(ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2962-_21))+(ref_AppliedPTransform_assert_that-Create-Map-decode-_23))+(ref_AppliedPTransform_assert_that-Group-pair_with_0_27))+(assert_that/Group/Flatten/Transcode/0))+(assert_that/Group/Flatten/Write/0) INFO:root:Running (assert_that/Group/Flatten/Read)+(assert_that/Group/GroupByKey/Write) INFO:root:Running (((assert_that/Group/GroupByKey/Read)+(ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_31))+(ref_AppliedPTransform_assert_that-Unkey_32))+(ref_AppliedPTransform_assert_that-Match_33) INFO:root:Running (((CheckSide/Group/GroupByKey/Read)+(ref_AppliedPTransform_CheckSide-Group-Map-_merge_tagged_vals_under_key-_47))+(ref_AppliedPTransform_CheckSide-Unkey_48))+(ref_AppliedPTransform_CheckSide-Match_49) INFO:root:Successfully completed job in 16.9044828414917 seconds. INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE ok test_partition (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... DEBUG:root:Unhandled type_constraint: Union[] DEBUG:root:Unhandled type_constraint: Union[] DEBUG:root:Unhandled type_constraint: Union[] DEBUG:root:Unhandled type_constraint: Union[] DEBUG:root:Unhandled type_constraint: Union[] DEBUG:root:Unhandled type_constraint: Union[] DEBUG:root:Unhandled type_constraint: Union[] DEBUG:root:Unhandled type_constraint: Union[] WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter. INFO:root:Default Python SDK image for environment is apache/beam_python3.6_sdk:2.31.0.dev INFO:root:No image given, using default Python SDK image WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter. INFO:root:Default Python SDK image for environment is apache/beam_python3.6_sdk:2.31.0.dev INFO:root:Python SDK container image set to "apache/beam_python3.6_sdk:2.31.0.dev" for Docker environment INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7fb4d4a99598> ==================== DEBUG:apache_beam.runners.portability.fn_api_runner.translations:33 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1] DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['ref_AppliedPTransform_Create-Impulse_3\n Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-FlatMap-lambda-at-core-py-2962-_4\n Create/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-AddRandomKeys_7\n Create/MaybeReshuffle/Reshuffle/AddRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_9\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-GroupByKey_10\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timestamps-_11\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-RemoveRandomKeys_12\n Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-Map-decode-_13\n Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_9ExternalTransform-beam-transforms-xlang-test-partition--ParMultiDo-Partition-\n ExternalTransform(beam:transforms:xlang:test:partition)/ParMultiDo(Partition):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Create-Impulse_17\n check_even/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Create-FlatMap-lambda-at-core-py-2962-_18\n check_even/Create/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Create-Map-decode-_20\n check_even/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-WindowInto-WindowIntoFn-_21\n check_even/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-ToVoidKey_22\n check_even/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Group-pair_with_0_24\n check_even/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Group-pair_with_1_25\n check_even/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Group-Flatten_26\n check_even/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Group-GroupByKey_27\n check_even/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Group-Map-_merge_tagged_vals_under_key-_28\n check_even/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Unkey_29\n check_even/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Match_30\n check_even/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Create-Impulse_33\n check_odd/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Create-FlatMap-lambda-at-core-py-2962-_34\n check_odd/Create/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Create-Map-decode-_36\n check_odd/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-WindowInto-WindowIntoFn-_37\n check_odd/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-ToVoidKey_38\n check_odd/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Group-pair_with_0_40\n check_odd/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Group-pair_with_1_41\n check_odd/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Group-Flatten_42\n check_odd/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Group-GroupByKey_43\n check_odd/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Group-Map-_merge_tagged_vals_under_key-_44\n check_odd/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Unkey_45\n check_odd/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Match_46\n check_odd/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>'] INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7fb4d4a99620> ==================== DEBUG:apache_beam.runners.portability.fn_api_runner.translations:33 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1] DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['ref_AppliedPTransform_Create-Impulse_3\n Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-FlatMap-lambda-at-core-py-2962-_4\n Create/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-AddRandomKeys_7\n Create/MaybeReshuffle/Reshuffle/AddRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_9\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-GroupByKey_10\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timestamps-_11\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-RemoveRandomKeys_12\n Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-Map-decode-_13\n Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_9ExternalTransform-beam-transforms-xlang-test-partition--ParMultiDo-Partition-\n ExternalTransform(beam:transforms:xlang:test:partition)/ParMultiDo(Partition):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Create-Impulse_17\n check_even/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Create-FlatMap-lambda-at-core-py-2962-_18\n check_even/Create/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Create-Map-decode-_20\n check_even/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-WindowInto-WindowIntoFn-_21\n check_even/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-ToVoidKey_22\n check_even/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Group-pair_with_0_24\n check_even/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Group-pair_with_1_25\n check_even/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Group-Flatten_26\n check_even/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Group-GroupByKey_27\n check_even/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Group-Map-_merge_tagged_vals_under_key-_28\n check_even/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Unkey_29\n check_even/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Match_30\n check_even/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Create-Impulse_33\n check_odd/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Create-FlatMap-lambda-at-core-py-2962-_34\n check_odd/Create/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Create-Map-decode-_36\n check_odd/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-WindowInto-WindowIntoFn-_37\n check_odd/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-ToVoidKey_38\n check_odd/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Group-pair_with_0_40\n check_odd/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Group-pair_with_1_41\n check_odd/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Group-Flatten_42\n check_odd/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Group-GroupByKey_43\n check_odd/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Group-Map-_merge_tagged_vals_under_key-_44\n check_odd/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Unkey_45\n check_odd/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Match_46\n check_odd/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>'] INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7fb4d4a99d08> ==================== DEBUG:apache_beam.runners.portability.fn_api_runner.translations:33 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1] DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['ref_AppliedPTransform_Create-Impulse_3\n Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-FlatMap-lambda-at-core-py-2962-_4\n Create/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-AddRandomKeys_7\n Create/MaybeReshuffle/Reshuffle/AddRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_9\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-GroupByKey_10\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timestamps-_11\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-RemoveRandomKeys_12\n Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-Map-decode-_13\n Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_9ExternalTransform-beam-transforms-xlang-test-partition--ParMultiDo-Partition-\n ExternalTransform(beam:transforms:xlang:test:partition)/ParMultiDo(Partition):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Create-Impulse_17\n check_even/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Create-FlatMap-lambda-at-core-py-2962-_18\n check_even/Create/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Create-Map-decode-_20\n check_even/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-WindowInto-WindowIntoFn-_21\n check_even/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-ToVoidKey_22\n check_even/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Group-pair_with_0_24\n check_even/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Group-pair_with_1_25\n check_even/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Group-Flatten_26\n check_even/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Group-GroupByKey_27\n check_even/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Group-Map-_merge_tagged_vals_under_key-_28\n check_even/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Unkey_29\n check_even/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_even-Match_30\n check_even/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Create-Impulse_33\n check_odd/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Create-FlatMap-lambda-at-core-py-2962-_34\n check_odd/Create/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Create-Map-decode-_36\n check_odd/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-WindowInto-WindowIntoFn-_37\n check_odd/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-ToVoidKey_38\n check_odd/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Group-pair_with_0_40\n check_odd/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Group-pair_with_1_41\n check_odd/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Group-Flatten_42\n check_odd/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Group-GroupByKey_43\n check_odd/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Group-Map-_merge_tagged_vals_under_key-_44\n check_odd/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Unkey_45\n check_odd/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_check_odd-Match_46\n check_odd/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>'] INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter. INFO:root:Default Python SDK image for environment is apache/beam_python3.6_sdk:2.31.0.dev INFO:root:==================== <function annotate_downstream_side_inputs at 0x7fc83f292268> ==================== INFO:root:==================== <function fix_side_input_pcoll_coders at 0x7fc83f292378> ==================== INFO:root:==================== <function pack_combiners at 0x7fc83f2927b8> ==================== INFO:root:==================== <function lift_combiners at 0x7fc83f292840> ==================== INFO:root:==================== <function expand_sdf at 0x7fc83f2929d8> ==================== INFO:root:==================== <function expand_gbk at 0x7fc83f292a60> ==================== INFO:root:==================== <function sink_flattens at 0x7fc83f292b70> ==================== INFO:root:==================== <function greedily_fuse at 0x7fc83f292bf8> ==================== INFO:root:==================== <function read_to_impulse at 0x7fc83f292c80> ==================== INFO:root:==================== <function impulse_to_input at 0x7fc83f292d08> ==================== INFO:root:==================== <function sort_stages at 0x7fc83f292f28> ==================== INFO:root:==================== <function setup_timer_mapping at 0x7fc83f292ea0> ==================== INFO:root:==================== <function populate_data_channel_coders at 0x7fc83f293048> ==================== INFO:root:starting control server on port 37641 INFO:root:starting data server on port 43489 INFO:root:starting state server on port 43479 INFO:root:starting logging server on port 44125 INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fc83eb63940> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.6_sdk:2.31.0.dev') INFO:root:Attempting to pull image apache/beam_python3.6_sdk:2.31.0.dev INFO:root:Unable to pull image apache/beam_python3.6_sdk:2.31.0.dev, defaulting to local image if it exists INFO:root:Waiting for docker to start up. Current status is running INFO:root:Docker container is running. container_id = b'68f52d72213b5eba1136038c01e449de3c4c92b37f6ea7112ef968932a8f919f', worker_id = worker_47 INFO:root:Running ((((ref_AppliedPTransform_Create-Impulse_3)+(ref_AppliedPTransform_Create-FlatMap-lambda-at-core-py-2962-_4))+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-AddRandomKeys_7))+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_9))+(Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write) INFO:root:Running ((((Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read)+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timestamps-_11))+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-RemoveRandomKeys_12))+(ref_AppliedPTransform_Create-Map-decode-_13))+(ref_PCollection_PCollection_1/Write) INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fc83eb60e48> for environment external_9beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.31.0.dev') INFO:root:Attempting to pull image apache/beam_java8_sdk:2.31.0.dev INFO:root:Unable to pull image apache/beam_java8_sdk:2.31.0.dev, defaulting to local image if it exists INFO:root:Waiting for docker to start up. Current status is running INFO:root:Docker container is running. container_id = b'a4e8bf5af0f7217ff13dea76990945279b485c97400f04a3bd634f9c993cf086', worker_id = worker_48 INFO:root:Running (((ref_PCollection_PCollection_1/Read)+(external_9ExternalTransform-beam-transforms-xlang-test-partition--ParMultiDo-Partition-))+(ref_PCollection_PCollection_9/Write))+(ref_PCollection_PCollection_10/Write) INFO:root:Running (((((ref_PCollection_PCollection_9/Read)+(ref_AppliedPTransform_check_odd-WindowInto-WindowIntoFn-_37))+(ref_AppliedPTransform_check_odd-ToVoidKey_38))+(ref_AppliedPTransform_check_odd-Group-pair_with_1_41))+(check_odd/Group/Flatten/Transcode/1))+(check_odd/Group/Flatten/Write/1) INFO:root:Running (((((ref_AppliedPTransform_check_odd-Create-Impulse_33)+(ref_AppliedPTransform_check_odd-Create-FlatMap-lambda-at-core-py-2962-_34))+(ref_AppliedPTransform_check_odd-Create-Map-decode-_36))+(ref_AppliedPTransform_check_odd-Group-pair_with_0_40))+(check_odd/Group/Flatten/Transcode/0))+(check_odd/Group/Flatten/Write/0) INFO:root:Running (check_odd/Group/Flatten/Read)+(check_odd/Group/GroupByKey/Write) INFO:root:Running (((check_odd/Group/GroupByKey/Read)+(ref_AppliedPTransform_check_odd-Group-Map-_merge_tagged_vals_under_key-_44))+(ref_AppliedPTransform_check_odd-Unkey_45))+(ref_AppliedPTransform_check_odd-Match_46) INFO:root:Running (((((ref_AppliedPTransform_check_even-Create-Impulse_17)+(ref_AppliedPTransform_check_even-Create-FlatMap-lambda-at-core-py-2962-_18))+(ref_AppliedPTransform_check_even-Create-Map-decode-_20))+(ref_AppliedPTransform_check_even-Group-pair_with_0_24))+(check_even/Group/Flatten/Transcode/0))+(check_even/Group/Flatten/Write/0) INFO:root:Running (((((ref_PCollection_PCollection_10/Read)+(ref_AppliedPTransform_check_even-WindowInto-WindowIntoFn-_21))+(ref_AppliedPTransform_check_even-ToVoidKey_22))+(ref_AppliedPTransform_check_even-Group-pair_with_1_25))+(check_even/Group/Flatten/Transcode/1))+(check_even/Group/Flatten/Write/1) INFO:root:Running (check_even/Group/Flatten/Read)+(check_even/Group/GroupByKey/Write) INFO:root:Running (((check_even/Group/GroupByKey/Read)+(ref_AppliedPTransform_check_even-Group-Map-_merge_tagged_vals_under_key-_28))+(ref_AppliedPTransform_check_even-Unkey_29))+(ref_AppliedPTransform_check_even-Match_30) INFO:root:Successfully completed job in 9.79562520980835 seconds. INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE ok test_prefix (apache_beam.transforms.validate_runner_xlang_test.ValidateRunnerXlangTest) ... DEBUG:root:Unhandled type_constraint: Union[] DEBUG:root:Unhandled type_constraint: Union[] DEBUG:root:Unhandled type_constraint: Union[] DEBUG:root:Unhandled type_constraint: Union[] WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter. INFO:root:Default Python SDK image for environment is apache/beam_python3.6_sdk:2.31.0.dev INFO:root:No image given, using default Python SDK image WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter. INFO:root:Default Python SDK image for environment is apache/beam_python3.6_sdk:2.31.0.dev INFO:root:Python SDK container image set to "apache/beam_python3.6_sdk:2.31.0.dev" for Docker environment INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function pack_combiners at 0x7fb4d4a99598> ==================== DEBUG:apache_beam.runners.portability.fn_api_runner.translations:21 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1] DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['ref_AppliedPTransform_Create-Impulse_3\n Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-FlatMap-lambda-at-core-py-2962-_4\n Create/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-AddRandomKeys_7\n Create/MaybeReshuffle/Reshuffle/AddRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_9\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-GroupByKey_10\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timestamps-_11\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-RemoveRandomKeys_12\n Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-Map-decode-_13\n Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_10ExternalTransform-beam-transforms-xlang-test-prefix--Map-ParMultiDo-Anonymous-\n ExternalTransform(beam:transforms:xlang:test:prefix)/Map/ParMultiDo(Anonymous):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Impulse_17\n assert_that/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2962-_18\n assert_that/Create/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Map-decode-_20\n assert_that/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_21\n assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-ToVoidKey_22\n assert_that/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_0_24\n assert_that/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_1_25\n assert_that/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Flatten_26\n assert_that/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-GroupByKey_27\n assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_28\n assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Unkey_29\n assert_that/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Match_30\n assert_that/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>'] INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function lift_combiners at 0x7fb4d4a99620> ==================== DEBUG:apache_beam.runners.portability.fn_api_runner.translations:21 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1] DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['ref_AppliedPTransform_Create-Impulse_3\n Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-FlatMap-lambda-at-core-py-2962-_4\n Create/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-AddRandomKeys_7\n Create/MaybeReshuffle/Reshuffle/AddRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_9\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-GroupByKey_10\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timestamps-_11\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-RemoveRandomKeys_12\n Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-Map-decode-_13\n Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_10ExternalTransform-beam-transforms-xlang-test-prefix--Map-ParMultiDo-Anonymous-\n ExternalTransform(beam:transforms:xlang:test:prefix)/Map/ParMultiDo(Anonymous):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Impulse_17\n assert_that/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2962-_18\n assert_that/Create/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Map-decode-_20\n assert_that/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_21\n assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-ToVoidKey_22\n assert_that/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_0_24\n assert_that/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_1_25\n assert_that/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Flatten_26\n assert_that/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-GroupByKey_27\n assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_28\n assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Unkey_29\n assert_that/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Match_30\n assert_that/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>'] INFO:apache_beam.runners.portability.fn_api_runner.translations:==================== <function sort_stages at 0x7fb4d4a99d08> ==================== DEBUG:apache_beam.runners.portability.fn_api_runner.translations:21 [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1] DEBUG:apache_beam.runners.portability.fn_api_runner.translations:Stages: ['ref_AppliedPTransform_Create-Impulse_3\n Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-FlatMap-lambda-at-core-py-2962-_4\n Create/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-AddRandomKeys_7\n Create/MaybeReshuffle/Reshuffle/AddRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_9\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-GroupByKey_10\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timestamps-_11\n Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-RemoveRandomKeys_12\n Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_Create-Map-decode-_13\n Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'external_10ExternalTransform-beam-transforms-xlang-test-prefix--Map-ParMultiDo-Anonymous-\n ExternalTransform(beam:transforms:xlang:test:prefix)/Map/ParMultiDo(Anonymous):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Impulse_17\n assert_that/Create/Impulse:beam:transform:impulse:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2962-_18\n assert_that/Create/FlatMap(<lambda at core.py:2962>):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Create-Map-decode-_20\n assert_that/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_21\n assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-ToVoidKey_22\n assert_that/ToVoidKey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_0_24\n assert_that/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-pair_with_1_25\n assert_that/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Flatten_26\n assert_that/Group/Flatten:beam:transform:flatten:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-GroupByKey_27\n assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_28\n assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Unkey_29\n assert_that/Unkey:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>', 'ref_AppliedPTransform_assert_that-Match_30\n assert_that/Match:beam:transform:pardo:v1\n must follow: \n downstream_side_inputs: <unknown>'] INFO:apache_beam.runners.portability.portable_runner:Job state changed to STOPPED INFO:apache_beam.runners.portability.portable_runner:Job state changed to STARTING INFO:apache_beam.runners.portability.portable_runner:Job state changed to RUNNING WARNING:root:Make sure that locally built Python SDK docker image has Python 3.6 interpreter. INFO:root:Default Python SDK image for environment is apache/beam_python3.6_sdk:2.31.0.dev INFO:root:==================== <function annotate_downstream_side_inputs at 0x7fc83f292268> ==================== INFO:root:==================== <function fix_side_input_pcoll_coders at 0x7fc83f292378> ==================== INFO:root:==================== <function pack_combiners at 0x7fc83f2927b8> ==================== INFO:root:==================== <function lift_combiners at 0x7fc83f292840> ==================== INFO:root:==================== <function expand_sdf at 0x7fc83f2929d8> ==================== INFO:root:==================== <function expand_gbk at 0x7fc83f292a60> ==================== INFO:root:==================== <function sink_flattens at 0x7fc83f292b70> ==================== INFO:root:==================== <function greedily_fuse at 0x7fc83f292bf8> ==================== INFO:root:==================== <function read_to_impulse at 0x7fc83f292c80> ==================== INFO:root:==================== <function impulse_to_input at 0x7fc83f292d08> ==================== INFO:root:==================== <function sort_stages at 0x7fc83f292f28> ==================== INFO:root:==================== <function setup_timer_mapping at 0x7fc83f292ea0> ==================== INFO:root:==================== <function populate_data_channel_coders at 0x7fc83f293048> ==================== INFO:root:starting control server on port 46773 INFO:root:starting data server on port 44449 INFO:root:starting state server on port 33403 INFO:root:starting logging server on port 36955 INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fc83ec3c208> for environment ref_Environment_default_environment_2 (beam:env:docker:v1, b'\n$apache/beam_python3.6_sdk:2.31.0.dev') INFO:root:Attempting to pull image apache/beam_python3.6_sdk:2.31.0.dev INFO:root:Unable to pull image apache/beam_python3.6_sdk:2.31.0.dev, defaulting to local image if it exists INFO:root:Waiting for docker to start up. Current status is running INFO:root:Docker container is running. container_id = b'dcbd705d5bf03329f8f2cdf3fddd6e0213f9879687cd442c56f8592dd75815f3', worker_id = worker_49 INFO:root:Running ((((ref_AppliedPTransform_Create-Impulse_3)+(ref_AppliedPTransform_Create-FlatMap-lambda-at-core-py-2962-_4))+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-AddRandomKeys_7))+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_9))+(Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write) INFO:root:Running ((((Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read)+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timestamps-_11))+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-RemoveRandomKeys_12))+(ref_AppliedPTransform_Create-Map-decode-_13))+(ref_PCollection_PCollection_1/Write) INFO:root:Running (((((ref_AppliedPTransform_assert_that-Create-Impulse_17)+(ref_AppliedPTransform_assert_that-Create-FlatMap-lambda-at-core-py-2962-_18))+(ref_AppliedPTransform_assert_that-Create-Map-decode-_20))+(ref_AppliedPTransform_assert_that-Group-pair_with_0_24))+(assert_that/Group/Flatten/Transcode/0))+(assert_that/Group/Flatten/Write/0) INFO:root:Created Worker handler <apache_beam.runners.portability.fn_api_runner.worker_handlers.DockerSdkWorkerHandler object at 0x7fc83ebd0780> for environment external_10beam:env:docker:v1 (beam:env:docker:v1, b'\n apache/beam_java8_sdk:2.31.0.dev') INFO:root:Attempting to pull image apache/beam_java8_sdk:2.31.0.dev INFO:root:Unable to pull image apache/beam_java8_sdk:2.31.0.dev, defaulting to local image if it exists INFO:root:Waiting for docker to start up. Current status is running INFO:root:Docker container is running. container_id = b'5aebfe2798aa97ade3b8b2c836ca4b79a48f552de25685f638f7818e0ead2ac6', worker_id = worker_50 INFO:root:Running ((ref_PCollection_PCollection_1/Read)+(external_10ExternalTransform-beam-transforms-xlang-test-prefix--Map-ParMultiDo-Anonymous-))+(ref_PCollection_PCollection_9/Write) INFO:root:Running (((((ref_PCollection_PCollection_9/Read)+(ref_AppliedPTransform_assert_that-WindowInto-WindowIntoFn-_21))+(ref_AppliedPTransform_assert_that-ToVoidKey_22))+(ref_AppliedPTransform_assert_that-Group-pair_with_1_25))+(assert_that/Group/Flatten/Transcode/1))+(assert_that/Group/Flatten/Write/1) INFO:root:Running (assert_that/Group/Flatten/Read)+(assert_that/Group/GroupByKey/Write) INFO:root:Running (((assert_that/Group/GroupByKey/Read)+(ref_AppliedPTransform_assert_that-Group-Map-_merge_tagged_vals_under_key-_28))+(ref_AppliedPTransform_assert_that-Unkey_29))+(ref_AppliedPTransform_assert_that-Match_30) INFO:root:Successfully completed job in 7.973848819732666 seconds. INFO:apache_beam.runners.portability.portable_runner:Job state changed to DONE ok ---------------------------------------------------------------------- XML: nosetests-xlangValidateRunner.xml ---------------------------------------------------------------------- XML: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 10 tests in 150.866s OK > Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup > Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup FAILURE: Build completed with 2 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:java:io:mongodb:compileJava'. > Compilation failed; see the compiler error output for details. * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPythonOnly'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/test-suites/direct/xlang/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPythonOnly/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 37m 29s 160 actionable tasks: 138 executed, 18 from cache, 4 up-to-date Publishing build scan... https://gradle.com/s/kihjwkf5iscre Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
