See <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/2199/display/redirect>
------------------------------------------ [...truncated 233.19 KB...] { "kind": "ParallelDo", "name": "s21", "properties": { "display_data": [ { "key": "fn", "label": "Transform Function", "namespace": "apache_beam.transforms.core.CallableWrapperDoFn", "type": "STRING", "value": "_equal" }, { "key": "fn", "label": "Transform Function", "namespace": "apache_beam.transforms.core.ParDo", "shortValue": "CallableWrapperDoFn", "type": "STRING", "value": "apache_beam.transforms.core.CallableWrapperDoFn" } ], "non_parallel_inputs": {}, "output_info": [ { "encoding": { "@type": "kind:windowed_value", "component_encodings": [ { "@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/", "component_encodings": [ { "@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/", "component_encodings": [], "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3" }, { "@type": "FastPrimitivesCoder$eNprYEpOLEhMzkiNT0pNzNVLzk9JLSqGUlxuicUlAUWZuZklmWWpxc4gQa5CBs3GQsbaQqZQ/vi0xJycpMTk7Hiw+kJmPEYFZCZn56RCjWABGsFaW8iWVJykBwDlGS3/", "component_encodings": [], "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3" } ], "is_pair_like": true, "pipeline_proto_coder_id": "ref_Coder_FastPrimitivesCoder_3" }, { "@type": "kind:global_window" } ], "is_wrapper": true }, "output_name": "out", "user_name": "assert_that/Match.out" } ], "parallel_input": { "@type": "OutputReference", "output_name": "out", "step_name": "s20" }, "serialized_fn": "ref_AppliedPTransform_assert_that/Match_26", "user_name": "assert_that/Match" } }, { "kind": "ParallelDo", "name": "s22", "properties": { "display_data": [ { "key": "fn", "label": "Transform Function", "namespace": "apache_beam.transforms.core.CallableWrapperDoFn", "type": "STRING", "value": "<lambda>" }, { "key": "fn", "label": "Transform Function", "namespace": "apache_beam.transforms.core.ParDo", "shortValue": "CallableWrapperDoFn", "type": "STRING", "value": "apache_beam.transforms.core.CallableWrapperDoFn" } ], "non_parallel_inputs": {}, "output_info": [ { "encoding": { "@type": "kind:windowed_value", "component_encodings": [ { "@type": "kind:pair", "component_encodings": [ { "@type": "kind:bytes" }, { "@type": "kind:bytes" } ], "is_pair_like": true }, { "@type": "kind:global_window" } ], "is_wrapper": true }, "output_name": "out", "user_name": "FlatMap(<lambda at sideinputs_test.py:306>)/MapToVoidKey0.out" } ], "parallel_input": { "@type": "OutputReference", "output_name": "out", "step_name": "s7" }, "serialized_fn": "ref_AppliedPTransform_FlatMap(<lambda at sideinputs_test.py:306>)/MapToVoidKey0_27", "user_name": "FlatMap(<lambda at sideinputs_test.py:306>)/MapToVoidKey0" } } ], "type": "JOB_TYPE_STREAMING" } root: INFO: Create job: <Job createTime: u'2019-01-06T00:23:53.519629Z' currentStateTime: u'1970-01-01T00:00:00Z' id: u'2019-01-05_16_23_52-16085823239817584597' location: u'us-central1' name: u'beamapp-jenkins-0106002338-539025' projectId: u'apache-beam-testing' stageStates: [] startTime: u'2019-01-06T00:23:53.519629Z' steps: [] tempFiles: [] type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)> root: INFO: Created job with id: [2019-01-05_16_23_52-16085823239817584597] root: INFO: To access the Dataflow monitoring console, please navigate to https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-05_16_23_52-16085823239817584597?project=apache-beam-testing root: WARNING: Waiting indefinitely for streaming job. root: INFO: Job 2019-01-05_16_23_52-16085823239817584597 is in state JOB_STATE_RUNNING root: INFO: 2019-01-06T00:23:55.571Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. root: INFO: 2019-01-06T00:23:56.857Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-4 in us-central1-c. root: INFO: 2019-01-06T00:23:57.287Z: JOB_MESSAGE_DETAILED: Expanding CollectionToSingleton operations into optimizable parts. root: INFO: 2019-01-06T00:23:57.296Z: JOB_MESSAGE_DETAILED: Expanding CoGroupByKey operations into optimizable parts. root: INFO: 2019-01-06T00:23:57.302Z: JOB_MESSAGE_DEBUG: Combiner lifting skipped for step FlatMap(<lambda at sideinputs_test.py:306>)/_DataflowIterableSideInput(MapToVoidKey0.out.0)/GroupByKey: GroupByKey not followed by a combiner. root: INFO: 2019-01-06T00:23:57.305Z: JOB_MESSAGE_DETAILED: Expanding SplittableProcessKeyed operations into optimizable parts. root: INFO: 2019-01-06T00:23:57.307Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into streaming Read/Write steps root: INFO: 2019-01-06T00:23:57.315Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information. root: INFO: 2019-01-06T00:23:57.330Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations root: INFO: 2019-01-06T00:23:57.333Z: JOB_MESSAGE_DETAILED: Created new flatten s7-c21 to unzip producers of s22 root: INFO: 2019-01-06T00:23:57.336Z: JOB_MESSAGE_DETAILED: Fusing consumer FlatMap(<lambda at sideinputs_test.py:306>)/_DataflowIterableSideInput(MapToVoidKey0.out.0)/PairWithVoidKey into FlatMap(<lambda at sideinputs_test.py:306>)/MapToVoidKey0 root: INFO: 2019-01-06T00:23:57.338Z: JOB_MESSAGE_DETAILED: Fusing consumer FlatMap(<lambda at sideinputs_test.py:306>)/_DataflowIterableSideInput(MapToVoidKey0.out.0)/GroupByKey/WriteStream into FlatMap(<lambda at sideinputs_test.py:306>)/_DataflowIterableSideInput(MapToVoidKey0.out.0)/PairWithVoidKey root: INFO: 2019-01-06T00:23:57.341Z: JOB_MESSAGE_DETAILED: Unzipping flatten s7-c21 for input s4.out root: INFO: 2019-01-06T00:23:57.343Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of FlatMap(<lambda at sideinputs_test.py:306>)/MapToVoidKey0, through flatten Flatten, into producer side1/Decode Values root: INFO: 2019-01-06T00:23:57.345Z: JOB_MESSAGE_DETAILED: Unzipping flatten s7 for input s4.out root: INFO: 2019-01-06T00:23:57.349Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of FlatMap(<lambda at sideinputs_test.py:306>)/MapToVoidKey0, through flatten Flatten, into producer side1/Decode Values root: INFO: 2019-01-06T00:23:57.352Z: JOB_MESSAGE_DETAILED: Unzipping flatten s17 for input s15.out root: INFO: 2019-01-06T00:23:57.355Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of assert_that/Group/GroupByKey/WriteStream, through flatten assert_that/Group/Flatten, into producer assert_that/Group/pair_with_0 root: INFO: 2019-01-06T00:23:57.357Z: JOB_MESSAGE_DETAILED: Fusing consumer FlatMap(<lambda at sideinputs_test.py:306>)/MapToVoidKey0 into side2/Decode Values root: INFO: 2019-01-06T00:23:57.359Z: JOB_MESSAGE_DETAILED: Fusing consumer FlatMap(<lambda at sideinputs_test.py:306>)/MapToVoidKey0 into side2/Decode Values root: INFO: 2019-01-06T00:23:57.362Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/GroupByKey/WriteStream into assert_that/Group/pair_with_1 root: INFO: 2019-01-06T00:23:57.364Z: JOB_MESSAGE_DETAILED: Fusing consumer FlatMap(<lambda at sideinputs_test.py:306>)/FlatMap(<lambda at sideinputs_test.py:306>) into main input/Decode Values root: INFO: 2019-01-06T00:23:57.366Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/WindowInto(WindowIntoFn) into FlatMap(<lambda at sideinputs_test.py:306>)/FlatMap(<lambda at sideinputs_test.py:306>) root: INFO: 2019-01-06T00:23:57.367Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Unkey into assert_that/Group/Map(_merge_tagged_vals_under_key) root: INFO: 2019-01-06T00:23:57.369Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Create/Decode Values into assert_that/Create/Impulse root: INFO: 2019-01-06T00:23:57.372Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/GroupByKey/MergeBuckets into assert_that/Group/GroupByKey/ReadStream root: INFO: 2019-01-06T00:23:57.374Z: JOB_MESSAGE_DETAILED: Fusing consumer FlatMap(<lambda at sideinputs_test.py:306>)/_DataflowIterableSideInput(MapToVoidKey0.out.0)/StreamingPCollectionViewWriter into FlatMap(<lambda at sideinputs_test.py:306>)/_DataflowIterableSideInput(MapToVoidKey0.out.0)/Values root: INFO: 2019-01-06T00:23:57.376Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/pair_with_1 into assert_that/ToVoidKey root: INFO: 2019-01-06T00:23:57.378Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/ToVoidKey into assert_that/WindowInto(WindowIntoFn) root: INFO: 2019-01-06T00:23:57.380Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/pair_with_0 into assert_that/Create/Decode Values root: INFO: 2019-01-06T00:23:57.382Z: JOB_MESSAGE_DETAILED: Fusing consumer side2/Decode Values into side2/Impulse root: INFO: 2019-01-06T00:23:57.384Z: JOB_MESSAGE_DETAILED: Fusing consumer main input/Decode Values into main input/Impulse root: INFO: 2019-01-06T00:23:57.385Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Match into assert_that/Unkey root: INFO: 2019-01-06T00:23:57.388Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/Map(_merge_tagged_vals_under_key) into assert_that/Group/GroupByKey/MergeBuckets root: INFO: 2019-01-06T00:23:57.390Z: JOB_MESSAGE_DETAILED: Fusing consumer FlatMap(<lambda at sideinputs_test.py:306>)/_DataflowIterableSideInput(MapToVoidKey0.out.0)/Values into FlatMap(<lambda at sideinputs_test.py:306>)/_DataflowIterableSideInput(MapToVoidKey0.out.0)/GroupByKey/MergeBuckets root: INFO: 2019-01-06T00:23:57.392Z: JOB_MESSAGE_DETAILED: Fusing consumer FlatMap(<lambda at sideinputs_test.py:306>)/_DataflowIterableSideInput(MapToVoidKey0.out.0)/GroupByKey/MergeBuckets into FlatMap(<lambda at sideinputs_test.py:306>)/_DataflowIterableSideInput(MapToVoidKey0.out.0)/GroupByKey/ReadStream root: INFO: 2019-01-06T00:23:57.394Z: JOB_MESSAGE_DETAILED: Fusing consumer side1/Decode Values into side1/Impulse root: INFO: 2019-01-06T00:23:57.401Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph. root: INFO: 2019-01-06T00:23:57.416Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps. root: INFO: 2019-01-06T00:23:57.466Z: JOB_MESSAGE_DEBUG: Assigning stage ids. root: INFO: 2019-01-06T00:23:57.674Z: JOB_MESSAGE_DEBUG: Executing wait step start2 root: INFO: 2019-01-06T00:23:57.685Z: JOB_MESSAGE_DEBUG: Starting worker pool setup. root: INFO: 2019-01-06T00:23:57.690Z: JOB_MESSAGE_BASIC: Starting 1 workers... root: INFO: 2019-01-06T00:24:00.217Z: JOB_MESSAGE_BASIC: Executing operation main input/Impulse+main input/Decode Values+FlatMap(<lambda at sideinputs_test.py:306>)/FlatMap(<lambda at sideinputs_test.py:306>)+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/WriteStream root: INFO: 2019-01-06T00:24:00.217Z: JOB_MESSAGE_BASIC: Executing operation side1/Impulse+side1/Decode Values+FlatMap(<lambda at sideinputs_test.py:306>)/MapToVoidKey0+FlatMap(<lambda at sideinputs_test.py:306>)/MapToVoidKey0+FlatMap(<lambda at sideinputs_test.py:306>)/_DataflowIterableSideInput(MapToVoidKey0.out.0)/PairWithVoidKey+FlatMap(<lambda at sideinputs_test.py:306>)/_DataflowIterableSideInput(MapToVoidKey0.out.0)/GroupByKey/WriteStream root: INFO: 2019-01-06T00:24:00.217Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/ReadStream+assert_that/Group/GroupByKey/MergeBuckets+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match root: INFO: 2019-01-06T00:24:00.217Z: JOB_MESSAGE_BASIC: Executing operation FlatMap(<lambda at sideinputs_test.py:306>)/_DataflowIterableSideInput(MapToVoidKey0.out.0)/GroupByKey/ReadStream+FlatMap(<lambda at sideinputs_test.py:306>)/_DataflowIterableSideInput(MapToVoidKey0.out.0)/GroupByKey/MergeBuckets+FlatMap(<lambda at sideinputs_test.py:306>)/_DataflowIterableSideInput(MapToVoidKey0.out.0)/Values+FlatMap(<lambda at sideinputs_test.py:306>)/_DataflowIterableSideInput(MapToVoidKey0.out.0)/StreamingPCollectionViewWriter root: INFO: 2019-01-06T00:24:00.217Z: JOB_MESSAGE_BASIC: Executing operation side2/Impulse+side2/Decode Values+FlatMap(<lambda at sideinputs_test.py:306>)/MapToVoidKey0+FlatMap(<lambda at sideinputs_test.py:306>)/MapToVoidKey0+FlatMap(<lambda at sideinputs_test.py:306>)/_DataflowIterableSideInput(MapToVoidKey0.out.0)/PairWithVoidKey+FlatMap(<lambda at sideinputs_test.py:306>)/_DataflowIterableSideInput(MapToVoidKey0.out.0)/GroupByKey/WriteStream root: INFO: 2019-01-06T00:24:00.222Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Create/Impulse+assert_that/Create/Decode Values+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/WriteStream root: INFO: 2019-01-06T00:24:41.133Z: JOB_MESSAGE_DEBUG: Executing input step topology_init_attach_disk_input_step root: INFO: 2019-01-06T00:24:43.056Z: JOB_MESSAGE_DETAILED: Workers have started successfully. root: INFO: 2019-01-06T00:28:27.726Z: JOB_MESSAGE_DETAILED: Cleaning up. root: INFO: 2019-01-06T00:28:27.758Z: JOB_MESSAGE_BASIC: Worker pool stopped. root: INFO: 2019-01-06T00:28:27.762Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... root: INFO: 2019-01-06T00:28:27.765Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. root: INFO: 2019-01-06T00:28:27.769Z: JOB_MESSAGE_BASIC: Stopping worker pool... root: INFO: 2019-01-06T00:30:04.264Z: JOB_MESSAGE_BASIC: Worker pool stopped. root: WARNING: Cancel failed because job 2019-01-05_16_23_52-16085823239817584597 is already terminated in state DONE. --------------------- >> end captured logging << --------------------- ---------------------------------------------------------------------- XML: <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 14 tests in 904.279s FAILED (failures=1) Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-05_16_15_52-10750447799263934212?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-05_16_23_52-16085823239817584597?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-05_16_15_52-12268564733089185119?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-05_16_23_44-16789106000810147961?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-05_16_15_53-7854089993116878734?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-05_16_15_54-7151542192135567213?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-05_16_22_31-184616061795139592?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-05_16_15_51-2985421973651888189?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-05_16_23_53-1768767639385865486?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-05_16_15_55-877035677794578235?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-05_16_22_46-4831108662218701809?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-05_16_15_54-18062822612308783326?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-05_16_22_54-617276224203992223?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-01-05_16_15_53-10037015354302784941?project=apache-beam-testing. > Task :beam-sdks-python:validatesRunnerStreamingTests FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/build.gradle'> line: 306 * What went wrong: Execution failed for task ':beam-sdks-python:validatesRunnerStreamingTests'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/4.10.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 30m 27s 60 actionable tasks: 55 executed, 5 from cache Publishing build scan... https://gradle.com/s/v7oq3l5ibhosw Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org For additional commands, e-mail: builds-h...@beam.apache.org