See <https://builds.apache.org/job/beam_PostCommit_Python36/66/display/redirect>
------------------------------------------ [...truncated 222.55 KB...] root: INFO: 2019-07-27T06:03:44.931Z: JOB_MESSAGE_DETAILED: Fusing consumer CombineGlobally(sum)/KeyWithVoid into Map(<lambda at autocomplete_test.py:66>) root: INFO: 2019-07-27T06:03:44.974Z: JOB_MESSAGE_DETAILED: Fusing consumer Map(<lambda at autocomplete_test.py:66>) into Map(<lambda at autocomplete_test.py:63>) root: INFO: 2019-07-27T06:03:45.023Z: JOB_MESSAGE_DETAILED: Fusing consumer TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/Combine/Extract into TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/Combine root: INFO: 2019-07-27T06:03:45.073Z: JOB_MESSAGE_DETAILED: Fusing consumer Map(<lambda at autocomplete_test.py:63>) into TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/Combine/Extract root: INFO: 2019-07-27T06:03:45.122Z: JOB_MESSAGE_DETAILED: Fusing consumer TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/Combine/Extract into TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/Combine root: INFO: 2019-07-27T06:03:45.179Z: JOB_MESSAGE_DETAILED: Fusing consumer TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/GroupByKey+TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/Combine/Partial into TopPerPrefix/PerElement/PerElement:PairWithVoid root: INFO: 2019-07-27T06:03:45.221Z: JOB_MESSAGE_DETAILED: Fusing consumer TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/Combine into TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/GroupByKey/Read root: INFO: 2019-07-27T06:03:45.267Z: JOB_MESSAGE_DETAILED: Fusing consumer TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/Combine into TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/GroupByKey/Read root: INFO: 2019-07-27T06:03:45.318Z: JOB_MESSAGE_DETAILED: Fusing consumer TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/GroupByKey/Write into TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/GroupByKey/Reify root: INFO: 2019-07-27T06:03:45.360Z: JOB_MESSAGE_DETAILED: Fusing consumer CombineGlobally(sum)/UnKey into CombineGlobally(sum)/CombinePerKey/Combine/Extract root: INFO: 2019-07-27T06:03:45.397Z: JOB_MESSAGE_DETAILED: Fusing consumer CombineGlobally(sum)/CombinePerKey/Combine/Extract into CombineGlobally(sum)/CombinePerKey/Combine root: INFO: 2019-07-27T06:03:45.453Z: JOB_MESSAGE_DETAILED: Fusing consumer TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/GroupByKey/Write into TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/GroupByKey/Reify root: INFO: 2019-07-27T06:03:45.506Z: JOB_MESSAGE_DETAILED: Fusing consumer TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/GroupByKey/Reify into TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/GroupByKey+TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/Combine/Partial root: INFO: 2019-07-27T06:03:45.553Z: JOB_MESSAGE_DETAILED: Fusing consumer CombineGlobally(sum)/CombinePerKey/Combine into CombineGlobally(sum)/CombinePerKey/GroupByKey/Read root: INFO: 2019-07-27T06:03:45.594Z: JOB_MESSAGE_DETAILED: Fusing consumer CombineGlobally(sum)/CombinePerKey/GroupByKey/Write into CombineGlobally(sum)/CombinePerKey/GroupByKey/Reify root: INFO: 2019-07-27T06:03:45.642Z: JOB_MESSAGE_DETAILED: Fusing consumer TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/GroupByKey+TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/Combine/Partial into TopPerPrefix/FlatMap(extract_prefixes) root: INFO: 2019-07-27T06:03:45.687Z: JOB_MESSAGE_DETAILED: Fusing consumer CombineGlobally(sum)/CombinePerKey/GroupByKey/Reify into CombineGlobally(sum)/CombinePerKey/GroupByKey+CombineGlobally(sum)/CombinePerKey/Combine/Partial root: INFO: 2019-07-27T06:03:45.753Z: JOB_MESSAGE_DETAILED: Fusing consumer CombineGlobally(sum)/CombinePerKey/GroupByKey+CombineGlobally(sum)/CombinePerKey/Combine/Partial into CombineGlobally(sum)/KeyWithVoid root: INFO: 2019-07-27T06:03:45.797Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/GroupByKey/Write into assert_that/Group/GroupByKey/Reify root: INFO: 2019-07-27T06:03:45.842Z: JOB_MESSAGE_DETAILED: Unzipping flatten s22 for input s20.out root: INFO: 2019-07-27T06:03:45.889Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of assert_that/Group/GroupByKey/Reify, through flatten assert_that/Group/Flatten, into producer assert_that/Group/pair_with_0 root: INFO: 2019-07-27T06:03:45.937Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Match into assert_that/Unkey root: INFO: 2019-07-27T06:03:45.985Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Unkey into assert_that/Group/Map(_merge_tagged_vals_under_key) root: INFO: 2019-07-27T06:03:46.019Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/Map(_merge_tagged_vals_under_key) into assert_that/Group/GroupByKey/GroupByWindow root: INFO: 2019-07-27T06:03:46.068Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/GroupByKey/GroupByWindow into assert_that/Group/GroupByKey/Read root: INFO: 2019-07-27T06:03:46.115Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/pair_with_0 into assert_that/Create/Read root: INFO: 2019-07-27T06:03:46.152Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/GroupByKey/Reify into assert_that/Group/pair_with_1 root: INFO: 2019-07-27T06:03:46.198Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/ToVoidKey into assert_that/WindowInto(WindowIntoFn) root: INFO: 2019-07-27T06:03:46.243Z: JOB_MESSAGE_DETAILED: Fusing consumer CombineGlobally(sum)/InjectDefault/InjectDefault into CombineGlobally(sum)/DoOnce/Read root: INFO: 2019-07-27T06:03:46.286Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/pair_with_1 into assert_that/ToVoidKey root: INFO: 2019-07-27T06:03:46.338Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/WindowInto(WindowIntoFn) into CombineGlobally(sum)/InjectDefault/InjectDefault root: INFO: 2019-07-27T06:03:46.388Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec. root: INFO: 2019-07-27T06:03:46.437Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph. root: INFO: 2019-07-27T06:03:46.483Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps. root: INFO: 2019-07-27T06:03:46.538Z: JOB_MESSAGE_DEBUG: Assigning stage ids. root: INFO: 2019-07-27T06:03:46.783Z: JOB_MESSAGE_DEBUG: Executing wait step start76 root: INFO: 2019-07-27T06:03:46.886Z: JOB_MESSAGE_BASIC: Executing operation CombineGlobally(sum)/CombinePerKey/GroupByKey/Create root: INFO: 2019-07-27T06:03:46.933Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Create root: INFO: 2019-07-27T06:03:46.945Z: JOB_MESSAGE_DEBUG: Starting worker pool setup. root: INFO: 2019-07-27T06:03:46.977Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-a... root: INFO: 2019-07-27T06:03:46.977Z: JOB_MESSAGE_BASIC: Executing operation TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/GroupByKey/Create root: INFO: 2019-07-27T06:03:47.029Z: JOB_MESSAGE_BASIC: Executing operation TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/GroupByKey/Create root: INFO: 2019-07-27T06:03:47.043Z: JOB_MESSAGE_BASIC: Finished operation CombineGlobally(sum)/CombinePerKey/GroupByKey/Create root: INFO: 2019-07-27T06:03:47.057Z: JOB_MESSAGE_BASIC: Finished operation TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/GroupByKey/Create root: INFO: 2019-07-27T06:03:47.057Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Create root: INFO: 2019-07-27T06:03:47.104Z: JOB_MESSAGE_BASIC: Finished operation TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/GroupByKey/Create root: INFO: 2019-07-27T06:03:47.139Z: JOB_MESSAGE_DEBUG: Value "CombineGlobally(sum)/CombinePerKey/GroupByKey/Session" materialized. root: INFO: 2019-07-27T06:03:47.184Z: JOB_MESSAGE_DEBUG: Value "TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/GroupByKey/Session" materialized. root: INFO: 2019-07-27T06:03:47.234Z: JOB_MESSAGE_DEBUG: Value "assert_that/Group/GroupByKey/Session" materialized. root: INFO: 2019-07-27T06:03:47.286Z: JOB_MESSAGE_DEBUG: Value "TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/GroupByKey/Session" materialized. root: INFO: 2019-07-27T06:03:47.328Z: JOB_MESSAGE_BASIC: Executing operation ReadFromText/Read+TopPerPrefix/PerElement/PerElement:PairWithVoid+TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/GroupByKey+TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/Combine/Partial+TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/GroupByKey/Reify+TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/GroupByKey/Write root: INFO: 2019-07-27T06:03:47.337Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-1 in us-central1-a. root: INFO: 2019-07-27T06:03:47.375Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Create/Read+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write root: INFO: 2019-07-27T06:04:51.314Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s). root: INFO: 2019-07-27T06:05:27.409Z: JOB_MESSAGE_DETAILED: Workers have started successfully. root: INFO: 2019-07-27T06:05:27.535Z: JOB_MESSAGE_DETAILED: Workers have started successfully. root: INFO: 2019-07-27T06:06:47.344Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-1 in us-central1-a. root: INFO: 2019-07-27T06:08:49.240Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Create/Read+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write root: INFO: 2019-07-27T06:08:56.189Z: JOB_MESSAGE_BASIC: Finished operation ReadFromText/Read+TopPerPrefix/PerElement/PerElement:PairWithVoid+TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/GroupByKey+TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/Combine/Partial+TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/GroupByKey/Reify+TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/GroupByKey/Write root: INFO: 2019-07-27T06:08:56.280Z: JOB_MESSAGE_BASIC: Executing operation TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/GroupByKey/Close root: INFO: 2019-07-27T06:08:56.384Z: JOB_MESSAGE_BASIC: Finished operation TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/GroupByKey/Close root: INFO: 2019-07-27T06:08:56.470Z: JOB_MESSAGE_BASIC: Executing operation TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/GroupByKey/Read+TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/Combine+TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/Combine/Extract+TopPerPrefix/FlatMap(extract_prefixes)+TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/GroupByKey+TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/Combine/Partial+TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/GroupByKey/Reify+TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/GroupByKey/Write root: INFO: 2019-07-27T06:09:11.902Z: JOB_MESSAGE_BASIC: Finished operation TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/GroupByKey/Read+TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/Combine+TopPerPrefix/PerElement/CombinePerKey(CountCombineFn)/Combine/Extract+TopPerPrefix/FlatMap(extract_prefixes)+TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/GroupByKey+TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/Combine/Partial+TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/GroupByKey/Reify+TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/GroupByKey/Write root: INFO: 2019-07-27T06:09:11.979Z: JOB_MESSAGE_BASIC: Executing operation TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/GroupByKey/Close root: INFO: 2019-07-27T06:09:12.048Z: JOB_MESSAGE_BASIC: Finished operation TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/GroupByKey/Close root: INFO: 2019-07-27T06:09:12.152Z: JOB_MESSAGE_BASIC: Executing operation TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/GroupByKey/Read+TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/Combine+TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/Combine/Extract+Map(<lambda at autocomplete_test.py:63>)+Map(<lambda at autocomplete_test.py:66>)+CombineGlobally(sum)/KeyWithVoid+CombineGlobally(sum)/CombinePerKey/GroupByKey+CombineGlobally(sum)/CombinePerKey/Combine/Partial+CombineGlobally(sum)/CombinePerKey/GroupByKey/Reify+CombineGlobally(sum)/CombinePerKey/GroupByKey/Write root: INFO: 2019-07-27T06:09:34.030Z: JOB_MESSAGE_BASIC: Finished operation TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/GroupByKey/Read+TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/Combine+TopPerPrefix/LargestPerKey(10)/TopPerKey(10)/CombinePerKey(TopCombineFn)/Combine/Extract+Map(<lambda at autocomplete_test.py:63>)+Map(<lambda at autocomplete_test.py:66>)+CombineGlobally(sum)/KeyWithVoid+CombineGlobally(sum)/CombinePerKey/GroupByKey+CombineGlobally(sum)/CombinePerKey/Combine/Partial+CombineGlobally(sum)/CombinePerKey/GroupByKey/Reify+CombineGlobally(sum)/CombinePerKey/GroupByKey/Write root: INFO: 2019-07-27T06:09:34.166Z: JOB_MESSAGE_BASIC: Executing operation CombineGlobally(sum)/CombinePerKey/GroupByKey/Close root: INFO: 2019-07-27T06:09:34.229Z: JOB_MESSAGE_BASIC: Finished operation CombineGlobally(sum)/CombinePerKey/GroupByKey/Close root: INFO: 2019-07-27T06:09:34.312Z: JOB_MESSAGE_BASIC: Executing operation CombineGlobally(sum)/CombinePerKey/GroupByKey/Read+CombineGlobally(sum)/CombinePerKey/Combine+CombineGlobally(sum)/CombinePerKey/Combine/Extract+CombineGlobally(sum)/UnKey root: INFO: 2019-07-27T06:09:45.823Z: JOB_MESSAGE_BASIC: Finished operation CombineGlobally(sum)/CombinePerKey/GroupByKey/Read+CombineGlobally(sum)/CombinePerKey/Combine+CombineGlobally(sum)/CombinePerKey/Combine/Extract+CombineGlobally(sum)/UnKey root: INFO: 2019-07-27T06:09:45.910Z: JOB_MESSAGE_DEBUG: Value "CombineGlobally(sum)/UnKey.out" materialized. root: INFO: 2019-07-27T06:09:46.002Z: JOB_MESSAGE_BASIC: Executing operation CombineGlobally(sum)/InjectDefault/_UnpickledSideInput(UnKey.out.0) root: INFO: 2019-07-27T06:09:46.062Z: JOB_MESSAGE_BASIC: Finished operation CombineGlobally(sum)/InjectDefault/_UnpickledSideInput(UnKey.out.0) root: INFO: 2019-07-27T06:09:46.151Z: JOB_MESSAGE_DEBUG: Value "CombineGlobally(sum)/InjectDefault/_UnpickledSideInput(UnKey.out.0).output" materialized. root: INFO: 2019-07-27T06:09:46.214Z: JOB_MESSAGE_BASIC: Executing operation CombineGlobally(sum)/DoOnce/Read+CombineGlobally(sum)/InjectDefault/InjectDefault+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write root: INFO: 2019-07-27T06:09:46.744Z: JOB_MESSAGE_DETAILED: Checking permissions granted to controller Service Account. root: INFO: 2019-07-27T06:09:47.252Z: JOB_MESSAGE_BASIC: Worker configuration: n1-standard-1 in us-central1-a. root: INFO: 2019-07-27T06:09:51.915Z: JOB_MESSAGE_BASIC: Finished operation CombineGlobally(sum)/DoOnce/Read+CombineGlobally(sum)/InjectDefault/InjectDefault+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write root: INFO: 2019-07-27T06:09:51.997Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Close root: INFO: 2019-07-27T06:09:52.053Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Close root: INFO: 2019-07-27T06:09:52.119Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Read+assert_that/Group/GroupByKey/GroupByWindow+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match root: INFO: 2019-07-27T06:10:01.560Z: JOB_MESSAGE_BASIC: Finished operation assert_that/Group/GroupByKey/Read+assert_that/Group/GroupByKey/GroupByWindow+assert_that/Group/Map(_merge_tagged_vals_under_key)+assert_that/Unkey+assert_that/Match root: INFO: 2019-07-27T06:10:01.644Z: JOB_MESSAGE_DEBUG: Executing success step success74 root: INFO: 2019-07-27T06:10:01.784Z: JOB_MESSAGE_DETAILED: Cleaning up. root: INFO: 2019-07-27T06:10:01.842Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. root: INFO: 2019-07-27T06:10:01.891Z: JOB_MESSAGE_BASIC: Stopping worker pool... --------------------- >> end captured logging << --------------------- <https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1150: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported experiments = p.options.view_as(DebugOptions).experiments or [] Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_03_41-2081226016173458292?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_19_33-3934491359207477888?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_28_34-10052945248829461535?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_36_34-6723337658632989144?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_03_39-16708000100328962534?project=apache-beam-testing. <https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:686: BeamDeprecationWarning: BigQuerySink is deprecated since 2.11.0. Use WriteToBigQuery instead. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_29_54-17864812102611266784?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_39_23-9150591440956111769?project=apache-beam-testing. kms_key=transform.kms_key)) Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_03_41-4573176126013640407?project=apache-beam-testing. <https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1150: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_16_37-13872084550053132759?project=apache-beam-testing. experiments = p.options.view_as(DebugOptions).experiments or [] Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_25_49-6235221106464947898?project=apache-beam-testing. <https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:638: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_35_44-11243508066822099434?project=apache-beam-testing. temp_location = p.options.view_as(GoogleCloudOptions).temp_location Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_44_49-9669966986621242564?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_03_39-18380051855701194654?project=apache-beam-testing. <https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:686: BeamDeprecationWarning: BigQuerySink is deprecated since 2.11.0. Use WriteToBigQuery instead. kms_key=transform.kms_key)) Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_26_10-8849515526452957103?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_35_02-8810017565944256583?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_43_49-16154049801750556322?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_03_38-16336166755686582721?project=apache-beam-testing. <https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:686: BeamDeprecationWarning: BigQuerySink is deprecated since 2.11.0. Use WriteToBigQuery instead. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_13_06-3284180206431294218?project=apache-beam-testing. kms_key=transform.kms_key)) Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_22_38-7901973561832213501?project=apache-beam-testing. Exception in thread Thread-1: Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_31_58-13767976555592334800?project=apache-beam-testing. Traceback (most recent call last): File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_03_38-11137594846099481087?project=apache-beam-testing. self.run() Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_13_06-16470615332507926465?project=apache-beam-testing. File "/usr/lib/python3.6/threading.py", line 864, in run self._target(*self._args, **self._kwargs) Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_22_57-17311114157111838907?project=apache-beam-testing. File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,> line 157, in poll_for_job_completion response = runner.dataflow_client.get_job(job_id) File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/utils/retry.py";,> line 197, in wrapper Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_31_53-13288468727955720130?project=apache-beam-testing. return fun(*args, **kwargs) Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_41_34-9569008448239251286?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_50_45-8251553417194185236?project=apache-beam-testing. File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py";,> line 670, in get_job response = self._client.projects_locations_jobs.Get(request) File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py";,> line 689, in Get config, request, global_params=global_params) File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/apitools/base/py/base_api.py";,> line 731, in _RunMethod return self.ProcessHttpResponse(method_config, http_response, request) File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/apitools/base/py/base_api.py";,> line 737, in ProcessHttpResponse self.__ProcessHttpResponse(method_config, http_response, request)) File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/apitools/base/py/base_api.py";,> line 604, in __ProcessHttpResponse http_response, method_config=method_config, request=request) apitools.base.py.exceptions.HttpNotFoundError: HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs/2019-07-26_23_03_38-16336166755686582721?alt=json>: response: <{'vary': 'Origin, X-Origin, Referer', 'content-type': 'application/json; charset=UTF-8', 'date': 'Sat, 27 Jul 2019 06:11:47 GMT', 'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 'transfer-encoding': 'chunked', 'status': '404', 'content-length': '280', '-content-encoding': 'gzip'}>, content <{ "error": { "code": 404, "message": "(80a9bb9822373ab5): Information about job 2019-07-26_23_03_38-16336166755686582721 could not be found in our system. Please double check the id is correct. If it is please contact customer support.", "status": "NOT_FOUND" } } > <https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery_test.py>:572: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported streaming = self.test_pipeline.options.view_as(StandardOptions).streaming <https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1150: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported experiments = p.options.view_as(DebugOptions).experiments or [] <https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/fileio_test.py>:232: FutureWarning: MatchAll is experimental. | 'GetPath' >> beam.Map(lambda metadata: metadata.path)) <https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/fileio_test.py>:243: FutureWarning: MatchAll is experimental. | 'Checksums' >> beam.Map(compute_hash)) <https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/fileio_test.py>:243: FutureWarning: ReadMatches is experimental. | 'Checksums' >> beam.Map(compute_hash)) Exception in thread Thread-1: Traceback (most recent call last): File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner self.run() File "/usr/lib/python3.6/threading.py", line 864, in run self._target(*self._args, **self._kwargs) File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py";,> line 157, in poll_for_job_completion response = runner.dataflow_client.get_job(job_id) File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/utils/retry.py";,> line 197, in wrapper return fun(*args, **kwargs) File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py";,> line 670, in get_job response = self._client.projects_locations_jobs.Get(request) File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py";,> line 689, in Get config, request, global_params=global_params) File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/apitools/base/py/base_api.py";,> line 731, in _RunMethod return self.ProcessHttpResponse(method_config, http_response, request) File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/apitools/base/py/base_api.py";,> line 737, in ProcessHttpResponse self.__ProcessHttpResponse(method_config, http_response, request)) File "<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/-1734967053/lib/python3.6/site-packages/apitools/base/py/base_api.py";,> line 604, in __ProcessHttpResponse http_response, method_config=method_config, request=request) apitools.base.py.exceptions.HttpNotFoundError: HttpError accessing <https://dataflow.googleapis.com/v1b3/projects/apache-beam-testing/locations/us-central1/jobs/2019-07-26_23_03_38-11137594846099481087?alt=json>: response: <{'vary': 'Origin, X-Origin, Referer', 'content-type': 'application/json; charset=UTF-8', 'date': 'Sat, 27 Jul 2019 06:12:06 GMT', 'server': 'ESF', 'cache-control': 'private', 'x-xss-protection': '0', 'x-frame-options': 'SAMEORIGIN', 'x-content-type-options': 'nosniff', 'transfer-encoding': 'chunked', 'status': '404', 'content-length': '280', '-content-encoding': 'gzip'}>, content <{ "error": { "code": 404, "message": "(7f72e61540aa6fb6): Information about job 2019-07-26_23_03_38-11137594846099481087 could not be found in our system. Please double check the id is correct. If it is please contact customer support.", "status": "NOT_FOUND" } } > Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_03_42-12559309378914856345?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_13_54-5234988979172418138?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_25_22-5535893700420831377?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_35_07-13386435653017728139?project=apache-beam-testing. <https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1150: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported experiments = p.options.view_as(DebugOptions).experiments or [] <https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:638: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported temp_location = p.options.view_as(GoogleCloudOptions).temp_location Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_03_40-9400541485608850200?project=apache-beam-testing. <https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:686: BeamDeprecationWarning: BigQuerySink is deprecated since 2.11.0. Use WriteToBigQuery instead. kms_key=transform.kms_key)) <https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/big_query_query_to_table_pipeline.py>:73: BeamDeprecationWarning: BigQuerySink is deprecated since 2.11.0. Use WriteToBigQuery instead. kms_key=kms_key)) Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_13_41-6246557841675198457?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_22_19-9497183091591197340?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_32_36-7302674976756828442?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2019-07-26_23_41_12-12841786183559503340?project=apache-beam-testing. ---------------------------------------------------------------------- XML: nosetests-postCommitIT-df-py36.xml ---------------------------------------------------------------------- XML: <https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 42 tests in 3405.999s FAILED (SKIP=5, failures=2) > Task :sdks:python:test-suites:dataflow:py36:postCommitIT FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://builds.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/test-suites/dataflow/py36/build.gradle'> line: 49 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py36:postCommitIT'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 57m 47s 63 actionable tasks: 46 executed, 17 from cache Publishing build scan... https://gradle.com/s/ozqpq7wek2624 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
