See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/799/display/redirect?page=changes>
Changes: [noreply] Pass user specified destination type to UpdateSchemaDestination [noreply] [Go SDK] Stream decode values in single iterations (#22904) [noreply] Enable autosharding for BQ: #22818 [noreply] Update wordcount_minimal.py by removing pipeline_args.extend (#22786) [noreply] Add map state in the Go Sdk (#22897) ------------------------------------------ [...truncated 2.72 MB...] INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py";,> line 790, in finish INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 raise self._upload_thread.last_error # pylint: disable=raising-bad-type INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py";,> line 763, in _start_upload INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 self._client.objects.Insert(self._insert_request, upload=self._upload) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/storage/storage_v1_client.py";,> line 1154, in Insert INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 upload=upload, upload_config=upload_config) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py";,> line 731, in _RunMethod INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 return self.ProcessHttpResponse(method_config, http_response, request) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py";,> line 737, in ProcessHttpResponse INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 self.__ProcessHttpResponse(method_config, http_response, request)) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py";,> line 604, in __ProcessHttpResponse INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 http_response, method_config=method_config, request=request) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 RuntimeError: apitools.base.py.exceptions.HttpError: HttpError accessing <https://www.googleapis.com/resumable/upload/storage/v1/b/temp-storage-for-end-to-end-tests/o?alt=json&name=py-it-cloud%2Foutput%2Fecc8709f-bdc6-445f-8b73-c7259ce12a2a%2Fbeam-temp-result-4c2833f6257511edb1885d750281bbd1%2F754cf1b9-5d7d-441f-a802-dd0a967a8daf.result&uploadType=resumable&upload_id=ADPycdsDGY4_skCGBH-ESv1cAnMIIz-vbaNGydYNGUgJfDgpn9-1rSb30QDJQHaHXP6-CiOmZVhwnXYtqGCjgBAP0p9shXohX2CK>: response: <{'content-type': 'text/plain; charset=utf-8', 'x-guploader-uploadid': 'ADPycdsDGY4_skCGBH-ESv1cAnMIIz-vbaNGydYNGUgJfDgpn9-1rSb30QDJQHaHXP6-CiOmZVhwnXYtqGCjgBAP0p9shXohX2CK', 'content-length': '0', 'date': 'Fri, 26 Aug 2022 19:28:51 GMT', 'server': 'UploadServer', 'status': '503'}>, content <> [while running 'write/Write/WriteImpl/WriteBundles'] INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:180) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at org.apache.beam.runners.fnexecution.control.FnApiControlClient$ResponseStreamObserver.onNext(FnApiControlClient.java:160) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.stub.ServerCalls$StreamingServerCallHandler$StreamingServerCallListener.onMessage(ServerCalls.java:262) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.ForwardingServerCallListener.onMessage(ForwardingServerCallListener.java:33) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.Contexts$ContextualizedServerCallListener.onMessage(Contexts.java:76) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailableInternal(ServerCallImpl.java:332) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerCallImpl$ServerStreamListenerImpl.messagesAvailable(ServerCallImpl.java:315) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ServerImpl$JumpToApplicationThreadServerStreamListener$1MessagesAvailable.runInContext(ServerImpl.java:834) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.ContextRunnable.run(ContextRunnable.java:37) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 at org.apache.beam.vendor.grpc.v1p48p1.io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:133) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 ... 3 more INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 22/08/26 19:28:51 WARN org.apache.spark.scheduler.TaskSetManager: Lost task 1.0 in stage 3.0 (TID 13, localhost, executor driver): java.util.concurrent.ExecutionException: java.lang.RuntimeException: Error received from SDK harness for instruction 5: Traceback (most recent call last): INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/runners/common.py";,> line 1458, in _invoke_bundle_method INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 bundle_method() INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/runners/common.py";,> line 567, in invoke_finish_bundle INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 self.signature.finish_bundle_method.method_value()) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/runners/common.py";,> line 1730, in finish_bundle_outputs INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 for result in results: INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/iobase.py";,> line 1202, in finish_bundle INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 self.writer.close(), INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/filebasedsink.py";,> line 435, in close INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 self.sink.close(self.temp_handle) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/textio.py";,> line 516, in close INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 super().close(file_handle) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/filebasedsink.py";,> line 167, in close INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 file_handle.close() INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/filesystemio.py";,> line 215, in close INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 self._uploader.finish() INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py";,> line 790, in finish INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 raise self._upload_thread.last_error # pylint: disable=raising-bad-type INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py";,> line 763, in _start_upload INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 self._client.objects.Insert(self._insert_request, upload=self._upload) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/internal/clients/storage/storage_v1_client.py";,> line 1154, in Insert INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 upload=upload, upload_config=upload_config) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py";,> line 731, in _RunMethod INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 return self.ProcessHttpResponse(method_config, http_response, request) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py";,> line 737, in ProcessHttpResponse INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 self.__ProcessHttpResponse(method_config, http_response, request)) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/apitools/base/py/base_api.py";,> line 604, in __ProcessHttpResponse INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 http_response, method_config=method_config, request=request) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 apitools.base.py.exceptions.HttpError: HttpError accessing <https://www.googleapis.com/resumable/upload/storage/v1/b/temp-storage-for-end-to-end-tests/o?alt=json&name=py-it-cloud%2Foutput%2Fecc8709f-bdc6-445f-8b73-c7259ce12a2a%2Fbeam-temp-result-4c2833f6257511edb1885d750281bbd1%2F754cf1b9-5d7d-441f-a802-dd0a967a8daf.result&uploadType=resumable&upload_id=ADPycdsDGY4_skCGBH-ESv1cAnMIIz-vbaNGydYNGUgJfDgpn9-1rSb30QDJQHaHXP6-CiOmZVhwnXYtqGCjgBAP0p9shXohX2CK>: response: <{'content-type': 'text/plain; charset=utf-8', 'x-guploader-uploadid': 'ADPycdsDGY4_skCGBH-ESv1cAnMIIz-vbaNGydYNGUgJfDgpn9-1rSb30QDJQHaHXP6-CiOmZVhwnXYtqGCjgBAP0p9shXohX2CK', 'content-length': '0', 'date': 'Fri, 26 Aug 2022 19:28:51 GMT', 'server': 'UploadServer', 'status': '503'}>, content <> INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 During handling of the above exception, another exception occurred: INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 Traceback (most recent call last): INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py";,> line 284, in _execute INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 response = task() INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py";,> line 357, in <lambda> INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 lambda: self.create_worker().do_instruction(request), request) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py";,> line 598, in do_instruction INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 getattr(request, request_type), request.instruction_id) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/runners/worker/sdk_worker.py";,> line 635, in process_bundle INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 bundle_processor.process_bundle(instruction_id)) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/runners/worker/bundle_processor.py";,> line 1009, in process_bundle INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 op.finish() INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/runners/worker/operations.py";,> line 943, in finish INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 self.dofn_runner.finish() INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/runners/common.py";,> line 1479, in finish INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 self._invoke_bundle_method(self.do_fn_invoker.invoke_finish_bundle) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/runners/common.py";,> line 1460, in _invoke_bundle_method INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 self._reraise_augmented(exn) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/runners/common.py";,> line 1507, in _reraise_augmented INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 raise new_exn.with_traceback(tb) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/runners/common.py";,> line 1458, in _invoke_bundle_method INFO apache_beam.runners.portability.portable_runner:portable_runner.py:583 Job state changed to FAILED INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 bundle_method() INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/runners/common.py";,> line 567, in invoke_finish_bundle INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 self.signature.finish_bundle_method.method_value()) INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/runners/common.py";,> line 1730, in finish_bundle_outputs INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 for result in results: INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/iobase.py";,> line 1202, in finish_bundle INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 self.writer.close(), INFO apache_beam.utils.subprocess_server:subprocess_server.py:132 File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/filebasedsink.py";,> line 435, in close --------------------------- Captured stdout teardown --------------------------- FAILED [ 17%] =============================== warnings summary =============================== ../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15 <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses from imp import load_source apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead. dataset_ref = client.dataset(unique_dataset_name, project=project) apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2285: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported is_streaming_pipeline = p.options.view_as(StandardOptions).streaming apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2291: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported experiments = p.options.view_as(DebugOptions).experiments or [] apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1129: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported temp_location = p.options.view_as(GoogleCloudOptions).temp_location apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1131: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME') apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2774: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported temp_location = pcoll.pipeline.options.view_as( apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2776: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2807: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported | _PassThroughThenCleanup(files_to_remove_pcoll)) apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2281: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported self.table_reference.projectId = pcoll.pipeline.options.view_as( apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead. table_ref = client.dataset(dataset_id).table(table_id) apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError. Select only valid columns before calling the reduction. return airline_df[at_top_airports].mean() apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/dataframe/io.py>:632: FutureWarning: WriteToFiles is experimental. sink=lambda _: _WriteToPandasFileSink( Exception in thread read_grpc_client_inputs: Traceback (most recent call last): apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/fileio.py>:581: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported p.options.view_as(GoogleCloudOptions).temp_location or File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner self.run() File "/usr/lib/python3.7/threading.py", line 870, in run self._target(*self._args, **self._kwargs) -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/pytest_postCommitExamples-spark-py37.xml> - =========================== short test summary info ============================ FAILED apache_beam/examples/complete/autocomplete_it_test.py::AutocompleteIT::test_autocomplete_output_files_on_small_input = 1 failed, 21 passed, 3 skipped, 6529 deselected, 38 warnings in 273.81s (0:04:33) = File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,> line 671, in <lambda> target=lambda: self._read_inputs(elements_iterator), File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,> line 654, in _read_inputs for elements in elements_iterator: File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py";,> line 426, in __next__ return self._next() File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py";,> line 826, in _next raise self grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with: status = StatusCode.CANCELLED details = "Multiplexer hanging up" debug_error_string = "{"created":"@1661542314.415991884","description":"Error received from peer ipv6:[::1]:44585","file":"src/core/lib/surface/call.cc","file_line":966,"grpc_message":"Multiplexer hanging up","grpc_status":1}" > Exception in thread read_grpc_client_inputs: Traceback (most recent call last): File "/usr/lib/python3.7/threading.py", line 926, in _bootstrap_inner self.run() File "/usr/lib/python3.7/threading.py", line 870, in run self._target(*self._args, **self._kwargs) File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,> line 671, in <lambda> target=lambda: self._read_inputs(elements_iterator), File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,> line 654, in _read_inputs for elements in elements_iterator: File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py";,> line 426, in __next__ return self._next() File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/grpc/_channel.py";,> line 826, in _next raise self grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with: status = StatusCode.CANCELLED details = "Multiplexer hanging up" debug_error_string = "{"created":"@1661542336.235950504","description":"Error received from peer ipv6:[::1]:39073","file":"src/core/lib/surface/call.cc","file_line":966,"grpc_message":"Multiplexer hanging up","grpc_status":1}" > > Task :sdks:python:test-suites:portable:py37:sparkExamples FAILED FAILURE: Build failed with an exception. * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 271 * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py37:sparkExamples'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 6m 80 actionable tasks: 51 executed, 27 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/3ltpxpvacwxfk Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
