See <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/13/display/redirect>
Changes: ------------------------------------------ [...truncated 3.14 MB...] INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/08 00:28:24 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/08 00:28:24 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils: Unable to retrieve the requested metadata.' INFO apache_beam.runners.worker.statecache:statecache.py:172 Creating state cache with size 0 INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:164 Creating insecure control channel for localhost:35379. INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:172 Control channel established. INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:215 Initializing SDKHarness with unbounded number of workers. INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/08 00:28:24 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam Fn Control client connected with id 131-1' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/08 00:28:24 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 131-3' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/08 00:28:24 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 131-2' INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:807 Creating insecure state channel for localhost:41651. INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/08 00:28:24 INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: getProcessBundleDescriptor request with id 131-4' INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:814 State channel established. INFO apache_beam.runners.worker.data_plane:data_plane.py:750 Creating client data channel for localhost:44731 INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/08 00:28:24 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn Data client connected.' INFO apache_beam.io.fileio:fileio.py:637 Moving temporary file gs://temp-storage-for-end-to-end-tests/temp-it/.tempa07891ef-a2b4-4927-9595-7ad4d060d801/4598189188425841853_95054b97-f2f4-472c-bb36-5f1dad6918ff to dir: gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-4126c3a1-820c-48cf-b212-006768277b48 as output.csv-2012-12-24T00:00:00-2012-12-25T00:00:00-00000-of-00004. Res: FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.tempa07891ef-a2b4-4927-9595-7ad4d060d801/4598189188425841853_95054b97-f2f4-472c-bb36-5f1dad6918ff', shard_index=-1, total_shards=0, window=[1356307200.0, 1356393600.0), pane=None, destination=None) INFO apache_beam.io.fileio:fileio.py:637 Moving temporary file gs://temp-storage-for-end-to-end-tests/temp-it/.tempa07891ef-a2b4-4927-9595-7ad4d060d801/4802339249571603211_4cc863c7-3d2a-47f7-80fc-0d3a2d493571 to dir: gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-4126c3a1-820c-48cf-b212-006768277b48 as output.csv-2012-12-25T00:00:00-2012-12-26T00:00:00-00000-of-00004. Res: FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.tempa07891ef-a2b4-4927-9595-7ad4d060d801/4802339249571603211_4cc863c7-3d2a-47f7-80fc-0d3a2d493571', shard_index=-1, total_shards=0, window=[1356393600.0, 1356480000.0), pane=None, destination=None) INFO apache_beam.io.fileio:fileio.py:637 Moving temporary file gs://temp-storage-for-end-to-end-tests/temp-it/.tempa07891ef-a2b4-4927-9595-7ad4d060d801/474657147301083487_2907f928-2f44-4777-ba76-cb33c56ca487 to dir: gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-4126c3a1-820c-48cf-b212-006768277b48 as output.csv-2012-12-23T00:00:00-2012-12-24T00:00:00-00000-of-00004. Res: FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.tempa07891ef-a2b4-4927-9595-7ad4d060d801/474657147301083487_2907f928-2f44-4777-ba76-cb33c56ca487', shard_index=-1, total_shards=0, window=[1356220800.0, 1356307200.0), pane=None, destination=None) INFO apache_beam.io.fileio:fileio.py:637 Moving temporary file gs://temp-storage-for-end-to-end-tests/temp-it/.tempa07891ef-a2b4-4927-9595-7ad4d060d801/4598189188425841853_49aed087-c578-4287-8d1d-74b87f559c17 to dir: gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-4126c3a1-820c-48cf-b212-006768277b48 as output.csv-2012-12-24T00:00:00-2012-12-25T00:00:00-00001-of-00004. Res: FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.tempa07891ef-a2b4-4927-9595-7ad4d060d801/4598189188425841853_49aed087-c578-4287-8d1d-74b87f559c17', shard_index=-1, total_shards=0, window=[1356307200.0, 1356393600.0), pane=None, destination=None) INFO apache_beam.io.fileio:fileio.py:637 Moving temporary file gs://temp-storage-for-end-to-end-tests/temp-it/.tempa07891ef-a2b4-4927-9595-7ad4d060d801/4802339249571603211_6ca6b539-164f-4e26-9123-f0898fa5a25e to dir: gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-4126c3a1-820c-48cf-b212-006768277b48 as output.csv-2012-12-25T00:00:00-2012-12-26T00:00:00-00001-of-00004. Res: FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.tempa07891ef-a2b4-4927-9595-7ad4d060d801/4802339249571603211_6ca6b539-164f-4e26-9123-f0898fa5a25e', shard_index=-1, total_shards=0, window=[1356393600.0, 1356480000.0), pane=None, destination=None) INFO apache_beam.io.fileio:fileio.py:637 Moving temporary file gs://temp-storage-for-end-to-end-tests/temp-it/.tempa07891ef-a2b4-4927-9595-7ad4d060d801/474657147301083487_20705ddd-98b3-43c8-b793-a5e8771d15c8 to dir: gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-4126c3a1-820c-48cf-b212-006768277b48 as output.csv-2012-12-23T00:00:00-2012-12-24T00:00:00-00001-of-00004. Res: FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.tempa07891ef-a2b4-4927-9595-7ad4d060d801/474657147301083487_20705ddd-98b3-43c8-b793-a5e8771d15c8', shard_index=-1, total_shards=0, window=[1356220800.0, 1356307200.0), pane=None, destination=None) INFO apache_beam.io.fileio:fileio.py:637 Moving temporary file gs://temp-storage-for-end-to-end-tests/temp-it/.tempa07891ef-a2b4-4927-9595-7ad4d060d801/4598189188425841853_c2773fd8-af06-4897-a760-293be2009761 to dir: gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-4126c3a1-820c-48cf-b212-006768277b48 as output.csv-2012-12-24T00:00:00-2012-12-25T00:00:00-00002-of-00004. Res: FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.tempa07891ef-a2b4-4927-9595-7ad4d060d801/4598189188425841853_c2773fd8-af06-4897-a760-293be2009761', shard_index=-1, total_shards=0, window=[1356307200.0, 1356393600.0), pane=None, destination=None) INFO apache_beam.io.fileio:fileio.py:637 Moving temporary file gs://temp-storage-for-end-to-end-tests/temp-it/.tempa07891ef-a2b4-4927-9595-7ad4d060d801/474657147301083487_7434ccee-f8ac-4a18-b84b-0ceeb080939c to dir: gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-4126c3a1-820c-48cf-b212-006768277b48 as output.csv-2012-12-23T00:00:00-2012-12-24T00:00:00-00002-of-00004. Res: FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.tempa07891ef-a2b4-4927-9595-7ad4d060d801/474657147301083487_7434ccee-f8ac-4a18-b84b-0ceeb080939c', shard_index=-1, total_shards=0, window=[1356220800.0, 1356307200.0), pane=None, destination=None) INFO apache_beam.io.fileio:fileio.py:637 Moving temporary file gs://temp-storage-for-end-to-end-tests/temp-it/.tempa07891ef-a2b4-4927-9595-7ad4d060d801/4802339249571603211_914d398d-b061-4bcc-95b0-0b2cc8eb3cf4 to dir: gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-4126c3a1-820c-48cf-b212-006768277b48 as output.csv-2012-12-25T00:00:00-2012-12-26T00:00:00-00002-of-00004. Res: FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.tempa07891ef-a2b4-4927-9595-7ad4d060d801/4802339249571603211_914d398d-b061-4bcc-95b0-0b2cc8eb3cf4', shard_index=-1, total_shards=0, window=[1356393600.0, 1356480000.0), pane=None, destination=None) INFO apache_beam.io.fileio:fileio.py:637 Moving temporary file gs://temp-storage-for-end-to-end-tests/temp-it/.tempa07891ef-a2b4-4927-9595-7ad4d060d801/4598189188425841853_9b3a6db1-3937-43df-b05e-f80e043a9ffe to dir: gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-4126c3a1-820c-48cf-b212-006768277b48 as output.csv-2012-12-24T00:00:00-2012-12-25T00:00:00-00003-of-00004. Res: FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.tempa07891ef-a2b4-4927-9595-7ad4d060d801/4598189188425841853_9b3a6db1-3937-43df-b05e-f80e043a9ffe', shard_index=-1, total_shards=0, window=[1356307200.0, 1356393600.0), pane=None, destination=None) INFO apache_beam.io.fileio:fileio.py:637 Moving temporary file gs://temp-storage-for-end-to-end-tests/temp-it/.tempa07891ef-a2b4-4927-9595-7ad4d060d801/4802339249571603211_7eaa0c09-1d7b-4425-a233-3ae0902548e1 to dir: gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-4126c3a1-820c-48cf-b212-006768277b48 as output.csv-2012-12-25T00:00:00-2012-12-26T00:00:00-00003-of-00004. Res: FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.tempa07891ef-a2b4-4927-9595-7ad4d060d801/4802339249571603211_7eaa0c09-1d7b-4425-a233-3ae0902548e1', shard_index=-1, total_shards=0, window=[1356393600.0, 1356480000.0), pane=None, destination=None) INFO apache_beam.io.fileio:fileio.py:637 Moving temporary file gs://temp-storage-for-end-to-end-tests/temp-it/.tempa07891ef-a2b4-4927-9595-7ad4d060d801/474657147301083487_b7c26080-1367-4908-9049-0cf077375fbe to dir: gs://temp-storage-for-end-to-end-tests/temp-it/flight_delays_it-4126c3a1-820c-48cf-b212-006768277b48 as output.csv-2012-12-23T00:00:00-2012-12-24T00:00:00-00003-of-00004. Res: FileResult(file_name='gs://temp-storage-for-end-to-end-tests/temp-it/.tempa07891ef-a2b4-4927-9595-7ad4d060d801/474657147301083487_b7c26080-1367-4908-9049-0cf077375fbe', shard_index=-1, total_shards=0, window=[1356220800.0, 1356307200.0), pane=None, destination=None) INFO apache_beam.io.fileio:fileio.py:661 Checking orphaned temporary files for destination None and window [1356307200.0, 1356393600.0) INFO apache_beam.io.gcp.gcsio:gcsio.py:559 Starting the size estimation of the input INFO apache_beam.io.fileio:fileio.py:661 Checking orphaned temporary files for destination None and window [1356393600.0, 1356480000.0) INFO apache_beam.io.gcp.gcsio:gcsio.py:559 Starting the size estimation of the input INFO apache_beam.io.fileio:fileio.py:661 Checking orphaned temporary files for destination None and window [1356220800.0, 1356307200.0) INFO apache_beam.io.gcp.gcsio:gcsio.py:559 Starting the size estimation of the input INFO apache_beam.io.gcp.gcsio:gcsio.py:572 Finished listing 0 files in 0.05951428413391113 seconds. INFO apache_beam.io.fileio:fileio.py:676 Some files may be left orphaned in the temporary folder: [] INFO apache_beam.io.gcp.gcsio:gcsio.py:572 Finished listing 0 files in 0.08423972129821777 seconds. INFO apache_beam.io.fileio:fileio.py:676 Some files may be left orphaned in the temporary folder: [] INFO apache_beam.io.gcp.gcsio:gcsio.py:572 Finished listing 0 files in 0.07470154762268066 seconds. INFO apache_beam.io.fileio:fileio.py:676 Some files may be left orphaned in the temporary folder: [] INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/08 00:28:25 INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing environment urn: "beam:env:external:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'payload: "\\n\\021\\n\\017localhost:37229"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:bytes:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:string_utf8:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:kv:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:bool:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:varint:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:double:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:iterable:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:timer:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:interval_window:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:length_prefix:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:global_window:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:windowed_value:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:param_windowed_value:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:state_backed_iterable:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:custom_window:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:row:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:coder:sharded_key:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:protocol:progress_reporting:v0"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:protocol:harness_monitoring_infos:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:protocol:worker_status:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:combinefn:packed_python:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:version:sdk_base:apache/beam_python3.8_sdk:2.37.0.dev"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'capabilities: "beam:transform:to_string:v1"' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'' INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/08 00:28:25 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up for unknown endpoint.' INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:244 No more requests from control plane INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:245 SDK Harness waiting for in-flight requests to complete INFO apache_beam.runners.worker.data_plane:data_plane.py:782 Closing all cached grpc data channels. INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:826 Closing all cached gRPC state handlers. ERROR apache_beam.runners.worker.data_plane:data_plane.py:641 Failed to read inputs in the data plane. Traceback (most recent call last): File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/runners/worker/data_plane.py";,> line 634, in _read_inputs for elements in elements_iterator: File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/grpc/_channel.py";,> line 426, in __next__ return self._next() File "<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/grpc/_channel.py";,> line 826, in _next raise self grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with: status = StatusCode.CANCELLED details = "Multiplexer hanging up" debug_error_string = "{"created":"@1644280105.790193046","description":"Error received from peer ipv6:[::1]:44731","file":"src/core/lib/surface/call.cc","file_line":1074,"grpc_message":"Multiplexer hanging up","grpc_status":1}" > INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:257 Done consuming work. INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'22/02/08 00:28:25 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job BeamApp-jenkins-0208002751-e9a174df_bbfca6e2-31cc-45e4-b134-a2c95b384f9d finished.' INFO apache_beam.runners.portability.portable_runner:portable_runner.py:574 Job state changed to DONE INFO apache_beam.io.gcp.gcsio:gcsio.py:559 Starting the size estimation of the input INFO apache_beam.io.gcp.gcsio:gcsio.py:572 Finished listing 4 files in 0.03937339782714844 seconds. INFO apache_beam.io.gcp.gcsio:gcsio.py:559 Starting the size estimation of the input INFO apache_beam.io.gcp.gcsio:gcsio.py:572 Finished listing 12 files in 0.04899930953979492 seconds. =============================== warnings summary =============================== apache_beam/io/filesystems_test.py:54 <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string apache_beam/io/filesystems_test.py:62 <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/tenacity/_asyncio.py>:42 <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703442/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead def call(self, fn, *args, **kwargs): apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead. dataset_ref = client.dataset(unique_dataset_name, project=project) apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2138: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported is_streaming_pipeline = p.options.view_as(StandardOptions).streaming apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2144: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported experiments = p.options.view_as(DebugOptions).experiments or [] apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1128: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported temp_location = p.options.view_as(GoogleCloudOptions).temp_location apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1130: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME') apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2437: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported temp_location = pcoll.pipeline.options.view_as( apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2439: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2463: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported pipeline_options=pcoll.pipeline.options, apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2134: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported self.table_reference.projectId = pcoll.pipeline.options.view_as( apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100: PendingDeprecationWarning: Client.dataset is deprecated and will be removed in a future version. Use a string like 'my_project.my_dataset' or a cloud.google.bigquery.DatasetReference object, instead. table_ref = client.dataset(dataset_id).table(table_id) apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:45: FutureWarning: Dropping of nuisance columns in DataFrame reductions (with 'numeric_only=None') is deprecated; in a future version this will raise TypeError. Select only valid columns before calling the reduction. return airline_df[at_top_airports].mean() apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental. return pcoll | fileio.WriteToFiles( apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/fileio.py>:550: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported p.options.view_as(GoogleCloudOptions).temp_location or -- Docs: https://docs.pytest.org/en/latest/warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/pytest_postCommitExamples-spark-py38.xml> - = 1 failed, 21 passed, 1 skipped, 5178 deselected, 82 warnings in 293.07 seconds = FAILURE: Build failed with an exception. * Where: Script '<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/test-suites/portable/common.gradle'> line: 248 * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py38:sparkExamples'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org BUILD FAILED in 8m 4s 79 actionable tasks: 52 executed, 25 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/srllvqb6tahnu Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
