See
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/1898/display/redirect>
Changes:
------------------------------------------
[...truncated 5.17 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
type_urn: "beam:artifact:type:file:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
type_payload:
"\n\232\001/tmp/beam-tempyuhaimgs/artifactsk7qbq1ef/4024252c6da1b06def9520c48a6cc2de0e37ebf48bf115ae6221a982fb2fc308/1-ref_Environment_default_e-pickled_main_session"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
role_urn: "beam:artifact:role:staging_to:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
role_payload: "\n\024pickled_main_session"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 }
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/06/08
01:28:29 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up
for unknown endpoint.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/06/08
01:28:29 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job
BeamApp-jenkins-0608012821-d9b72f82_e29923c9-60a2-46e5-9196-b0ff5bb15127:
Pipeline translated successfully. Computing outputs
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/06/08
01:28:29 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils:
Unable to retrieve the requested metadata.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/06/08
01:28:29 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils:
Unable to retrieve the requested metadata.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/06/08
01:28:29 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils:
Unable to retrieve the requested metadata.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/06/08
01:28:29 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils:
Unable to retrieve the requested metadata.
INFO apache_beam.runners.worker.statecache:statecache.py:234 Creating state
cache with size 0
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:187 Creating
insecure control channel for localhost:34377.
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:195 Control
channel established.
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:243 Initializing
SDKHarness with unbounded number of workers.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/06/08
01:28:29 INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam
Fn Control client connected with id 8-1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/06/08
01:28:29 INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService:
getProcessBundleDescriptor request with id 8-2
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:889 Creating
insecure state channel for localhost:41787.
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:896 State channel
established.
INFO apache_beam.runners.worker.data_plane:data_plane.py:770 Creating
client data channel for localhost:45595
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/06/08
01:28:29 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn
Data client connected.
INFO apache_beam.io.gcp.gcsio:gcsio.py:649 Finished listing 2 files in
0.056549072265625 seconds.
INFO apache_beam.io.filebasedsink:filebasedsink.py:316 Starting
finalize_write threads with num_shards: 2 (skipped: 0), batches: 1,
num_threads: 2
INFO apache_beam.io.filebasedsink:filebasedsink.py:360 Renamed 2 shards in
0.41 seconds.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/06/08
01:28:29 INFO
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing
environment urn: "beam:env:external:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 payload:
"\n\021\n\017localhost:44767"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:bytes:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:string_utf8:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:kv:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:bool:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:varint:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:double:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:iterable:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:timer:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:interval_window:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:length_prefix:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:global_window:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:windowed_value:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:param_windowed_value:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:state_backed_iterable:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:custom_window:v1"
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:272 No more
requests from control plane
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:row:v1"
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:273 SDK Harness
waiting for in-flight requests to complete
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:sharded_key:v1"
INFO apache_beam.runners.worker.data_plane:data_plane.py:803 Closing all
cached grpc data channels.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:nullable:v1"
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:908 Closing all
cached gRPC state handlers.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:protocol:progress_reporting:v0"
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:285 Done consuming
work.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:protocol:harness_monitoring_infos:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:protocol:worker_status:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:combinefn:packed_python:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:version:sdk_base:apache/beam_python3.7_sdk:2.49.0.dev"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:transform:to_string:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:protocol:data_sampling:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
dependencies {
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
type_urn: "beam:artifact:type:file:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
type_payload:
"\n\232\001/tmp/beam-tempyuhaimgs/artifactsk7qbq1ef/4024252c6da1b06def9520c48a6cc2de0e37ebf48bf115ae6221a982fb2fc308/1-ref_Environment_default_e-pickled_main_session"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
role_urn: "beam:artifact:role:staging_to:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
role_payload: "\n\024pickled_main_session"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 }
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/06/08
01:28:29 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up
for unknown endpoint.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/06/08
01:28:29 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job
BeamApp-jenkins-0608012821-d9b72f82_e29923c9-60a2-46e5-9196-b0ff5bb15127
finished.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/06/08
01:28:29 INFO org.sparkproject.jetty.server.AbstractConnector: Stopped
Spark@525ae957{HTTP/1.1, (http/1.1)}{127.0.0.1:4041}
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:590
Job state changed to DONE
INFO apache_beam.io.gcp.gcsio:gcsio.py:649 Finished listing 2 files in
0.04805755615234375 seconds.
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15:
DeprecationWarning: the imp module is deprecated in favour of importlib; see
the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:121
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py>:121:
DeprecationWarning: pkg_resources is deprecated as an API
warnings.warn("pkg_resources is deprecated as an API", DeprecationWarning)
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:2870:
18 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py>:2870:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:2870:
13 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py>:2870:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.cloud')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:2349
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:2349
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:2349
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:2349
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py>:2349:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(parent)
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:2870
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py>:2870:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.logging')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:2870
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py>:2870:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2022703441/lib/python3.7/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/google/rpc/__init__.py>:20:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63:
PendingDeprecationWarning: Client.dataset is deprecated and will be removed in
a future version. Use a string like 'my_project.my_dataset' or a
cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2028:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2034:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1176:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1178:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2664:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2666:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2697:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
| _PassThroughThenCleanup(files_to_remove_pcoll))
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2024:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1169:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
self.project = self.project or p.options.view_as(GoogleCloudOptions).project
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100:
PendingDeprecationWarning: Client.dataset is deprecated and will be removed in
a future version. Use a string like 'my_project.my_dataset' or a
cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47:
FutureWarning: Dropping of nuisance columns in DataFrame reductions (with
'numeric_only=None') is deprecated; in a future version this will raise
TypeError. Select only valid columns before calling the reduction.
return airline_df[at_top_airports].mean()
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/fileio.py>:593:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/pytest_postCommitExamples-spark-py37.xml>
-
=========================== short test summary info ============================
FAILED
apache_beam/examples/avro_nyc_trips_it_test.py::AvroNycTripsIT::test_avro_nyc_trips_output_files_on_small_input
- AssertionError: Lists differ: [{'se[429 chars]3928}, {'service': 'Uber',
'day': 'Fri', 'tota[391 chars]042}] != [{'se[429 chars]3928}]
First list contains 1 additional elements.
First extra element 1:
{'service': 'Uber', 'day': 'Fri', 'total_price': 21.22, 'total_driver_pay':
17.41, 'total_trip_miles': 4.16, 'total_trip_minutes': 17.816666666666666,
'total_number_of_trips': 2, 'price_per_trip': 10.61, 'price_per_mile':
5.100961538461538, 'price_per_minute': 1.1910196445275958,
'driver_pay_per_trip': 8.705, 'driver_pay_per_mile': 4.185096153846153,
'driver_pay_per_minute': 0.9771749298409729, 'miles_per_hour':
14.00935453695042}
Diff is 1126 characters long. Set self.maxDiff to None to see it.
= 1 failed, 22 passed, 10 skipped, 6914 deselected, 77 warnings in 239.99s
(0:03:59) =
> Task :sdks:python:test-suites:portable:py37:sparkExamples FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 276
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py311:sparkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 276
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py37:sparkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 39s
81 actionable tasks: 51 executed, 28 from cache, 2 up-to-date
Publishing build scan...
https://ge.apache.org/s/ha3nqclfogdpm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
