See
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/1645/display/redirect>
Changes:
------------------------------------------
[...truncated 3.22 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at
org.apache.spark.rdd.RDD.$anonfun$getOrCompute$1(RDD.scala:386)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at
org.apache.spark.storage.BlockManager.$anonfun$doPutIterator$1(BlockManager.scala:1423)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at
org.apache.spark.storage.BlockManager.org$apache$spark$storage$BlockManager$$doPut(BlockManager.scala:1350)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at
org.apache.spark.storage.BlockManager.doPutIterator(BlockManager.scala:1414)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at
org.apache.spark.storage.BlockManager.getOrElseUpdate(BlockManager.scala:1237)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at
org.apache.spark.rdd.RDD.getOrCompute(RDD.scala:384)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at
org.apache.spark.rdd.RDD.iterator(RDD.scala:335)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at
org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at
org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at
org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at
org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at
org.apache.spark.rdd.RDD.iterator(RDD.scala:337)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at
org.apache.spark.shuffle.ShuffleWriteProcessor.write(ShuffleWriteProcessor.scala:59)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at
org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:99)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at
org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:52)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at
org.apache.spark.scheduler.Task.run(Task.scala:131)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at
org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at
org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at
org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 at
java.lang.Thread.run(Thread.java:750)
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/04/05
01:32:37 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils:
Unable to retrieve the requested metadata.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/04/05
01:32:37 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils:
Unable to retrieve the requested metadata.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/04/05
01:32:37 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils:
Unable to retrieve the requested metadata.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/04/05
01:32:37 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils:
Unable to retrieve the requested metadata.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/04/05
01:32:37 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils:
Unable to retrieve the requested metadata.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/04/05
01:32:37 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils:
Unable to retrieve the requested metadata.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/04/05
01:32:37 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils:
Unable to retrieve the requested metadata.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/04/05
01:32:37 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils:
Unable to retrieve the requested metadata.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/04/05
01:32:37 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils:
Unable to retrieve the requested metadata.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/04/05
01:32:37 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils:
Unable to retrieve the requested metadata.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/04/05
01:32:37 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils:
Unable to retrieve the requested metadata.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/04/05
01:32:37 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils:
Unable to retrieve the requested metadata.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/04/05
01:32:37 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils:
Unable to retrieve the requested metadata.
INFO apache_beam.runners.worker.statecache:statecache.py:234 Creating state
cache with size 0
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:187 Creating
insecure control channel for localhost:44319.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/04/05
01:32:37 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils:
Unable to retrieve the requested metadata.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/04/05
01:32:37 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils:
Unable to retrieve the requested metadata.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/04/05
01:32:37 WARN software.amazon.awssdk.regions.internal.util.EC2MetadataUtils:
Unable to retrieve the requested metadata.
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:195 Control
channel established.
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:243 Initializing
SDKHarness with unbounded number of workers.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/04/05
01:32:37 INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService: Beam
Fn Control client connected with id 239-1
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/04/05
01:32:37 INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService:
getProcessBundleDescriptor request with id 239-2
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:889 Creating
insecure state channel for localhost:35125.
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:896 State channel
established.
INFO root:environments.py:376 Default Python SDK image for environment is
apache/beam_python3.7_sdk:2.47.0.dev
INFO apache_beam.runners.worker.data_plane:data_plane.py:772 Creating
client data channel for localhost:44151
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/04/05
01:32:37 INFO org.apache.beam.runners.fnexecution.data.GrpcDataService: Beam Fn
Data client connected.
INFO apache_beam.io.fileio:fileio.py:701 Moving temporary files <map object
at 0x7ff14c090b50> to dir: gs://temp-storage-for-end-to-end-tests/temp-it as
['86c1560e-6168-4db7-b219-cea70fd226b1.result-00000-of-00002',
'86c1560e-6168-4db7-b219-cea70fd226b1.result-00001-of-00002']
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/04/05
01:32:38 INFO
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory: Closing
environment urn: "beam:env:external:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 payload:
"\n\021\n\017localhost:44489"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:bytes:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:string_utf8:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:kv:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:bool:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:varint:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:double:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:iterable:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:timer:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:interval_window:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:length_prefix:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:global_window:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:windowed_value:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:param_windowed_value:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:state_backed_iterable:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:custom_window:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:row:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:sharded_key:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:coder:nullable:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:protocol:progress_reporting:v0"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:protocol:harness_monitoring_infos:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:protocol:worker_status:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:combinefn:packed_python:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:version:sdk_base:apache/beam_python3.7_sdk:2.47.0.dev"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:transform:sdf_truncate_sized_restrictions:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:transform:to_string:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
capabilities: "beam:protocol:data_sampling:v1"
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:272 No more
requests from control plane
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:273 SDK Harness
waiting for in-flight requests to complete
INFO apache_beam.runners.worker.data_plane:data_plane.py:805 Closing all
cached grpc data channels.
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:908 Closing all
cached gRPC state handlers.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/04/05
01:32:38 WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer: Hanged up
for unknown endpoint.
INFO apache_beam.runners.worker.sdk_worker:sdk_worker.py:285 Done consuming
work.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/04/05
01:32:38 INFO org.apache.beam.runners.spark.SparkPipelineRunner: Job
BeamApp-jenkins-0405013234-a3dca3be_fdd0563a-82a2-4ccf-b85d-03bf005bd218
finished.
INFO apache_beam.utils.subprocess_server:subprocess_server.py:126 23/04/05
01:32:38 INFO org.sparkproject.jetty.server.AbstractConnector: Stopped
Spark@a950b81{HTTP/1.1, (http/1.1)}{127.0.0.1:4040}
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:590
Job state changed to DONE
INFO apache_beam.io.gcp.gcsio:gcsio.py:649 Finished listing 2 files in
0.056177377700805664 seconds.
PASSED [100%]
=============================== warnings summary ===============================
../../build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/hdfs/config.py>:15:
DeprecationWarning: the imp module is deprecated in favour of importlib; see
the module's documentation for alternative uses
from imp import load_source
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:121
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py>:121:
DeprecationWarning: pkg_resources is deprecated as an API
warnings.warn("pkg_resources is deprecated as an API", DeprecationWarning)
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:2870:
18 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py>:2870:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:2870:
13 warnings
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py>:2870:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.cloud')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:2349
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:2349
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:2349
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:2349
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py>:2349:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(parent)
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:2870
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py>:2870:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.logging')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py:2870
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/pkg_resources/__init__.py>:2870:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.iam')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
declare_namespace(pkg)
../../build/gradleenv/2022703441/lib/python3.7/site-packages/google/rpc/__init__.py:20
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/2022703441/lib/python3.7/site-packages/google/rpc/__init__.py>:20:
DeprecationWarning: Deprecated call to
`pkg_resources.declare_namespace('google.rpc')`.
Implementing implicit namespace packages (as specified in PEP 420) is
preferred to `pkg_resources.declare_namespace`. See
https://setuptools.pypa.io/en/latest/references/keywords.html#keyword-namespace-packages
pkg_resources.declare_namespace(__name__)
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63:
PendingDeprecationWarning: Client.dataset is deprecated and will be removed in
a future version. Use a string like 'my_project.my_dataset' or a
cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2030:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2036:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1173:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1175:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2665:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2667:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2698:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
| _PassThroughThenCleanup(files_to_remove_pcoll))
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2026:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1166:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
self.project = self.project or p.options.view_as(GoogleCloudOptions).project
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100:
PendingDeprecationWarning: Client.dataset is deprecated and will be removed in
a future version. Use a string like 'my_project.my_dataset' or a
cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47:
FutureWarning: Dropping of nuisance columns in DataFrame reductions (with
'numeric_only=None') is deprecated; in a future version this will raise
TypeError. Select only valid columns before calling the reduction.
return airline_df[at_top_airports].mean()
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/dataframe/io.py>:664:
FutureWarning: WriteToFiles is experimental.
sink=lambda _: _WriteToPandasFileSink(
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/fileio.py>:596:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/pytest_postCommitExamples-spark-py37.xml>
-
=== 22 passed, 10 skipped, 6853 deselected, 79 warnings in 296.34s (0:04:56) ===
FAILURE: Build failed with an exception.
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 276
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py310:sparkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 139
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 6m 27s
81 actionable tasks: 51 executed, 28 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/ugpadw2wtekzi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
