See
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/1019/display/redirect>
Changes:
------------------------------------------
[...truncated 373.32 KB...]
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function pack_combiners at 0x7f7147b80550>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function lift_combiners at 0x7f7147b805e0>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function sort_stages at 0x7f7147b80d30>
====================
INFO apache_beam.io.gcp.tests.utils:utils.py:93 Clean up a BigQuery table
with project: apache-beam-testing, dataset: FiltersTestIT, table:
cold_days_1667071774409.
_____________________ FlightDelaysTest.test_flight_delays ______________________
self = <apache_beam.examples.dataframe.flight_delays_it_test.FlightDelaysTest
testMethod=test_flight_delays>
@pytest.mark.examples_postcommit
@pytest.mark.it_postcommit
def test_flight_delays(self):
> flight_delays.run_flight_delay_pipeline(
self.test_pipeline,
start_date='2012-12-23',
end_date='2012-12-25',
output=self.output_path)
apache_beam/examples/dataframe/flight_delays_it_test.py:106:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
apache_beam/examples/dataframe/flight_delays.py:83: in run_flight_delay_pipeline
with pipeline as p:
apache_beam/pipeline.py:597: in __exit__
self.result = self.run()
apache_beam/testing/test_pipeline.py:112: in run
result = super().run(
apache_beam/pipeline.py:550: in run
self._options).run(False)
apache_beam/pipeline.py:574: in run
return self.runner.run_pipeline(self, self._options)
apache_beam/runners/portability/spark_runner.py:47: in run_pipeline
return super().run_pipeline(pipeline, options)
apache_beam/runners/portability/portable_runner.py:439: in run_pipeline
job_service_handle = self.create_job_service(options)
apache_beam/runners/portability/portable_runner.py:318: in create_job_service
return self.create_job_service_handle(server.start(), options)
apache_beam/runners/portability/job_server.py:81: in start
self._endpoint = self._job_server.start()
apache_beam/runners/portability/job_server.py:106: in start
cmd, endpoint = self.subprocess_cmd_and_endpoint()
apache_beam/runners/portability/job_server.py:150: in
subprocess_cmd_and_endpoint
jar_path = self.local_jar(self.path_to_jar())
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = <apache_beam.runners.portability.spark_runner.SparkJarJobServer object
at 0x7f70fc147fd0>
def path_to_jar(self):
if self._jar:
if not os.path.exists(self._jar):
url = urllib.parse.urlparse(self._jar)
if not url.scheme:
> raise ValueError(
'Unable to parse jar URL "%s". If using a full URL, make sure '
'the scheme is specified. If using a local file path, make sure
'
'the file exists; you may have to first build the job server '
'using `./gradlew runners:spark:3:job-server:shadowJar`.' %
self._jar)
E ValueError: Unable to parse jar URL
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/runners/spark/2/job-server/build/libs/beam-runners-spark-3-job-server-2.44.0-SNAPSHOT.jar";.>
If using a full URL, make sure the scheme is specified. If using a local file
path, make sure the file exists; you may have to first build the job server
using `./gradlew runners:spark:3:job-server:shadowJar`.
apache_beam/runners/portability/spark_runner.py:87: ValueError
------------------------------ Captured log call -------------------------------
INFO root:transforms.py:182 Computing dataframe stage
<ComputeStage(PTransform)
label=[[ComputedExpression[move_grouped_columns_to_index_DataFrame_140123146684064]]:140123163984704]>
for
Stage[inputs={PlaceholderExpression[placeholder_DataFrame_140123146684496]},
partitioning=Arbitrary,
ops=[ComputedExpression[move_grouped_columns_to_index_DataFrame_140123146684064]],
outputs={ComputedExpression[move_grouped_columns_to_index_DataFrame_140123146684064],
PlaceholderExpression[placeholder_DataFrame_140123146684496]}]
INFO root:transforms.py:182 Computing dataframe stage
<ComputeStage(PTransform)
label=[[ComputedExpression[apply_DataFrame_140123163190000]]:140124474876560]>
for
Stage[inputs={ComputedExpression[move_grouped_columns_to_index_DataFrame_140123146684064]},
partitioning=Index['airline'],
ops=[ComputedExpression[apply_DataFrame_140123163190000]],
outputs={ComputedExpression[apply_DataFrame_140123163190000]}]
INFO apache_beam.io.fileio:fileio.py:595 Added temporary directory
gs://temp-storage-for-end-to-end-tests/temp-it/.temp10bd22dc-1ecc-4197-9b75-9567c511a1d3
INFO apache_beam.runners.worker.worker_pool_main:worker_pool_main.py:93
Listening for workers at localhost:35967
INFO root:environments.py:376 Default Python SDK image for environment is
apache/beam_python3.10_sdk:2.44.0.dev
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function pack_combiners at 0x7f7147b80550>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function lift_combiners at 0x7f7147b805e0>
====================
INFO
apache_beam.runners.portability.fn_api_runner.translations:translations.py:714
==================== <function sort_stages at 0x7f7147b80d30>
====================
=============================== warnings summary ===============================
../../build/gradleenv/-1720702907/lib/python3.10/site-packages/hdfs/config.py:15
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/hdfs/config.py>:15:
DeprecationWarning: the imp module is deprecated in favour of importlib and
slated for removal in Python 3.12; see the module's documentation for
alternative uses
from imp import load_source
../../build/gradleenv/-1720702907/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17:
DeprecationWarning: The distutils package is deprecated and slated for removal
in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
from distutils import util
../../build/gradleenv/-1720702907/lib/python3.10/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/tenacity/_asyncio.py>:42:
DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use
"async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/typehints/pandas_type_compatibility_test.py:66
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:66:
FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas
in a future version. Use pandas.Index with the appropriate dtype instead.
}).set_index(pd.Int64Index(range(123, 223), name='an_index')),
apache_beam/typehints/pandas_type_compatibility_test.py:89
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:89:
FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas
in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(123, 223), name='an_index'),
apache_beam/typehints/pandas_type_compatibility_test.py:90
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/typehints/pandas_type_compatibility_test.py>:90:
FutureWarning: pandas.Int64Index is deprecated and will be removed from pandas
in a future version. Use pandas.Index with the appropriate dtype instead.
pd.Int64Index(range(475, 575), name='another_index'),
apache_beam/examples/complete/autocomplete_it_test.py: 3 warnings
apache_beam/examples/complete/top_wikipedia_sessions_it_test.py: 3 warnings
apache_beam/examples/complete/game/hourly_team_score_it_test.py: 2 warnings
apache_beam/examples/complete/game/user_score_it_test.py: 3 warnings
apache_beam/examples/cookbook/bigquery_side_input_it_test.py: 1 warning
apache_beam/examples/cookbook/coders_it_test.py: 3 warnings
apache_beam/examples/dataframe/flight_delays_it_test.py: 1 warning
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/build/gradleenv/-1720702907/lib/python3.10/site-packages/httplib2/__init__.py>:147:
DeprecationWarning: ssl.PROTOCOL_TLS is deprecated
context = ssl.SSLContext(DEFAULT_TLS_VERSION)
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63:
PendingDeprecationWarning: Client.dataset is deprecated and will be removed in
a future version. Use a string like 'my_project.my_dataset' or a
cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1992:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1998:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1140:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1142:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2485:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2487:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2511:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1988:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1133:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
self.project = self.project or p.options.view_as(GoogleCloudOptions).project
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100:
PendingDeprecationWarning: Client.dataset is deprecated and will be removed in
a future version. Use a string like 'my_project.my_dataset' or a
cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47:
FutureWarning: Dropping of nuisance columns in DataFrame reductions (with
'numeric_only=None') is deprecated; in a future version this will raise
TypeError. Select only valid columns before calling the reduction.
return airline_df[at_top_airports].mean()
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/dataframe/io.py>:659:
FutureWarning: WriteToFiles is experimental.
return pcoll | fileio.WriteToFiles(
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
apache_beam/examples/dataframe/wordcount_test.py::WordCountTest::test_basics
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/apache_beam/io/fileio.py>:590:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/pytest_postCommitExamples-spark-py310.xml>
-
=========================== short test summary info ============================
FAILED
apache_beam/examples/complete/autocomplete_it_test.py::AutocompleteIT::test_autocomplete_output_files_on_small_input
- ValueError: Unable to parse jar URL
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/runners/spark/2/job-server/build/libs/beam-runners-spark-3-job-server-2.44.0-SNAPSHOT.jar";.>
If using a full URL, make sure the scheme is specified. If using a local file
path, make sure the file exists; you may have to first build the job server
using `./gradlew runners:spark:3:job-server:shadowJar`.
FAILED
apache_beam/examples/complete/estimate_pi_it_test.py::EstimatePiIT::test_estimate_pi_output_file
- ValueError: Unable to parse jar URL
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/runners/spark/2/job-server/build/libs/beam-runners-spark-3-job-server-2.44.0-SNAPSHOT.jar";.>
If using a full URL, make sure the scheme is specified. If using a local file
path, make sure the file exists; you may have to first build the job server
using `./gradlew runners:spark:3:job-server:shadowJar`.
FAILED
apache_beam/examples/complete/top_wikipedia_sessions_it_test.py::ComputeTopSessionsIT::test_top_wikipedia_sessions_output_files_on_small_input
- ValueError: Unable to parse jar URL
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/runners/spark/2/job-server/build/libs/beam-runners-spark-3-job-server-2.44.0-SNAPSHOT.jar";.>
If using a full URL, make sure the scheme is specified. If using a local file
path, make sure the file exists; you may have to first build the job server
using `./gradlew runners:spark:3:job-server:shadowJar`.
FAILED
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_output_checksum_on_small_input
- ValueError: Unable to parse jar URL
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/runners/spark/2/job-server/build/libs/beam-runners-spark-3-job-server-2.44.0-SNAPSHOT.jar";.>
If using a full URL, make sure the scheme is specified. If using a local file
path, make sure the file exists; you may have to first build the job server
using `./gradlew runners:spark:3:job-server:shadowJar`.
FAILED
apache_beam/examples/complete/game/user_score_it_test.py::UserScoreIT::test_userscore_output_checksum_on_small_input
- ValueError: Unable to parse jar URL
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/runners/spark/2/job-server/build/libs/beam-runners-spark-3-job-server-2.44.0-SNAPSHOT.jar";.>
If using a full URL, make sure the scheme is specified. If using a local file
path, make sure the file exists; you may have to first build the job server
using `./gradlew runners:spark:3:job-server:shadowJar`.
FAILED
apache_beam/examples/cookbook/bigquery_side_input_it_test.py::BigQuerySideInputIT::test_bigquery_side_input_it
- ValueError: Unable to parse jar URL
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/runners/spark/2/job-server/build/libs/beam-runners-spark-3-job-server-2.44.0-SNAPSHOT.jar";.>
If using a full URL, make sure the scheme is specified. If using a local file
path, make sure the file exists; you may have to first build the job server
using `./gradlew runners:spark:3:job-server:shadowJar`.
FAILED
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
- ValueError: Unable to parse jar URL
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/runners/spark/2/job-server/build/libs/beam-runners-spark-3-job-server-2.44.0-SNAPSHOT.jar";.>
If using a full URL, make sure the scheme is specified. If using a local file
path, make sure the file exists; you may have to first build the job server
using `./gradlew runners:spark:3:job-server:shadowJar`.
FAILED
apache_beam/examples/cookbook/coders_it_test.py::CodersIT::test_coders_output_files_on_small_input
- ValueError: Unable to parse jar URL
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/runners/spark/2/job-server/build/libs/beam-runners-spark-3-job-server-2.44.0-SNAPSHOT.jar";.>
If using a full URL, make sure the scheme is specified. If using a local file
path, make sure the file exists; you may have to first build the job server
using `./gradlew runners:spark:3:job-server:shadowJar`.
FAILED
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
- ValueError: Unable to parse jar URL
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/runners/spark/2/job-server/build/libs/beam-runners-spark-3-job-server-2.44.0-SNAPSHOT.jar";.>
If using a full URL, make sure the scheme is specified. If using a local file
path, make sure the file exists; you may have to first build the job server
using `./gradlew runners:spark:3:job-server:shadowJar`.
FAILED
apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
- ValueError: Unable to parse jar URL
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/runners/spark/2/job-server/build/libs/beam-runners-spark-3-job-server-2.44.0-SNAPSHOT.jar";.>
If using a full URL, make sure the scheme is specified. If using a local file
path, make sure the file exists; you may have to first build the job server
using `./gradlew runners:spark:3:job-server:shadowJar`.
ERROR
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
- apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not
exist: apache-beam-testing.BigQueryTornadoesIT.monthly_tornadoes_1667071771115
ERROR
apache_beam/examples/cookbook/filters_test.py::FiltersTest::test_filters_output_bigquery_matcher
- apache_beam.io.gcp.tests.utils.GcpTestIOError: BigQuery table does not
exist: apache-beam-testing.FiltersTestIT.cold_days_1667071774409
= 10 failed, 12 passed, 6 skipped, 6664 deselected, 61 warnings, 2 errors in
54.25s =
> Task :sdks:python:test-suites:portable:py310:sparkExamples FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 271
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py37:sparkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Spark/ws/src/sdks/python/test-suites/portable/common.gradle'>
line: 271
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py310:sparkExamples'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3m 29s
78 actionable tasks: 49 executed, 27 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/5andxbkxphrpu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
