See 
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/1667/display/redirect?page=changes>

Changes:

[noreply] Merge pull request #29781: Add SparkStructuredStreamingRunner to


------------------------------------------
[...truncated 12.00 MB...]
INFO     root:environments.py:314 Using provided Python SDK container 
image: gcr.io/cloud-dataflow/v1beta3/beam_python3.10_sdk:beam-master-20231212
INFO     root:environments.py:321 Python SDK container image set to 
"gcr.io/cloud-dataflow/v1beta3/beam_python3.10_sdk:beam-master-20231212" for 
Docker environment
INFO     
apache_beam.runners.dataflow.internal.apiclient:apiclient.py:677 Starting GCS 
upload to 
gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1215160301-152343-p949vi5a.1702656181.152508/apache_beam-2.54.0.dev0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl...
INFO     
apache_beam.runners.dataflow.internal.apiclient:apiclient.py:687 Completed GCS 
upload to 
gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1215160301-152343-p949vi5a.1702656181.152508/apache_beam-2.54.0.dev0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
 in 0 seconds.
INFO     
apache_beam.runners.dataflow.internal.apiclient:apiclient.py:677 Starting GCS 
upload to 
gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1215160301-152343-p949vi5a.1702656181.152508/pipeline.pb...
INFO     
apache_beam.runners.dataflow.internal.apiclient:apiclient.py:687 Completed GCS 
upload to 
gs://temp-storage-for-end-to-end-tests/staging-it/beamapp-jenkins-1215160301-152343-p949vi5a.1702656181.152508/pipeline.pb
 in 0 seconds.
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:339 
Unknown pipeline options received: 
--sleep_secs=20,--kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test.
 Ignore if flags are used for internal purposes.
WARNING  apache_beam.options.pipeline_options:pipeline_options.py:339 
Unknown pipeline options received: 
--sleep_secs=20,--kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test.
 Ignore if flags are used for internal purposes.
INFO     
apache_beam.runners.dataflow.internal.apiclient:apiclient.py:858 Create job: 
<Job
 clientRequestId: '20231215160301153398-1003'
 createTime: '2023-12-15T16:03:02.393914Z'
 currentStateTime: '1970-01-01T00:00:00Z'
 id: '2023-12-15_08_03_01-8653471436821513204'
 location: 'us-central1'
 name: 'beamapp-jenkins-1215160301-152343-p949vi5a'
 projectId: 'apache-beam-testing'
 stageStates: []
 startTime: '2023-12-15T16:03:02.393914Z'
 steps: []
 tempFiles: []
 type: TypeValueValuesEnum(JOB_TYPE_STREAMING, 2)>
INFO     
apache_beam.runners.dataflow.internal.apiclient:apiclient.py:860 Created job 
with id: [2023-12-15_08_03_01-8653471436821513204]
INFO     
apache_beam.runners.dataflow.internal.apiclient:apiclient.py:861 Submitted job: 
2023-12-15_08_03_01-8653471436821513204
INFO     
apache_beam.runners.dataflow.internal.apiclient:apiclient.py:862 To access the 
Dataflow monitoring console, please navigate to 
https://console.cloud.google.com/dataflow/jobs/us-central1/2023-12-15_08_03_01-8653471436821513204?project=apache-beam-testing
INFO     
apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:58 
Console log: 
INFO     
apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:59 
https://console.cloud.google.com/dataflow/jobs/us-central1/2023-12-15_08_03_01-8653471436821513204?project=apache-beam-testing
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:151 Job 
2023-12-15_08_03_01-8653471436821513204 is in state JOB_STATE_RUNNING
WARNING  
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:203 
2023-12-15T16:03:03.658Z: JOB_MESSAGE_WARNING: Autoscaling is enabled for 
Dataflow Streaming Engine. Workers will scale between 1 and 100 unless 
maxNumWorkers is specified.
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2023-12-15T16:03:18.565Z: JOB_MESSAGE_BASIC: Worker configuration: 
e2-standard-2 in us-central1-b.
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2023-12-15T16:03:23.426Z: JOB_MESSAGE_BASIC: Running job using Streaming Engine
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2023-12-15T16:03:23.456Z: JOB_MESSAGE_BASIC: Using cloud KMLS key to protect 
persistent state.
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2023-12-15T16:03:23.864Z: JOB_MESSAGE_BASIC: Starting 1 workers in 
us-central1-b...
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2023-12-15T16:03:42.757Z: JOB_MESSAGE_BASIC: Your project already contains 100 
Dataflow-created metric descriptors, so new user metrics of the form 
custom.googleapis.com/* will not be created. However, all user metrics are also 
available in the metric dataflow.googleapis.com/job/user_counter. If you rely 
on the custom metrics, you can delete old / unused metric descriptors. See 
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
 and 
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:201 
2023-12-15T16:05:10.146Z: JOB_MESSAGE_BASIC: All workers have finished the 
startup processes and began to receive work requests.
WARNING  
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:217 Timing out 
on waiting for job 2023-12-15_08_03_01-8653471436821513204 after 601 seconds
INFO     
apache_beam.io.gcp.tests.bigquery_matcher:bigquery_matcher.py:121 Attempting to 
perform query SELECT total_score FROM 
`apache-beam-testing.leader_board_it_dataset1702656179745b91.leader_board_users`
 WHERE total_score=5000 LIMIT 1 to BQ
INFO     
apache_beam.io.gcp.tests.bigquery_matcher:bigquery_matcher.py:96 Read from 
given query (SELECT total_score FROM 
`apache-beam-testing.leader_board_it_dataset1702656179745b91.leader_board_users`
 WHERE total_score=5000 LIMIT 1), total rows 1
INFO     
apache_beam.io.gcp.tests.bigquery_matcher:bigquery_matcher.py:101 Generate 
checksum: de00231fe6730b972c0ff60a99988438911cda53
INFO     
apache_beam.io.gcp.tests.bigquery_matcher:bigquery_matcher.py:121 Attempting to 
perform query SELECT total_score FROM 
`apache-beam-testing.leader_board_it_dataset1702656179745b91.leader_board_teams`
 WHERE total_score=5000 LIMIT 1 to BQ
WARNING  apache_beam.utils.retry:retry.py:290 Retry with exponential 
backoff: waiting for 2.909488559532628 seconds before retrying 
_query_with_retry because we caught exception: 
google.api_core.exceptions.NotFound: 404 Not found: Table 
apache-beam-testing:leader_board_it_dataset1702656179745b91.leader_board_teams 
was not found in location US

Location: US
Job ID: 84875ab4-085b-4e95-ada6-8f707dcc08b1

 Traceback for above exception (most recent call last):
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/utils/retry.py";,>
 line 275, in wrapper
    return fun(*args, **kwargs)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/bigquery_matcher.py";,>
 line 125, in _query_with_retry
    rows = query_job.result(timeout=60)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/cloud/bigquery/job/query.py";,>
 line 1595, in result
    do_get_result()
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/retry/retry_unary.py";,>
 line 293, in retry_wrapped_func
    return retry_target(
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/retry/retry_unary.py";,>
 line 153, in retry_target
    _retry_error_helper(
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/retry/retry_base.py";,>
 line 212, in _retry_error_helper
    raise final_exc from source_exc
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/retry/retry_unary.py";,>
 line 144, in retry_target
    result = target()
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/cloud/bigquery/job/query.py";,>
 line 1584, in do_get_result
    super(QueryJob, self).result(retry=retry, timeout=timeout)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/cloud/bigquery/job/base.py";,>
 line 952, in result
    return super(_AsyncJob, self).result(timeout=timeout, **kwargs)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/future/polling.py";,>
 line 261, in result
    raise self._exception

INFO     
apache_beam.io.gcp.tests.bigquery_matcher:bigquery_matcher.py:121 Attempting to 
perform query SELECT total_score FROM 
`apache-beam-testing.leader_board_it_dataset1702656179745b91.leader_board_teams`
 WHERE total_score=5000 LIMIT 1 to BQ
WARNING  apache_beam.utils.retry:retry.py:290 Retry with exponential 
backoff: waiting for 8.647253320736464 seconds before retrying 
_query_with_retry because we caught exception: 
google.api_core.exceptions.NotFound: 404 Not found: Table 
apache-beam-testing:leader_board_it_dataset1702656179745b91.leader_board_teams 
was not found in location US

Location: US
Job ID: 5fac3b4d-286c-4b6c-bfc2-7c721cf07cc9

 Traceback for above exception (most recent call last):
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/utils/retry.py";,>
 line 275, in wrapper
    return fun(*args, **kwargs)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/bigquery_matcher.py";,>
 line 125, in _query_with_retry
    rows = query_job.result(timeout=60)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/cloud/bigquery/job/query.py";,>
 line 1595, in result
    do_get_result()
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/retry/retry_unary.py";,>
 line 293, in retry_wrapped_func
    return retry_target(
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/retry/retry_unary.py";,>
 line 153, in retry_target
    _retry_error_helper(
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/retry/retry_base.py";,>
 line 212, in _retry_error_helper
    raise final_exc from source_exc
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/retry/retry_unary.py";,>
 line 144, in retry_target
    result = target()
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/cloud/bigquery/job/query.py";,>
 line 1584, in do_get_result
    super(QueryJob, self).result(retry=retry, timeout=timeout)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/cloud/bigquery/job/base.py";,>
 line 952, in result
    return super(_AsyncJob, self).result(timeout=timeout, **kwargs)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/future/polling.py";,>
 line 261, in result
    raise self._exception

INFO     
apache_beam.io.gcp.tests.bigquery_matcher:bigquery_matcher.py:121 Attempting to 
perform query SELECT total_score FROM 
`apache-beam-testing.leader_board_it_dataset1702656179745b91.leader_board_teams`
 WHERE total_score=5000 LIMIT 1 to BQ
WARNING  apache_beam.utils.retry:retry.py:290 Retry with exponential 
backoff: waiting for 14.813304127593788 seconds before retrying 
_query_with_retry because we caught exception: 
google.api_core.exceptions.NotFound: 404 Not found: Table 
apache-beam-testing:leader_board_it_dataset1702656179745b91.leader_board_teams 
was not found in location US

Location: US
Job ID: b548dc5a-e89b-4e24-8e59-8baa9e4acd6d

 Traceback for above exception (most recent call last):
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/utils/retry.py";,>
 line 275, in wrapper
    return fun(*args, **kwargs)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/bigquery_matcher.py";,>
 line 125, in _query_with_retry
    rows = query_job.result(timeout=60)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/cloud/bigquery/job/query.py";,>
 line 1595, in result
    do_get_result()
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/retry/retry_unary.py";,>
 line 293, in retry_wrapped_func
    return retry_target(
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/retry/retry_unary.py";,>
 line 153, in retry_target
    _retry_error_helper(
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/retry/retry_base.py";,>
 line 212, in _retry_error_helper
    raise final_exc from source_exc
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/retry/retry_unary.py";,>
 line 144, in retry_target
    result = target()
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/cloud/bigquery/job/query.py";,>
 line 1584, in do_get_result
    super(QueryJob, self).result(retry=retry, timeout=timeout)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/cloud/bigquery/job/base.py";,>
 line 952, in result
    return super(_AsyncJob, self).result(timeout=timeout, **kwargs)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/future/polling.py";,>
 line 261, in result
    raise self._exception

INFO     
apache_beam.io.gcp.tests.bigquery_matcher:bigquery_matcher.py:121 Attempting to 
perform query SELECT total_score FROM 
`apache-beam-testing.leader_board_it_dataset1702656179745b91.leader_board_teams`
 WHERE total_score=5000 LIMIT 1 to BQ
WARNING  apache_beam.utils.retry:retry.py:290 Retry with exponential 
backoff: waiting for 32.039334135828724 seconds before retrying 
_query_with_retry because we caught exception: 
google.api_core.exceptions.NotFound: 404 Not found: Table 
apache-beam-testing:leader_board_it_dataset1702656179745b91.leader_board_teams 
was not found in location US

Location: US
Job ID: 44259d1b-f467-45ea-bad0-442e44e824a2

 Traceback for above exception (most recent call last):
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/utils/retry.py";,>
 line 275, in wrapper
    return fun(*args, **kwargs)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/bigquery_matcher.py";,>
 line 125, in _query_with_retry
    rows = query_job.result(timeout=60)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/cloud/bigquery/job/query.py";,>
 line 1595, in result
    do_get_result()
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/retry/retry_unary.py";,>
 line 293, in retry_wrapped_func
    return retry_target(
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/retry/retry_unary.py";,>
 line 153, in retry_target
    _retry_error_helper(
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/retry/retry_base.py";,>
 line 212, in _retry_error_helper
    raise final_exc from source_exc
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/retry/retry_unary.py";,>
 line 144, in retry_target
    result = target()
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/cloud/bigquery/job/query.py";,>
 line 1584, in do_get_result
    super(QueryJob, self).result(retry=retry, timeout=timeout)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/cloud/bigquery/job/base.py";,>
 line 952, in result
    return super(_AsyncJob, self).result(timeout=timeout, **kwargs)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/future/polling.py";,>
 line 261, in result
    raise self._exception

INFO     
apache_beam.io.gcp.tests.bigquery_matcher:bigquery_matcher.py:121 Attempting to 
perform query SELECT total_score FROM 
`apache-beam-testing.leader_board_it_dataset1702656179745b91.leader_board_teams`
 WHERE total_score=5000 LIMIT 1 to BQ
WARNING  apache_beam.utils.retry:retry.py:290 Retry with exponential 
backoff: waiting for 72.41153984865721 seconds before retrying 
_query_with_retry because we caught exception: 
google.api_core.exceptions.NotFound: 404 Not found: Table 
apache-beam-testing:leader_board_it_dataset1702656179745b91.leader_board_teams 
was not found in location US

Location: US
Job ID: db7e014f-1080-42eb-8ad7-1ba841175014

 Traceback for above exception (most recent call last):
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/utils/retry.py";,>
 line 275, in wrapper
    return fun(*args, **kwargs)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/bigquery_matcher.py";,>
 line 125, in _query_with_retry
    rows = query_job.result(timeout=60)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/cloud/bigquery/job/query.py";,>
 line 1595, in result
    do_get_result()
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/retry/retry_unary.py";,>
 line 293, in retry_wrapped_func
    return retry_target(
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/retry/retry_unary.py";,>
 line 153, in retry_target
    _retry_error_helper(
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/retry/retry_base.py";,>
 line 212, in _retry_error_helper
    raise final_exc from source_exc
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/retry/retry_unary.py";,>
 line 144, in retry_target
    result = target()
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/cloud/bigquery/job/query.py";,>
 line 1584, in do_get_result
    super(QueryJob, self).result(retry=retry, timeout=timeout)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/cloud/bigquery/job/base.py";,>
 line 952, in result
    return super(_AsyncJob, self).result(timeout=timeout, **kwargs)
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/build/gradleenv/2050596098/lib/python3.10/site-packages/google/api_core/future/polling.py";,>
 line 261, in result
    raise self._exception

INFO     
apache_beam.io.gcp.tests.bigquery_matcher:bigquery_matcher.py:121 Attempting to 
perform query SELECT total_score FROM 
`apache-beam-testing.leader_board_it_dataset1702656179745b91.leader_board_teams`
 WHERE total_score=5000 LIMIT 1 to BQ
=============================== warnings summary 
===============================
apache_beam/io/gcp/bigquery.py:2603
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2603:
 DeprecationWarning: invalid escape sequence '\#'
    """Read data from BigQuery.

apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_native_source
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:170:
 BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use 
ReadFromBigQuery instead.
    beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))

apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_file_loads
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_streaming_inserts
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_it
apache_beam/examples/complete/game/game_stats_it_test.py::GameStatsIT::test_game_stats_it
apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63:
 PendingDeprecationWarning: Client.dataset is deprecated and will be removed in 
a future version. Use a string like 'my_project.my_dataset' or a 
cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100:
 PendingDeprecationWarning: Client.dataset is deprecated and will be removed in 
a future version. Use a string like 'my_project.my_dataset' or a 
cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47:
 FutureWarning: The default value of numeric_only in DataFrame.mean is 
deprecated. In a future version, it will default to False. In addition, 
specifying 'numeric_only=None' is deprecated. Select only valid columns or 
specify the value of numeric_only to silence this warning.
    return airline_df[at_top_airports].mean()

apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:706:
 BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use 
ReadFromBigQuery instead.
    beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: 
<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/pytest_postCommitIT-df-py310.xml>
 -
=========================== short test summary info 
============================
FAILED 
apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it
 - google.api_core.exceptions.NotFound: 404 Not found: Table 
apache-beam-testing:leader_board_it_dataset1702656179745b91.leader_board_teams 
was not found in location US

Location: US
Job ID: 96d9d0b3-69b5-450b-85b4-2cf2ba5dce7b
====== 1 failed, 82 passed, 49 skipped, 
10 warnings in 5964.73s (1:39:24) ======

> Task :sdks:python:test-suites:dataflow:py310:postCommitIT FAILED

FAILURE: Build failed with an exception.

* Where:
Script 
'<https://ci-beam.apache.org/job/beam_PostCommit_Python310/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
 line: 139

* What went wrong:
Execution failed for task 
':sdks:python:test-suites:dataflow:py310:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.

Deprecated Gradle features were used in this build, making it incompatible with 
Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings 
and determine if they come from your own scripts or plugins.

For more on this, please refer to 
https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings
 in the Gradle documentation.

BUILD FAILED in 1h 45m 14s
217 actionable tasks: 151 executed, 62 from cache, 4 up-to-date

Publishing build scan...

The request was rejected.
Gradle Enterprise plugin version 3.16 is newer than the newest version 
supported by Gradle Enterprise 2023.3.4 which is 3.15. Please update to a newer 
version of Gradle Enterprise.

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org

Reply via email to