See 
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/850/display/redirect>

Changes:


------------------------------------------
[...truncated 12.19 MB...]
INFO     
apache_beam.runners.dataflow.test_dataflow_runner:test_dataflow_runner.py:59 
https://console.cloud.google.com/dataflow/jobs/us-central1/2023-10-31_16_02_59-6966690761323341229?project=apache-beam-testing
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:150 Job 
2023-10-31_16_02_59-6966690761323341229 is in state JOB_STATE_RUNNING
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 
2023-10-31T23:03:04.016Z: JOB_MESSAGE_BASIC: Worker configuration: 
e2-standard-2 in us-central1-b.
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 
2023-10-31T23:03:06.341Z: JOB_MESSAGE_BASIC: Executing operation Generate 
Direct Rows/Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Create
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 
2023-10-31T23:03:06.399Z: JOB_MESSAGE_BASIC: Starting 1 workers in 
us-central1-b...
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 
2023-10-31T23:03:06.883Z: JOB_MESSAGE_BASIC: Finished operation Generate Direct 
Rows/Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Create
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 
2023-10-31T23:03:15.553Z: JOB_MESSAGE_BASIC: Executing operation Generate 
Direct Rows/Create/Impulse+Generate Direct Rows/Create/FlatMap(<lambda at 
core.py:3774>)+Generate Direct 
Rows/Create/MaybeReshuffle/Reshuffle/AddRandomKeys+Generate Direct 
Rows/Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Generate
 Direct 
Rows/Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify+Generate 
Direct Rows/Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 
2023-10-31T23:03:34.149Z: JOB_MESSAGE_BASIC: Your project already contains 100 
Dataflow-created metric descriptors, so new user metrics of the form 
custom.googleapis.com/* will not be created. However, all user metrics are also 
available in the metric dataflow.googleapis.com/job/user_counter. If you rely 
on the custom metrics, you can delete old / unused metric descriptors. See 
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
 and 
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 
2023-10-31T23:06:28.251Z: JOB_MESSAGE_BASIC: All workers have finished the 
startup processes and began to receive work requests.
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 
2023-10-31T23:06:28.711Z: JOB_MESSAGE_BASIC: Finished operation Generate Direct 
Rows/Create/Impulse+Generate Direct Rows/Create/FlatMap(<lambda at 
core.py:3774>)+Generate Direct 
Rows/Create/MaybeReshuffle/Reshuffle/AddRandomKeys+Generate Direct 
Rows/Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/Map(reify_timestamps)+Generate
 Direct 
Rows/Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Reify+Generate 
Direct Rows/Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 
2023-10-31T23:06:28.757Z: JOB_MESSAGE_BASIC: Executing operation Generate 
Direct Rows/Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Close
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 
2023-10-31T23:06:29.071Z: JOB_MESSAGE_BASIC: Finished operation Generate Direct 
Rows/Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Close
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 
2023-10-31T23:06:29.121Z: JOB_MESSAGE_BASIC: Executing operation Generate 
Direct 
Rows/Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read+Generate 
Direct 
Rows/Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow+Generate
 Direct 
Rows/Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Generate
 Direct Rows/Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Generate Direct 
Rows/Create/Map(decode)+Generate Direct 
Rows/WriteToBigTable/ParDo(_BigTableWriteFn)
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 
2023-11-01T00:17:01.977Z: JOB_MESSAGE_BASIC: Cancel request is committed for 
workflow job: 2023-10-31_16_02_59-6966690761323341229.
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 
2023-11-01T00:17:02.001Z: JOB_MESSAGE_BASIC: Finished operation Generate Direct 
Rows/Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read+Generate 
Direct 
Rows/Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/GroupByWindow+Generate
 Direct 
Rows/Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/FlatMap(restore_timestamps)+Generate
 Direct Rows/Create/MaybeReshuffle/Reshuffle/RemoveRandomKeys+Generate Direct 
Rows/Create/Map(decode)+Generate Direct 
Rows/WriteToBigTable/ParDo(_BigTableWriteFn)
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:200 
2023-11-01T00:17:02.154Z: JOB_MESSAGE_BASIC: Stopping worker pool...
INFO     
apache_beam.runners.dataflow.dataflow_runner:dataflow_runner.py:150 Job 
2023-10-31_16_02_59-6966690761323341229 is in state JOB_STATE_CANCELLING
WARNING  apache_beam.utils.retry:retry.py:290 Retry with exponential 
backoff: waiting for 2.51962751332813 seconds before retrying get_job because 
we caught exception: apitools.base.py.exceptions.InvalidUserInputError: Request 
missing required parameter jobId
 Traceback for above exception (most recent call last):
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/utils/retry.py";,>
 line 275, in wrapper
    return fun(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py";,>
 line 914, in get_job
    response = self._client.projects_locations_jobs.Get(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py";,>
 line 747, in Get
    return self._RunMethod(config, request, global_params=global_params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/base_api.py";,>
 line 701, in _RunMethod
    http_request = self.PrepareHttpRequest(
                   ^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/base_api.py";,>
 line 683, in PrepareHttpRequest
    url_builder.relative_path = self.__ConstructRelativePath(
                                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/base_api.py";,>
 line 583, in __ConstructRelativePath
    return util.ExpandRelativePath(method_config, params,
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/util.py";,>
 line 129, in ExpandRelativePath
    raise exceptions.InvalidUserInputError(

WARNING  apache_beam.utils.retry:retry.py:290 Retry with exponential 
backoff: waiting for 6.969039758908547 seconds before retrying get_job because 
we caught exception: apitools.base.py.exceptions.InvalidUserInputError: Request 
missing required parameter jobId
 Traceback for above exception (most recent call last):
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/utils/retry.py";,>
 line 275, in wrapper
    return fun(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py";,>
 line 914, in get_job
    response = self._client.projects_locations_jobs.Get(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py";,>
 line 747, in Get
    return self._RunMethod(config, request, global_params=global_params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/base_api.py";,>
 line 701, in _RunMethod
    http_request = self.PrepareHttpRequest(
                   ^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/base_api.py";,>
 line 683, in PrepareHttpRequest
    url_builder.relative_path = self.__ConstructRelativePath(
                                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/base_api.py";,>
 line 583, in __ConstructRelativePath
    return util.ExpandRelativePath(method_config, params,
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/util.py";,>
 line 129, in ExpandRelativePath
    raise exceptions.InvalidUserInputError(

WARNING  apache_beam.utils.retry:retry.py:290 Retry with exponential 
backoff: waiting for 15.190037287013292 seconds before retrying get_job because 
we caught exception: apitools.base.py.exceptions.InvalidUserInputError: Request 
missing required parameter jobId
 Traceback for above exception (most recent call last):
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/utils/retry.py";,>
 line 275, in wrapper
    return fun(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py";,>
 line 914, in get_job
    response = self._client.projects_locations_jobs.Get(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py";,>
 line 747, in Get
    return self._RunMethod(config, request, global_params=global_params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/base_api.py";,>
 line 701, in _RunMethod
    http_request = self.PrepareHttpRequest(
                   ^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/base_api.py";,>
 line 683, in PrepareHttpRequest
    url_builder.relative_path = self.__ConstructRelativePath(
                                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/base_api.py";,>
 line 583, in __ConstructRelativePath
    return util.ExpandRelativePath(method_config, params,
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/util.py";,>
 line 129, in ExpandRelativePath
    raise exceptions.InvalidUserInputError(

WARNING  apache_beam.utils.retry:retry.py:290 Retry with exponential 
backoff: waiting for 28.97088571193109 seconds before retrying get_job because 
we caught exception: apitools.base.py.exceptions.InvalidUserInputError: Request 
missing required parameter jobId
 Traceback for above exception (most recent call last):
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/utils/retry.py";,>
 line 275, in wrapper
    return fun(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py";,>
 line 914, in get_job
    response = self._client.projects_locations_jobs.Get(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py";,>
 line 747, in Get
    return self._RunMethod(config, request, global_params=global_params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/base_api.py";,>
 line 701, in _RunMethod
    http_request = self.PrepareHttpRequest(
                   ^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/base_api.py";,>
 line 683, in PrepareHttpRequest
    url_builder.relative_path = self.__ConstructRelativePath(
                                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/base_api.py";,>
 line 583, in __ConstructRelativePath
    return util.ExpandRelativePath(method_config, params,
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/util.py";,>
 line 129, in ExpandRelativePath
    raise exceptions.InvalidUserInputError(

WARNING  apache_beam.utils.retry:retry.py:290 Retry with exponential 
backoff: waiting for 59.54475217708611 seconds before retrying get_job because 
we caught exception: apitools.base.py.exceptions.InvalidUserInputError: Request 
missing required parameter jobId
 Traceback for above exception (most recent call last):
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/utils/retry.py";,>
 line 275, in wrapper
    return fun(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py";,>
 line 914, in get_job
    response = self._client.projects_locations_jobs.Get(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py";,>
 line 747, in Get
    return self._RunMethod(config, request, global_params=global_params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/base_api.py";,>
 line 701, in _RunMethod
    http_request = self.PrepareHttpRequest(
                   ^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/base_api.py";,>
 line 683, in PrepareHttpRequest
    url_builder.relative_path = self.__ConstructRelativePath(
                                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/base_api.py";,>
 line 583, in __ConstructRelativePath
    return util.ExpandRelativePath(method_config, params,
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/util.py";,>
 line 129, in ExpandRelativePath
    raise exceptions.InvalidUserInputError(

WARNING  apache_beam.utils.retry:retry.py:290 Retry with exponential 
backoff: waiting for 134.34420538977 seconds before retrying get_job because we 
caught exception: apitools.base.py.exceptions.InvalidUserInputError: Request 
missing required parameter jobId
 Traceback for above exception (most recent call last):
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/utils/retry.py";,>
 line 275, in wrapper
    return fun(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py";,>
 line 914, in get_job
    response = self._client.projects_locations_jobs.Get(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py";,>
 line 747, in Get
    return self._RunMethod(config, request, global_params=global_params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/base_api.py";,>
 line 701, in _RunMethod
    http_request = self.PrepareHttpRequest(
                   ^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/base_api.py";,>
 line 683, in PrepareHttpRequest
    url_builder.relative_path = self.__ConstructRelativePath(
                                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/base_api.py";,>
 line 583, in __ConstructRelativePath
    return util.ExpandRelativePath(method_config, params,
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/util.py";,>
 line 129, in ExpandRelativePath
    raise exceptions.InvalidUserInputError(

WARNING  apache_beam.utils.retry:retry.py:290 Retry with exponential 
backoff: waiting for 227.68609176118758 seconds before retrying get_job because 
we caught exception: apitools.base.py.exceptions.InvalidUserInputError: Request 
missing required parameter jobId
 Traceback for above exception (most recent call last):
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/utils/retry.py";,>
 line 275, in wrapper
    return fun(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/runners/dataflow/internal/apiclient.py";,>
 line 914, in get_job
    response = self._client.projects_locations_jobs.Get(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/runners/dataflow/internal/clients/dataflow/dataflow_v1b3_client.py";,>
 line 747, in Get
    return self._RunMethod(config, request, global_params=global_params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/base_api.py";,>
 line 701, in _RunMethod
    http_request = self.PrepareHttpRequest(
                   ^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/base_api.py";,>
 line 683, in PrepareHttpRequest
    url_builder.relative_path = self.__ConstructRelativePath(
                                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/base_api.py";,>
 line 583, in __ConstructRelativePath
    return util.ExpandRelativePath(method_config, params,
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File 
"<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/apitools/base/py/util.py";,>
 line 129, in ExpandRelativePath
    raise exceptions.InvalidUserInputError(
=============================== warnings summary 
===============================
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
../../build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py:17
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/build/gradleenv/2050596099/lib/python3.11/site-packages/google/api_core/operations_v1/abstract_operations_client.py>:17:
 DeprecationWarning: The distutils package is deprecated and slated for removal 
in Python 3.12. Use setuptools or check PEP 632 for potential alternatives
    from distutils import util

apache_beam/examples/complete/game/game_stats_it_test.py::GameStatsIT::test_game_stats_it
apache_beam/examples/complete/game/hourly_team_score_it_test.py::HourlyTeamScoreIT::test_hourly_team_score_it
apache_beam/examples/complete/game/leader_board_it_test.py::LeaderBoardIT::test_leader_board_it
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_file_loads
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_streaming_inserts
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63:
 PendingDeprecationWarning: Client.dataset is deprecated and will be removed in 
a future version. Use a string like 'my_project.my_dataset' or a 
cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100:
 PendingDeprecationWarning: Client.dataset is deprecated and will be removed in 
a future version. Use a string like 'my_project.my_dataset' or a 
cloud.google.bigquery.DatasetReference object, instead.
    table_ref = client.dataset(dataset_id).table(table_id)

apache_beam/examples/dataframe/flight_delays_it_test.py::FlightDelaysTest::test_flight_delays
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/examples/dataframe/flight_delays.py>:47:
 FutureWarning: The default value of numeric_only in DataFrame.mean is 
deprecated. In a future version, it will default to False. In addition, 
specifying 'numeric_only=None' is deprecated. Select only valid columns or 
specify the value of numeric_only to silence this warning.
    return airline_df[at_top_airports].mean()

apache_beam/io/gcp/bigquery_read_it_test.py::ReadTests::test_native_source
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:170:
 BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use 
ReadFromBigQuery instead.
    beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))

apache_beam/io/gcp/bigquery_read_it_test.py::ReadNewTypesTests::test_native_source
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:706:
 BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use 
ReadFromBigQuery instead.
    beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
- generated xml file: 
<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/pytest_postCommitIT-df-py311.xml>
 -
=========================== short test summary info 
============================
FAILED 
apache_beam/examples/cookbook/bigtableio_it_test.py::BigtableIOWriteTest::test_bigtable_write
 - apitools.base.py.exceptions.InvalidUserInputError: Request missing required 
parameter jobId
====== 1 failed, 86 passed, 51 skipped, 
17 warnings in 8526.40s (2:22:06) ======

> Task :sdks:python:test-suites:dataflow:py311:postCommitIT FAILED

FAILURE: Build failed with an exception.

* Where:
Script 
'<https://ci-beam.apache.org/job/beam_PostCommit_Python311/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
 line: 139

* What went wrong:
Execution failed for task 
':sdks:python:test-suites:dataflow:py311:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Get more help at https://help.gradle.org.

Deprecated Gradle features were used in this build, making it incompatible with 
Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings 
and determine if they come from your own scripts or plugins.

For more on this, please refer to 
https://docs.gradle.org/8.4/userguide/command_line_interface.html#sec:command_line_warnings
 in the Gradle documentation.

BUILD FAILED in 2h 28m 48s
214 actionable tasks: 153 executed, 57 from cache, 4 up-to-date

Publishing build scan...
https://ge.apache.org/s/4756tvlairnl4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to