See
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/383/display/redirect?page=changes>
Changes:
[noreply] Drop dataclasses requirement, we only support python 3.7+ (#17640)
------------------------------------------
[...truncated 93.08 KB...]
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/cloud/bigquery/job/query.py";,>
line 1489, in do_get_result
super(QueryJob,
self).result(retry=retry, timeout=timeout)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/cloud/bigquery/job/base.py";,>
line 728, in result
return super(_AsyncJob,
self).result(timeout=timeout, **kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/future/polling.py";,>
line 135, in result
raise self._exception
[32mINFO [0m
apache_beam.io.gcp.tests.bigquery_matcher:bigquery_matcher.py:121 Attempting to
perform query SELECT total_score FROM
`apache-beam-testing.leader_board_it_dataset16524466197514.leader_board_teams`
WHERE total_score=5000 LIMIT 1 to BQ
[33mWARNING [0m apache_beam.utils.retry:retry.py:290 Retry with exponential
backoff: waiting for 9.061643307792082 seconds before retrying
_query_with_retry because we caught exception:
google.api_core.exceptions.NotFound: 404 Not found: Table
apache-beam-testing:leader_board_it_dataset16524466197514.leader_board_teams
was not found in location US
Location: US
Job ID:
c39e6165-2649-444c-a4e5-25810dc0d3e8
Traceback for above exception
(most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/utils/retry.py";,>
line 275, in wrapper
return fun(*args, **kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/tests/bigquery_matcher.py";,>
line 125, in _query_with_retry
rows =
query_job.result(timeout=60)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/cloud/bigquery/job/query.py";,>
line 1499, in result
do_get_result()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/retry.py";,>
line 286, in retry_wrapped_func
return retry_target(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/retry.py";,>
line 189, in retry_target
return target()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/cloud/bigquery/job/query.py";,>
line 1489, in do_get_result
super(QueryJob,
self).result(retry=retry, timeout=timeout)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/cloud/bigquery/job/base.py";,>
line 728, in result
return super(_AsyncJob,
self).result(timeout=timeout, **kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/future/polling.py";,>
line 135, in result
raise self._exception
[32mINFO [0m
apache_beam.io.gcp.tests.bigquery_matcher:bigquery_matcher.py:121 Attempting to
perform query SELECT total_score FROM
`apache-beam-testing.leader_board_it_dataset16524466197514.leader_board_teams`
WHERE total_score=5000 LIMIT 1 to BQ
[33mWARNING [0m apache_beam.utils.retry:retry.py:290 Retry with exponential
backoff: waiting for 14.977345200369903 seconds before retrying
_query_with_retry because we caught exception:
google.api_core.exceptions.NotFound: 404 Not found: Table
apache-beam-testing:leader_board_it_dataset16524466197514.leader_board_teams
was not found in location US
Location: US
Job ID:
122de491-d311-4663-80f3-357362392d15
Traceback for above exception
(most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/utils/retry.py";,>
line 275, in wrapper
return fun(*args, **kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/tests/bigquery_matcher.py";,>
line 125, in _query_with_retry
rows =
query_job.result(timeout=60)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/cloud/bigquery/job/query.py";,>
line 1499, in result
do_get_result()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/retry.py";,>
line 286, in retry_wrapped_func
return retry_target(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/retry.py";,>
line 189, in retry_target
return target()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/cloud/bigquery/job/query.py";,>
line 1489, in do_get_result
super(QueryJob,
self).result(retry=retry, timeout=timeout)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/cloud/bigquery/job/base.py";,>
line 728, in result
return super(_AsyncJob,
self).result(timeout=timeout, **kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/future/polling.py";,>
line 135, in result
raise self._exception
[32mINFO [0m
apache_beam.io.gcp.tests.bigquery_matcher:bigquery_matcher.py:121 Attempting to
perform query SELECT total_score FROM
`apache-beam-testing.leader_board_it_dataset16524466197514.leader_board_teams`
WHERE total_score=5000 LIMIT 1 to BQ
[33mWARNING [0m apache_beam.utils.retry:retry.py:290 Retry with exponential
backoff: waiting for 33.7422098062038 seconds before retrying _query_with_retry
because we caught exception: google.api_core.exceptions.NotFound: 404 Not
found: Table
apache-beam-testing:leader_board_it_dataset16524466197514.leader_board_teams
was not found in location US
Location: US
Job ID:
f1483bca-8f5b-4b12-a509-9552914c396d
Traceback for above exception
(most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/utils/retry.py";,>
line 275, in wrapper
return fun(*args, **kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/tests/bigquery_matcher.py";,>
line 125, in _query_with_retry
rows =
query_job.result(timeout=60)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/cloud/bigquery/job/query.py";,>
line 1499, in result
do_get_result()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/retry.py";,>
line 286, in retry_wrapped_func
return retry_target(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/retry.py";,>
line 189, in retry_target
return target()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/cloud/bigquery/job/query.py";,>
line 1489, in do_get_result
super(QueryJob,
self).result(retry=retry, timeout=timeout)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/cloud/bigquery/job/base.py";,>
line 728, in result
return super(_AsyncJob,
self).result(timeout=timeout, **kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/future/polling.py";,>
line 135, in result
raise self._exception
[32mINFO [0m
apache_beam.io.gcp.tests.bigquery_matcher:bigquery_matcher.py:121 Attempting to
perform query SELECT total_score FROM
`apache-beam-testing.leader_board_it_dataset16524466197514.leader_board_teams`
WHERE total_score=5000 LIMIT 1 to BQ
[33mWARNING [0m apache_beam.utils.retry:retry.py:290 Retry with exponential
backoff: waiting for 62.57949542271237 seconds before retrying
_query_with_retry because we caught exception:
google.api_core.exceptions.NotFound: 404 Not found: Table
apache-beam-testing:leader_board_it_dataset16524466197514.leader_board_teams
was not found in location US
Location: US
Job ID:
08c88da5-b6dd-4151-826e-f66b60484af5
Traceback for above exception
(most recent call last):
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/utils/retry.py";,>
line 275, in wrapper
return fun(*args, **kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/tests/bigquery_matcher.py";,>
line 125, in _query_with_retry
rows =
query_job.result(timeout=60)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/cloud/bigquery/job/query.py";,>
line 1499, in result
do_get_result()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/retry.py";,>
line 286, in retry_wrapped_func
return retry_target(
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/retry.py";,>
line 189, in retry_target
return target()
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/cloud/bigquery/job/query.py";,>
line 1489, in do_get_result
super(QueryJob,
self).result(retry=retry, timeout=timeout)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/cloud/bigquery/job/base.py";,>
line 728, in result
return super(_AsyncJob,
self).result(timeout=timeout, **kwargs)
File
"<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/api_core/future/polling.py";,>
line 135, in result
raise self._exception
[32mINFO [0m
apache_beam.io.gcp.tests.bigquery_matcher:bigquery_matcher.py:121 Attempting to
perform query SELECT total_score FROM
`apache-beam-testing.leader_board_it_dataset16524466197514.leader_board_teams`
WHERE total_score=5000 LIMIT 1 to BQ
[33m=============================== warnings summary
===============================[0m
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
apache_beam/io/filesystems_test.py:54
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54:
DeprecationWarning: invalid escape sequence \c
self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint:
disable=anomalous-backslash-in-string
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
apache_beam/io/filesystems_test.py:62
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62:
DeprecationWarning: invalid escape sequence \d
self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), #
pylint: disable=anomalous-backslash-in-string
<unknown>:54
<unknown>:54
<unknown>:54
<unknown>:54
<unknown>:54
<unknown>:54
<unknown>:54
<unknown>:54
<unknown>:54: DeprecationWarning: invalid escape sequence \c
<unknown>:62
<unknown>:62
<unknown>:62
<unknown>:62
<unknown>:62
<unknown>:62
<unknown>:62
<unknown>:62
<unknown>:62: DeprecationWarning: invalid escape sequence \d
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/tenacity/_asyncio.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/tenacity/_asyncio.py>:42:
DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use
"async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/dataframe/io.py:629
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/dataframe/io.py>:629:
FutureWarning: WriteToFiles is experimental.
return pcoll | fileio.WriteToFiles(
apache_beam/io/fileio.py:550
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/fileio.py>:550:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
apache_beam/io/gcp/bigquery.py:2519
apache_beam/io/gcp/bigquery.py:2519
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2519:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/io/gcp/bigquery.py:2521
apache_beam/io/gcp/bigquery.py:2521
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2521:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/io/gcp/bigquery.py:2545
apache_beam/io/gcp/bigquery.py:2545
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2545:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
pipeline_options=pcoll.pipeline.options,
apache_beam/io/gcp/bigquery.py:2194
apache_beam/io/gcp/bigquery.py:2194
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2194:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
apache_beam/io/gcp/bigquery.py:2198
apache_beam/io/gcp/bigquery.py:2198
apache_beam/io/gcp/bigquery.py:2198
apache_beam/io/gcp/bigquery.py:2198
apache_beam/io/gcp/bigquery.py:2198
apache_beam/io/gcp/bigquery.py:2198
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2198:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/io/gcp/bigquery.py:2204
apache_beam/io/gcp/bigquery.py:2204
apache_beam/io/gcp/bigquery.py:2204
apache_beam/io/gcp/bigquery.py:2204
apache_beam/io/gcp/bigquery.py:2204
apache_beam/io/gcp/bigquery.py:2204
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2204:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/io/gcp/bigquery_file_loads.py:1128
apache_beam/io/gcp/bigquery_file_loads.py:1128
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1128:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/io/gcp/bigquery_file_loads.py:1130
apache_beam/io/gcp/bigquery_file_loads.py:1130
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1130:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/io/gcp/tests/utils.py:100
apache_beam/io/gcp/tests/utils.py:100
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:100:
PendingDeprecationWarning: Client.dataset is deprecated and will be removed in
a future version. Use a string like 'my_project.my_dataset' or a
cloud.google.bigquery.DatasetReference object, instead.
table_ref = client.dataset(dataset_id).table(table_id)
apache_beam/io/gcp/tests/utils.py:63
apache_beam/io/gcp/tests/utils.py:63
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63:
PendingDeprecationWarning: Client.dataset is deprecated and will be removed in
a future version. Use a string like 'my_project.my_dataset' or a
cloud.google.bigquery.DatasetReference object, instead.
dataset_ref = client.dataset(unique_dataset_name, project=project)
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/pytest_postCommitIT-df-py39-xdist.xml>
-
[31m[1m======== 1 failed, 15 passed, 3 skipped, 70 warnings in 878.26 seconds
=========[0m
> Task :sdks:python:test-suites:dataflow:py39:examples FAILED
FAILURE: Build failed with an exception.
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 187
* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py39:examples'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 15m 45s
15 actionable tasks: 9 executed, 4 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/hgrrnaliz6l5y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
