See
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/4167/display/redirect?page=changes>
Changes:
[kawaigin] [BEAM-12506] Changed WindowedValueHolder into a Row type
------------------------------------------
[...truncated 10.34 MB...]
[1m last_exc,[0m
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
value = None, from_value = ServiceUnavailable('Transport closed',)
[1m> ???[0m
[1m[31mE google.api_core.exceptions.RetryError: Deadline of 3600.0s
exceeded while calling functools.partial(<function
_wrap_unary_errors.<locals>.error_remapped_callable at 0x7f2fecf49840>,
database:
"projects/apache-beam-testing/instances/beam-test/databases/pybeam-write-a63ff2354b6421a"[0m
[1m[31mE , metadata=[('google-cloud-resource-prefix',
'projects/apache-beam-testing/instances/beam-test/databases/pybeam-write-a63ff2354b6421a'),
('x-goog-request-params',
'database=projects/apache-beam-testing/instances/beam-test/databases/pybeam-write-a63ff2354b6421a'),
('x-goog-api-client', 'gl-python/3.6.8 grpc/1.39.0 gax/1.31.1 gapic/1.19.1
gccl/1.19.1')]), last exception: 503 Transport closed[0m
[1m[31m<string>[0m:3: RetryError
------------------------------ Captured log setup ------------------------------
[32mINFO [0m
apache_beam.io.gcp.experimental.spannerio_write_it_test:spannerio_write_it_test.py:92
.... Setting up!
[32mINFO [0m
apache_beam.io.gcp.experimental.spannerio_write_it_test:spannerio_write_it_test.py:101
.... Spanner Client created!
[32mINFO [0m
apache_beam.io.gcp.experimental.spannerio_write_it_test:spannerio_write_it_test.py:61
Creating test database: pybeam-write-a63ff2354b6421a
[32mINFO [0m
apache_beam.io.gcp.experimental.spannerio_write_it_test:spannerio_write_it_test.py:72
Creating database: Done! name:
"projects/apache-beam-testing/instances/beam-test/databases/pybeam-write-a63ff2354b6421a"
state: READY
create_time {
seconds: 1627517507
nanos: 274437000
}
[32mINFO [0m
apache_beam.io.gcp.experimental.spannerio_write_it_test:spannerio_write_it_test.py:104
Spanner Write IT Setup Complete...
------------------------------ Captured log call -------------------------------
[33mWARNING [0m apache_beam.options.pipeline_options:pipeline_options.py:309
Discarding unparseable args: ['--sleep_secs=20',
'--kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test']
[33mWARNING [0m root:environments.py:374 Make sure that locally built Python
SDK docker image has Python 3.6 interpreter.
[32mINFO [0m root:environments.py:380 Default Python SDK image for
environment is apache/beam_python3.6_sdk:2.33.0.dev
[32mINFO [0m
apache_beam.runners.portability.fn_api_runner.translations:translations.py:650
==================== <function annotate_downstream_side_inputs at
0x7f2fed5db378> ====================
[32mINFO [0m
apache_beam.runners.portability.fn_api_runner.translations:translations.py:650
==================== <function fix_side_input_pcoll_coders at 0x7f2fed5db488>
====================
[32mINFO [0m
apache_beam.runners.portability.fn_api_runner.translations:translations.py:650
==================== <function pack_combiners at 0x7f2fed5db8c8>
====================
[32mINFO [0m
apache_beam.runners.portability.fn_api_runner.translations:translations.py:650
==================== <function lift_combiners at 0x7f2fed5db950>
====================
[32mINFO [0m
apache_beam.runners.portability.fn_api_runner.translations:translations.py:650
==================== <function expand_sdf at 0x7f2fed5dbae8>
====================
[32mINFO [0m
apache_beam.runners.portability.fn_api_runner.translations:translations.py:650
==================== <function expand_gbk at 0x7f2fed5dbb70>
====================
[32mINFO [0m
apache_beam.runners.portability.fn_api_runner.translations:translations.py:650
==================== <function sink_flattens at 0x7f2fed5dbc80>
====================
[32mINFO [0m
apache_beam.runners.portability.fn_api_runner.translations:translations.py:650
==================== <function greedily_fuse at 0x7f2fed5dbd08>
====================
[32mINFO [0m
apache_beam.runners.portability.fn_api_runner.translations:translations.py:650
==================== <function read_to_impulse at 0x7f2fed5dbd90>
====================
[32mINFO [0m
apache_beam.runners.portability.fn_api_runner.translations:translations.py:650
==================== <function impulse_to_input at 0x7f2fed5dbe18>
====================
[32mINFO [0m
apache_beam.runners.portability.fn_api_runner.translations:translations.py:650
==================== <function sort_stages at 0x7f2fed5dc0d0>
====================
[32mINFO [0m
apache_beam.runners.portability.fn_api_runner.translations:translations.py:650
==================== <function setup_timer_mapping at 0x7f2fed5dc048>
====================
[32mINFO [0m
apache_beam.runners.portability.fn_api_runner.translations:translations.py:650
==================== <function populate_data_channel_coders at 0x7f2fed5dc158>
====================
[32mINFO [0m apache_beam.runners.worker.statecache:statecache.py:172
Creating state cache with size 100
[32mINFO [0m
apache_beam.runners.portability.fn_api_runner.worker_handlers:worker_handlers.py:895
Created Worker handler
<apache_beam.runners.portability.fn_api_runner.worker_handlers.EmbeddedWorkerHandler
object at 0x7f2fed1136d8> for environment
ref_Environment_default_environment_1 (beam:env:embedded_python:v1, b'')
[32mINFO [0m
apache_beam.runners.portability.fn_api_runner.fn_runner:fn_runner.py:607
Running
((((ref_AppliedPTransform_Create-Impulse_3)+(ref_AppliedPTransform_Create-FlatMap-lambda-at-core-py-2968-_4))+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-AddRandomKeys_7))+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-Map-reify_timestamps-_9))+(Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Write)
[32mINFO [0m
apache_beam.runners.portability.fn_api_runner.fn_runner:fn_runner.py:607
Running
((((((((Create/MaybeReshuffle/Reshuffle/ReshufflePerKey/GroupByKey/Read)+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-ReshufflePerKey-FlatMap-restore_timestamps-_11))+(ref_AppliedPTransform_Create-MaybeReshuffle-Reshuffle-RemoveRandomKeys_12))+(ref_AppliedPTransform_Create-Map-decode-_13))+(ref_AppliedPTransform_WriteToSpanner-make-batches-Making-mutation-groups_16))+(ref_AppliedPTransform_WriteToSpanner-make-batches-Filtering-Batchable-Mutations-ParDo-_BatchableFilt_18))+(WriteToSpanner/make
batches/Merging batchable and
unbatchable/Write/0))+(ref_AppliedPTransform_WriteToSpanner-make-batches-ParDo-_BatchFn-_19))+(WriteToSpanner/make
batches/Merging batchable and unbatchable/Write/1)
[32mINFO [0m
apache_beam.runners.portability.fn_api_runner.fn_runner:fn_runner.py:607
Running (WriteToSpanner/make batches/Merging batchable and
unbatchable/Read)+(ref_AppliedPTransform_WriteToSpanner-Writing-to-spanner_21)
[33m=============================== warnings summary
===============================[0m
apache_beam/io/gcp/bigquery.py:1929
apache_beam/io/gcp/bigquery.py:1929
apache_beam/io/gcp/bigquery.py:1929
apache_beam/io/gcp/bigquery.py:1929
apache_beam/io/gcp/bigquery.py:1929
apache_beam/io/gcp/bigquery.py:1929
apache_beam/io/gcp/bigquery.py:1929
apache_beam/io/gcp/bigquery.py:1929
apache_beam/io/gcp/bigquery.py:1929
apache_beam/io/gcp/bigquery.py:1929
apache_beam/io/gcp/bigquery.py:1929
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1929:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = pcoll.pipeline.options.view_as(
apache_beam/io/gcp/bigquery.py:1931
apache_beam/io/gcp/bigquery.py:1931
apache_beam/io/gcp/bigquery.py:1931
apache_beam/io/gcp/bigquery.py:1931
apache_beam/io/gcp/bigquery.py:1931
apache_beam/io/gcp/bigquery.py:1931
apache_beam/io/gcp/bigquery.py:1931
apache_beam/io/gcp/bigquery.py:1931
apache_beam/io/gcp/bigquery.py:1931
apache_beam/io/gcp/bigquery.py:1931
apache_beam/io/gcp/bigquery.py:1931
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1931:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/io/gcp/bigquery.py:1961
apache_beam/io/gcp/bigquery.py:1961
apache_beam/io/gcp/bigquery.py:1961
apache_beam/io/gcp/bigquery.py:1961
apache_beam/io/gcp/bigquery.py:1961
apache_beam/io/gcp/bigquery.py:1961
apache_beam/io/gcp/bigquery.py:1961
apache_beam/io/gcp/bigquery.py:1961
apache_beam/io/gcp/bigquery.py:1961
apache_beam/io/gcp/bigquery.py:1961
apache_beam/io/gcp/bigquery.py:1961
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1961:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
| _PassThroughThenCleanup(files_to_remove_pcoll))
apache_beam/io/gcp/bigquery.py:1684
apache_beam/io/gcp/bigquery.py:1684
apache_beam/io/gcp/bigquery.py:1684
apache_beam/io/gcp/bigquery.py:1684
apache_beam/io/gcp/bigquery.py:1684
apache_beam/io/gcp/bigquery.py:1684
apache_beam/io/gcp/bigquery.py:1684
apache_beam/io/gcp/bigquery.py:1684
apache_beam/io/gcp/bigquery.py:1684
apache_beam/io/gcp/bigquery.py:1684
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1684:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
self.table_reference.projectId = pcoll.pipeline.options.view_as(
apache_beam/io/gcp/bigquery.py:1688
apache_beam/io/gcp/bigquery.py:1688
apache_beam/io/gcp/bigquery.py:1688
apache_beam/io/gcp/bigquery.py:1688
apache_beam/io/gcp/bigquery.py:1688
apache_beam/io/gcp/bigquery.py:1688
apache_beam/io/gcp/bigquery.py:1688
apache_beam/io/gcp/bigquery.py:1688
apache_beam/io/gcp/bigquery.py:1688
apache_beam/io/gcp/bigquery.py:1688
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1688:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
is_streaming_pipeline = p.options.view_as(StandardOptions).streaming
apache_beam/io/gcp/bigquery.py:1694
apache_beam/io/gcp/bigquery.py:1694
apache_beam/io/gcp/bigquery.py:1694
apache_beam/io/gcp/bigquery.py:1694
apache_beam/io/gcp/bigquery.py:1694
apache_beam/io/gcp/bigquery.py:1694
apache_beam/io/gcp/bigquery.py:1694
apache_beam/io/gcp/bigquery.py:1694
apache_beam/io/gcp/bigquery.py:1694
apache_beam/io/gcp/bigquery.py:1694
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:1694:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
experiments = p.options.view_as(DebugOptions).experiments or []
apache_beam/io/gcp/bigquery_file_loads.py:1098
apache_beam/io/gcp/bigquery_file_loads.py:1098
apache_beam/io/gcp/bigquery_file_loads.py:1098
apache_beam/io/gcp/bigquery_file_loads.py:1098
apache_beam/io/gcp/bigquery_file_loads.py:1098
apache_beam/io/gcp/bigquery_file_loads.py:1098
apache_beam/io/gcp/bigquery_file_loads.py:1098
apache_beam/io/gcp/bigquery_file_loads.py:1098
apache_beam/io/gcp/bigquery_file_loads.py:1098
apache_beam/io/gcp/bigquery_file_loads.py:1098
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1098:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
temp_location = p.options.view_as(GoogleCloudOptions).temp_location
apache_beam/io/gcp/bigquery_file_loads.py:1100
apache_beam/io/gcp/bigquery_file_loads.py:1100
apache_beam/io/gcp/bigquery_file_loads.py:1100
apache_beam/io/gcp/bigquery_file_loads.py:1100
apache_beam/io/gcp/bigquery_file_loads.py:1100
apache_beam/io/gcp/bigquery_file_loads.py:1100
apache_beam/io/gcp/bigquery_file_loads.py:1100
apache_beam/io/gcp/bigquery_file_loads.py:1100
apache_beam/io/gcp/bigquery_file_loads.py:1100
apache_beam/io/gcp/bigquery_file_loads.py:1100
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1100:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')
apache_beam/io/gcp/big_query_query_to_table_pipeline.py:84
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/big_query_query_to_table_pipeline.py>:84:
BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use
ReadFromBigQuery instead.
kms_key=kms_key))
apache_beam/io/gcp/bigquery_read_it_test.py:281
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:281:
BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use
ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
apache_beam/io/gcp/bigquery_read_it_test.py:165
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:165:
BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use
ReadFromBigQuery instead.
beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/1398941890/lib/python3.6/site-packages/google/cloud/datastore/_gapic.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/1398941890/lib/python3.6/site-packages/google/cloud/datastore/_gapic.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/build/gradleenv/1398941890/lib/python3.6/site-packages/google/cloud/datastore/_gapic.py>:42:
PendingDeprecationWarning: The `channel` argument is deprecated; use
`transport` instead.
channel=channel, client_info=client._client_info
apache_beam/io/gcp/bigquery_read_it_test.py:395
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:395:
FutureWarning: ReadAllFromBigQuery is experimental.
| beam.io.ReadAllFromBigQuery())
apache_beam/io/gcp/bigquery.py:2061
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2061:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name
apache_beam/io/gcp/bigquery.py:2062
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2062:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
project = pcoll.pipeline.options.view_as(GoogleCloudOptions).project
apache_beam/io/gcp/bigquery.py:2075
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2075:
BeamDeprecationWarning: options is deprecated since First stable release.
References to <pipeline>.options will not be supported
options=pcoll.pipeline.options,
apache_beam/io/gcp/experimental/spannerio_read_it_test.py:124
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:124:
FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility
guarantees.
sql="select * from Users")
apache_beam/io/gcp/experimental/spannerio_write_it_test.py:162
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:162:
FutureWarning: WriteToSpanner is experimental. No backwards-compatibility
guarantees.
database_id=self.TEST_DATABASE))
apache_beam/io/gcp/experimental/spannerio_write_it_test.py:181
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:181:
FutureWarning: WriteToSpanner is experimental. No backwards-compatibility
guarantees.
database_id=self.TEST_DATABASE))
apache_beam/io/gcp/experimental/spannerio_write_it_test.py:126
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_write_it_test.py>:126:
FutureWarning: WriteToSpanner is experimental. No backwards-compatibility
guarantees.
max_batch_size_bytes=250))
apache_beam/io/gcp/experimental/spannerio_read_it_test.py:113
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/apache_beam/io/gcp/experimental/spannerio_read_it_test.py>:113:
FutureWarning: ReadFromSpanner is experimental. No backwards-compatibility
guarantees.
columns=["UserId", "Key"])
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file:
<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/pytest_postCommitIT-direct-py36.xml>
-
[31m[1m======== 26 passed, 1 skipped, 97 warnings, 2 error in 4028.61 seconds
=========[0m
> Task :sdks:python:test-suites:direct:py36:postCommitIT FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':sdks:python:test-suites:portable:py36:portableWordCountSparkRunnerBatch'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Python36/ws/src/sdks/python/test-suites/direct/common.gradle'>
line: 54
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:py36:postCommitIT'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 42m 50s
216 actionable tasks: 153 executed, 59 from cache, 4 up-to-date
Publishing build scan...
https://gradle.com/s/ufb5qjs7nq3qe
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
