See 
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/4894/display/redirect?page=changes>

Changes:

[Pablo Estrada] Simplify README for new users

[laraschmidt] Fix final allowskew error to properly handle a large allowedSkew

[noreply] [BEAM-13946] Add get_dummies(), a non-deferred column operation on

[noreply] [release-2.36.0] Fix pickler argument for 2.36 blog (#16774)


------------------------------------------
[...truncated 2.34 MB...]
apache_beam/io/gcp/bigquery.py:2144
apache_beam/io/gcp/bigquery.py:2144
apache_beam/io/gcp/bigquery.py:2144
apache_beam/io/gcp/bigquery.py:2144
apache_beam/io/gcp/bigquery.py:2144
apache_beam/io/gcp/bigquery.py:2144
apache_beam/io/gcp/bigquery.py:2144
apache_beam/io/gcp/bigquery.py:2144
apache_beam/io/gcp/bigquery.py:2144
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2144:
 BeamDeprecationWarning: options is deprecated since First stable release. 
References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/io/gcp/bigquery_file_loads.py:1128
apache_beam/io/gcp/bigquery_file_loads.py:1128
apache_beam/io/gcp/bigquery_file_loads.py:1128
apache_beam/io/gcp/bigquery_file_loads.py:1128
apache_beam/io/gcp/bigquery_file_loads.py:1128
apache_beam/io/gcp/bigquery_file_loads.py:1128
apache_beam/io/gcp/bigquery_file_loads.py:1128
apache_beam/io/gcp/bigquery_file_loads.py:1128
apache_beam/io/gcp/bigquery_file_loads.py:1128
apache_beam/io/gcp/bigquery_file_loads.py:1128
apache_beam/io/gcp/bigquery_file_loads.py:1128
apache_beam/io/gcp/bigquery_file_loads.py:1128
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1128:
 BeamDeprecationWarning: options is deprecated since First stable release. 
References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/io/gcp/bigquery_file_loads.py:1130
apache_beam/io/gcp/bigquery_file_loads.py:1130
apache_beam/io/gcp/bigquery_file_loads.py:1130
apache_beam/io/gcp/bigquery_file_loads.py:1130
apache_beam/io/gcp/bigquery_file_loads.py:1130
apache_beam/io/gcp/bigquery_file_loads.py:1130
apache_beam/io/gcp/bigquery_file_loads.py:1130
apache_beam/io/gcp/bigquery_file_loads.py:1130
apache_beam/io/gcp/bigquery_file_loads.py:1130
apache_beam/io/gcp/bigquery_file_loads.py:1130
apache_beam/io/gcp/bigquery_file_loads.py:1130
apache_beam/io/gcp/bigquery_file_loads.py:1130
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1130:
 BeamDeprecationWarning: options is deprecated since First stable release. 
References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/io/gcp/big_query_query_to_table_pipeline.py:84
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/big_query_query_to_table_pipeline.py>:84:
 BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use 
ReadFromBigQuery instead.
    kms_key=kms_key))

apache_beam/io/gcp/bigquery.py:2481
apache_beam/io/gcp/bigquery.py:2481
apache_beam/io/gcp/bigquery.py:2481
apache_beam/io/gcp/bigquery.py:2481
apache_beam/io/gcp/bigquery.py:2481
apache_beam/io/gcp/bigquery.py:2481
apache_beam/io/gcp/bigquery.py:2481
apache_beam/io/gcp/bigquery.py:2481
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2481:
 BeamDeprecationWarning: options is deprecated since First stable release. 
References to <pipeline>.options will not be supported
    project_id = pcoll.pipeline.options.view_as(GoogleCloudOptions).project

apache_beam/io/gcp/bigquery.py:2509
apache_beam/io/gcp/bigquery.py:2509
apache_beam/io/gcp/bigquery.py:2509
apache_beam/io/gcp/bigquery.py:2509
apache_beam/io/gcp/bigquery.py:2509
apache_beam/io/gcp/bigquery.py:2509
apache_beam/io/gcp/bigquery.py:2509
apache_beam/io/gcp/bigquery.py:2509
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2509:
 BeamDeprecationWarning: options is deprecated since First stable release. 
References to <pipeline>.options will not be supported
    | _PassThroughThenCleanupTempDatasets(project_to_cleanup_pcoll))

apache_beam/io/gcp/bigquery_read_it_test.py:167
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:167:
 BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use 
ReadFromBigQuery instead.
    beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))

apache_beam/io/gcp/bigquery_read_it_test.py:556
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:556:
 BeamDeprecationWarning: BigQuerySource is deprecated since 2.25.0. Use 
ReadFromBigQuery instead.
    beam.io.BigQuerySource(query=self.query, use_standard_sql=True)))

<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/1398941891/lib/python3.7/site-packages/google/cloud/datastore/_gapic.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/1398941891/lib/python3.7/site-packages/google/cloud/datastore/_gapic.py>:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/1398941891/lib/python3.7/site-packages/google/cloud/datastore/_gapic.py>:42
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/build/gradleenv/1398941891/lib/python3.7/site-packages/google/cloud/datastore/_gapic.py>:42:
 PendingDeprecationWarning: The `channel` argument is deprecated; use 
`transport` instead.
    channel=channel, client_info=client._client_info

apache_beam/io/gcp/bigquery_read_it_test.py:670
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_read_it_test.py>:670:
 FutureWarning: ReadAllFromBigQuery is experimental.
    | beam.io.ReadAllFromBigQuery())

apache_beam/io/gcp/bigquery.py:2611
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2611:
 BeamDeprecationWarning: options is deprecated since First stable release. 
References to <pipeline>.options will not be supported
    job_name = pcoll.pipeline.options.view_as(GoogleCloudOptions).job_name

apache_beam/io/gcp/bigquery.py:2612
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2612:
 BeamDeprecationWarning: options is deprecated since First stable release. 
References to <pipeline>.options will not be supported
    project = pcoll.pipeline.options.view_as(GoogleCloudOptions).project

apache_beam/io/gcp/bigquery.py:2625
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2625:
 BeamDeprecationWarning: options is deprecated since First stable release. 
References to <pipeline>.options will not be supported
    options=pcoll.pipeline.options,

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: 
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_directRunnerIT-batch.xml>
 -
============= 32 passed, 1 skipped, 119 warnings in 151.16 seconds 
=============
>>> RUNNING integration tests with pipeline options: --runner=TestDirectRunner 
>>> --project=apache-beam-testing --region=us-central1 
>>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it 
>>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it 
>>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output 
>>> --sdk_location=build/apache-beam.tar.gz 
>>> --requirements_file=postcommit_requirements.txt --num_workers=1 
>>> --sleep_secs=20 --streaming 
>>> --kms_key_name=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>>  
>>> --dataflow_kms_key=projects/apache-beam-testing/locations/global/keyRings/beam-it/cryptoKeys/test
>>>   pytest options: --capture=no --numprocesses=8 --timeout=4500 --color=yes 
>>> --log-cli-level=INFO 
>>> apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it 
>>> apache_beam/io/gcp/pubsub_integration_test.py::PubSubIntegrationTest 
>>> apache_beam/io/gcp/bigquery_test.py::BigQueryStreamingInsertTransformIntegrationTests::test_multiple_destinations_transform
>>>  apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT 
>>> apache_beam/io/gcp/bigquery_file_loads_test.py::BigQueryFileLoadsIT::test_bqfl_streaming
>>>   collect markers: 
============================= test session starts 
==============================
platform linux -- Python 3.7.12, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
rootdir: 
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python,> 
inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 4500.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I
[gw0] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw1] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw2] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw3] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw5] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw6] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw4] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
[gw7] Python 3.7.12 (default, Jan 15 2022, 18:42:10)  -- [GCC 9.3.0]
gw0 [7] / gw1 [7] / gw2 [7] / gw3 [7] / gw4 [7] / gw5 [7] / gw6 [7] / gw7 
[7]

scheduling tests via LoadScheduling

apache_beam/io/gcp/bigquery_test.py::BigQueryStreamingInsertTransformIntegrationTests::test_multiple_destinations_transform
 
apache_beam/io/gcp/pubsub_integration_test.py::PubSubIntegrationTest::test_streaming_with_attributes
 
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_file_loads 
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_streaming_inserts 
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it 
apache_beam/io/gcp/pubsub_integration_test.py::PubSubIntegrationTest::test_streaming_data_only
 
apache_beam/io/gcp/bigquery_file_loads_test.py::BigQueryFileLoadsIT::test_bqfl_streaming
 
[gw3] PASSED 
apache_beam/io/gcp/bigquery_test.py::BigQueryStreamingInsertTransformIntegrationTests::test_multiple_destinations_transform
 
[gw4] PASSED 
apache_beam/io/gcp/bigquery_file_loads_test.py::BigQueryFileLoadsIT::test_bqfl_streaming
 
[gw0] PASSED 
apache_beam/examples/wordcount_it_test.py::WordCountIT::test_wordcount_it 
[gw6] PASSED 
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_streaming_inserts 
[gw2] PASSED 
apache_beam/io/gcp/pubsub_integration_test.py::PubSubIntegrationTest::test_streaming_with_attributes
 
[gw1] PASSED 
apache_beam/io/gcp/pubsub_integration_test.py::PubSubIntegrationTest::test_streaming_data_only
 
[gw5] PASSED 
apache_beam/io/gcp/bigquery_test.py::PubSubBigQueryIT::test_file_loads 

=============================== warnings summary 
===============================
apache_beam/io/gcp/bigquery_test.py:1181
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_test.py>:1181:
 BeamDeprecationWarning: options is deprecated since First stable release. 
References to <pipeline>.options will not be supported
    streaming = self.test_pipeline.options.view_as(StandardOptions).streaming

apache_beam/io/gcp/bigquery.py:2138
apache_beam/io/gcp/bigquery.py:2138
apache_beam/io/gcp/bigquery.py:2138
apache_beam/io/gcp/bigquery.py:2138
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2138:
 BeamDeprecationWarning: options is deprecated since First stable release. 
References to <pipeline>.options will not be supported
    is_streaming_pipeline = p.options.view_as(StandardOptions).streaming

apache_beam/io/gcp/bigquery.py:2144
apache_beam/io/gcp/bigquery.py:2144
apache_beam/io/gcp/bigquery.py:2144
apache_beam/io/gcp/bigquery.py:2144
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2144:
 BeamDeprecationWarning: options is deprecated since First stable release. 
References to <pipeline>.options will not be supported
    experiments = p.options.view_as(DebugOptions).experiments or []

apache_beam/runners/direct/transform_evaluator.py:1029
apache_beam/runners/direct/transform_evaluator.py:1029
apache_beam/runners/direct/transform_evaluator.py:1029
apache_beam/runners/direct/transform_evaluator.py:1029
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/runners/direct/transform_evaluator.py>:1029:
 DeprecationWarning: Using or importing the ABCs from 'collections' instead of 
from 'collections.abc' is deprecated since Python 3.3,and in 3.9 it will stop 
working
    isinstance(element.value, collections.Iterable) and

apache_beam/io/gcp/bigquery.py:2134
apache_beam/io/gcp/bigquery.py:2134
apache_beam/io/gcp/bigquery.py:2134
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery.py>:2134:
 BeamDeprecationWarning: options is deprecated since First stable release. 
References to <pipeline>.options will not be supported
    self.table_reference.projectId = pcoll.pipeline.options.view_as(

apache_beam/io/gcp/bigquery_file_loads.py:1128
apache_beam/io/gcp/bigquery_file_loads.py:1128
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1128:
 BeamDeprecationWarning: options is deprecated since First stable release. 
References to <pipeline>.options will not be supported
    temp_location = p.options.view_as(GoogleCloudOptions).temp_location

apache_beam/io/gcp/bigquery_file_loads.py:1130
apache_beam/io/gcp/bigquery_file_loads.py:1130
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/bigquery_file_loads.py>:1130:
 BeamDeprecationWarning: options is deprecated since First stable release. 
References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).job_name or 'AUTOMATIC_JOB_NAME')

apache_beam/io/gcp/tests/utils.py:63
apache_beam/io/gcp/tests/utils.py:63
  
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/apache_beam/io/gcp/tests/utils.py>:63:
 PendingDeprecationWarning: Client.dataset is deprecated and will be removed in 
a future version. Use a string like 'my_project.my_dataset' or a 
cloud.google.bigquery.DatasetReference object, instead.
    dataset_ref = client.dataset(unique_dataset_name, project=project)

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: 
<https://ci-beam.apache.org/job/beam_PostCommit_Python37/ws/src/sdks/python/pytest_directRunnerIT-streaming.xml>
 -
==================== 7 passed, 22 warnings in 76.28 seconds 
====================

> Task :sdks:python:container:py37:docker
  apache_beam/coders/coder_impl.c: In function 
‘__pyx_f_11apache_beam_6coders_10coder_impl_17SequenceCoderImpl_encode_to_stream’:
  apache_beam/coders/coder_impl.c:36620:32: warning: comparison of integer 
expressions of different signedness: ‘size_t’ {aka ‘long unsigned int’} and 
‘int64_t’ {aka ‘long int’} [-Wsign-compare]
  36620 |       __pyx_t_9 = ((__pyx_t_14 > __pyx_v_target_buffer_size) 
!= 0);
        |                                ^
  apache_beam/coders/coder_impl.c: In function 
‘__pyx_f_11apache_beam_6coders_10coder_impl_12RowCoderImpl_decode_from_stream’:
  apache_beam/coders/coder_impl.c:52350:59: warning: ‘__pyx_v_running’ 
may be used uninitialized in this function [-Wmaybe-uninitialized]
  52350 |       __pyx_t_1 = __Pyx_PyInt_From_long(((__pyx_v_running >> 
__Pyx_mod_long(__pyx_v_i, 8)) & 0x01)); if (unlikely(!__pyx_t_1)) __PYX_ERR(0, 
1655, __pyx_L1_error)
        |                                          
~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
  gcc -pthread -shared 
build/temp.linux-x86_64-3.7/apache_beam/coders/coder_impl.o -L/usr/local/lib 
-lpython3.7m -o 
build/lib.linux-x86_64-3.7/apache_beam/coders/coder_impl.cpython-37m-x86_64-linux-gnu.so
  building 'apache_beam.metrics.cells' extension
  creating build/temp.linux-x86_64-3.7/apache_beam/metrics
  gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv 
-O3 -Wall -fPIC -I/usr/local/include/python3.7m -c apache_beam/metrics/cells.c 
-o build/temp.linux-x86_64-3.7/apache_beam/metrics/cells.o
  gcc -pthread -shared 
build/temp.linux-x86_64-3.7/apache_beam/metrics/cells.o -L/usr/local/lib 
-lpython3.7m -o 
build/lib.linux-x86_64-3.7/apache_beam/metrics/cells.cpython-37m-x86_64-linux-gnu.so
  building 'apache_beam.metrics.execution' extension
  gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall 
-fPIC -I/usr/local/include/python3.7m -c apache_beam/metrics/execution.c -o 
build/temp.linux-x86_64-3.7/apache_beam/metrics/execution.o
  gcc -pthread -shared 
build/temp.linux-x86_64-3.7/apache_beam/metrics/execution.o -L/usr/local/lib 
-lpython3.7m -o 
build/lib.linux-x86_64-3.7/apache_beam/metrics/execution.cpython-37m-x86_64-linux-gnu.so
  building 'apache_beam.runners.common' extension
  gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall 
-fPIC -I/usr/local/include/python3.7m -c apache_beam/runners/common.c -o 
build/temp.linux-x86_64-3.7/apache_beam/runners/common.o
  gcc -pthread -shared 
build/temp.linux-x86_64-3.7/apache_beam/runners/common.o -L/usr/local/lib 
-lpython3.7m -o 
build/lib.linux-x86_64-3.7/apache_beam/runners/common.cpython-37m-x86_64-linux-gnu.so
  building 'apache_beam.runners.worker.logger' extension
  gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall 
-fPIC -I/usr/local/include/python3.7m -c apache_beam/runners/worker/logger.c -o 
build/temp.linux-x86_64-3.7/apache_beam/runners/worker/logger.o
  gcc -pthread -shared 
build/temp.linux-x86_64-3.7/apache_beam/runners/worker/logger.o 
-L/usr/local/lib -lpython3.7m -o 
build/lib.linux-x86_64-3.7/apache_beam/runners/worker/logger.cpython-37m-x86_64-linux-gnu.so
  building 'apache_beam.runners.worker.opcounters' extension
  gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall 
-fPIC -I/usr/local/include/python3.7m -c 
apache_beam/runners/worker/opcounters.c -o 
build/temp.linux-x86_64-3.7/apache_beam/runners/worker/opcounters.o
  gcc -pthread -shared 
build/temp.linux-x86_64-3.7/apache_beam/runners/worker/opcounters.o 
-L/usr/local/lib -lpython3.7m -o 
build/lib.linux-x86_64-3.7/apache_beam/runners/worker/opcounters.cpython-37m-x86_64-linux-gnu.so
  building 'apache_beam.runners.worker.operations' extension
  gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv 
-O3 -Wall -fPIC -I/usr/local/include/python3.7m -c 
apache_beam/runners/worker/operations.c -o 
build/temp.linux-x86_64-3.7/apache_beam/runners/worker/operations.o

> Task :sdks:python:test-suites:portable:py37:postCommitPy37IT
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: 
Un-registering task and sending final execution state FINISHED to JobManager 
for task DataSink (DiscardingOutput) (8/16)#0 c254d4e571290ddcccc7e0b2b26f0bd1.'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 18, 
2022 6:11:34 AM org.apache.flink.runtime.executiongraph.Execution 
transitionState'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: 
MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (8/16) 
(900b20488fbd884cce6cf6903e424ccd) switched from RUNNING to FINISHED.'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 18, 
2022 6:11:34 AM org.apache.flink.runtime.executiongraph.Execution 
transitionState'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: 
DataSink (DiscardingOutput) (8/16) (c254d4e571290ddcccc7e0b2b26f0bd1) switched 
from RUNNING to FINISHED.'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 18, 
2022 6:11:34 AM 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService 
getProcessBundleDescriptor'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: 
getProcessBundleDescriptor request with id 1-108'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 18, 
2022 6:11:34 AM 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService 
getProcessBundleDescriptor'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: 
getProcessBundleDescriptor request with id 1-104'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 18, 
2022 6:11:34 AM 
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService 
getProcessBundleDescriptor'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: 
getProcessBundleDescriptor request with id 1-112'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 18, 
2022 6:11:34 AM org.apache.flink.runtime.taskmanager.Task transitionState'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: 
MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (16/16)#0 
(4c5ced59d7a0d61a857699fc5611ed72) switched from RUNNING to FINISHED.'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 18, 
2022 6:11:34 AM org.apache.flink.runtime.taskmanager.Task doRun'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: 
Freeing task resources for MapPartition (MapPartition at [4]assert_that/{Group, 
Unkey, Match}) (16/16)#0 (4c5ced59d7a0d61a857699fc5611ed72).'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 18, 
2022 6:11:34 AM org.apache.flink.runtime.taskexecutor.TaskExecutor 
unregisterTaskAndNotifyFinalState'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: 
Un-registering task and sending final execution state FINISHED to JobManager 
for task MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) 
(16/16)#0 4c5ced59d7a0d61a857699fc5611ed72.'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 18, 
2022 6:11:34 AM org.apache.flink.runtime.taskmanager.Task transitionState'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: 
DataSink (DiscardingOutput) (16/16)#0 (a56db2529ca50ada7556d85ba3426873) 
switched from RUNNING to FINISHED.'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 18, 
2022 6:11:34 AM org.apache.flink.runtime.taskmanager.Task doRun'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: 
Freeing task resources for DataSink (DiscardingOutput) (16/16)#0 
(a56db2529ca50ada7556d85ba3426873).'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 18, 
2022 6:11:34 AM org.apache.flink.runtime.executiongraph.Execution 
transitionState'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: 
MapPartition (MapPartition at [4]assert_that/{Group, Unkey, Match}) (16/16) 
(4c5ced59d7a0d61a857699fc5611ed72) switched from RUNNING to FINISHED.'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 18, 
2022 6:11:34 AM org.apache.flink.runtime.taskexecutor.TaskExecutor 
unregisterTaskAndNotifyFinalState'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO: 
Un-registering task and sending final execution state FINISHED to JobManager 
for task DataSink (DiscardingOutput) (16/16)#0 
a56db2529ca50ada7556d85ba3426873.'
INFO     apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 18, 
2022 6:11:34 AM org.apache.flink.runtime.executiongraph.Execution 
transitionState'
java.lang.OutOfMemoryError: GC overhead limit exceeded
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to