See
<https://ci-beam.apache.org/job/beam_PostCommit_Python_Examples_Flink/23/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13679] playground - move quick start category to the top
(#16808)
[noreply] Update license_script.sh (#16789)
[noreply] [BEAM-13908] [Coverage] Better testing coverage for gcpopts (#16816)
[noreply] Merge pull request #16809 from [BEAM-12164] Added integration test for
------------------------------------------
[...truncated 32.45 MB...]
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"PTRANSFORM": "fn/read/ref_PCollection_PCollection_43:0"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"urn": "beam:metric:element_count:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"type": "beam:metrics:sum_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"payload": "AQ==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"PCOLLECTION": "ref_PCollection_PCollection_43"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"urn": "beam:metric:pardo_execution_time:start_bundle_msecs:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"type": "beam:metrics:sum_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"payload": "AA==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"PTRANSFORM":
"ref_AppliedPTransform_WriteToText-Write-WriteImpl-DoOnce-FlatMap-lambda-at-core-py-3228-_73"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"urn": "beam:metric:element_count:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"type": "beam:metrics:sum_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"payload": "AQ==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"PCOLLECTION": "ref_PCollection_PCollection_45"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"urn": "beam:metric:element_count:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"type": "beam:metrics:sum_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"payload": "AQ==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"PCOLLECTION": "ref_PCollection_PCollection_44"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"urn": "beam:metric:pardo_execution_time:start_bundle_msecs:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"type": "beam:metrics:sum_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"payload": "AA==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"PTRANSFORM":
"ref_AppliedPTransform_WriteToText-Write-WriteImpl-DoOnce-Map-decode-_75"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"urn": "beam:metric:pardo_execution_time:finish_bundle_msecs:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"type": "beam:metrics:sum_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"payload": "AA==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"PTRANSFORM": "fn/read/ref_PCollection_PCollection_43:0"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"urn": "beam:metric:ptransform_execution_time:total_msecs:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"type": "beam:metrics:sum_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"payload": "AA==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"PTRANSFORM":
"ref_AppliedPTransform_WriteToText-Write-WriteImpl-DoOnce-Map-decode-_75"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"urn": "beam:metric:pardo_execution_time:process_bundle_msecs:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"type": "beam:metrics:sum_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"payload": "AA==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"PTRANSFORM":
"ref_AppliedPTransform_WriteToText-Write-WriteImpl-DoOnce-Map-decode-_75"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"urn": "beam:metric:pardo_execution_time:finish_bundle_msecs:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"type": "beam:metrics:sum_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"payload": "AA==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"PTRANSFORM": "fn/write/ref_PCollection_PCollection_45:0"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"urn": "beam:metric:pardo_execution_time:start_bundle_msecs:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"type": "beam:metrics:sum_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"payload": "AA==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"PTRANSFORM": "fn/read/ref_PCollection_PCollection_43:0"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"urn": "beam:metric:pardo_execution_time:start_bundle_msecs:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"type": "beam:metrics:sum_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"payload": "AA==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"PTRANSFORM": "fn/write/ref_PCollection_PCollection_45:0"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"urn": "beam:metric:pardo_execution_time:finish_bundle_msecs:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"type": "beam:metrics:sum_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"payload": "AA==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"PTRANSFORM":
"ref_AppliedPTransform_WriteToText-Write-WriteImpl-DoOnce-FlatMap-lambda-at-core-py-3228-_73"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"urn": "beam:metric:ptransform_execution_time:total_msecs:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"type": "beam:metrics:sum_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"payload": "AA==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"PTRANSFORM": "fn/write/ref_PCollection_PCollection_45:0"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"urn": "beam:metric:pardo_execution_time:process_bundle_msecs:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"type": "beam:metrics:sum_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"payload": "AA==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"PTRANSFORM": "fn/read/ref_PCollection_PCollection_43:0"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"urn": "beam:metric:pardo_execution_time:finish_bundle_msecs:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"type": "beam:metrics:sum_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"payload": "AA==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"PTRANSFORM":
"ref_AppliedPTransform_WriteToText-Write-WriteImpl-DoOnce-Map-decode-_75"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"urn": "beam:metric:sampled_byte_size:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"type": "beam:metrics:distribution_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"payload": "AQ4ODg==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"PCOLLECTION": "ref_PCollection_PCollection_44"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"urn": "beam:metric:sampled_byte_size:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"type": "beam:metrics:distribution_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"payload": "AQ4ODg==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"PCOLLECTION": "ref_PCollection_PCollection_45"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' },
{'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"urn": "beam:metric:sampled_byte_size:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"type": "beam:metrics:distribution_int64:v1",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"payload": "AQ0NDQ==",'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"labels": {'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'
"PCOLLECTION": "ref_PCollection_PCollection_43"'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' }]'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b' }'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'}'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:13:03 AM
org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess
closeInternal'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopping SessionDispatcherLeaderProcess.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:13:03 AM org.apache.flink.runtime.dispatcher.Dispatcher onStop'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopping dispatcher akka://flink/user/rpc/dispatcher_2.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:13:03 AM org.apache.flink.runtime.dispatcher.Dispatcher
terminateRunningJobs'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopping all currently running jobs of dispatcher
akka://flink/user/rpc/dispatcher_2.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:13:03 AM
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager
close'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Closing the slot manager.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:13:03 AM
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager
suspend'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Suspending the slot manager.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:13:03 AM org.apache.flink.runtime.dispatcher.Dispatcher lambda$onStop$0'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopped dispatcher akka://flink/user/rpc/dispatcher_2.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:13:03 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopping Akka RPC service.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:13:03 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService stopService'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopping Akka RPC service.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:13:03 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService
lambda$stopService$7'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopped Akka RPC service.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:13:03 AM org.apache.flink.runtime.blob.AbstractBlobCache close'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Shutting down BLOB cache'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:13:03 AM org.apache.flink.runtime.blob.AbstractBlobCache close'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Shutting down BLOB cache'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:13:03 AM org.apache.flink.runtime.blob.BlobServer close'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopped BLOB server at 0.0.0.0:42651'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:13:03 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService
lambda$stopService$7'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Stopped Akka RPC service.'
INFO apache_beam.runners.portability.portable_runner:portable_runner.py:574
Job state changed to DONE
INFO apache_beam.io.gcp.gcsio:gcsio.py:559 Starting the size estimation of
the input
INFO apache_beam.io.gcp.gcsio:gcsio.py:572 Finished listing 3 files in
0.04290056228637695 seconds.
PASSED [ 56%]
apache_beam/examples/cookbook/bigquery_tornadoes_it_test.py::BigqueryTornadoesIT::test_bigquery_tornadoes_it
-------------------------------- live log call ---------------------------------
INFO apache_beam.runners.worker.worker_pool_main:worker_pool_main.py:93
Listening for workers at localhost:41215
WARNING root:environments.py:371 Make sure that locally built Python SDK
docker image has Python 3.9 interpreter.
INFO root:environments.py:380 Default Python SDK image for environment is
apache/beam_python3.9_sdk:2.38.0.dev
> Task :sdks:python:test-suites:portable:py37:flinkExamples
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:43 AM org.apache.flink.runtime.taskmanager.Task transitionState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
MapPartition (MapPartition at
[2]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/ImpulseEmptyPC/{FlatMap(<lambda
at core.py:3228>), Map(decode)}) (15/16)#0 (4b9bec0fb51d192b8a9e1e5d4553f10a)
switched from RUNNING to FINISHED.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:43 AM org.apache.flink.runtime.taskmanager.Task doRun'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Freeing task resources for MapPartition (MapPartition at
[2]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/ImpulseEmptyPC/{FlatMap(<lambda
at core.py:3228>), Map(decode)}) (15/16)#0 (4b9bec0fb51d192b8a9e1e5d4553f10a).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:43 AM org.apache.flink.runtime.taskmanager.Task transitionState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
DataSink (DiscardingOutput) (15/16)#0 (23362891e5f1af39afba335af995e420)
switched from RUNNING to FINISHED.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:43 AM org.apache.flink.runtime.taskmanager.Task doRun'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Freeing task resources for DataSink (DiscardingOutput) (15/16)#0
(23362891e5f1af39afba335af995e420).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:43 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
unregisterTaskAndNotifyFinalState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Un-registering task and sending final execution state FINISHED to JobManager
for task DataSink (DiscardingOutput) (15/16)#0
23362891e5f1af39afba335af995e420.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:43 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
unregisterTaskAndNotifyFinalState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Un-registering task and sending final execution state FINISHED to JobManager
for task MapPartition (MapPartition at
[2]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/ImpulseEmptyPC/{FlatMap(<lambda
at core.py:3228>), Map(decode)}) (15/16)#0 4b9bec0fb51d192b8a9e1e5d4553f10a.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:43 AM org.apache.flink.runtime.executiongraph.Execution
transitionState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
DataSink (DiscardingOutput) (15/16) (23362891e5f1af39afba335af995e420) switched
from RUNNING to FINISHED.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:43 AM org.apache.flink.runtime.executiongraph.Execution
transitionState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
MapPartition (MapPartition at
[2]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/ImpulseEmptyPC/{FlatMap(<lambda
at core.py:3228>), Map(decode)}) (15/16) (4b9bec0fb51d192b8a9e1e5d4553f10a)
switched from RUNNING to FINISHED.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM org.apache.flink.runtime.taskmanager.Task transitionState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
MapPartition (MapPartition at
[6]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/{ImpulseSingleElementPC,
CopyJobNamePrefix, SchemaModJobNamePrefix, GenerateFilePrefix,
LoadJobNamePrefix}) (14/16)#0 (1b4547a03e96165f823cf459af869241) switched from
RUNNING to FINISHED.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM org.apache.flink.runtime.taskmanager.Task doRun'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Freeing task resources for MapPartition (MapPartition at
[6]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/{ImpulseSingleElementPC,
CopyJobNamePrefix, SchemaModJobNamePrefix, GenerateFilePrefix,
LoadJobNamePrefix}) (14/16)#0 (1b4547a03e96165f823cf459af869241).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
unregisterTaskAndNotifyFinalState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Un-registering task and sending final execution state FINISHED to JobManager
for task MapPartition (MapPartition at
[6]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/{ImpulseSingleElementPC,
CopyJobNamePrefix, SchemaModJobNamePrefix, GenerateFilePrefix,
LoadJobNamePrefix}) (14/16)#0 1b4547a03e96165f823cf459af869241.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM org.apache.flink.runtime.executiongraph.Execution
transitionState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
MapPartition (MapPartition at
[6]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/{ImpulseSingleElementPC,
CopyJobNamePrefix, SchemaModJobNamePrefix, GenerateFilePrefix,
LoadJobNamePrefix}) (14/16) (1b4547a03e96165f823cf459af869241) switched from
RUNNING to FINISHED.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager
processResourceRequirements'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Received resource requirements from job 7b0c75bbe0708a06794b8d71ec3206a4:
[ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN},
numberOfRequiredSlots=14}]'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM org.apache.flink.runtime.taskmanager.Task transitionState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
MapPartition (MapPartition at
[6]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/{ImpulseSingleElementPC,
CopyJobNamePrefix, SchemaModJobNamePrefix, GenerateFilePrefix,
LoadJobNamePrefix}) (10/16)#0 (b793c1c59c38a1282787162c3fcb8007) switched from
RUNNING to FINISHED.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM org.apache.flink.runtime.taskmanager.Task doRun'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Freeing task resources for MapPartition (MapPartition at
[6]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/{ImpulseSingleElementPC,
CopyJobNamePrefix, SchemaModJobNamePrefix, GenerateFilePrefix,
LoadJobNamePrefix}) (10/16)#0 (b793c1c59c38a1282787162c3fcb8007).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
unregisterTaskAndNotifyFinalState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Un-registering task and sending final execution state FINISHED to JobManager
for task MapPartition (MapPartition at
[6]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/{ImpulseSingleElementPC,
CopyJobNamePrefix, SchemaModJobNamePrefix, GenerateFilePrefix,
LoadJobNamePrefix}) (10/16)#0 b793c1c59c38a1282787162c3fcb8007.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM org.apache.flink.runtime.executiongraph.Execution
transitionState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
MapPartition (MapPartition at
[6]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/{ImpulseSingleElementPC,
CopyJobNamePrefix, SchemaModJobNamePrefix, GenerateFilePrefix,
LoadJobNamePrefix}) (10/16) (b793c1c59c38a1282787162c3fcb8007) switched from
RUNNING to FINISHED.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager
processResourceRequirements'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Received resource requirements from job 7b0c75bbe0708a06794b8d71ec3206a4:
[ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN},
numberOfRequiredSlots=13}]'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM org.apache.flink.runtime.taskmanager.Task transitionState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
MapPartition (MapPartition at
[6]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/{ImpulseSingleElementPC,
CopyJobNamePrefix, SchemaModJobNamePrefix, GenerateFilePrefix,
LoadJobNamePrefix}) (5/16)#0 (a0388551de37309063724985047bf241) switched from
RUNNING to FINISHED.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM org.apache.flink.runtime.taskmanager.Task doRun'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Freeing task resources for MapPartition (MapPartition at
[6]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/{ImpulseSingleElementPC,
CopyJobNamePrefix, SchemaModJobNamePrefix, GenerateFilePrefix,
LoadJobNamePrefix}) (5/16)#0 (a0388551de37309063724985047bf241).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM org.apache.flink.runtime.taskmanager.Task transitionState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
MapPartition (MapPartition at
[6]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/{ImpulseSingleElementPC,
CopyJobNamePrefix, SchemaModJobNamePrefix, GenerateFilePrefix,
LoadJobNamePrefix}) (16/16)#0 (e6c7027dfe69faedb73bc86ffdac564a) switched from
RUNNING to FINISHED.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM org.apache.flink.runtime.taskmanager.Task doRun'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Freeing task resources for MapPartition (MapPartition at
[6]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/{ImpulseSingleElementPC,
CopyJobNamePrefix, SchemaModJobNamePrefix, GenerateFilePrefix,
LoadJobNamePrefix}) (16/16)#0 (e6c7027dfe69faedb73bc86ffdac564a).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
unregisterTaskAndNotifyFinalState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Un-registering task and sending final execution state FINISHED to JobManager
for task MapPartition (MapPartition at
[6]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/{ImpulseSingleElementPC,
CopyJobNamePrefix, SchemaModJobNamePrefix, GenerateFilePrefix,
LoadJobNamePrefix}) (5/16)#0 a0388551de37309063724985047bf241.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
unregisterTaskAndNotifyFinalState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Un-registering task and sending final execution state FINISHED to JobManager
for task MapPartition (MapPartition at
[6]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/{ImpulseSingleElementPC,
CopyJobNamePrefix, SchemaModJobNamePrefix, GenerateFilePrefix,
LoadJobNamePrefix}) (16/16)#0 e6c7027dfe69faedb73bc86ffdac564a.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM org.apache.flink.runtime.executiongraph.Execution
transitionState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
MapPartition (MapPartition at
[6]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/{ImpulseSingleElementPC,
CopyJobNamePrefix, SchemaModJobNamePrefix, GenerateFilePrefix,
LoadJobNamePrefix}) (5/16) (a0388551de37309063724985047bf241) switched from
RUNNING to FINISHED.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager
processResourceRequirements'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Received resource requirements from job 7b0c75bbe0708a06794b8d71ec3206a4:
[ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN},
numberOfRequiredSlots=12}]'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM org.apache.flink.runtime.executiongraph.Execution
transitionState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
MapPartition (MapPartition at
[6]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/{ImpulseSingleElementPC,
CopyJobNamePrefix, SchemaModJobNamePrefix, GenerateFilePrefix,
LoadJobNamePrefix}) (16/16) (e6c7027dfe69faedb73bc86ffdac564a) switched from
RUNNING to FINISHED.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager
processResourceRequirements'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Received resource requirements from job 7b0c75bbe0708a06794b8d71ec3206a4:
[ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN},
numberOfRequiredSlots=11}]'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM org.apache.flink.runtime.taskmanager.Task transitionState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
MapPartition (MapPartition at
[6]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/{ImpulseSingleElementPC,
CopyJobNamePrefix, SchemaModJobNamePrefix, GenerateFilePrefix,
LoadJobNamePrefix}) (7/16)#0 (b91120af85afca9352164594cd13897c) switched from
RUNNING to FINISHED.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM org.apache.flink.runtime.taskmanager.Task doRun'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Freeing task resources for MapPartition (MapPartition at
[6]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/{ImpulseSingleElementPC,
CopyJobNamePrefix, SchemaModJobNamePrefix, GenerateFilePrefix,
LoadJobNamePrefix}) (7/16)#0 (b91120af85afca9352164594cd13897c).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
unregisterTaskAndNotifyFinalState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Un-registering task and sending final execution state FINISHED to JobManager
for task MapPartition (MapPartition at
[6]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/{ImpulseSingleElementPC,
CopyJobNamePrefix, SchemaModJobNamePrefix, GenerateFilePrefix,
LoadJobNamePrefix}) (7/16)#0 b91120af85afca9352164594cd13897c.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM org.apache.flink.runtime.executiongraph.Execution
transitionState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
MapPartition (MapPartition at
[6]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/{ImpulseSingleElementPC,
CopyJobNamePrefix, SchemaModJobNamePrefix, GenerateFilePrefix,
LoadJobNamePrefix}) (7/16) (b91120af85afca9352164594cd13897c) switched from
RUNNING to FINISHED.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM
org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager
processResourceRequirements'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Received resource requirements from job 7b0c75bbe0708a06794b8d71ec3206a4:
[ResourceRequirement{resourceProfile=ResourceProfile{UNKNOWN},
numberOfRequiredSlots=10}]'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:44 AM org.apache.flink.runtime.taskmanager.Task transitionState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
MapPartition (MapPartition at
[6]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/{ImpulseSingleElementPC,
CopyJobNamePrefix, SchemaModJobNamePrefix, GenerateFilePrefix,
LoadJobNamePrefix}) (1/16)#0 (a69b764e2b068296a15f6e6c83ab5f4b) switched from
RUNNING to FINISHED.'
> Task :sdks:python:test-suites:portable:py37:flinkExamples
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:43 AM org.apache.flink.runtime.taskmanager.Task transitionState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
MapPartition (MapPartition at
[2]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/ImpulseEmptyPC/{FlatMap(<lambda
at core.py:3228>), Map(decode)}) (15/16)#0 (4b9bec0fb51d192b8a9e1e5d4553f10a)
switched from RUNNING to FINISHED.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:43 AM org.apache.flink.runtime.taskmanager.Task doRun'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Freeing task resources for MapPartition (MapPartition at
[2]WriteTeamScoreSums/WriteToBigQuery/BigQueryBatchFileLoads/ImpulseEmptyPC/{FlatMap(<lambda
at core.py:3228>), Map(decode)}) (15/16)#0 (4b9bec0fb51d192b8a9e1e5d4553f10a).'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:43 AM org.apache.flink.runtime.taskmanager.Task transitionState'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
DataSink (DiscardingOutput) (15/16)#0 (23362891e5f1af39afba335af995e420)
switched from RUNNING to FINISHED.'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'Feb 11,
2022 6:10:43 AM org.apache.flink.runtime.taskmanager.Task doRun'
INFO apache_beam.utils.subprocess_server:subprocess_server.py:125 b'INFO:
Freeing task resources for DataSink (DiscardingOutput) (15/16)#0
(23362891e5f1af39afba335af995e420).'
java.lang.OutOfMemoryError: GC overhead limit exceeded
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
