See
<https://builds.apache.org/job/beam_PostCommit_PortableJar_Flink/920/display/redirect?page=changes>
Changes:
[daniel.o.programmer] [BEAM-7970] Rebuild Go protos with new protobuf version
------------------------------------------
[...truncated 91.38 KB...]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Running initialization on master
for job BeamApp-jenkins-1217010234-a4133206 (4b5d422f3dbf6dd21bf5ae07c863ea5c).
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Successfully ran initialization
on master in 3 ms.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService
- Proposing leadership to contender
org.apache.flink.runtime.jobmaster.JobManagerRunner@1ce8fdda @
akka://flink/user/jobmanager_1
[mini-cluster-io-thread-10] INFO
org.apache.flink.runtime.jobmaster.JobManagerRunner - JobManager runner for job
BeamApp-jenkins-1217010234-a4133206 (4b5d422f3dbf6dd21bf5ae07c863ea5c) was
granted leadership with session id ae1e8c1e-bb7f-41d2-b05e-c51caed16670 at
akka://flink/user/jobmanager_1.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Starting execution of job
BeamApp-jenkins-1217010234-a4133206 (4b5d422f3dbf6dd21bf5ae07c863ea5c) under
job master id b05ec51caed16670ae1e8c1ebb7f41d2.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Job
BeamApp-jenkins-1217010234-a4133206 (4b5d422f3dbf6dd21bf5ae07c863ea5c) switched
from state CREATED to RUNNING.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSource (Impulse)
(1/1) (d51502832ab974c84aaf3159e17d6c16) switched from CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl - Cannot serve slot
request, no ResourceManager connected. Adding as pending request
[SlotRequestId{66a081955a061f7ef2ef7e3ec3badc01}]
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSource (Impulse)
(1/1) (94c2b9ba3db9c5a8d40c115164fbedd1) switched from CREATED to SCHEDULED.
[jobmanager-future-thread-1] INFO
org.apache.flink.runtime.highavailability.nonha.embedded.EmbeddedLeaderService
- Received confirmation of leadership for leader akka://flink/user/jobmanager_1
, session=ae1e8c1e-bb7f-41d2-b05e-c51caed16670
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Connecting to ResourceManager
akka://flink/user/resourcemanager(a99f864ead316707529c0b3f26e74ab3)
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Resolved ResourceManager
address, beginning registration
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.jobmaster.JobMaster - Registration at ResourceManager
attempt 1 (timeout=100ms)
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager -
Registering job manager
b05ec51caed16670ae1e8c1ebb7f41d2@akka://flink/user/jobmanager_1 for job
4b5d422f3dbf6dd21bf5ae07c863ea5c.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Registered
job manager b05ec51caed16670ae1e8c1ebb7f41d2@akka://flink/user/jobmanager_1 for
job 4b5d422f3dbf6dd21bf5ae07c863ea5c.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.jobmaster.JobMaster - JobManager successfully
registered at ResourceManager, leader id: a99f864ead316707529c0b3f26e74ab3.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl - Requesting new slot
[SlotRequestId{66a081955a061f7ef2ef7e3ec3badc01}] and profile
ResourceProfile{cpuCores=-1.0, heapMemoryInMB=-1, directMemoryInMB=-1,
nativeMemoryInMB=-1, networkMemoryInMB=-1, managedMemoryInMB=-1} from resource
manager.
[flink-akka.actor.default-dispatcher-5] INFO
org.apache.flink.runtime.resourcemanager.StandaloneResourceManager - Request
slot with profile ResourceProfile{cpuCores=-1.0, heapMemoryInMB=-1,
directMemoryInMB=-1, nativeMemoryInMB=-1, networkMemoryInMB=-1,
managedMemoryInMB=-1} for job 4b5d422f3dbf6dd21bf5ae07c863ea5c with allocation
id 925e55ffa57519711ee2f4fc93995f35.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Receive slot request
925e55ffa57519711ee2f4fc93995f35 for job 4b5d422f3dbf6dd21bf5ae07c863ea5c from
resource manager with leader id a99f864ead316707529c0b3f26e74ab3.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Allocated slot for
925e55ffa57519711ee2f4fc93995f35.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Add job
4b5d422f3dbf6dd21bf5ae07c863ea5c for job leader monitoring.
[mini-cluster-io-thread-13] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Try to register at job
manager akka://flink/user/jobmanager_1 with leader id
ae1e8c1e-bb7f-41d2-b05e-c51caed16670.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Resolved JobManager
address, beginning registration
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Registration at
JobManager attempt 1 (timeout=100ms)
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.JobLeaderService - Successful
registration at job manager akka://flink/user/jobmanager_1 for job
4b5d422f3dbf6dd21bf5ae07c863ea5c.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Establish JobManager
connection for job 4b5d422f3dbf6dd21bf5ae07c863ea5c.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Offer reserved slots to
the leader of job 4b5d422f3dbf6dd21bf5ae07c863ea5c.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSource (Impulse)
(1/1) (d51502832ab974c84aaf3159e17d6c16) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying DataSource
(Impulse) (1/1) (attempt #0) to 194d57cf-e87a-41f0-b7a7-35e4b54ca700 @
localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSource (Impulse)
(1/1) (94c2b9ba3db9c5a8d40c115164fbedd1) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-3] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying DataSource
(Impulse) (1/1) (attempt #0) to 194d57cf-e87a-41f0-b7a7-35e4b54ca700 @
localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task DataSource
(Impulse) (1/1).
[DataSource (Impulse) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
DataSource (Impulse) (1/1) (d51502832ab974c84aaf3159e17d6c16) switched from
CREATED to DEPLOYING.
[DataSource (Impulse) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Creating FileSystem stream leak safety net for task DataSource (Impulse) (1/1)
(d51502832ab974c84aaf3159e17d6c16) [DEPLOYING]
[DataSource (Impulse) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Loading JAR files for task DataSource (Impulse) (1/1)
(d51502832ab974c84aaf3159e17d6c16) [DEPLOYING].
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task DataSource
(Impulse) (1/1).
[DataSource (Impulse) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
DataSource (Impulse) (1/1) (94c2b9ba3db9c5a8d40c115164fbedd1) switched from
CREATED to DEPLOYING.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTable - Activate slot
925e55ffa57519711ee2f4fc93995f35.
[DataSource (Impulse) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Creating FileSystem stream leak safety net for task DataSource (Impulse) (1/1)
(94c2b9ba3db9c5a8d40c115164fbedd1) [DEPLOYING]
[DataSource (Impulse) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Loading JAR files for task DataSource (Impulse) (1/1)
(94c2b9ba3db9c5a8d40c115164fbedd1) [DEPLOYING].
[DataSource (Impulse) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Registering task at network: DataSource (Impulse) (1/1)
(d51502832ab974c84aaf3159e17d6c16) [DEPLOYING].
[DataSource (Impulse) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Registering task at network: DataSource (Impulse) (1/1)
(94c2b9ba3db9c5a8d40c115164fbedd1) [DEPLOYING].
[DataSource (Impulse) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
DataSource (Impulse) (1/1) (94c2b9ba3db9c5a8d40c115164fbedd1) switched from
DEPLOYING to RUNNING.
[DataSource (Impulse) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
DataSource (Impulse) (1/1) (d51502832ab974c84aaf3159e17d6c16) switched from
DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSource (Impulse)
(1/1) (94c2b9ba3db9c5a8d40c115164fbedd1) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSource (Impulse)
(1/1) (d51502832ab974c84aaf3159e17d6c16) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN MapPartition
(MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at
ExtractOutput[0]) (1/1) (c69d0befc328499954a1d7a24907f195) switched from
CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN MapPartition
(MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at
ExtractOutput[0]) (1/1) (c69d0befc328499954a1d7a24907f195) switched from
SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying CHAIN
MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap
(FlatMap at ExtractOutput[0]) (1/1) (attempt #0) to
194d57cf-e87a-41f0-b7a7-35e4b54ca700 @ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN MapPartition
(MapPartition at [1]Create/FlatMap(<lambda at core.py:2573>)) -> FlatMap
(FlatMap at ExtractOutput[0]) (1/1) (9225a4d4af98d75a49e0d0c98043f367) switched
from CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN MapPartition
(MapPartition at [1]Create/FlatMap(<lambda at core.py:2573>)) -> FlatMap
(FlatMap at ExtractOutput[0]) (1/1) (9225a4d4af98d75a49e0d0c98043f367) switched
from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying CHAIN
MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2573>)) ->
FlatMap (FlatMap at ExtractOutput[0]) (1/1) (attempt #0) to
194d57cf-e87a-41f0-b7a7-35e4b54ca700 @ localhost (dataPort=-1)
[DataSource (Impulse) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
DataSource (Impulse) (1/1) (94c2b9ba3db9c5a8d40c115164fbedd1) switched from
RUNNING to FINISHED.
[DataSource (Impulse) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Freeing task resources for DataSource (Impulse) (1/1)
(94c2b9ba3db9c5a8d40c115164fbedd1).
[DataSource (Impulse) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Ensuring all FileSystem streams are closed for task DataSource (Impulse) (1/1)
(94c2b9ba3db9c5a8d40c115164fbedd1) [FINISHED]
[DataSource (Impulse) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
DataSource (Impulse) (1/1) (d51502832ab974c84aaf3159e17d6c16) switched from
RUNNING to FINISHED.
[DataSource (Impulse) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Freeing task resources for DataSource (Impulse) (1/1)
(d51502832ab974c84aaf3159e17d6c16).
[DataSource (Impulse) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task -
Ensuring all FileSystem streams are closed for task DataSource (Impulse) (1/1)
(d51502832ab974c84aaf3159e17d6c16) [FINISHED]
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task CHAIN
MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap
(FlatMap at ExtractOutput[0]) (1/1).
[CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap
(FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - CHAIN MapPartition (MapPartition at
[4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)
(c69d0befc328499954a1d7a24907f195) switched from CREATED to DEPLOYING.
[CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap
(FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak
safety net for task CHAIN MapPartition (MapPartition at [4]assert_that/{Create,
Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)
(c69d0befc328499954a1d7a24907f195) [DEPLOYING]
[CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap
(FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task CHAIN
MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap
(FlatMap at ExtractOutput[0]) (1/1) (c69d0befc328499954a1d7a24907f195)
[DEPLOYING].
[CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap
(FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Registering task at network: CHAIN
MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap
(FlatMap at ExtractOutput[0]) (1/1) (c69d0befc328499954a1d7a24907f195)
[DEPLOYING].
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task CHAIN
MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2573>)) ->
FlatMap (FlatMap at ExtractOutput[0]) (1/1).
[CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at
core.py:2573>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - CHAIN MapPartition (MapPartition at
[1]Create/FlatMap(<lambda at core.py:2573>)) -> FlatMap (FlatMap at
ExtractOutput[0]) (1/1) (9225a4d4af98d75a49e0d0c98043f367) switched from
CREATED to DEPLOYING.
[CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at
core.py:2573>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak
safety net for task CHAIN MapPartition (MapPartition at
[1]Create/FlatMap(<lambda at core.py:2573>)) -> FlatMap (FlatMap at
ExtractOutput[0]) (1/1) (9225a4d4af98d75a49e0d0c98043f367) [DEPLOYING]
[CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at
core.py:2573>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task CHAIN
MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2573>)) ->
FlatMap (FlatMap at ExtractOutput[0]) (1/1) (9225a4d4af98d75a49e0d0c98043f367)
[DEPLOYING].
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task DataSource
(Impulse) 94c2b9ba3db9c5a8d40c115164fbedd1.
[CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap
(FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - CHAIN MapPartition (MapPartition at
[4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)
(c69d0befc328499954a1d7a24907f195) switched from DEPLOYING to RUNNING.
[CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at
core.py:2573>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Registering task at network: CHAIN
MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2573>)) ->
FlatMap (FlatMap at ExtractOutput[0]) (1/1) (9225a4d4af98d75a49e0d0c98043f367)
[DEPLOYING].
[CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at
core.py:2573>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - CHAIN MapPartition (MapPartition at
[1]Create/FlatMap(<lambda at core.py:2573>)) -> FlatMap (FlatMap at
ExtractOutput[0]) (1/1) (9225a4d4af98d75a49e0d0c98043f367) switched from
DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN MapPartition
(MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at
ExtractOutput[0]) (1/1) (c69d0befc328499954a1d7a24907f195) switched from
DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN MapPartition
(MapPartition at [1]Create/FlatMap(<lambda at core.py:2573>)) -> FlatMap
(FlatMap at ExtractOutput[0]) (1/1) (9225a4d4af98d75a49e0d0c98043f367) switched
from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-2] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task DataSource
(Impulse) d51502832ab974c84aaf3159e17d6c16.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSource (Impulse)
(1/1) (94c2b9ba3db9c5a8d40c115164fbedd1) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-4] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - DataSource (Impulse)
(1/1) (d51502832ab974c84aaf3159e17d6c16) switched from RUNNING to FINISHED.
[CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap
(FlatMap at ExtractOutput[0]) (1/1)] WARN
org.apache.beam.runners.fnexecution.environment.DockerCommand - Unable to pull
docker image apachebeam/python3.5_sdk:2.19.0.dev, cause: Received exit code 1
for command 'docker pull apachebeam/python3.5_sdk:2.19.0.dev'. stderr: Error
response from daemon: manifest for apachebeam/python3.5_sdk:2.19.0.dev not found
[grpc-default-executor-0] INFO
org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService -
GetManifest for
BEAM-PIPELINE/BeamApp-jenkins-1217010234-a4133206/artifact-manifest.json
[grpc-default-executor-0] INFO
org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService -
Manifest at
BEAM-PIPELINE/BeamApp-jenkins-1217010234-a4133206/artifact-manifest.json has 1
artifact locations
[grpc-default-executor-0] INFO
org.apache.beam.runners.fnexecution.artifact.AbstractArtifactRetrievalService -
GetManifest for
BEAM-PIPELINE/BeamApp-jenkins-1217010234-a4133206/artifact-manifest.json -> 1
artifacts
[grpc-default-executor-0] INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Beam Fn
Logging client connected.
[grpc-default-executor-0] INFO
/usr/local/lib/python3.5/site-packages/apache_beam/runners/worker/sdk_worker_main.py:106
- Logging handler created.
[grpc-default-executor-0] INFO
/usr/local/lib/python3.5/site-packages/apache_beam/runners/worker/sdk_worker_main.py:132
- semi_persistent_directory: /tmp
[grpc-default-executor-0] WARN
/usr/local/lib/python3.5/site-packages/apache_beam/options/pipeline_options.py:284
- Discarding unparseable args:
['--pipeline_resources_detector_factory_class=org.apache.beam.runners.core.construction.resources.PipelineResourcesOptions$ClasspathScanningResourcesDetectorFactory',
'--retrieval_service_type=CLASSLOADER', '--pipeline_type_check',
'--app_name=None', '--fail_on_checkpointing_errors', '--parallelism=1',
'--job_server_timeout=60', '--direct_runner_use_stacked_bundle',
'--enable_metrics', '--options_id=1']
[grpc-default-executor-0] INFO
/usr/local/lib/python3.5/site-packages/apache_beam/runners/worker/sdk_worker_main.py:144
- Python sdk harness started with pipeline_options: {'environment_config':
'apachebeam/python3.5_sdk:2.19.0.dev', 'artifact_port': '0',
'flink_job_server_jar':
'<https://builds.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/runners/flink/1.9/job-server/build/libs/beam-runners-flink-1.9-job-server-2.19.0-SNAPSHOT.jar',>
'job_name': 'BeamApp-jenkins-1217010234-a4133206', 'experiments':
['beam_fn_api'], 'environment_type': 'DOCKER', 'output_executable_path':
'flink-test-20191217-010218.jar', 'save_main_session': True, 'job_port': '0',
'environment_cache_millis': '0', 'runner': 'None', 'sdk_location': 'container',
'expansion_port': '0', 'sdk_worker_parallelism': '1'}
[grpc-default-executor-0] INFO
/usr/local/lib/python3.5/site-packages/apache_beam/runners/worker/statecache.py:137
- Creating state cache with size 0
[grpc-default-executor-0] INFO
/usr/local/lib/python3.5/site-packages/apache_beam/runners/worker/sdk_worker.py:84
- Creating insecure control channel for localhost:38299.
[grpc-default-executor-0] INFO
/usr/local/lib/python3.5/site-packages/apache_beam/runners/worker/sdk_worker.py:92
- Control channel established.
[grpc-default-executor-0] INFO
/usr/local/lib/python3.5/site-packages/apache_beam/runners/worker/sdk_worker.py:109
- Initializing SDKHarness with unbounded number of workers.
[grpc-default-executor-0] INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService -
Beam Fn Control client connected with id 1-1
[grpc-default-executor-0] INFO
/usr/local/lib/python3.5/site-packages/apache_beam/runners/worker/sdk_worker.py:525
- Creating insecure state channel for localhost:33465.
[grpc-default-executor-0] INFO
/usr/local/lib/python3.5/site-packages/apache_beam/runners/worker/sdk_worker.py:532
- State channel established.
[grpc-default-executor-0] INFO
/usr/local/lib/python3.5/site-packages/apache_beam/runners/worker/data_plane.py:416
- Creating client data channel for localhost:33897
[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client
connected.
[grpc-default-executor-1] INFO
/usr/local/lib/python3.5/site-packages/apache_beam/runners/worker/sdk_worker_main.py:88
- Status HTTP server running at localhost:43171
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Partition (1/1)
(cd0aa9fd2c4203bc63ba2fcb46ff2d83) switched from CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Partition (1/1)
(cd0aa9fd2c4203bc63ba2fcb46ff2d83) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying Partition
(1/1) (attempt #0) to 194d57cf-e87a-41f0-b7a7-35e4b54ca700 @ localhost
(dataPort=-1)
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task Partition
(1/1).
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN Filter
(UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at
GroupCombine: assert_that/Group/GroupByKey) -> Map (Key Extractor) (1/1)
(6ac293d9c6aaa90c08cf46f07dc42985) switched from CREATED to SCHEDULED.
[Partition (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Partition
(1/1) (cd0aa9fd2c4203bc63ba2fcb46ff2d83) switched from CREATED to DEPLOYING.
[Partition (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating
FileSystem stream leak safety net for task Partition (1/1)
(cd0aa9fd2c4203bc63ba2fcb46ff2d83) [DEPLOYING]
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN Filter
(UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at
GroupCombine: assert_that/Group/GroupByKey) -> Map (Key Extractor) (1/1)
(6ac293d9c6aaa90c08cf46f07dc42985) switched from SCHEDULED to DEPLOYING.
[Partition (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR
files for task Partition (1/1) (cd0aa9fd2c4203bc63ba2fcb46ff2d83) [DEPLOYING].
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying CHAIN Filter
(UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at
GroupCombine: assert_that/Group/GroupByKey) -> Map (Key Extractor) (1/1)
(attempt #0) to 194d57cf-e87a-41f0-b7a7-35e4b54ca700 @ localhost (dataPort=-1)
[Partition (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering
task at network: Partition (1/1) (cd0aa9fd2c4203bc63ba2fcb46ff2d83) [DEPLOYING].
[Partition (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Partition
(1/1) (cd0aa9fd2c4203bc63ba2fcb46ff2d83) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Partition (1/1)
(cd0aa9fd2c4203bc63ba2fcb46ff2d83) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN MapPartition
(MapPartition at [6]{Create, Map(<lambda at <string>:20>), assert_that}) ->
FlatMap (FlatMap at ExtractOutput[0]) (1/1) (9a5e93602447502430fcdaaa6c73aad7)
switched from CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN MapPartition
(MapPartition at [6]{Create, Map(<lambda at <string>:20>), assert_that}) ->
FlatMap (FlatMap at ExtractOutput[0]) (1/1) (9a5e93602447502430fcdaaa6c73aad7)
switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying CHAIN
MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:20>),
assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1) (attempt #0) to
194d57cf-e87a-41f0-b7a7-35e4b54ca700 @ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task CHAIN Filter
(UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at
GroupCombine: assert_that/Group/GroupByKey) -> Map (Key Extractor) (1/1).
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine
(GroupCombine at GroupCombine: assert_that/Group/GroupByKey) -> Map (Key
Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - CHAIN Filter
(UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at
GroupCombine: assert_that/Group/GroupByKey) -> Map (Key Extractor) (1/1)
(6ac293d9c6aaa90c08cf46f07dc42985) switched from CREATED to DEPLOYING.
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine
(GroupCombine at GroupCombine: assert_that/Group/GroupByKey) -> Map (Key
Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Creating
FileSystem stream leak safety net for task CHAIN Filter (UnionFixFilter) -> Map
(Key Extractor) -> GroupCombine (GroupCombine at GroupCombine:
assert_that/Group/GroupByKey) -> Map (Key Extractor) (1/1)
(6ac293d9c6aaa90c08cf46f07dc42985) [DEPLOYING]
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine
(GroupCombine at GroupCombine: assert_that/Group/GroupByKey) -> Map (Key
Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Loading JAR
files for task CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: assert_that/Group/GroupByKey) ->
Map (Key Extractor) (1/1) (6ac293d9c6aaa90c08cf46f07dc42985) [DEPLOYING].
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine
(GroupCombine at GroupCombine: assert_that/Group/GroupByKey) -> Map (Key
Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Registering
task at network: CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: assert_that/Group/GroupByKey) ->
Map (Key Extractor) (1/1) (6ac293d9c6aaa90c08cf46f07dc42985) [DEPLOYING].
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine
(GroupCombine at GroupCombine: assert_that/Group/GroupByKey) -> Map (Key
Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - CHAIN Filter
(UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at
GroupCombine: assert_that/Group/GroupByKey) -> Map (Key Extractor) (1/1)
(6ac293d9c6aaa90c08cf46f07dc42985) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN Filter
(UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at
GroupCombine: assert_that/Group/GroupByKey) -> Map (Key Extractor) (1/1)
(6ac293d9c6aaa90c08cf46f07dc42985) switched from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task CHAIN
MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:20>),
assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1).
[CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:20>),
assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - CHAIN MapPartition (MapPartition at
[6]{Create, Map(<lambda at <string>:20>), assert_that}) -> FlatMap (FlatMap at
ExtractOutput[0]) (1/1) (9a5e93602447502430fcdaaa6c73aad7) switched from
CREATED to DEPLOYING.
[CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:20>),
assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak
safety net for task CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda
at <string>:20>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)
(9a5e93602447502430fcdaaa6c73aad7) [DEPLOYING]
[CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:20>),
assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task CHAIN
MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:20>),
assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)
(9a5e93602447502430fcdaaa6c73aad7) [DEPLOYING].
[CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:20>),
assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Registering task at network: CHAIN
MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:20>),
assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)
(9a5e93602447502430fcdaaa6c73aad7) [DEPLOYING].
[CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:20>),
assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - CHAIN MapPartition (MapPartition at
[6]{Create, Map(<lambda at <string>:20>), assert_that}) -> FlatMap (FlatMap at
ExtractOutput[0]) (1/1) (9a5e93602447502430fcdaaa6c73aad7) switched from
DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-10] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN MapPartition
(MapPartition at [6]{Create, Map(<lambda at <string>:20>), assert_that}) ->
FlatMap (FlatMap at ExtractOutput[0]) (1/1) (9a5e93602447502430fcdaaa6c73aad7)
switched from DEPLOYING to RUNNING.
[CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:20>),
assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] WARN
org.apache.flink.metrics.MetricGroup - The operator name MapPartition
(MapPartition at [6]{Create, Map(<lambda at <string>:20>), assert_that})
exceeded the 80 characters length limit and was truncated.
[CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap
(FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - CHAIN MapPartition (MapPartition at
[4]assert_that/{Create, Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)
(c69d0befc328499954a1d7a24907f195) switched from RUNNING to FINISHED.
[CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap
(FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for CHAIN
MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap
(FlatMap at ExtractOutput[0]) (1/1) (c69d0befc328499954a1d7a24907f195).
[CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at
core.py:2573>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - CHAIN MapPartition (MapPartition at
[1]Create/FlatMap(<lambda at core.py:2573>)) -> FlatMap (FlatMap at
ExtractOutput[0]) (1/1) (9225a4d4af98d75a49e0d0c98043f367) switched from
RUNNING to FINISHED.
[CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at
core.py:2573>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for CHAIN
MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2573>)) ->
FlatMap (FlatMap at ExtractOutput[0]) (1/1) (9225a4d4af98d75a49e0d0c98043f367).
[Partition (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Partition
(1/1) (cd0aa9fd2c4203bc63ba2fcb46ff2d83) switched from RUNNING to FINISHED.
[Partition (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task
resources for Partition (1/1) (cd0aa9fd2c4203bc63ba2fcb46ff2d83).
[CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:20>),
assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Closing
environment urn: "beam:env:docker:v1"
payload: "\n#apachebeam/python3.5_sdk:2.19.0.dev"
[CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:20>),
assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn
Logging clients still connected during shutdown.
[CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:20>),
assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] WARN
org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown
endpoint.
[CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:20>),
assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment -
Closing Docker container
d3d298f33b82b8511c7032286dec353d6abfea75132db6e27a72b06b4402a5d6. Logs:
2019/12/17 01:03:24 Initializing python harness: /opt/apache/beam/boot --id=1-1
--logging_endpoint=localhost:45209 --artifact_endpoint=localhost:44035
--provision_endpoint=localhost:42311 --control_endpoint=localhost:38299
2019/12/17 01:03:25 Installing setup packages ...
2019/12/17 01:03:25 Found artifact: pickled_main_session
2019/12/17 01:03:25 Executing: python -m
apache_beam.runners.worker.sdk_worker_main
[CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda at
core.py:2573>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task CHAIN MapPartition (MapPartition at [1]Create/FlatMap(<lambda
at core.py:2573>)) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)
(9225a4d4af98d75a49e0d0c98043f367) [FINISHED]
[Partition (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Ensuring all
FileSystem streams are closed for task Partition (1/1)
(cd0aa9fd2c4203bc63ba2fcb46ff2d83) [FINISHED]
[CHAIN MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap
(FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task CHAIN MapPartition (MapPartition at [4]assert_that/{Create,
Group}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)
(c69d0befc328499954a1d7a24907f195) [FINISHED]
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task Partition
cd0aa9fd2c4203bc63ba2fcb46ff2d83.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task CHAIN
MapPartition (MapPartition at [1]Create/FlatMap(<lambda at core.py:2573>)) ->
FlatMap (FlatMap at ExtractOutput[0]) 9225a4d4af98d75a49e0d0c98043f367.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Partition (1/1)
(cd0aa9fd2c4203bc63ba2fcb46ff2d83) switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-6] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task CHAIN
MapPartition (MapPartition at [4]assert_that/{Create, Group}) -> FlatMap
(FlatMap at ExtractOutput[0]) c69d0befc328499954a1d7a24907f195.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN MapPartition
(MapPartition at [1]Create/FlatMap(<lambda at core.py:2573>)) -> FlatMap
(FlatMap at ExtractOutput[0]) (1/1) (9225a4d4af98d75a49e0d0c98043f367) switched
from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN MapPartition
(MapPartition at [4]assert_that/{Create, Group}) -> FlatMap (FlatMap at
ExtractOutput[0]) (1/1) (c69d0befc328499954a1d7a24907f195) switched from
RUNNING to FINISHED.
[CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:20>),
assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] WARN
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Error
cleaning up servers urn: "beam:env:docker:v1"
payload: "\n#apachebeam/python3.5_sdk:2.19.0.dev"
java.io.IOException: Received exit code 1 for command 'docker rm
d3d298f33b82b8511c7032286dec353d6abfea75132db6e27a72b06b4402a5d6'. stderr:
Error: No such container:
d3d298f33b82b8511c7032286dec353d6abfea75132db6e27a72b06b4402a5d6
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:234)
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.runShortCommand(DockerCommand.java:168)
at
org.apache.beam.runners.fnexecution.environment.DockerCommand.removeContainer(DockerCommand.java:163)
at
org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment.close(DockerContainerEnvironment.java:95)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.$closeResource(DefaultJobBundleFactory.java:476)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.close(DefaultJobBundleFactory.java:476)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.unref(DefaultJobBundleFactory.java:491)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory$WrappedSdkHarnessClient.access$1800(DefaultJobBundleFactory.java:431)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.lambda$createEnvironmentCaches$3(DefaultJobBundleFactory.java:168)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.processPendingNotifications(LocalCache.java:1809)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.runUnlockedCleanup(LocalCache.java:3462)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.postWriteCleanup(LocalCache.java:3438)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$Segment.clear(LocalCache.java:3215)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache.clear(LocalCache.java:4270)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.cache.LocalCache$LocalManualCache.invalidateAll(LocalCache.java:4909)
at
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory.close(DefaultJobBundleFactory.java:258)
at
org.apache.beam.runners.fnexecution.control.DefaultExecutableStageContext.close(DefaultExecutableStageContext.java:43)
at
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.closeActual(ReferenceCountingExecutableStageContextFactory.java:208)
at
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.access$200(ReferenceCountingExecutableStageContextFactory.java:184)
at
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.release(ReferenceCountingExecutableStageContextFactory.java:173)
at
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.scheduleRelease(ReferenceCountingExecutableStageContextFactory.java:132)
at
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory.access$300(ReferenceCountingExecutableStageContextFactory.java:44)
at
org.apache.beam.runners.fnexecution.control.ReferenceCountingExecutableStageContextFactory$WrappedContext.close(ReferenceCountingExecutableStageContextFactory.java:204)
at
org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.$closeResource(FlinkExecutableStageFunction.java:204)
at
org.apache.beam.runners.flink.translation.functions.FlinkExecutableStageFunction.close(FlinkExecutableStageFunction.java:290)
at
org.apache.flink.api.common.functions.util.FunctionUtils.closeFunction(FunctionUtils.java:43)
at org.apache.flink.runtime.operators.BatchTask.run(BatchTask.java:508)
at
org.apache.flink.runtime.operators.BatchTask.invoke(BatchTask.java:369)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:705)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:530)
at java.lang.Thread.run(Thread.java:748)
[CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:20>),
assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - CHAIN MapPartition (MapPartition at
[6]{Create, Map(<lambda at <string>:20>), assert_that}) -> FlatMap (FlatMap at
ExtractOutput[0]) (1/1) (9a5e93602447502430fcdaaa6c73aad7) switched from
RUNNING to FINISHED.
[CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:20>),
assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Freeing task resources for CHAIN
MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:20>),
assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)
(9a5e93602447502430fcdaaa6c73aad7).
[CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:20>),
assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Ensuring all FileSystem streams are
closed for task CHAIN MapPartition (MapPartition at [6]{Create, Map(<lambda at
<string>:20>), assert_that}) -> FlatMap (FlatMap at ExtractOutput[0]) (1/1)
(9a5e93602447502430fcdaaa6c73aad7) [FINISHED]
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Un-registering task and
sending final execution state FINISHED to JobManager for task CHAIN
MapPartition (MapPartition at [6]{Create, Map(<lambda at <string>:20>),
assert_that}) -> FlatMap (FlatMap at ExtractOutput[0])
9a5e93602447502430fcdaaa6c73aad7.
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - CHAIN MapPartition
(MapPartition at [6]{Create, Map(<lambda at <string>:20>), assert_that}) ->
FlatMap (FlatMap at ExtractOutput[0]) (1/1) (9a5e93602447502430fcdaaa6c73aad7)
switched from RUNNING to FINISHED.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce
(GroupReduce at assert_that/Group/GroupByKey) (1/1)
(f34591ac0c7f348131d8662a3ce3cd65) switched from CREATED to SCHEDULED.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce
(GroupReduce at assert_that/Group/GroupByKey) (1/1)
(f34591ac0c7f348131d8662a3ce3cd65) switched from SCHEDULED to DEPLOYING.
[flink-akka.actor.default-dispatcher-8] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - Deploying GroupReduce
(GroupReduce at assert_that/Group/GroupByKey) (1/1) (attempt #0) to
194d57cf-e87a-41f0-b7a7-35e4b54ca700 @ localhost (dataPort=-1)
[flink-akka.actor.default-dispatcher-11] INFO
org.apache.flink.runtime.taskexecutor.TaskExecutor - Received task GroupReduce
(GroupReduce at assert_that/Group/GroupByKey) (1/1).
[GroupReduce (GroupReduce at assert_that/Group/GroupByKey) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - GroupReduce (GroupReduce at
assert_that/Group/GroupByKey) (1/1) (f34591ac0c7f348131d8662a3ce3cd65) switched
from CREATED to DEPLOYING.
[GroupReduce (GroupReduce at assert_that/Group/GroupByKey) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Creating FileSystem stream leak
safety net for task GroupReduce (GroupReduce at assert_that/Group/GroupByKey)
(1/1) (f34591ac0c7f348131d8662a3ce3cd65) [DEPLOYING]
[GroupReduce (GroupReduce at assert_that/Group/GroupByKey) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Loading JAR files for task
GroupReduce (GroupReduce at assert_that/Group/GroupByKey) (1/1)
(f34591ac0c7f348131d8662a3ce3cd65) [DEPLOYING].
[GroupReduce (GroupReduce at assert_that/Group/GroupByKey) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - Registering task at network:
GroupReduce (GroupReduce at assert_that/Group/GroupByKey) (1/1)
(f34591ac0c7f348131d8662a3ce3cd65) [DEPLOYING].
[GroupReduce (GroupReduce at assert_that/Group/GroupByKey) (1/1)] INFO
org.apache.flink.runtime.taskmanager.Task - GroupReduce (GroupReduce at
assert_that/Group/GroupByKey) (1/1) (f34591ac0c7f348131d8662a3ce3cd65) switched
from DEPLOYING to RUNNING.
[flink-akka.actor.default-dispatcher-12] INFO
org.apache.flink.runtime.executiongraph.ExecutionGraph - GroupReduce
(GroupReduce at assert_that/Group/GroupByKey) (1/1)
(f34591ac0c7f348131d8662a3ce3cd65) switched from DEPLOYING to RUNNING.
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine
(GroupCombine at GroupCombine: assert_that/Group/GroupByKey) -> Map (Key
Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - CHAIN Filter
(UnionFixFilter) -> Map (Key Extractor) -> GroupCombine (GroupCombine at
GroupCombine: assert_that/Group/GroupByKey) -> Map (Key Extractor) (1/1)
(6ac293d9c6aaa90c08cf46f07dc42985) switched from RUNNING to FINISHED.
[CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) -> GroupCombine
(GroupCombine at GroupCombine: assert_that/Group/GroupByKey) -> Map (Key
Extractor) (1/1)] INFO org.apache.flink.runtime.taskmanager.Task - Freeing task
resources for CHAIN Filter (UnionFixFilter) -> Map (Key Extractor) ->
GroupCombine (GroupCombine at GroupCombine: assert_that/Group/GroupByKey) ->
Map (Key Extractor) (1/1) (6ac293d9c6aaa90c08cf46f07dc42985).
OpenJDK 64-Bit Server VM warning: INFO: os::commit_memory(0x000000027f600000,
3382181888, 0) failed; error='Cannot allocate memory' (errno=12)
#
# There is insufficient memory for the Java Runtime Environment to continue.
# Native memory allocation (mmap) failed to map 3382181888 bytes for committing
reserved memory.
# An error report file with more information is saved as:
#
<https://builds.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/hs_err_pid23971.log>
rm -rf $ENV_DIR
rm -f $OUTPUT_JAR
>>> FAILURE
if [[ "$TEST_EXIT_CODE" -eq 0 ]]; then
echo ">>> SUCCESS"
else
echo ">>> FAILURE"
fi
exit $TEST_EXIT_CODE
> Task :runners:flink:1.9:job-server:testPipelineJar FAILED
FAILURE: Build failed with an exception.
* Where:
Script
'<https://builds.apache.org/job/beam_PostCommit_PortableJar_Flink/ws/src/runners/flink/job-server/flink_job_server.gradle'>
line: 188
* What went wrong:
Execution failed for task ':runners:flink:1.9:job-server:testPipelineJar'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 12m 19s
73 actionable tasks: 55 executed, 17 from cache, 1 up-to-date
Publishing build scan...
https://gradle.com/s/5ptakqfrs3nim
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
