See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Flink/7039/display/redirect?page=changes>
Changes:
[heejong] [BEAM-12051] fix target/go-licenses: no such file or directory
[Kyle Weaver] [BEAM-11483] Ignore windowed GBK tests in Spark portable
streaming.
[Kyle Weaver] [BEAM-12095] Fix Spark job server in uber jar path as well.
[kawaigin] [BEAM-12096] Attempt to fix flaky test
[kawaigin] Added logging of potential ImportError
[kawaigin] Use PropertyMock to replace the global singleton current_env()
[kawaigin] Changed warning logs about not in REPL env to error level and fixed a
[noreply] [BEAM-9547] Raise WontImplementError for a few more operations
(#14330)
[noreply] [BEAM-11544] BQML pattern (#13644)
[noreply] [BEAM-11574] Enable cross-language integration tests on Dataflow
[noreply] [BEAM-11585] Select.flattenedSchema doesn't flatten nested array
fields
[noreply] Updating Go tests on PR template. (#14442)
[noreply] [BEAM-7372] cleanup codes for py2 compatibility from
------------------------------------------
[...truncated 38.54 MB...]
"NAME": "event.bytes",
"PTRANSFORM":
"SessionSideInputJoin/SessionSideInputJoin.Monitor/ParMultiDo(Monitor)"
}
}, {
"urn": "beam:metric:user:sum_int64:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "oI0G",
"labels": {
"NAMESPACE": "SessionSideInputJoin.Events",
"NAME": "event.elements",
"PTRANSFORM":
"SessionSideInputJoin/SessionSideInputJoin.Monitor/ParMultiDo(Monitor)"
}
}, {
"urn": "beam:metric:user:distribution_int64:v1",
"type": "beam:metrics:distribution_int64:v1",
"payload": "oI0GmNuH2rC8r58C1oSozYov+YiozYov",
"labels": {
"NAMESPACE": "SessionSideInputJoin.Events",
"NAME": "event.processingTime",
"PTRANSFORM":
"SessionSideInputJoin/SessionSideInputJoin.Monitor/ParMultiDo(Monitor)"
}
}, {
"urn": "beam:metric:user:distribution_int64:v1",
"type": "beam:metrics:distribution_int64:v1",
"payload": "oI0G4IfhsPven/8BgIiL+OgphtaL+Ogp",
"labels": {
"NAMESPACE": "SessionSideInputJoin.Events",
"NAME": "event.eventTimestamp",
"PTRANSFORM":
"SessionSideInputJoin/SessionSideInputJoin.Monitor/ParMultiDo(Monitor)"
}
}, {
"urn": "beam:metric:user:sum_int64:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "ueLgAw==",
"labels": {
"NAMESPACE": "SessionSideInputJoin.Results",
"NAME": "result.bytes",
"PTRANSFORM":
"SessionSideInputJoin/SessionSideInputJoin.Debug/ParMultiDo(Monitor)"
}
}, {
"urn": "beam:metric:user:sum_int64:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "4M4F",
"labels": {
"NAMESPACE": "SessionSideInputJoin.Results",
"NAME": "result.elements",
"PTRANSFORM":
"SessionSideInputJoin/SessionSideInputJoin.Debug/ParMultiDo(Monitor)"
}
}, {
"urn": "beam:metric:user:distribution_int64:v1",
"type": "beam:metrics:distribution_int64:v1",
"payload": "4M4FgN6Dj/mB6uoBo9iv+OgpxaWw+Ogp",
"labels": {
"NAMESPACE": "SessionSideInputJoin.Results",
"NAME": "result.eventTimestamp",
"PTRANSFORM":
"SessionSideInputJoin/SessionSideInputJoin.Debug/ParMultiDo(Monitor)"
}
}, {
"urn": "beam:metric:user:distribution_int64:v1",
"type": "beam:metrics:distribution_int64:v1",
"payload": "4M4F6+2vi9HlsIgC/YuozYovn5KozYov",
"labels": {
"NAMESPACE": "SessionSideInputJoin.Results",
"NAME": "result.processingTime",
"PTRANSFORM":
"SessionSideInputJoin/SessionSideInputJoin.Debug/ParMultiDo(Monitor)"
}
}, {
"urn": "beam:metric:user:sum_int64:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "4M4F",
"labels": {
"NAMESPACE": "SessionSideInputJoin",
"NAME": "discarded",
"PTRANSFORM": "SessionSideInputJoin.DevNull/ParMultiDo(Anonymous)"
}
}, {
"urn": "beam:metric:user:sum_int64:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "0A8=",
"labels": {
"NAMESPACE": "SessionSideInputJoin",
"NAME": "newPersons",
"PTRANSFORM":
"SessionSideInputJoin/SessionSideInputJoin.Snoop/ParMultiDo(Anonymous)"
}
}, {
"urn": "beam:metric:user:sum_int64:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "oI0G",
"labels": {
"NAMESPACE": "SessionSideInputJoin",
"NAME": "events",
"PTRANSFORM":
"SessionSideInputJoin/SessionSideInputJoin.Snoop/ParMultiDo(Anonymous)"
}
}, {
"urn": "beam:metric:user:sum_int64:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "8C4=",
"labels": {
"NAMESPACE": "SessionSideInputJoin",
"NAME": "newAuctions",
"PTRANSFORM":
"SessionSideInputJoin/SessionSideInputJoin.Snoop/ParMultiDo(Anonymous)"
}
}, {
"urn": "beam:metric:user:sum_int64:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "4M4F",
"labels": {
"NAMESPACE": "SessionSideInputJoin",
"NAME": "bids",
"PTRANSFORM":
"SessionSideInputJoin/SessionSideInputJoin.Snoop/ParMultiDo(Anonymous)"
}
}, {
"urn": "beam:metric:user:sum_int64:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "9AM=",
"labels": {
"NAMESPACE": "source",
"NAME": "elements_read",
"PTRANSFORM":
"NexmarkUtils.GenerateSideInputData/GenerateSequence/Read(BoundedCountingSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)/ProcessKeyedElements/SplittableParDoViaKeyedWorkItems.ProcessElements"
}
}, {
"urn": "beam:metric:user:sum_int64:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "4M4F",
"labels": {
"NAMESPACE": "SessionSideInputJoin",
"NAME": "records",
"PTRANSFORM": "SessionSideInputJoin.Format/ParMultiDo(Anonymous)"
}
}]
}
}
2021-04-07T00:09:56.280Z Waiting for main pipeline to 'finish'
2021-04-07T00:09:56.280Z DONE SessionSideInputJoin
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:4, state:ALLOCATED, resource profile:
ResourceProfile{managedMemory=8.000mb (8388608 bytes), networkMemory=4.000mb
(4194304 bytes)}, allocationId: 1c8ee2df30ac4373c1fca21e64bba173, jobId:
f3fe3f5208534acca04747fb4968da6a).
2021-04-07T00:09:56.283Z 1 samples not enough to calculate steady-state event
rate
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.taskexecutor.TaskExecutor$JobLeaderListenerImpl
jobManagerLostLeadership
INFO: JobManager for job f3fe3f5208534acca04747fb4968da6a with leader id
a58d84c0c3e9e99300fb259dbe74462b lost leadership.
Apr 07, 2021 12:09:56 AM org.apache.beam.sdk.testutils.metrics.MetricsReader
getCounterMetric
SEVERE: Failed to get metric fatal, from namespace SessionSideInputJoin
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:13, state:ALLOCATED, resource profile:
ResourceProfile{managedMemory=8.000mb (8388608 bytes), networkMemory=4.000mb
(4194304 bytes)}, allocationId: 4eb2e7cfbf7ce28969f33c16bb3dfb16, jobId:
f3fe3f5208534acca04747fb4968da6a).
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:15, state:ALLOCATED, resource profile:
ResourceProfile{managedMemory=8.000mb (8388608 bytes), networkMemory=4.000mb
(4194304 bytes)}, allocationId: c5a5ead99c250a8d11d894b1b9f6c7c0, jobId:
f3fe3f5208534acca04747fb4968da6a).
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:8, state:ALLOCATED, resource profile:
ResourceProfile{managedMemory=8.000mb (8388608 bytes), networkMemory=4.000mb
(4194304 bytes)}, allocationId: 17bd6b646cf4dd34e5154045fefca9d9, jobId:
f3fe3f5208534acca04747fb4968da6a).
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:12, state:ALLOCATED, resource profile:
ResourceProfile{managedMemory=8.000mb (8388608 bytes), networkMemory=4.000mb
(4194304 bytes)}, allocationId: d07de40f51dc0b82fa904e785b0da2e4, jobId:
f3fe3f5208534acca04747fb4968da6a).
Apr 07, 2021 12:09:56 AM org.apache.flink.runtime.webmonitor.WebMonitorEndpoint
lambda$shutDownInternal$5
INFO: Removing cache directory /tmp/flink-web-ui
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:11, state:ALLOCATED, resource profile:
ResourceProfile{managedMemory=8.000mb (8388608 bytes), networkMemory=4.000mb
(4194304 bytes)}, allocationId: d0e5e574b4ca9321e2a261a095650712, jobId:
f3fe3f5208534acca04747fb4968da6a).
Apr 07, 2021 12:09:56 AM org.apache.flink.runtime.rest.RestServerEndpoint
lambda$closeAsync$1
INFO: Shut down complete.
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:1, state:ALLOCATED, resource profile:
ResourceProfile{managedMemory=8.000mb (8388608 bytes), networkMemory=4.000mb
(4194304 bytes)}, allocationId: 052a73da26e8305fd3fabd5f53f75cc5, jobId:
f3fe3f5208534acca04747fb4968da6a).
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.resourcemanager.ResourceManager deregisterApplication
INFO: Shut down cluster because application is in CANCELED, diagnostics
DispatcherResourceManagerComponent has been closed..
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:14, state:ALLOCATED, resource profile:
ResourceProfile{managedMemory=8.000mb (8388608 bytes), networkMemory=4.000mb
(4194304 bytes)}, allocationId: d4eb23fb8fe5faec1e044b3aae25bb57, jobId:
f3fe3f5208534acca04747fb4968da6a).
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.entrypoint.component.DispatcherResourceManagerComponent
closeAsyncInternal
INFO: Closing components.
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:2, state:ALLOCATED, resource profile:
ResourceProfile{managedMemory=8.000mb (8388608 bytes), networkMemory=4.000mb
(4194304 bytes)}, allocationId: 161556e70d30e775c0d3e8066ab59181, jobId:
f3fe3f5208534acca04747fb4968da6a).
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess
closeInternal
INFO: Stopping SessionDispatcherLeaderProcess.
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:6, state:ALLOCATED, resource profile:
ResourceProfile{managedMemory=8.000mb (8388608 bytes), networkMemory=4.000mb
(4194304 bytes)}, allocationId: 04680e2647a7da3408a833bd094b4994, jobId:
f3fe3f5208534acca04747fb4968da6a).
Apr 07, 2021 12:09:56 AM org.apache.flink.runtime.dispatcher.Dispatcher onStop
INFO: Stopping dispatcher akka://flink/user/rpc/dispatcher_58.
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl close
INFO: Closing the SlotManager.
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:9, state:ALLOCATED, resource profile:
ResourceProfile{managedMemory=8.000mb (8388608 bytes), networkMemory=4.000mb
(4194304 bytes)}, allocationId: 6c2fccb52c97b40530c2c4ce8dabf1f8, jobId:
f3fe3f5208534acca04747fb4968da6a).
Apr 07, 2021 12:09:56 AM org.apache.flink.runtime.dispatcher.Dispatcher
terminateRunningJobs
INFO: Stopping all currently running jobs of dispatcher
akka://flink/user/rpc/dispatcher_58.
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.resourcemanager.slotmanager.SlotManagerImpl suspend
INFO: Suspending the SlotManager.
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:5, state:ALLOCATED, resource profile:
ResourceProfile{managedMemory=8.000mb (8388608 bytes), networkMemory=4.000mb
(4194304 bytes)}, allocationId: 00ce84a81de62d4b71adf6244cc7221f, jobId:
f3fe3f5208534acca04747fb4968da6a).
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:0, state:ALLOCATED, resource profile:
ResourceProfile{managedMemory=8.000mb (8388608 bytes), networkMemory=4.000mb
(4194304 bytes)}, allocationId: 943059bd3a35561257f32ad6504d8d3e, jobId:
f3fe3f5208534acca04747fb4968da6a).
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:3, state:ALLOCATED, resource profile:
ResourceProfile{managedMemory=8.000mb (8388608 bytes), networkMemory=4.000mb
(4194304 bytes)}, allocationId: 546e66a7dd3cf16f1b57d1ddfda220ee, jobId:
f3fe3f5208534acca04747fb4968da6a).
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.rest.handler.legacy.backpressure.BackPressureRequestCoordinator
shutDown
INFO: Shutting down back pressure request coordinator.
Apr 07, 2021 12:09:56 AM org.apache.flink.runtime.dispatcher.Dispatcher
lambda$onStop$0
INFO: Stopped dispatcher akka://flink/user/rpc/dispatcher_58.
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:7, state:ALLOCATED, resource profile:
ResourceProfile{managedMemory=8.000mb (8388608 bytes), networkMemory=4.000mb
(4194304 bytes)}, allocationId: 4224b05f77b98af61a403ba2f4a9f043, jobId:
f3fe3f5208534acca04747fb4968da6a).
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO: Stop job leader service.
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.state.TaskExecutorLocalStateStoresManager shutdown
INFO: Shutting down TaskExecutorLocalStateStoresManager.
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO: FileChannelManager removed spill file directory
/tmp/flink-io-220b92d9-b120-44b5-b3a9-ad6ff238a111
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.io.network.NettyShuffleEnvironment close
INFO: Shutting down the network environment and its components.
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.io.disk.FileChannelManagerImpl lambda$getFileCloser$0
INFO: FileChannelManager removed spill file directory
/tmp/flink-netty-shuffle-e4b05d62-309a-4648-bd8b-519ffdadc549
Apr 07, 2021 12:09:56 AM org.apache.flink.runtime.taskexecutor.KvStateService
shutdown
INFO: Shutting down the kvState service and its components.
Apr 07, 2021 12:09:56 AM
org.apache.flink.runtime.taskexecutor.DefaultJobLeaderService stop
INFO: Stop job leader service.
Apr 07, 2021 12:09:56 AM org.apache.flink.runtime.filecache.FileCache shutdown
INFO: removed file cache directory
/tmp/flink-dist-cache-f90c092d-3b83-4f94-90ed-48b127bcc6cb
Apr 07, 2021 12:09:56 AM org.apache.flink.runtime.taskexecutor.TaskExecutor
handleOnStopException
INFO: Stopped TaskExecutor akka://flink/user/rpc/taskmanager_56.
Apr 07, 2021 12:09:56 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService
stopService
INFO: Stopping Akka RPC service.
Apr 07, 2021 12:09:56 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService
stopService
INFO: Stopping Akka RPC service.
Apr 07, 2021 12:09:56 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService
lambda$stopService$7
INFO: Stopped Akka RPC service.
Apr 07, 2021 12:09:56 AM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Apr 07, 2021 12:09:56 AM org.apache.flink.runtime.blob.AbstractBlobCache close
INFO: Shutting down BLOB cache
Apr 07, 2021 12:09:56 AM org.apache.flink.runtime.blob.BlobServer close
INFO: Stopped BLOB server at 0.0.0.0:38489
Apr 07, 2021 12:09:56 AM org.apache.flink.runtime.rpc.akka.AkkaRpcService
lambda$stopService$7
INFO: Stopped Akka RPC service.
> Task :sdks:java:testing:nexmark:run FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:testing:nexmark:run'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 33s
112 actionable tasks: 2 executed, 110 up-to-date
Publishing build scan...
https://gradle.com/s/upchz7z2jcqc2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
