See
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/121/display/redirect?page=changes>
Changes:
[swegner] Increase Dataflow max parallelism.
[alan.myrvold] Fix faling spark quickstart
[swegner] fixup! Improve comment
------------------------------------------
[...truncated 27.72 MB...]
Apr 17, 2018 6:08:18 PM com.datatorrent.stram.engine.Node emitEndStream
INFO: 17 sending EndOfStream
Apr 17, 2018 6:08:18 PM com.datatorrent.stram.engine.Node emitEndStream
INFO: 18 sending EndOfStream
Apr 17, 2018 6:08:18 PM com.datatorrent.stram.engine.Node emitEndStream
INFO: 19 sending EndOfStream
Apr 17, 2018 6:08:18 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:19 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:19 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:19 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:19 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:19 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:19 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:19 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:19 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:19 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:19 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:19 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:19 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:19 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:19 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:19 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:19 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:19 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:19 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:19 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:19 PM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Undeploy request: [14]
Apr 17, 2018 6:08:19 PM com.datatorrent.stram.engine.StreamingContainer
undeploy
INFO: Undeploy complete.
Apr 17, 2018 6:08:19 PM com.datatorrent.bufferserver.server.Server$3 run
INFO: Removing ln
LogicalNode@345cc9b5identifier=tcp://localhost:42596/14.output.14,
upstream=14.output.14, group=stream17/15.input, partitions=[],
iterator=com.datatorrent.bufferserver.internal.DataList$DataListIterator@105988eb{da=com.datatorrent.bufferserver.internal.DataList$Block@93ec2e4{identifier=14.output.14,
data=1048576, readingOffset=0, writingOffset=245,
starting_window=5ad6380d00000001, ending_window=5ad6380d00000007, refCount=2,
uniqueIdentifier=0, next=null, future=null}}} from dl
com.datatorrent.bufferserver.internal.DataList@2b6f59bc {14.output.14}
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Undeploy request: [16, 17, 18, 19, 15]
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.engine.StreamingContainer
undeploy
INFO: Undeploy complete.
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Undeploy request: [1]
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.engine.StreamingContainer
undeploy
INFO: Undeploy complete.
Apr 17, 2018 6:08:20 PM com.datatorrent.bufferserver.server.Server$3 run
INFO: Removing ln
LogicalNode@503d8e28identifier=tcp://localhost:42596/1.output.1,
upstream=1.output.1, group=stream6/2.input, partitions=[],
iterator=com.datatorrent.bufferserver.internal.DataList$DataListIterator@319dc84a{da=com.datatorrent.bufferserver.internal.DataList$Block@6ddf0042{identifier=1.output.1,
data=1048576, readingOffset=0, writingOffset=291,
starting_window=5ad6380d00000001, ending_window=5ad6380d00000007, refCount=2,
uniqueIdentifier=0, next=null, future=null}}} from dl
com.datatorrent.bufferserver.internal.DataList@1209c6ff {1.output.1}
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Undeploy request: [11]
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.engine.StreamingContainer
undeploy
INFO: Undeploy complete.
Apr 17, 2018 6:08:20 PM com.datatorrent.bufferserver.server.Server$3 run
INFO: Removing ln
LogicalNode@19b7bdcaidentifier=tcp://localhost:42596/11.outputPort.11,
upstream=11.outputPort.11, group=stream2/13.data2, partitions=[],
iterator=com.datatorrent.bufferserver.internal.DataList$DataListIterator@437acfbb{da=com.datatorrent.bufferserver.internal.DataList$Block@1c7a8006{identifier=11.outputPort.11,
data=1048576, readingOffset=0, writingOffset=77,
starting_window=5ad6380d00000001, ending_window=5ad6380d00000002, refCount=2,
uniqueIdentifier=0, next=null, future=null}}} from dl
com.datatorrent.bufferserver.internal.DataList@9325edb {11.outputPort.11}
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Undeploy request: [13]
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.engine.StreamingContainer
undeploy
INFO: Undeploy complete.
Apr 17, 2018 6:08:20 PM com.datatorrent.bufferserver.server.Server$3 run
INFO: Removing ln
LogicalNode@7561c38eidentifier=tcp://localhost:42596/13.out.13,
upstream=13.out.13, group=stream12/14.input, partitions=[],
iterator=com.datatorrent.bufferserver.internal.DataList$DataListIterator@55d05f3c{da=com.datatorrent.bufferserver.internal.DataList$Block@4042552a{identifier=13.out.13,
data=1048576, readingOffset=0, writingOffset=263,
starting_window=5ad6380d00000001, ending_window=5ad6380d00000007, refCount=2,
uniqueIdentifier=0, next=null, future=null}}} from dl
com.datatorrent.bufferserver.internal.DataList@8709794 {13.out.13}
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Undeploy request: [10]
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.engine.StreamingContainer
undeploy
INFO: Undeploy complete.
Apr 17, 2018 6:08:20 PM com.datatorrent.bufferserver.server.Server$3 run
INFO: Removing ln
LogicalNode@522de3fidentifier=tcp://localhost:42596/10.output.9,
upstream=10.output.9, group=stream0/11.inputPort, partitions=[],
iterator=com.datatorrent.bufferserver.internal.DataList$DataListIterator@132fd4c7{da=com.datatorrent.bufferserver.internal.DataList$Block@44515021{identifier=10.output.9,
data=1048576, readingOffset=0, writingOffset=77,
starting_window=5ad6380d00000001, ending_window=5ad6380d00000002, refCount=2,
uniqueIdentifier=0, next=null, future=null}}} from dl
com.datatorrent.bufferserver.internal.DataList@16e8a684 {10.output.9}
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Undeploy request: [2, 3, 4, 5, 6]
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.engine.StreamingContainer
undeploy
INFO: Undeploy complete.
Apr 17, 2018 6:08:20 PM com.datatorrent.bufferserver.server.Server$3 run
INFO: Removing ln
LogicalNode@444bb6a2identifier=tcp://localhost:42596/6.outputPort.6,
upstream=6.outputPort.6, group=stream1/7.input, partitions=[],
iterator=com.datatorrent.bufferserver.internal.DataList$DataListIterator@1aa84ffa{da=com.datatorrent.bufferserver.internal.DataList$Block@77cc2984{identifier=6.outputPort.6,
data=1048576, readingOffset=0, writingOffset=357,
starting_window=5ad6380d00000001, ending_window=5ad6380d00000007, refCount=2,
uniqueIdentifier=0, next=null, future=null}}} from dl
com.datatorrent.bufferserver.internal.DataList@3952bf04 {6.outputPort.6}
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Undeploy request: [7]
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.engine.StreamingContainer
undeploy
INFO: Undeploy complete.
Apr 17, 2018 6:08:20 PM com.datatorrent.bufferserver.server.Server$3 run
INFO: Removing ln
LogicalNode@40cb5477identifier=tcp://localhost:42596/7.output.7,
upstream=7.output.7, group=stream4/8.input, partitions=[],
iterator=com.datatorrent.bufferserver.internal.DataList$DataListIterator@6a5df22c{da=com.datatorrent.bufferserver.internal.DataList$Block@32d2b702{identifier=7.output.7,
data=1048576, readingOffset=0, writingOffset=237,
starting_window=5ad6380d00000001, ending_window=5ad6380d00000007, refCount=2,
uniqueIdentifier=0, next=null, future=null}}} from dl
com.datatorrent.bufferserver.internal.DataList@24c438d5 {7.output.7}
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.Journal write
WARNING: Journal output stream is null. Skipping write to the WAL.
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Undeploy request: [8, 9, 12]
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.engine.StreamingContainer
undeploy
INFO: Undeploy complete.
Apr 17, 2018 6:08:20 PM com.datatorrent.bufferserver.server.Server$3 run
INFO: Removing ln
LogicalNode@af7498didentifier=tcp://localhost:42596/12.output.12,
upstream=12.output.12, group=stream16/13.data1, partitions=[],
iterator=com.datatorrent.bufferserver.internal.DataList$DataListIterator@84219d6{da=com.datatorrent.bufferserver.internal.DataList$Block@d0b5660{identifier=12.output.12,
data=1048576, readingOffset=0, writingOffset=237,
starting_window=5ad6380d00000001, ending_window=5ad6380d00000007, refCount=2,
uniqueIdentifier=0, next=null, future=null}}} from dl
com.datatorrent.bufferserver.internal.DataList@2ac69a64 {12.output.12}
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.StreamingContainerManager
processHeartbeat
INFO: requesting idle shutdown for container container-8
Apr 17, 2018 6:08:20 PM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Received shutdown request type ABORT
Apr 17, 2018 6:08:20 PM
com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-8 msg: [container-8] Exiting heartbeat loop..
Apr 17, 2018 6:08:20 PM
com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Container container-8 terminating.
Apr 17, 2018 6:08:21 PM com.datatorrent.stram.StreamingContainerManager
processHeartbeat
INFO: requesting idle shutdown for container container-0
Apr 17, 2018 6:08:21 PM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Received shutdown request type ABORT
Apr 17, 2018 6:08:21 PM
com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-0 msg: [container-0] Exiting heartbeat loop..
Apr 17, 2018 6:08:21 PM
com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Container container-0 terminating.
Apr 17, 2018 6:08:21 PM com.datatorrent.stram.StreamingContainerManager
processHeartbeat
INFO: requesting idle shutdown for container container-1
Apr 17, 2018 6:08:21 PM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Received shutdown request type ABORT
Apr 17, 2018 6:08:21 PM
com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-1 msg: [container-1] Exiting heartbeat loop..
Apr 17, 2018 6:08:21 PM
com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Container container-1 terminating.
Apr 17, 2018 6:08:21 PM com.datatorrent.stram.StreamingContainerManager
processHeartbeat
INFO: requesting idle shutdown for container container-2
Apr 17, 2018 6:08:21 PM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Received shutdown request type ABORT
Apr 17, 2018 6:08:21 PM
com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-2 msg: [container-2] Exiting heartbeat loop..
Apr 17, 2018 6:08:21 PM
com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Container container-2 terminating.
Apr 17, 2018 6:08:21 PM com.datatorrent.stram.StreamingContainerManager
processHeartbeat
INFO: requesting idle shutdown for container container-4
Apr 17, 2018 6:08:21 PM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Received shutdown request type ABORT
Apr 17, 2018 6:08:21 PM
com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-4 msg: [container-4] Exiting heartbeat loop..
Apr 17, 2018 6:08:21 PM
com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Container container-4 terminating.
Apr 17, 2018 6:08:21 PM com.datatorrent.stram.StreamingContainerManager
processHeartbeat
INFO: requesting idle shutdown for container container-5
Apr 17, 2018 6:08:21 PM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Received shutdown request type ABORT
Apr 17, 2018 6:08:21 PM
com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-5 msg: [container-5] Exiting heartbeat loop..
Apr 17, 2018 6:08:21 PM
com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Container container-5 terminating.
Apr 17, 2018 6:08:21 PM com.datatorrent.stram.StreamingContainerManager
processHeartbeat
INFO: requesting idle shutdown for container container-3
Apr 17, 2018 6:08:21 PM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Received shutdown request type ABORT
Apr 17, 2018 6:08:21 PM
com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-3 msg: [container-3] Exiting heartbeat loop..
Apr 17, 2018 6:08:21 PM
com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Container container-3 terminating.
Apr 17, 2018 6:08:21 PM com.datatorrent.stram.StreamingContainerManager
processHeartbeat
INFO: requesting idle shutdown for container container-6
Apr 17, 2018 6:08:21 PM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Received shutdown request type ABORT
Apr 17, 2018 6:08:21 PM
com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-6 msg: [container-6] Exiting heartbeat loop..
Apr 17, 2018 6:08:21 PM
com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Container container-6 terminating.
Apr 17, 2018 6:08:21 PM com.datatorrent.stram.StreamingContainerManager
processHeartbeat
INFO: requesting idle shutdown for container container-7
Apr 17, 2018 6:08:21 PM com.datatorrent.stram.engine.StreamingContainer
processHeartbeatResponse
INFO: Received shutdown request type ABORT
Apr 17, 2018 6:08:21 PM
com.datatorrent.stram.StramLocalCluster$UmbilicalProtocolLocalImpl log
INFO: container-7 msg: [container-7] Exiting heartbeat loop..
Apr 17, 2018 6:08:21 PM
com.datatorrent.stram.StramLocalCluster$LocalStreamingContainerLauncher run
INFO: Container container-7 terminating.
Apr 17, 2018 6:08:21 PM com.datatorrent.stram.StramLocalCluster run
INFO: Application finished.
Apr 17, 2018 6:08:21 PM com.datatorrent.bufferserver.server.Server$1 run
INFO: Server stopped listening at /0.0.0.0:42596
Gradle Test Executor 1 finished executing tests.
260 tests completed, 1 failed, 1 skipped
Finished generating test XML results (1.318 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/ws/src/runners/apex/build/test-results/validatesRunnerBatch>
Generating HTML test report...
Finished generating test html results (1.298 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/ws/src/runners/apex/build/reports/tests/validatesRunnerBatch>
:beam-runners-apex:validatesRunnerBatch FAILED
:beam-runners-apex:validatesRunnerBatch (Thread[main,5,main]) completed. Took
45 mins 23.034 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':beam-runners-apex:validatesRunnerBatch'.
> There were failing tests. See the report at:
> file://<https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex_Gradle/ws/src/runners/apex/build/reports/tests/validatesRunnerBatch/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
See
https://docs.gradle.org/4.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 46m 59s
32 actionable tasks: 32 executed
Publishing build scan...
https://gradle.com/s/chhqgztm7b3y4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Recording test results
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
Not sending mail to unregistered user [email protected]
