See
<https://builds.apache.org/job/beam_PostRelease_NightlySnapshot/125/display/redirect?page=changes>
Changes:
[klk] Add test for a trigger with windowed SQL query
[klk] Increase whitelist of false detections in SdkCoreApiSurfaceTest
[klk] Eliminate beam-model-fn-execution test-jar deps
[klk] Eliminate beam-sdks-java-fn-execution test-jar deps
[klk] Eliminate incorrect sdks-java-core test-jar deps
[klk] Notate uses of beam-runners-core-java test-jar
[aljoscha.krettek] Annotate ParDoTest.duplicateTimerSetting with UsesTestStream
------------------------------------------
[...truncated 2.51 MB...]
INFO: Finished task 3.0 in stage 2.0 (TID 11) in 97 ms on localhost (executor
driver) (4/8)
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Running task 7.0 in stage 2.0 (TID 15)
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Getting 0 non-empty blocks out of 4 blocks
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Started 0 remote fetches in 1 ms
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Getting 0 non-empty blocks out of 4 blocks
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Started 0 remote fetches in 0 ms
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Getting 0 non-empty blocks out of 4 blocks
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Started 0 remote fetches in 0 ms
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Getting 0 non-empty blocks out of 4 blocks
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Started 0 remote fetches in 0 ms
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block rdd_41_5 stored as values in memory (estimated size 16.0 B, free
1825.1 MB)
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block rdd_41_6 stored as values in memory (estimated size 16.0 B, free
1825.1 MB)
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block rdd_41_4 stored as values in memory (estimated size 16.0 B, free
1825.1 MB)
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Added rdd_41_5 in memory on 127.0.0.1:43056 (size: 16.0 B, free: 1825.4
MB)
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Added rdd_41_6 in memory on 127.0.0.1:43056 (size: 16.0 B, free: 1825.4
MB)
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Added rdd_41_4 in memory on 127.0.0.1:43056 (size: 16.0 B, free: 1825.4
MB)
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 6.0 in stage 2.0 (TID 14). 11942 bytes result sent to driver
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block rdd_41_7 stored as values in memory (estimated size 16.0 B, free
1825.1 MB)
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Added rdd_41_7 in memory on 127.0.0.1:43056 (size: 16.0 B, free: 1825.4
MB)
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 6.0 in stage 2.0 (TID 14) in 119 ms on localhost (executor
driver) (5/8)
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 7.0 in stage 2.0 (TID 15). 11942 bytes result sent to driver
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 5.0 in stage 2.0 (TID 13). 11942 bytes result sent to driver
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 4.0 in stage 2.0 (TID 12). 11942 bytes result sent to driver
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 7.0 in stage 2.0 (TID 15) in 116 ms on localhost (executor
driver) (6/8)
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 5.0 in stage 2.0 (TID 13) in 139 ms on localhost (executor
driver) (7/8)
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 4.0 in stage 2.0 (TID 12) in 140 ms on localhost (executor
driver) (8/8)
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Removed TaskSet 2.0, whose tasks have all completed, from pool
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: ResultStage 2 (collect at BoundedDataset.java:87) finished in 0.213 s
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Job 0 finished: collect at BoundedDataset.java:87, took 3.736539 s
Mar 13, 2018 11:05:14 AM org.apache.beam.runners.spark.SparkRunner$Evaluator
enterCompositeTransform
INFO: Entering directly-translatable composite transform:
'WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Create.Values'
Mar 13, 2018 11:05:14 AM org.apache.beam.runners.spark.SparkRunner$Evaluator
doVisitTransform
INFO: Evaluating Create.Values
Mar 13, 2018 11:05:14 AM org.apache.beam.runners.spark.SparkRunner$Evaluator
doVisitTransform
INFO: Evaluating org.apache.beam.sdk.transforms.Reify$ReifyView$1@61d37daf
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block broadcast_3 stored as values in memory (estimated size 672.0 B,
free 1825.1 MB)
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block broadcast_3_piece0 stored as bytes in memory (estimated size 361.0
B, free 1825.1 MB)
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Added broadcast_3_piece0 in memory on 127.0.0.1:43056 (size: 361.0 B,
free: 1825.4 MB)
Mar 13, 2018 11:05:14 AM org.apache.spark.internal.Logging$class logInfo
INFO: Created broadcast 3 from broadcast at SideInputBroadcast.java:59
Mar 13, 2018 11:05:14 AM org.apache.beam.runners.spark.SparkRunner$Evaluator
doVisitTransform
INFO: Evaluating org.apache.beam.sdk.transforms.MapElements$1@5d576d2c
Mar 13, 2018 11:05:14 AM org.apache.beam.runners.spark.SparkRunner$Evaluator
doVisitTransform
INFO: Evaluating
org.apache.beam.sdk.io.WriteFiles$FinalizeTempFileBundles$FinalizeFn@1370d37
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Starting job: foreach at BoundedDataset.java:117
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Got job 1 (foreach at BoundedDataset.java:117) with 4 output partitions
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Final stage: ResultStage 3 (foreach at BoundedDataset.java:117)
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Parents of final stage: List()
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Missing parents: List()
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Submitting ResultStage 3
(WriteCounts/WriteFiles/FinalizeTempFileBundles/Finalize/ParMultiDo(Finalize).output
MapPartitionsRDD[53] at values at TransformTranslator.java:400), which has no
missing parents
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block broadcast_4 stored as values in memory (estimated size 84.1 KB,
free 1825.0 MB)
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Block broadcast_4_piece0 stored as bytes in memory (estimated size 22.4
KB, free 1825.0 MB)
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Added broadcast_4_piece0 in memory on 127.0.0.1:43056 (size: 22.4 KB,
free: 1825.3 MB)
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Created broadcast 4 from broadcast at DAGScheduler.scala:1006
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Submitting 4 missing tasks from ResultStage 3
(WriteCounts/WriteFiles/FinalizeTempFileBundles/Finalize/ParMultiDo(Finalize).output
MapPartitionsRDD[53] at values at TransformTranslator.java:400) (first 15
tasks are for partitions Vector(0, 1, 2, 3))
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Adding task set 3.0 with 4 tasks
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Starting task 0.0 in stage 3.0 (TID 16, localhost, executor driver,
partition 0, PROCESS_LOCAL, 4827 bytes)
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Starting task 1.0 in stage 3.0 (TID 17, localhost, executor driver,
partition 1, PROCESS_LOCAL, 4827 bytes)
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Starting task 2.0 in stage 3.0 (TID 18, localhost, executor driver,
partition 2, PROCESS_LOCAL, 4827 bytes)
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Starting task 3.0 in stage 3.0 (TID 19, localhost, executor driver,
partition 3, PROCESS_LOCAL, 4837 bytes)
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Running task 0.0 in stage 3.0 (TID 16)
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Running task 2.0 in stage 3.0 (TID 18)
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Running task 3.0 in stage 3.0 (TID 19)
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Running task 1.0 in stage 3.0 (TID 17)
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 0.0 in stage 3.0 (TID 16). 12141 bytes result sent to driver
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 2.0 in stage 3.0 (TID 18). 12141 bytes result sent to driver
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 1.0 in stage 3.0 (TID 17). 12141 bytes result sent to driver
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 1.0 in stage 3.0 (TID 17) in 69 ms on localhost (executor
driver) (1/4)
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 0.0 in stage 3.0 (TID 16) in 74 ms on localhost (executor
driver) (2/4)
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 2.0 in stage 3.0 (TID 18) in 71 ms on localhost (executor
driver) (3/4)
Mar 13, 2018 11:05:15 AM
org.apache.beam.sdk.io.WriteFiles$FinalizeTempFileBundles$FinalizeFn process
INFO: Finalizing 4 file results
Mar 13, 2018 11:05:15 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
createMissingEmptyShards
INFO: Finalizing for destination null num shards 4.
Mar 13, 2018 11:05:15 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
moveToOutputFiles
INFO: Will copy temporary file
FileResult{tempFilename=/tmp/groovy-generated-2862961204884482974-tmpdir/word-count-beam/.temp-beam-2018-03-13_11-05-08-0/0ec0e93d-ebf8-4f4c-99d7-9671fca91dac,
shard=0,
window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@2b4182bb,
paneInfo=PaneInfo.NO_FIRING} to final location
/tmp/groovy-generated-2862961204884482974-tmpdir/word-count-beam/counts-00000-of-00004
Mar 13, 2018 11:05:15 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
moveToOutputFiles
INFO: Will copy temporary file
FileResult{tempFilename=/tmp/groovy-generated-2862961204884482974-tmpdir/word-count-beam/.temp-beam-2018-03-13_11-05-08-0/0270a536-27ac-415c-9369-36a9e198a353,
shard=1,
window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@2b4182bb,
paneInfo=PaneInfo.NO_FIRING} to final location
/tmp/groovy-generated-2862961204884482974-tmpdir/word-count-beam/counts-00001-of-00004
Mar 13, 2018 11:05:15 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
moveToOutputFiles
INFO: Will copy temporary file
FileResult{tempFilename=/tmp/groovy-generated-2862961204884482974-tmpdir/word-count-beam/.temp-beam-2018-03-13_11-05-08-0/f3d519be-0eca-4c79-8c19-0b77ce2e796a,
shard=2,
window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@2b4182bb,
paneInfo=PaneInfo.NO_FIRING} to final location
/tmp/groovy-generated-2862961204884482974-tmpdir/word-count-beam/counts-00002-of-00004
Mar 13, 2018 11:05:15 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
moveToOutputFiles
INFO: Will copy temporary file
FileResult{tempFilename=/tmp/groovy-generated-2862961204884482974-tmpdir/word-count-beam/.temp-beam-2018-03-13_11-05-08-0/f08d3712-3c45-405f-aa28-48506fefe473,
shard=3,
window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@2b4182bb,
paneInfo=PaneInfo.NO_FIRING} to final location
/tmp/groovy-generated-2862961204884482974-tmpdir/word-count-beam/counts-00003-of-00004
Mar 13, 2018 11:05:15 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
removeTemporaryFiles
INFO: Will remove known temporary file
/tmp/groovy-generated-2862961204884482974-tmpdir/word-count-beam/.temp-beam-2018-03-13_11-05-08-0/0270a536-27ac-415c-9369-36a9e198a353
Mar 13, 2018 11:05:15 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
removeTemporaryFiles
INFO: Will remove known temporary file
/tmp/groovy-generated-2862961204884482974-tmpdir/word-count-beam/.temp-beam-2018-03-13_11-05-08-0/0ec0e93d-ebf8-4f4c-99d7-9671fca91dac
Mar 13, 2018 11:05:15 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
removeTemporaryFiles
INFO: Will remove known temporary file
/tmp/groovy-generated-2862961204884482974-tmpdir/word-count-beam/.temp-beam-2018-03-13_11-05-08-0/f3d519be-0eca-4c79-8c19-0b77ce2e796a
Mar 13, 2018 11:05:15 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
removeTemporaryFiles
INFO: Will remove known temporary file
/tmp/groovy-generated-2862961204884482974-tmpdir/word-count-beam/.temp-beam-2018-03-13_11-05-08-0/f08d3712-3c45-405f-aa28-48506fefe473
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 3.0 in stage 3.0 (TID 19). 15889 bytes result sent to driver
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Finished task 3.0 in stage 3.0 (TID 19) in 126 ms on localhost (executor
driver) (4/4)
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Removed TaskSet 3.0, whose tasks have all completed, from pool
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: ResultStage 3 (foreach at BoundedDataset.java:117) finished in 0.131 s
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Job 1 finished: foreach at BoundedDataset.java:117, took 0.162042 s
Mar 13, 2018 11:05:15 AM org.apache.beam.runners.spark.SparkRunner lambda$run$1
INFO: Batch pipeline execution complete.
Mar 13, 2018 11:05:15 AM org.spark_project.jetty.server.AbstractConnector doStop
INFO: Stopped Spark@286b159{HTTP/1.1,[http/1.1]}{127.0.0.1:4040}
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Stopped Spark web UI at http://127.0.0.1:4040
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: MapOutputTrackerMasterEndpoint stopped!
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: MemoryStore cleared
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: BlockManager stopped
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: BlockManagerMaster stopped
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: OutputCommitCoordinator stopped!
Mar 13, 2018 11:05:15 AM org.apache.spark.internal.Logging$class logInfo
INFO: Successfully stopped SparkContext
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:43 min
[INFO] Finished at: 2018-03-13T11:05:15Z
[INFO] Final Memory: 97M/1279M
[INFO] ------------------------------------------------------------------------
grep Foundation counts*
counts-00000-of-00004:Foundation: 1
Verified Foundation: 1
[SUCCESS]
Mar 13, 2018 11:05:21 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-03-13T11:05:19.869Z: (b39923b0aea5cf7f): Executing operation
WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Close
Mar 13, 2018 11:05:21 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-03-13T11:05:19.939Z: (b39923b0aea5c957): Executing operation
WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Create
Mar 13, 2018 11:05:21 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-03-13T11:05:20.081Z: (b39923b0aea5c8e0): Executing operation
WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/GroupByKey/Read+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues+WordCount.CountWords/Count.PerElement/Combine.perKey(Count)/Combine.GroupedValues/Extract+MapElements/Map+WriteCounts/WriteFiles/RewindowIntoGlobal/Window.Assign+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles+WriteCounts/WriteFiles/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow)+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write
Mar 13, 2018 11:05:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-03-13T11:05:30.987Z: (50b9103aebfec0d2): Executing operation
WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Close
Mar 13, 2018 11:05:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-03-13T11:05:31.045Z: (b39923b0aea5c7f2): Executing operation
WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Read+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten+WriteCounts/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum+WriteCounts/WriteFiles/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow)
Mar 13, 2018 11:05:35 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-03-13T11:05:33.503Z: Executing operation s12-u31
Mar 13, 2018 11:05:35 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-03-13T11:05:33.794Z: Executing operation
WriteCounts/WriteFiles/GatherTempFileResults/View.AsList/CreateDataflowView
Mar 13, 2018 11:05:35 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-03-13T11:05:33.976Z: Executing operation
WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Create.Values/Read(CreateSource)+WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Reify.ReifyView/ParDo(Anonymous)+WriteCounts/WriteFiles/GatherTempFileResults/Reify.ReifyViewInGlobalWindow/Values/Values/Map+WriteCounts/WriteFiles/FinalizeTempFileBundles/Finalize
Mar 13, 2018 11:05:37 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-03-13T11:05:36.187Z: (e8ec32395c826f3f): Cleaning up.
Mar 13, 2018 11:05:37 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-03-13T11:05:36.271Z: (e8ec32395c82624d): Stopping worker pool...
Mar 13, 2018 11:08:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-03-13T11:07:59.824Z: (caf4e46451e0aa7c): Autoscaling: Resized worker
pool from 1 to 0.
Mar 13, 2018 11:08:01 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-03-13T11:07:59.845Z: (caf4e46451e0a862): Autoscaling: Would further
reduce the number of workers but reached the minimum number allowed for the job.
Mar 13, 2018 11:08:07 AM org.apache.beam.runners.dataflow.DataflowPipelineJob
waitUntilFinish
INFO: Job 2018-03-13_04_03_11-14329802875283228269 finished with status DONE.
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 06:13 min
[INFO] Finished at: 2018-03-13T11:08:07Z
[INFO] Final Memory: 53M/914M
[INFO] ------------------------------------------------------------------------
gsutil cat gs://temp-storage-for-release-validation-tests/quickstart/count* |
grep Montague:
Montague: 47
Verified Montague: 47
gsutil rm gs://temp-storage-for-release-validation-tests/quickstart/count*
Removing
gs://temp-storage-for-release-validation-tests/quickstart/counts-00000-of-00003...
/ [1 objects]
Removing
gs://temp-storage-for-release-validation-tests/quickstart/counts-00001-of-00003...
/ [2 objects]
Removing
gs://temp-storage-for-release-validation-tests/quickstart/counts-00002-of-00003...
/ [3 objects]
Operation completed over 3 objects.
[SUCCESS]
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':runners:apex:runQuickstartJavaApex'.
> Process 'command '/usr/local/asfpackages/java/jdk1.8.0_152/bin/java''
> finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 7m 8s
6 actionable tasks: 6 executed
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user aljoscha.kret...@gmail.com
Not sending mail to unregistered user k...@google.com
