See
<https://ci-beam.apache.org/job/beam_PostRelease_NightlySnapshot/1362/display/redirect>
Changes:
------------------------------------------
[...truncated 4.01 MB...]
May 03, 2021 11:23:27 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-03T11:23:26.914Z: Fusing consumer
ExtractUserScore/Combine.perKey(SumInteger)/GroupByKey/Write into
ExtractUserScore/Combine.perKey(SumInteger)/GroupByKey/Reify
May 03, 2021 11:23:27 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-03T11:23:26.950Z: Fusing consumer
ExtractUserScore/Combine.perKey(SumInteger)/Combine.GroupedValues into
ExtractUserScore/Combine.perKey(SumInteger)/GroupByKey/Read
May 03, 2021 11:23:27 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-03T11:23:26.971Z: Fusing consumer
ExtractUserScore/Combine.perKey(SumInteger)/Combine.GroupedValues/Extract into
ExtractUserScore/Combine.perKey(SumInteger)/Combine.GroupedValues
May 03, 2021 11:23:27 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-03T11:23:26.995Z: Fusing consumer WriteUserScoreSums/ConvertToRow
into ExtractUserScore/Combine.perKey(SumInteger)/Combine.GroupedValues/Extract
May 03, 2021 11:23:27 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-03T11:23:27.019Z: Fusing consumer
WriteUserScoreSums/TextIO.Write/WriteFiles/RewindowIntoGlobal/Window.Assign
into WriteUserScoreSums/ConvertToRow
May 03, 2021 11:23:27 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-03T11:23:27.052Z: Fusing consumer
WriteUserScoreSums/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles
into
WriteUserScoreSums/TextIO.Write/WriteFiles/RewindowIntoGlobal/Window.Assign
May 03, 2021 11:23:27 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-03T11:23:27.107Z: Fusing consumer
WriteUserScoreSums/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify
into
WriteUserScoreSums/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles
> Task :runners:direct-java:runQuickstartJavaDirect
May 03, 2021 11:23:29 AM org.apache.beam.sdk.io.FileBasedSource
getEstimatedSizeBytes
INFO: Filepattern pom.xml matched 1 files with total size 16568
May 03, 2021 11:23:29 AM org.apache.beam.sdk.io.FileBasedSource split
INFO: Splitting filepattern pom.xml into bundles of size 828 took 1 ms and
produced 1 files and 20 bundles
May 03, 2021 11:23:34 AM
org.apache.beam.sdk.io.WriteFiles$WriteShardsIntoTempFilesFn processElement
INFO: Opening writer 6bc03c07-5a35-4932-a8dc-33be01e61526 for window
org.apache.beam.sdk.transforms.windowing.GlobalWindow@66c883f7 pane
PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0}
destination null
May 03, 2021 11:23:34 AM
org.apache.beam.sdk.io.WriteFiles$WriteShardsIntoTempFilesFn processElement
INFO: Opening writer e25e088d-c5ae-4813-852b-e65b0430ba9c for window
org.apache.beam.sdk.transforms.windowing.GlobalWindow@66c883f7 pane
PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0}
destination null
May 03, 2021 11:23:34 AM
org.apache.beam.sdk.io.WriteFiles$WriteShardsIntoTempFilesFn processElement
INFO: Opening writer 709fade0-95c9-4c6b-81de-389e37734e3b for window
org.apache.beam.sdk.transforms.windowing.GlobalWindow@66c883f7 pane
PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0}
destination null
May 03, 2021 11:23:34 AM
org.apache.beam.sdk.io.WriteFiles$WriteShardsIntoTempFilesFn processElement
INFO: Opening writer 9578c5ff-146b-4194-a672-0447845bc0a7 for window
org.apache.beam.sdk.transforms.windowing.GlobalWindow@66c883f7 pane
PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0, onTimeIndex=0}
destination null
May 03, 2021 11:23:34 AM org.apache.beam.sdk.io.FileBasedSink$Writer close
INFO: Successfully wrote temporary file
/tmp/groovy-generated-2128296651866507227-tmpdir/word-count-beam/.temp-beam-4ea97ef0-f27c-43f9-9a82-cf6cd53bf725/709fade0-95c9-4c6b-81de-389e37734e3b
May 03, 2021 11:23:34 AM org.apache.beam.sdk.io.FileBasedSink$Writer close
INFO: Successfully wrote temporary file
/tmp/groovy-generated-2128296651866507227-tmpdir/word-count-beam/.temp-beam-4ea97ef0-f27c-43f9-9a82-cf6cd53bf725/9578c5ff-146b-4194-a672-0447845bc0a7
May 03, 2021 11:23:34 AM org.apache.beam.sdk.io.FileBasedSink$Writer close
INFO: Successfully wrote temporary file
/tmp/groovy-generated-2128296651866507227-tmpdir/word-count-beam/.temp-beam-4ea97ef0-f27c-43f9-9a82-cf6cd53bf725/e25e088d-c5ae-4813-852b-e65b0430ba9c
May 03, 2021 11:23:34 AM org.apache.beam.sdk.io.FileBasedSink$Writer close
INFO: Successfully wrote temporary file
/tmp/groovy-generated-2128296651866507227-tmpdir/word-count-beam/.temp-beam-4ea97ef0-f27c-43f9-9a82-cf6cd53bf725/6bc03c07-5a35-4932-a8dc-33be01e61526
May 03, 2021 11:23:34 AM
org.apache.beam.sdk.io.WriteFiles$FinalizeTempFileBundles$FinalizeFn process
INFO: Finalizing 4 file results
May 03, 2021 11:23:34 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
createMissingEmptyShards
INFO: Finalizing for destination null num shards 4.
May 03, 2021 11:23:34 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
moveToOutputFiles
INFO: Will copy temporary file
FileResult{tempFilename=/tmp/groovy-generated-2128296651866507227-tmpdir/word-count-beam/.temp-beam-4ea97ef0-f27c-43f9-9a82-cf6cd53bf725/6bc03c07-5a35-4932-a8dc-33be01e61526,
shard=3,
window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@66c883f7,
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0,
onTimeIndex=0}} to final location
/tmp/groovy-generated-2128296651866507227-tmpdir/word-count-beam/counts-00003-of-00004
May 03, 2021 11:23:34 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
moveToOutputFiles
INFO: Will copy temporary file
FileResult{tempFilename=/tmp/groovy-generated-2128296651866507227-tmpdir/word-count-beam/.temp-beam-4ea97ef0-f27c-43f9-9a82-cf6cd53bf725/e25e088d-c5ae-4813-852b-e65b0430ba9c,
shard=1,
window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@66c883f7,
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0,
onTimeIndex=0}} to final location
/tmp/groovy-generated-2128296651866507227-tmpdir/word-count-beam/counts-00001-of-00004
May 03, 2021 11:23:34 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
moveToOutputFiles
INFO: Will copy temporary file
FileResult{tempFilename=/tmp/groovy-generated-2128296651866507227-tmpdir/word-count-beam/.temp-beam-4ea97ef0-f27c-43f9-9a82-cf6cd53bf725/9578c5ff-146b-4194-a672-0447845bc0a7,
shard=0,
window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@66c883f7,
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0,
onTimeIndex=0}} to final location
/tmp/groovy-generated-2128296651866507227-tmpdir/word-count-beam/counts-00000-of-00004
May 03, 2021 11:23:34 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
moveToOutputFiles
INFO: Will copy temporary file
FileResult{tempFilename=/tmp/groovy-generated-2128296651866507227-tmpdir/word-count-beam/.temp-beam-4ea97ef0-f27c-43f9-9a82-cf6cd53bf725/709fade0-95c9-4c6b-81de-389e37734e3b,
shard=2,
window=org.apache.beam.sdk.transforms.windowing.GlobalWindow@66c883f7,
paneInfo=PaneInfo{isFirst=true, isLast=true, timing=ON_TIME, index=0,
onTimeIndex=0}} to final location
/tmp/groovy-generated-2128296651866507227-tmpdir/word-count-beam/counts-00002-of-00004
May 03, 2021 11:23:34 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
removeTemporaryFiles
INFO: Will remove known temporary file
/tmp/groovy-generated-2128296651866507227-tmpdir/word-count-beam/.temp-beam-4ea97ef0-f27c-43f9-9a82-cf6cd53bf725/e25e088d-c5ae-4813-852b-e65b0430ba9c
May 03, 2021 11:23:34 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
removeTemporaryFiles
INFO: Will remove known temporary file
/tmp/groovy-generated-2128296651866507227-tmpdir/word-count-beam/.temp-beam-4ea97ef0-f27c-43f9-9a82-cf6cd53bf725/709fade0-95c9-4c6b-81de-389e37734e3b
May 03, 2021 11:23:34 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
removeTemporaryFiles
INFO: Will remove known temporary file
/tmp/groovy-generated-2128296651866507227-tmpdir/word-count-beam/.temp-beam-4ea97ef0-f27c-43f9-9a82-cf6cd53bf725/6bc03c07-5a35-4932-a8dc-33be01e61526
May 03, 2021 11:23:34 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
removeTemporaryFiles
INFO: Will remove known temporary file
/tmp/groovy-generated-2128296651866507227-tmpdir/word-count-beam/.temp-beam-4ea97ef0-f27c-43f9-9a82-cf6cd53bf725/9578c5ff-146b-4194-a672-0447845bc0a7
May 03, 2021 11:23:34 AM org.apache.beam.sdk.io.FileBasedSink$WriteOperation
removeTemporaryFiles
WARNING: Failed to match temporary files under:
[/tmp/groovy-generated-2128296651866507227-tmpdir/word-count-beam/.temp-beam-4ea97ef0-f27c-43f9-9a82-cf6cd53bf725/].
grep Foundation counts*
counts-00001-of-00004:Foundation: 1
Verified Foundation: 1
[SUCCESS]
> Task :runners:google-cloud-dataflow-java:runMobileGamingJavaDataflow
May 03, 2021 11:23:29 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-03T11:23:27.135Z: Fusing consumer
WriteUserScoreSums/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write
into
WriteUserScoreSums/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify
May 03, 2021 11:23:29 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-03T11:23:27.176Z: Fusing consumer
WriteUserScoreSums/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow
into
WriteUserScoreSums/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Read
May 03, 2021 11:23:29 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-03T11:23:27.221Z: Fusing consumer
WriteUserScoreSums/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten
into
WriteUserScoreSums/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/GroupUnwritten/GroupByWindow
May 03, 2021 11:23:29 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-03T11:23:27.276Z: Fusing consumer
WriteUserScoreSums/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/DropShardNum
into
WriteUserScoreSums/TextIO.Write/WriteFiles/WriteUnshardedBundlesToTempFiles/WriteUnwritten
May 03, 2021 11:23:29 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-03T11:23:27.705Z: Executing operation
ExtractUserScore/Combine.perKey(SumInteger)/GroupByKey/Create
May 03, 2021 11:23:29 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-03T11:23:27.777Z: Starting 1 workers in us-central1-f...
May 03, 2021 11:23:29 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-03T11:23:28.095Z: Finished operation
ExtractUserScore/Combine.perKey(SumInteger)/GroupByKey/Create
May 03, 2021 11:23:29 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-03T11:23:28.253Z: Executing operation
TextIO.Read/Read+ParseGameEvent+ExtractUserScore/MapElements/Map+ExtractUserScore/Combine.perKey(SumInteger)/GroupByKey+ExtractUserScore/Combine.perKey(SumInteger)/Combine.GroupedValues/Partial+ExtractUserScore/Combine.perKey(SumInteger)/GroupByKey/Reify+ExtractUserScore/Combine.perKey(SumInteger)/GroupByKey/Write
May 03, 2021 11:23:34 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-03T11:23:32.841Z: Your project already contains 100
Dataflow-created metric descriptors, so new user metrics of the form
custom.googleapis.com/* will not be created. However, all user metrics are also
available in the metric dataflow.googleapis.com/job/user_counter. If you rely
on the custom metrics, you can delete old / unused metric descriptors. See
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.list
and
https://developers.google.com/apis-explorer/#p/monitoring/v3/monitoring.projects.metricDescriptors.delete
May 03, 2021 11:24:18 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-03T11:24:18.268Z: Autoscaling: Raised the number of workers to 1
based on the rate of progress in the currently running stage(s).
May 03, 2021 11:24:58 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-03T11:24:57.168Z: Workers have started successfully.
May 03, 2021 11:24:58 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-03T11:24:57.205Z: Workers have started successfully.
May 03, 2021 11:25:09 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-05-03T11:25:08.022Z: java.lang.NoClassDefFoundError:
org/apache/beam/sdk/metrics/MetricsLogger
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at
org.apache.beam.runners.dataflow.worker.BatchModeExecutionContext$1.createContainer(BatchModeExecutionContext.java:106)
at
org.apache.beam.runners.dataflow.worker.BatchModeExecutionContext$1.createContainer(BatchModeExecutionContext.java:103)
at
org.apache.beam.runners.dataflow.worker.MetricsContainerRegistry.lambda$getContainer$0(MetricsContainerRegistry.java:39)
at
java.util.concurrent.ConcurrentSkipListMap.computeIfAbsent(ConcurrentSkipListMap.java:1682)
at
org.apache.beam.runners.dataflow.worker.MetricsContainerRegistry.getContainer(MetricsContainerRegistry.java:39)
at
org.apache.beam.runners.dataflow.worker.DataflowExecutionContext.createOperationContext(DataflowExecutionContext.java:212)
at
org.apache.beam.runners.dataflow.worker.SourceOperationExecutorFactory.create(SourceOperationExecutorFactory.java:49)
at
org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:376)
at
org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:314)
at
org.apache.beam.runners.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.doWork(DataflowBatchWorkerHarness.java:140)
at
org.apache.beam.runners.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:120)
at
org.apache.beam.runners.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:107)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.ClassNotFoundException:
org.apache.beam.sdk.metrics.MetricsLogger
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 28 more
May 03, 2021 11:25:16 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-05-03T11:25:13.660Z: java.lang.NoClassDefFoundError:
org/apache/beam/runners/dataflow/worker/repackaged/org/apache/beam/runners/core/metrics/MetricsContainerImpl
at
org.apache.beam.runners.dataflow.worker.BatchModeExecutionContext$1.createContainer(BatchModeExecutionContext.java:106)
at
org.apache.beam.runners.dataflow.worker.BatchModeExecutionContext$1.createContainer(BatchModeExecutionContext.java:103)
at
org.apache.beam.runners.dataflow.worker.MetricsContainerRegistry.lambda$getContainer$0(MetricsContainerRegistry.java:39)
at
java.util.concurrent.ConcurrentSkipListMap.computeIfAbsent(ConcurrentSkipListMap.java:1682)
at
org.apache.beam.runners.dataflow.worker.MetricsContainerRegistry.getContainer(MetricsContainerRegistry.java:39)
at
org.apache.beam.runners.dataflow.worker.DataflowExecutionContext.createOperationContext(DataflowExecutionContext.java:212)
at
org.apache.beam.runners.dataflow.worker.SourceOperationExecutorFactory.create(SourceOperationExecutorFactory.java:49)
at
org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:376)
at
org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:314)
at
org.apache.beam.runners.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.doWork(DataflowBatchWorkerHarness.java:140)
at
org.apache.beam.runners.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:120)
at
org.apache.beam.runners.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:107)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
May 03, 2021 11:25:23 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-05-03T11:25:22.348Z: java.lang.NoClassDefFoundError:
org/apache/beam/runners/dataflow/worker/repackaged/org/apache/beam/runners/core/metrics/MetricsContainerImpl
at
org.apache.beam.runners.dataflow.worker.BatchModeExecutionContext$1.createContainer(BatchModeExecutionContext.java:106)
at
org.apache.beam.runners.dataflow.worker.BatchModeExecutionContext$1.createContainer(BatchModeExecutionContext.java:103)
at
org.apache.beam.runners.dataflow.worker.MetricsContainerRegistry.lambda$getContainer$0(MetricsContainerRegistry.java:39)
at
java.util.concurrent.ConcurrentSkipListMap.computeIfAbsent(ConcurrentSkipListMap.java:1682)
at
org.apache.beam.runners.dataflow.worker.MetricsContainerRegistry.getContainer(MetricsContainerRegistry.java:39)
at
org.apache.beam.runners.dataflow.worker.DataflowExecutionContext.createOperationContext(DataflowExecutionContext.java:212)
at
org.apache.beam.runners.dataflow.worker.SourceOperationExecutorFactory.create(SourceOperationExecutorFactory.java:49)
at
org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:376)
at
org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:314)
at
org.apache.beam.runners.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.doWork(DataflowBatchWorkerHarness.java:140)
at
org.apache.beam.runners.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:120)
at
org.apache.beam.runners.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:107)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
May 03, 2021 11:25:33 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-05-03T11:25:32.008Z: java.lang.NoClassDefFoundError:
org/apache/beam/runners/dataflow/worker/repackaged/org/apache/beam/runners/core/metrics/MetricsContainerImpl
at
org.apache.beam.runners.dataflow.worker.BatchModeExecutionContext$1.createContainer(BatchModeExecutionContext.java:106)
at
org.apache.beam.runners.dataflow.worker.BatchModeExecutionContext$1.createContainer(BatchModeExecutionContext.java:103)
at
org.apache.beam.runners.dataflow.worker.MetricsContainerRegistry.lambda$getContainer$0(MetricsContainerRegistry.java:39)
at
java.util.concurrent.ConcurrentSkipListMap.computeIfAbsent(ConcurrentSkipListMap.java:1682)
at
org.apache.beam.runners.dataflow.worker.MetricsContainerRegistry.getContainer(MetricsContainerRegistry.java:39)
at
org.apache.beam.runners.dataflow.worker.DataflowExecutionContext.createOperationContext(DataflowExecutionContext.java:212)
at
org.apache.beam.runners.dataflow.worker.SourceOperationExecutorFactory.create(SourceOperationExecutorFactory.java:49)
at
org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:376)
at
org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:314)
at
org.apache.beam.runners.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.doWork(DataflowBatchWorkerHarness.java:140)
at
org.apache.beam.runners.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:120)
at
org.apache.beam.runners.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:107)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
May 03, 2021 11:25:33 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-03T11:25:32.033Z: Finished operation
TextIO.Read/Read+ParseGameEvent+ExtractUserScore/MapElements/Map+ExtractUserScore/Combine.perKey(SumInteger)/GroupByKey+ExtractUserScore/Combine.perKey(SumInteger)/Combine.GroupedValues/Partial+ExtractUserScore/Combine.perKey(SumInteger)/GroupByKey/Reify+ExtractUserScore/Combine.perKey(SumInteger)/GroupByKey/Write
May 03, 2021 11:25:33 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2021-05-03T11:25:32.159Z: Workflow failed. Causes:
S02:TextIO.Read/Read+ParseGameEvent+ExtractUserScore/MapElements/Map+ExtractUserScore/Combine.perKey(SumInteger)/GroupByKey+ExtractUserScore/Combine.perKey(SumInteger)/Combine.GroupedValues/Partial+ExtractUserScore/Combine.perKey(SumInteger)/GroupByKey/Reify+ExtractUserScore/Combine.perKey(SumInteger)/GroupByKey/Write
failed., Internal Issue (387df2ddad001920): 63963027:24514
May 03, 2021 11:25:33 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-03T11:25:32.228Z: Cleaning up.
May 03, 2021 11:25:33 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-03T11:25:32.310Z: Stopping worker pool...
May 03, 2021 11:26:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-03T11:26:11.945Z: Autoscaling: Resized worker pool from 1 to 0.
May 03, 2021 11:26:12 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2021-05-03T11:26:11.988Z: Worker pool stopped.
May 03, 2021 11:26:24 AM org.apache.beam.runners.dataflow.DataflowPipelineJob
logTerminalState
INFO: Job 2021-05-03_04_23_13-9692232114645001839 failed with status FAILED.
gsutil cat
gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/java-userscore-result-dataflow-runner.txt*
| grep user19_BananaWallaby
CommandException: No URLs matched:
gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/java-userscore-result-dataflow-runner.txt*
CommandException: No URLs matched:
gs://temp-storage-for-release-validation-tests/nightly-snapshot-validation/java-userscore-result-dataflow-runner.txt*
[ERROR] Failed command
> Task :runners:google-cloud-dataflow-java:runMobileGamingJavaDataflow FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:runQuickstartJavaDataflow'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:runMobileGamingJavaDataflowBom'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:runMobileGamingJavaDataflow'.
> Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with
> non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 26m 7s
9 actionable tasks: 8 executed, 1 from cache
Publishing build scan...
https://gradle.com/s/ccf5amhwmwvua
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
