See
<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/1271/display/redirect?page=changes>
Changes:
[pablo] Make .gitignore rules work correctly with rat.
------------------------------------------
[...truncated 19.62 MB...]
INFO: 2018-08-16T16:55:28.883Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as
view/GBKaSVForData/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as
view/ParMultiDo(ToIsmRecordForMapLike)+SpannerIO.Write/Write mutations to Cloud
Spanner/Keys sample as view/GBKaSVForSize/Write+SpannerIO.Write/Write mutations
to Cloud Spanner/Keys sample as view/GBKaSVForKeys/Write
Aug 16, 2018 4:55:36 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2018-08-16T16:55:33.515Z: java.io.IOException:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 410 Gone
{
"code" : 503,
"errors" : [ {
"domain" : "global",
"message" : "Backend Error",
"reason" : "backendError"
} ],
"message" : "Backend Error"
}
at
com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel.waitForCompletionAndThrowIfUploadFailed(AbstractGoogleAsyncWriteChannel.java:432)
at
com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel.close(AbstractGoogleAsyncWriteChannel.java:287)
at java.nio.channels.Channels$1.close(Channels.java:178)
at
com.google.cloud.dataflow.worker.repackaged.com.google.common.io.CountingOutputStream.close(CountingOutputStream.java:68)
at
com.google.cloud.dataflow.worker.IsmSink$IsmSinkWriter.close(IsmSink.java:296)
at
com.google.cloud.dataflow.worker.SizeReportingSinkWrapper$SizeLimitingWriterWrapper.close(SizeReportingSinkWrapper.java:53)
at
com.google.cloud.dataflow.worker.util.common.worker.WriteOperation.finish(WriteOperation.java:95)
at
com.google.cloud.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:83)
at
com.google.cloud.dataflow.worker.BatchDataflowWorker.executeWork(BatchDataflowWorker.java:393)
at
com.google.cloud.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:362)
at
com.google.cloud.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:290)
at
com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.doWork(DataflowBatchWorkerHarness.java:134)
at
com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:114)
at
com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:101)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 410 Gone
{
"code" : 503,
"errors" : [ {
"domain" : "global",
"message" : "Backend Error",
"reason" : "backendError"
} ],
"message" : "Backend Error"
}
at
com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at
com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at
com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at
com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:432)
at
com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at
com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at
com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel$UploadOperation.call(AbstractGoogleAsyncWriteChannel.java:358)
... 4 more
Aug 16, 2018 4:55:36 PM
org.apache.beam.runners.dataflow.TestDataflowRunner$ErrorMonitorMessagesHandler
process
INFO: Dataflow job 2018-08-16_09_53_16-10007593659939626950 threw
exception. Failure message was: java.io.IOException:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 410 Gone
{
"code" : 503,
"errors" : [ {
"domain" : "global",
"message" : "Backend Error",
"reason" : "backendError"
} ],
"message" : "Backend Error"
}
at
com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel.waitForCompletionAndThrowIfUploadFailed(AbstractGoogleAsyncWriteChannel.java:432)
at
com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel.close(AbstractGoogleAsyncWriteChannel.java:287)
at java.nio.channels.Channels$1.close(Channels.java:178)
at
com.google.cloud.dataflow.worker.repackaged.com.google.common.io.CountingOutputStream.close(CountingOutputStream.java:68)
at
com.google.cloud.dataflow.worker.IsmSink$IsmSinkWriter.close(IsmSink.java:296)
at
com.google.cloud.dataflow.worker.SizeReportingSinkWrapper$SizeLimitingWriterWrapper.close(SizeReportingSinkWrapper.java:53)
at
com.google.cloud.dataflow.worker.util.common.worker.WriteOperation.finish(WriteOperation.java:95)
at
com.google.cloud.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:83)
at
com.google.cloud.dataflow.worker.BatchDataflowWorker.executeWork(BatchDataflowWorker.java:393)
at
com.google.cloud.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:362)
at
com.google.cloud.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:290)
at
com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.doWork(DataflowBatchWorkerHarness.java:134)
at
com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:114)
at
com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:101)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by:
com.google.api.client.googleapis.json.GoogleJsonResponseException: 410 Gone
{
"code" : 503,
"errors" : [ {
"domain" : "global",
"message" : "Backend Error",
"reason" : "backendError"
} ],
"message" : "Backend Error"
}
at
com.google.api.client.googleapis.json.GoogleJsonResponseException.from(GoogleJsonResponseException.java:146)
at
com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:113)
at
com.google.api.client.googleapis.services.json.AbstractGoogleJsonClientRequest.newExceptionOnError(AbstractGoogleJsonClientRequest.java:40)
at
com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:432)
at
com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:352)
at
com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:469)
at
com.google.cloud.hadoop.util.AbstractGoogleAsyncWriteChannel$UploadOperation.call(AbstractGoogleAsyncWriteChannel.java:358)
... 4 more
Aug 16, 2018 4:55:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-08-16T16:55:44.588Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as view/GBKaSVForSize/Close
Aug 16, 2018 4:55:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-08-16T16:55:44.634Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as view/GBKaSVForKeys/Close
Aug 16, 2018 4:55:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-08-16T16:55:44.667Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as
view/GBKaSVForSize/Read+SpannerIO.Write/Write mutations to Cloud Spanner/Keys
sample as view/ParDo(ToIsmMetadataRecordForSize)
Aug 16, 2018 4:55:46 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-08-16T16:55:44.714Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as
view/GBKaSVForKeys/Read+SpannerIO.Write/Write mutations to Cloud Spanner/Keys
sample as view/ParDo(ToIsmMetadataRecordForKey)
Aug 16, 2018 4:55:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-08-16T16:55:57.586Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as view/Flatten.PCollections
Aug 16, 2018 4:55:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-08-16T16:55:57.855Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Keys sample as view/CreateDataflowView
Aug 16, 2018 4:55:58 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-08-16T16:55:58.065Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Partition input+SpannerIO.Write/Write mutations to
Cloud Spanner/Group by partition/Reify+SpannerIO.Write/Write mutations to Cloud
Spanner/Group by partition/Write
Aug 16, 2018 4:56:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-08-16T16:56:05.506Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Group by partition/Close
Aug 16, 2018 4:56:06 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-08-16T16:56:05.577Z: Executing operation SpannerIO.Write/Write
mutations to Cloud Spanner/Group by partition/Read+SpannerIO.Write/Write
mutations to Cloud Spanner/Group by
partition/GroupByWindow+SpannerIO.Write/Write mutations to Cloud Spanner/Batch
mutations together+SpannerIO.Write/Write mutations to Cloud Spanner/Write
mutations to Spanner
Aug 16, 2018 4:56:14 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-08-16T16:56:13.144Z: Cleaning up.
Aug 16, 2018 4:56:14 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-08-16T16:56:13.472Z: Stopping worker pool...
Aug 16, 2018 4:58:08 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-08-16T16:58:08.072Z: Autoscaling: Resized worker pool from 1 to
0.
Aug 16, 2018 4:58:08 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-08-16T16:58:08.113Z: Autoscaling: Would further reduce the
number of workers but reached the minimum number allowed for the job.
Aug 16, 2018 4:58:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-08-16_09_53_16-10007593659939626950 finished with status
DONE.
Aug 16, 2018 4:58:16 PM org.apache.beam.runners.dataflow.TestDataflowRunner
checkForPAssertSuccess
INFO: Success result for Dataflow job
2018-08-16_09_53_16-10007593659939626950. Found 0 success, 0 failures out of 0
expected assertions.
Aug 16, 2018 4:58:16 PM
org.apache.beam.runners.dataflow.DataflowPipelineJob waitUntilFinish
INFO: Job 2018-08-16_09_53_16-10007593659939626950 finished with status
DONE.
Gradle Test Executor 146 finished executing tests.
> Task
> :beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest
Finished generating test XML results (0.011 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/test-results/googleCloudPlatformIntegrationTest>
Generating HTML test report...
Finished generating test html results (0.01 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/runners/google-cloud-dataflow-java/build/reports/tests/googleCloudPlatformIntegrationTest>
Packing task
':beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest'
:beam-runners-google-cloud-dataflow-java:googleCloudPlatformIntegrationTest
(Thread[Task worker for ':' Thread 5,5,main]) completed. Took 31 mins 4.456
secs.
:beam-runners-google-cloud-dataflow-java:buildDependents (Thread[Task worker
for ':' Thread 5,5,main]) started.
> Task :beam-runners-google-cloud-dataflow-java:buildDependents
Caching disabled for task
':beam-runners-google-cloud-dataflow-java:buildDependents': Caching has not
been enabled for the task
Task ':beam-runners-google-cloud-dataflow-java:buildDependents' is not
up-to-date because:
Task has not declared any outputs despite executing actions.
:beam-runners-google-cloud-dataflow-java:buildDependents (Thread[Task worker
for ':' Thread 5,5,main]) completed. Took 0.001 secs.
:beam-sdks-java-io-google-cloud-platform:buildDependents (Thread[Task worker
for ':' Thread 5,5,main]) started.
:beam-runners-google-cloud-dataflow-java:postCommit (Thread[Daemon
worker,5,main]) started.
> Task :beam-runners-google-cloud-dataflow-java:postCommit
Skipping task ':beam-runners-google-cloud-dataflow-java:postCommit' as it has
no actions.
:beam-runners-google-cloud-dataflow-java:postCommit (Thread[Daemon
worker,5,main]) completed. Took 0.0 secs.
> Task :beam-sdks-java-io-google-cloud-platform:buildDependents
Caching disabled for task
':beam-sdks-java-io-google-cloud-platform:buildDependents': Caching has not
been enabled for the task
Task ':beam-sdks-java-io-google-cloud-platform:buildDependents' is not
up-to-date because:
Task has not declared any outputs despite executing actions.
:beam-sdks-java-io-google-cloud-platform:buildDependents (Thread[Task worker
for ':' Thread 5,5,main]) completed. Took 0.0 secs.
:beam-runners-direct-java:buildDependents (Thread[Task worker for ':' Thread
5,5,main]) started.
:beam-sdks-java-extensions-protobuf:buildDependents (Thread[Task worker for ':'
Thread 11,5,main]) started.
> Task :beam-runners-direct-java:buildDependents
Caching disabled for task ':beam-runners-direct-java:buildDependents': Caching
has not been enabled for the task
Task ':beam-runners-direct-java:buildDependents' is not up-to-date because:
Task has not declared any outputs despite executing actions.
:beam-runners-direct-java:buildDependents (Thread[Task worker for ':' Thread
5,5,main]) completed. Took 0.0 secs.
> Task :beam-sdks-java-extensions-protobuf:buildDependents
Caching disabled for task
':beam-sdks-java-extensions-protobuf:buildDependents': Caching has not been
enabled for the task
Task ':beam-sdks-java-extensions-protobuf:buildDependents' is not up-to-date
because:
Task has not declared any outputs despite executing actions.
:beam-sdks-java-extensions-protobuf:buildDependents (Thread[Task worker for ':'
Thread 11,5,main]) completed. Took 0.0 secs.
:beam-runners-java-fn-execution:buildDependents (Thread[Task worker for ':'
Thread 5,5,main]) started.
:beam-runners-local-java-core:buildDependents (Thread[Task worker for
':',5,main]) started.
> Task :beam-runners-java-fn-execution:buildDependents
Caching disabled for task ':beam-runners-java-fn-execution:buildDependents':
Caching has not been enabled for the task
Task ':beam-runners-java-fn-execution:buildDependents' is not up-to-date
because:
Task has not declared any outputs despite executing actions.
:beam-runners-java-fn-execution:buildDependents (Thread[Task worker for ':'
Thread 5,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-harness:buildDependents (Thread[Task worker for ':' Thread
5,5,main]) started.
:beam-vendor-sdks-java-extensions-protobuf:buildDependents (Thread[Task worker
for ':' Thread 2,5,main]) started.
> Task :beam-runners-local-java-core:buildDependents
Caching disabled for task ':beam-runners-local-java-core:buildDependents':
Caching has not been enabled for the task
Task ':beam-runners-local-java-core:buildDependents' is not up-to-date because:
Task has not declared any outputs despite executing actions.
:beam-runners-local-java-core:buildDependents (Thread[Task worker for
':',5,main]) completed. Took 0.0 secs.
> Task :beam-sdks-java-harness:buildDependents
Caching disabled for task ':beam-sdks-java-harness:buildDependents': Caching
has not been enabled for the task
Task ':beam-sdks-java-harness:buildDependents' is not up-to-date because:
Task has not declared any outputs despite executing actions.
:beam-sdks-java-harness:buildDependents (Thread[Task worker for ':' Thread
5,5,main]) completed. Took 0.0 secs.
> Task :beam-vendor-sdks-java-extensions-protobuf:buildDependents
Caching disabled for task
':beam-vendor-sdks-java-extensions-protobuf:buildDependents': Caching has not
been enabled for the task
Task ':beam-vendor-sdks-java-extensions-protobuf:buildDependents' is not
up-to-date because:
Task has not declared any outputs despite executing actions.
:beam-sdks-java-extensions-google-cloud-platform-core:buildDependents
(Thread[Task worker for ':' Thread 5,5,main]) started.
:beam-vendor-sdks-java-extensions-protobuf:buildDependents (Thread[Task worker
for ':' Thread 2,5,main]) completed. Took 0.0 secs.
:beam-sdks-java-fn-execution:buildDependents (Thread[Task worker for ':' Thread
10,5,main]) started.
> Task :beam-sdks-java-extensions-google-cloud-platform-core:buildDependents
Caching disabled for task
':beam-sdks-java-extensions-google-cloud-platform-core:buildDependents':
Caching has not been enabled for the task
Task ':beam-sdks-java-extensions-google-cloud-platform-core:buildDependents' is
not up-to-date because:
Task has not declared any outputs despite executing actions.
:beam-sdks-java-extensions-google-cloud-platform-core:buildDependents
(Thread[Task worker for ':' Thread 5,5,main]) completed. Took 0.0 secs.
> Task :beam-sdks-java-fn-execution:buildDependents
Caching disabled for task ':beam-sdks-java-fn-execution:buildDependents':
Caching has not been enabled for the task
Task ':beam-sdks-java-fn-execution:buildDependents' is not up-to-date because:
Task has not declared any outputs despite executing actions.
:beam-sdks-java-fn-execution:buildDependents (Thread[Task worker for ':' Thread
10,5,main]) completed. Took 0.0 secs.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':beam-runners-apex:compileTestJava'.
> Compilation failed with exit code 1; see the compiler error output for
> details.
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':beam-examples-java:directRunnerPreCommit'.
> There were failing tests. See the report at:
> file://<https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/ws/src/examples/java/build/reports/tests/directRunnerPreCommit/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
See
https://docs.gradle.org/4.8/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 47m 44s
809 actionable tasks: 804 executed, 5 from cache
Publishing build scan...
https://gradle.com/s/23u2jgszd6y7y
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
