See
<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/2735/display/redirect>
Changes:
------------------------------------------
[...truncated 219.87 KB...]
Total Jars: 53 (includes project)
Total Time: 7.873s [7873ms]
Average Time/Jar: 0.1485471698113s [148.5471698113ms]
*******************
:sdks:java:harness:shadowJar (Thread[Execution worker for ':' Thread 7,5,main])
completed. Took 8.416 secs.
:runners:java-fn-execution:compileJava (Thread[Execution worker for ':' Thread
7,5,main]) started.
> Task :runners:java-fn-execution:compileJava FROM-CACHE
Build cache key for task ':runners:java-fn-execution:compileJava' is
f07a1f53d9baa158280ea71ba54a97b6
Task ':runners:java-fn-execution:compileJava' is not up-to-date because:
No history is available.
Origin for
org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@7489afe2:
{executionTime=22391, hostName=apache-beam-jenkins-2, operatingSystem=Linux,
buildInvocationId=kqofu2ojfjbqpdztqoflmzv55u, creationTime=1574460580362,
identity=:runners:java-fn-execution:compileJava,
type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution,
userName=jenkins, gradleVersion=5.2.1,
rootPath=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_ValidatesRunner_Samza/src}
Unpacked trees for task ':runners:java-fn-execution:compileJava' from cache.
:runners:java-fn-execution:compileJava (Thread[Execution worker for ':' Thread
7,5,main]) completed. Took 2.408 secs.
:runners:java-fn-execution:classes (Thread[Execution worker for ':' Thread
7,5,main]) started.
> Task :runners:java-fn-execution:classes UP-TO-DATE
Skipping task ':runners:java-fn-execution:classes' as it has no actions.
:runners:java-fn-execution:classes (Thread[Execution worker for ':' Thread
7,5,main]) completed. Took 0.0 secs.
:runners:java-fn-execution:jar (Thread[Execution worker for ':' Thread
8,5,main]) started.
> Task :runners:java-fn-execution:jar
Build cache key for task ':runners:java-fn-execution:jar' is
29b7990ca65020c6bad9169857d5ee2f
Caching disabled for task ':runners:java-fn-execution:jar': Caching has not
been enabled for the task
Task ':runners:java-fn-execution:jar' is not up-to-date because:
No history is available.
:runners:java-fn-execution:jar (Thread[Execution worker for ':' Thread
8,5,main]) completed. Took 0.047 secs.
:runners:direct-java:compileJava (Thread[Execution worker for ':' Thread
8,5,main]) started.
:runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava
(Thread[Execution worker for ':' Thread 6,5,main]) started.
> Task :runners:direct-java:compileJava FROM-CACHE
Build cache key for task ':runners:direct-java:compileJava' is
ba171e6f809950bd9362360ef351da2b
Task ':runners:direct-java:compileJava' is not up-to-date because:
No history is available.
Origin for
org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@22b3d77e:
{executionTime=10707, hostName=apache-beam-jenkins-2, operatingSystem=Linux,
buildInvocationId=ngkzwdhm6fep5m6dbe36u7u4qi, creationTime=1574461189708,
identity=:runners:direct-java:compileJava,
type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution,
userName=jenkins, gradleVersion=5.2.1,
rootPath=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java11_Examples_Dataflow_Portability/src}
Unpacked trees for task ':runners:direct-java:compileJava' from cache.
:runners:direct-java:compileJava (Thread[Execution worker for ':' Thread
8,5,main]) completed. Took 0.099 secs.
:runners:direct-java:classes (Thread[Execution worker for ':' Thread 8,5,main])
started.
> Task :runners:direct-java:classes UP-TO-DATE
Skipping task ':runners:direct-java:classes' as it has no actions.
:runners:direct-java:classes (Thread[Execution worker for ':' Thread 8,5,main])
completed. Took 0.0 secs.
:runners:direct-java:shadowJar (Thread[Execution worker for ':' Thread
8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava
> FROM-CACHE
file or directory
'<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/ws/src/runners/google-cloud-dataflow-java/worker/legacy-worker/src/main/java',>
not found
Build cache key for task
':runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava' is
a6b9520a7911d7e64d52aa57310e1521
Task ':runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava' is
not up-to-date because:
No history is available.
Origin for
org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@22dc8166:
{executionTime=16278, hostName=apache-beam-jenkins-2, operatingSystem=Linux,
buildInvocationId=hksxzina2vbcjo3gjoxtvayd5u, creationTime=1574469178035,
identity=:runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava,
type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution,
userName=jenkins, gradleVersion=5.2.1,
rootPath=/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Compressed_TextIOIT_HDFS/src}
Unpacked trees for task
':runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava' from
cache.
:runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava
(Thread[Execution worker for ':' Thread 6,5,main]) completed. Took 0.391 secs.
:runners:google-cloud-dataflow-java:worker:legacy-worker:classes
(Thread[Execution worker for ':' Thread 6,5,main]) started.
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:classes
> UP-TO-DATE
Skipping task
':runners:google-cloud-dataflow-java:worker:legacy-worker:classes' as it has no
actions.
:runners:google-cloud-dataflow-java:worker:legacy-worker:classes
(Thread[Execution worker for ':' Thread 6,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar
(Thread[Execution worker for ':' Thread 6,5,main]) started.
> Task :runners:direct-java:shadowJar
Build cache key for task ':runners:direct-java:shadowJar' is
cf47df9343cbf95b1cc796e697c95f87
Caching disabled for task ':runners:direct-java:shadowJar': Caching has not
been enabled for the task
Task ':runners:direct-java:shadowJar' is not up-to-date because:
No history is available.
Custom actions are attached to task ':runners:direct-java:shadowJar'.
*******************
GRADLE SHADOW STATS
Total Jars: 6 (includes project)
Total Time: 0.583s [583ms]
Average Time/Jar: 0.0971666666667s [97.1666666667ms]
*******************
:runners:direct-java:shadowJar (Thread[Execution worker for ':' Thread
8,5,main]) completed. Took 0.789 secs.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution worker
for ':' Thread 8,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE
Build cache key for task ':sdks:java:io:google-cloud-platform:compileTestJava'
is 1ef620042710cd2eac93c7ea002d5c9e
Task ':sdks:java:io:google-cloud-platform:compileTestJava' is not up-to-date
because:
No history is available.
Origin for
org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@6745dab2:
{executionTime=13894, hostName=apache-beam-jenkins-2, operatingSystem=Linux,
buildInvocationId=y3zgnaghwvgg7l7kf7hwxunv7i, creationTime=1574463421152,
identity=:sdks:java:io:google-cloud-platform:compileTestJava,
type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution,
userName=jenkins, gradleVersion=5.2.1,
rootPath=/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Java_PortabilityApi/src}
Unpacked trees for task ':sdks:java:io:google-cloud-platform:compileTestJava'
from cache.
:sdks:java:io:google-cloud-platform:compileTestJava (Thread[Execution worker
for ':' Thread 8,5,main]) completed. Took 0.408 secs.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution worker for
':' Thread 8,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testClasses UP-TO-DATE
Skipping task ':sdks:java:io:google-cloud-platform:testClasses' as it has no
actions.
:sdks:java:io:google-cloud-platform:testClasses (Thread[Execution worker for
':' Thread 8,5,main]) completed. Took 0.0 secs.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution worker for ':'
Thread 8,5,main]) started.
> Task :sdks:java:io:google-cloud-platform:testJar
Build cache key for task ':sdks:java:io:google-cloud-platform:testJar' is
bbb93bf6bea711952f8db8f11ae85785
Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar':
Caching has not been enabled for the task
Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because:
No history is available.
:sdks:java:io:google-cloud-platform:testJar (Thread[Execution worker for ':'
Thread 8,5,main]) completed. Took 0.053 secs.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution worker
for ':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE
Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava'
is c3fbd90cb1e223812acdcbae9fba7f63
Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date
because:
No history is available.
Origin for
org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter$TaskExecution@78304a2f:
{executionTime=9791, hostName=apache-beam-jenkins-2, operatingSystem=Linux,
buildInvocationId=hksxzina2vbcjo3gjoxtvayd5u, creationTime=1574469172811,
identity=:runners:google-cloud-dataflow-java:compileTestJava,
type=org.gradle.api.internal.tasks.execution.ExecuteActionsTaskExecuter.TaskExecution,
userName=jenkins, gradleVersion=5.2.1,
rootPath=/home/jenkins/jenkins-slave/workspace/beam_PerformanceTests_Compressed_TextIOIT_HDFS/src}
Unpacked trees for task ':runners:google-cloud-dataflow-java:compileTestJava'
from cache.
:runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution worker
for ':' Thread 8,5,main]) completed. Took 0.158 secs.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution worker for
':' Thread 8,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE
Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no
actions.
:runners:google-cloud-dataflow-java:testClasses (Thread[Execution worker for
':' Thread 8,5,main]) completed. Took 0.0 secs.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution worker for ':'
Thread 5,5,main]) started.
> Task :runners:google-cloud-dataflow-java:testJar
Build cache key for task ':runners:google-cloud-dataflow-java:testJar' is
fb2f0158e9b08eb586f66c79c65e0560
Caching disabled for task ':runners:google-cloud-dataflow-java:testJar':
Caching has not been enabled for the task
Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because:
No history is available.
:runners:google-cloud-dataflow-java:testJar (Thread[Execution worker for ':'
Thread 5,5,main]) completed. Took 0.038 secs.
> Task :runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar
Build cache key for task
':runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar' is
98a16deaf40850926cdf3b06d998b96e
Caching disabled for task
':runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar': Caching
has not been enabled for the task
Task ':runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar' is
not up-to-date because:
No history is available.
Custom actions are attached to task
':runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar'.
*******************
GRADLE SHADOW STATS
Total Jars: 16 (includes project)
Total Time: 3.577s [3577ms]
Average Time/Jar: 0.2235625s [223.5625ms]
*******************
:runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar
(Thread[Execution worker for ':' Thread 6,5,main]) completed. Took 4.484 secs.
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution worker for
':' Thread 6,5,main]) started.
> Task :sdks:java:io:file-based-io-tests:integrationTest
Build cache key for task ':sdks:java:io:file-based-io-tests:integrationTest' is
31f577adbdc40927c6639fa270bb0807
Task ':sdks:java:io:file-based-io-tests:integrationTest' is not up-to-date
because:
Task.upToDateWhen is false.
Custom actions are attached to task
':sdks:java:io:file-based-io-tests:integrationTest'.
Starting process 'Gradle Test Executor 1'. Working directory:
<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/ws/src/sdks/java/io/file-based-io-tests>
Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java
-DbeamTestPipelineOptions=["--runner=DataflowRunner","--project=apache-beam-testing","--tempRoot=gs://temp-storage-for-perf-tests","--filenamePrefix=gs://temp-storage-for-perf-tests/beam_PerformanceTests_AvroIOIT/2735/","--numberOfRecords=225000000","--expectedHash=2f9f5ca33ea464b25109c0297eb6aecb","--datasetSize=1089730000","--bigQueryDataset=beam_performance","--bigQueryTable=avroioit_results","--numWorkers=5","--autoscalingAlgorithm=NONE","--workerHarnessContainerImage=","--dataflowWorkerJar=${dataflowWorkerJar}"]
-Djava.security.manager=worker.org.gradle.process.internal.worker.child.BootstrapSecurityManager
-Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US
-Duser.language=en -Duser.variant -ea -cp
/home/jenkins/.gradle/caches/5.2.1/workerMain/gradle-worker.jar
worker.org.gradle.process.internal.worker.GradleWorkerMain 'Gradle Test
Executor 1'
Successfully started process 'Gradle Test Executor 1'
Gradle Test Executor 1 started executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
org.apache.beam.sdk.io.avro.AvroIOIT STANDARD_ERROR
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/ws/src/runners/google-cloud-dataflow-java/worker/legacy-worker/build/libs/beam-runners-google-cloud-dataflow-java-legacy-worker-2.18.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in
[jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.25/bccda40ebc8067491b32a88f49615a747d20082d/slf4j-jdk14-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.25/110cefe2df103412849d72ef7a67e4e91e4266b4/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory]
Gradle Test Executor 1 finished executing tests.
> Task :sdks:java:io:file-based-io-tests:integrationTest
org.apache.beam.sdk.io.avro.AvroIOIT > writeThenReadAll FAILED
java.lang.RuntimeException: Failed to construct instance from factory
method DataflowRunner#fromOptions(interface
org.apache.beam.sdk.options.PipelineOptions)
at
org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:224)
at
org.apache.beam.sdk.util.InstanceBuilder.build(InstanceBuilder.java:155)
at
org.apache.beam.sdk.PipelineRunner.fromOptions(PipelineRunner.java:55)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:309)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:350)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:331)
at
org.apache.beam.sdk.io.avro.AvroIOIT.writeThenReadAll(AvroIOIT.java:156)
Caused by:
java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.beam.sdk.util.InstanceBuilder.buildFromMethod(InstanceBuilder.java:214)
... 6 more
Caused by:
java.lang.IllegalArgumentException: DataflowRunner requires
gcpTempLocation, but failed to retrieve a value from PipelineOptions
at
org.apache.beam.runners.dataflow.DataflowRunner.fromOptions(DataflowRunner.java:257)
... 11 more
Caused by:
java.lang.RuntimeException: Unable to verify project with ID
apache-beam-testing
at
org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.tryCreateDefaultBucket(GcpOptions.java:342)
at
org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.create(GcpOptions.java:300)
at
org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.create(GcpOptions.java:288)
at
org.apache.beam.sdk.options.ProxyInvocationHandler.returnDefaultHelper(ProxyInvocationHandler.java:592)
at
org.apache.beam.sdk.options.ProxyInvocationHandler.getDefault(ProxyInvocationHandler.java:533)
at
org.apache.beam.sdk.options.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:158)
at com.sun.proxy.$Proxy13.getGcpTempLocation(Unknown Source)
at
org.apache.beam.runners.dataflow.DataflowRunner.fromOptions(DataflowRunner.java:255)
... 11 more
Caused by:
java.io.IOException: Unable to get project number
at
org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.getProjectNumber(GcpOptions.java:408)
at
org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.getProjectNumber(GcpOptions.java:383)
at
org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.tryCreateDefaultBucket(GcpOptions.java:340)
... 18 more
Caused by:
java.io.IOException: Error code 404 trying to get
security access token from Compute Engine metadata for the default service
account. This may be because the virtual machine instance does not have
permission scopes specified. It is possible to skip checking for Compute Engine
metadata by specifying the environment variable NO_GCE_CHECK=true.
at
com.google.auth.oauth2.ComputeEngineCredentials.refreshAccessToken(ComputeEngineCredentials.java:156)
at
com.google.auth.oauth2.OAuth2Credentials.refresh(OAuth2Credentials.java:181)
at
com.google.auth.oauth2.OAuth2Credentials.getRequestMetadata(OAuth2Credentials.java:167)
at
com.google.auth.http.HttpCredentialsAdapter.initialize(HttpCredentialsAdapter.java:96)
at
com.google.cloud.hadoop.util.ChainingHttpRequestInitializer.initialize(ChainingHttpRequestInitializer.java:52)
at
com.google.api.client.http.HttpRequestFactory.buildRequest(HttpRequestFactory.java:93)
at
com.google.api.client.googleapis.services.AbstractGoogleClientRequest.buildHttpRequest(AbstractGoogleClientRequest.java:397)
at
com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:515)
at
com.google.api.client.googleapis.services.AbstractGoogleClientRequest.executeUnparsed(AbstractGoogleClientRequest.java:448)
at
com.google.api.client.googleapis.services.AbstractGoogleClientRequest.execute(AbstractGoogleClientRequest.java:565)
at
com.google.cloud.hadoop.util.ResilientOperation$AbstractGoogleClientRequestExecutor.call(ResilientOperation.java:171)
at
com.google.cloud.hadoop.util.ResilientOperation.retry(ResilientOperation.java:67)
at
org.apache.beam.sdk.extensions.gcp.options.GcpOptions$GcpTempLocationFactory.getProjectNumber(GcpOptions.java:400)
... 20 more
1 test completed, 1 failed
Finished generating test XML results (0.017 secs) into:
<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/ws/src/sdks/java/io/file-based-io-tests/build/test-results/integrationTest>
Generating HTML test report...
Finished generating test html results (0.03 secs) into:
<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest>
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution worker for
':' Thread 6,5,main]) completed. Took 9.368 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> There were failing tests. See the report at:
> file://<https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT/ws/src/sdks/java/io/file-based-io-tests/build/reports/tests/integrationTest/index.html>
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 57s
86 actionable tasks: 55 executed, 31 from cache
Publishing build scan...
https://gradle.com/s/h7ge6yejyg4ay
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
