See <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/2923/display/redirect?page=changes>
Changes: [kawaigin] [BEAM-12178] Fix flakiness [kawaigin] Added an onerror warning users about temp files not deleted by recording [noreply] [BEAM-9547] Add tests for groupby(dropna) (#14553) ------------------------------------------ [...truncated 304.95 KB...] Watching 1495 directories to track changes Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava'. Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is 10ab723466070bab57519e12138800b0 Task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' is not up-to-date because: No history is available. Watching 1495 directories to track changes Watching 1495 directories to track changes Watching 1495 directories to track changes Watching 1527 directories to track changes Watching 1537 directories to track changes Watching 1539 directories to track changes Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:compileJava' with cache key 10ab723466070bab57519e12138800b0 :runners:google-cloud-dataflow-java:****:legacy-****:compileJava (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.34 secs. :runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 2,5,main]) started. > Task :runners:google-cloud-dataflow-java:****:legacy-****:classes UP-TO-DATE Skipping task ':runners:google-cloud-dataflow-java:****:legacy-****:classes' as it has no actions. :runners:google-cloud-dataflow-java:****:legacy-****:classes (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.0 secs. :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 2,5,main]) started. > Task :sdks:java:io:google-cloud-platform:testJar Watching 1424 directories to track changes Watching 1425 directories to track changes Caching disabled for task ':sdks:java:io:google-cloud-platform:testJar' because: Caching has not been enabled for the task Task ':sdks:java:io:google-cloud-platform:testJar' is not up-to-date because: No history is available. Watching 1425 directories to track changes Watching 1539 directories to track changes :sdks:java:io:google-cloud-platform:testJar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.252 secs. :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) started. > Task :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar FROM-CACHE Watching 1539 directories to track changes Watching 1539 directories to track changes Watching 1539 directories to track changes Watching 1540 directories to track changes Custom actions are attached to task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar'. Build cache key for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is 8771b6d8bcb7f9cdf94a286448677aca Task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' is not up-to-date because: No history is available. Watching 1540 directories to track changes Watching 1551 directories to track changes Loaded cache entry for task ':runners:google-cloud-dataflow-java:****:legacy-****:shadowJar' with cache key 8771b6d8bcb7f9cdf94a286448677aca :runners:google-cloud-dataflow-java:****:legacy-****:shadowJar (Thread[Execution **** for ':' Thread 2,5,main]) completed. Took 0.187 secs. > Task :runners:google-cloud-dataflow-java:compileTestJava FROM-CACHE Watching 1539 directories to track changes Watching 1539 directories to track changes Watching 1539 directories to track changes Watching 1550 directories to track changes Custom actions are attached to task ':runners:google-cloud-dataflow-java:compileTestJava'. Build cache key for task ':runners:google-cloud-dataflow-java:compileTestJava' is 117573f037b96de8e294307480b8e00f Task ':runners:google-cloud-dataflow-java:compileTestJava' is not up-to-date because: No history is available. Watching 1550 directories to track changes Watching 1550 directories to track changes Watching 1550 directories to track changes Watching 1562 directories to track changes Watching 1563 directories to track changes Watching 1564 directories to track changes Loaded cache entry for task ':runners:google-cloud-dataflow-java:compileTestJava' with cache key 117573f037b96de8e294307480b8e00f :runners:google-cloud-dataflow-java:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.177 secs. :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) started. > Task :runners:google-cloud-dataflow-java:testClasses UP-TO-DATE Skipping task ':runners:google-cloud-dataflow-java:testClasses' as it has no actions. :runners:google-cloud-dataflow-java:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs. :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 10,5,main]) started. > Task :runners:google-cloud-dataflow-java:testJar Watching 1564 directories to track changes Watching 1564 directories to track changes Watching 1565 directories to track changes Caching disabled for task ':runners:google-cloud-dataflow-java:testJar' because: Caching has not been enabled for the task Task ':runners:google-cloud-dataflow-java:testJar' is not up-to-date because: No history is available. Watching 1565 directories to track changes file or directory '<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/runners/google-cloud-dataflow-java/build/resources/test',> not found Watching 1565 directories to track changes :runners:google-cloud-dataflow-java:testJar (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.032 secs. :sdks:java:io:hadoop-format:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) started. This JVM does not support getting OS memory, so no OS memory status updates will be broadcast > Task :sdks:java:io:hadoop-format:compileTestJava Watching 1565 directories to track changes Watching 1565 directories to track changes Watching 1565 directories to track changes Watching 1565 directories to track changes Watching 1573 directories to track changes Custom actions are attached to task ':sdks:java:io:hadoop-format:compileTestJava'. Build cache key for task ':sdks:java:io:hadoop-format:compileTestJava' is cb50358315649f35ae4efe70fdd3fa28 Task ':sdks:java:io:hadoop-format:compileTestJava' is not up-to-date because: No history is available. Watching 1573 directories to track changes Watching 1573 directories to track changes Watching 1573 directories to track changes The input changes require a full rebuild for incremental task ':sdks:java:io:hadoop-format:compileTestJava'. Full recompilation is required because no incremental change information is available. This is usually caused by clean builds or changing compiler arguments. Starting process 'Gradle Worker Daemon 1'. Working directory: /home/jenkins/.gradle/****s Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Xbootclasspath/p:/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.errorprone/javac/9+181-r4173-1/bdf4c0aa7d540ee1f7bf14d47447aea4bbf450c5/javac-9+181-r4173-1.jar -Xmx512m -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -cp /home/jenkins/.gradle/caches/6.8.3/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Worker Daemon 1' Successfully started process 'Gradle Worker Daemon 1' Started Gradle **** daemon (0.394 secs) with fork options DaemonForkOptions{executable=/usr/lib/jvm/java-8-openjdk-amd64/bin/java, minHeapSize=null, maxHeapSize=null, jvmArgs=[-Xbootclasspath/p:/home/jenkins/.gradle/caches/modules-2/files-2.1/com.google.errorprone/javac/9+181-r4173-1/bdf4c0aa7d540ee1f7bf14d47447aea4bbf450c5/javac-9+181-r4173-1.jar], keepAliveMode=SESSION}. Compiling with JDK Java compiler API. Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Created classpath snapshot for incremental compilation in 2.025 secs. 5930 duplicate classes found in classpath (see all with --debug). Watching 1581 directories to track changes Watching 1582 directories to track changes Watching 1583 directories to track changes Stored cache entry for task ':sdks:java:io:hadoop-format:compileTestJava' with cache key cb50358315649f35ae4efe70fdd3fa28 :sdks:java:io:hadoop-format:compileTestJava (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 8.586 secs. :sdks:java:io:hadoop-format:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) started. > Task :sdks:java:io:hadoop-format:testClasses Skipping task ':sdks:java:io:hadoop-format:testClasses' as it has no actions. :sdks:java:io:hadoop-format:testClasses (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 0.0 secs. :sdks:java:io:hadoop-format:integrationTest (Thread[Execution **** for ':' Thread 10,5,main]) started. Gradle Test Executor 2 started executing tests. > Task :sdks:java:io:hadoop-format:integrationTest Watching 1583 directories to track changes Watching 1583 directories to track changes Watching 1583 directories to track changes Custom actions are attached to task ':sdks:java:io:hadoop-format:integrationTest'. Build cache key for task ':sdks:java:io:hadoop-format:integrationTest' is 280cadabc58983f64b5a16237077e398 Task ':sdks:java:io:hadoop-format:integrationTest' is not up-to-date because: Task.upToDateWhen is false. Watching 1583 directories to track changes Watching 1583 directories to track changes Starting process 'Gradle Test Executor 2'. Working directory: <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/sdks/java/io/hadoop-format> Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -DbeamTestPipelineOptions=["--tempRoot=gs://temp-storage-for-perf-tests","--project=apache-beam-testing","--runner=DataflowRunner","--numberOfRecords=600000","--bigQueryDataset=beam_performance","--bigQueryTable=hadoopformatioit_results","--influxMeasurement=hadoopformatioit_results","--influxDatabase=beam_test_metrics","--influxHost=http://10.128.0.96:8086","--postgresUsername=postgres","--postgresPassword=uuinkks","--postgresDatabaseName=postgres","--postgresServerName=104.154.198.97","--postgresSsl=false","--postgresPort=5432","--numWorkers=5","--autoscalingAlgorithm=NONE","--****HarnessContainerImage=","--dataflowWorkerJar=<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.30.0-SNAPSHOT.jar","--region=us-central1";]> -Djava.security.manager=****.org.gradle.process.internal.****.child.BootstrapSecurityManager -Dorg.gradle.native=false -Xmx2g -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -ea -cp /home/jenkins/.gradle/caches/6.8.3/****Main/gradle-****.jar ****.org.gradle.process.internal.****.GradleWorkerMain 'Gradle Test Executor 2' Successfully started process 'Gradle Test Executor 2' org.apache.beam.sdk.io.hadoop.format.HadoopFormatIOIT STANDARD_ERROR SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/runners/google-cloud-dataflow-java/****/legacy-****/build/libs/beam-runners-google-cloud-dataflow-java-legacy-****-2.30.0-SNAPSHOT.jar!/org/slf4j/impl/StaticLoggerBinder.class]> SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-jdk14/1.7.30/d35953dd2fe54ebe39fdf18cfd82fe6eb35b25ed/slf4j-jdk14-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/ch.qos.logback/logback-classic/1.1.3/d90276fff414f06cb375f2057f6778cd63c6082f/logback-classic-1.1.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/jenkins/.gradle/caches/modules-2/files-2.1/org.slf4j/slf4j-log4j12/1.7.30/c21f55139d8141d2231214fb1feaf50a1edca95e/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.JDK14LoggerFactory] Apr 17, 2021 12:20:08 AM org.apache.beam.sdk.io.common.IOITHelper executeWithRetry WARNING: Attempt #1 of 3 failed: The connection attempt failed.. Apr 17, 2021 12:20:08 AM org.apache.beam.sdk.io.common.IOITHelper executeWithRetry WARNING: Retrying in 2000 ms. Apr 17, 2021 12:20:20 AM org.apache.beam.sdk.io.common.IOITHelper executeWithRetry WARNING: Attempt #2 of 3 failed: The connection attempt failed.. Apr 17, 2021 12:20:20 AM org.apache.beam.sdk.io.common.IOITHelper executeWithRetry WARNING: Retrying in 4000 ms. Apr 17, 2021 12:20:34 AM org.apache.beam.sdk.io.common.IOITHelper executeWithRetry WARNING: Attempt #3 of 3 failed: The connection attempt failed.. Apr 17, 2021 12:20:34 AM org.apache.beam.sdk.io.common.IOITHelper executeWithRetry WARNING: Attempt #1 of 3 failed: ERROR: table "beamtest_hadoopformatioit_2021_04_17_00_19_58_65" does not exist. Apr 17, 2021 12:20:34 AM org.apache.beam.sdk.io.common.IOITHelper executeWithRetry WARNING: Retrying in 2000 ms. Apr 17, 2021 12:20:36 AM org.apache.beam.sdk.io.common.IOITHelper executeWithRetry WARNING: Attempt #2 of 3 failed: ERROR: table "beamtest_hadoopformatioit_2021_04_17_00_19_58_65" does not exist. Apr 17, 2021 12:20:36 AM org.apache.beam.sdk.io.common.IOITHelper executeWithRetry WARNING: Retrying in 4000 ms. Apr 17, 2021 12:20:40 AM org.apache.beam.sdk.io.common.IOITHelper executeWithRetry WARNING: Attempt #3 of 3 failed: ERROR: table "beamtest_hadoopformatioit_2021_04_17_00_19_58_65" does not exist. Gradle Test Executor 2 finished executing tests. > Task :sdks:java:io:hadoop-format:integrationTest FAILED org.apache.beam.sdk.io.hadoop.format.HadoopFormatIOIT > classMethod FAILED org.postgresql.util.PSQLException: The connection attempt failed. at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:315) at org.postgresql.core.ConnectionFactory.openConnection(ConnectionFactory.java:51) at org.postgresql.jdbc.PgConnection.<init>(PgConnection.java:225) at org.postgresql.Driver.makeConnection(Driver.java:465) at org.postgresql.Driver.connect(Driver.java:264) at java.sql.DriverManager.getConnection(DriverManager.java:664) at java.sql.DriverManager.getConnection(DriverManager.java:247) at org.postgresql.ds.common.BaseDataSource.getConnection(BaseDataSource.java:103) at org.postgresql.ds.common.BaseDataSource.getConnection(BaseDataSource.java:87) at org.apache.beam.sdk.io.common.DatabaseTestHelper.createTable(DatabaseTestHelper.java:45) at org.apache.beam.sdk.io.hadoop.format.HadoopFormatIOIT.createTable(HadoopFormatIOIT.java:151) at org.apache.beam.sdk.io.common.IOITHelper.executeWithRetry(IOITHelper.java:86) at org.apache.beam.sdk.io.common.IOITHelper.executeWithRetry(IOITHelper.java:66) at org.apache.beam.sdk.io.hadoop.format.HadoopFormatIOIT.setUp(HadoopFormatIOIT.java:146) Caused by: java.net.SocketTimeoutException: connect timed out at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:607) at org.postgresql.core.PGStream.createSocket(PGStream.java:231) at org.postgresql.core.PGStream.<init>(PGStream.java:132) at org.postgresql.core.v3.ConnectionFactoryImpl.enableGSSEncrypted(ConnectionFactoryImpl.java:475) at org.postgresql.core.v3.ConnectionFactoryImpl.tryConnect(ConnectionFactoryImpl.java:144) at org.postgresql.core.v3.ConnectionFactoryImpl.openConnectionImpl(ConnectionFactoryImpl.java:213) ... 13 more org.apache.beam.sdk.io.hadoop.format.HadoopFormatIOIT > classMethod FAILED org.postgresql.util.PSQLException: ERROR: table "beamtest_hadoopformatioit_2021_04_17_00_19_58_65" does not exist at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2553) at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2285) at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:323) at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:473) at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:393) at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:322) at org.postgresql.jdbc.PgStatement.executeCachedSql(PgStatement.java:308) at org.postgresql.jdbc.PgStatement.executeWithFlags(PgStatement.java:284) at org.postgresql.jdbc.PgStatement.executeUpdate(PgStatement.java:258) at org.apache.beam.sdk.io.common.DatabaseTestHelper.deleteTable(DatabaseTestHelper.java:65) at org.apache.beam.sdk.io.hadoop.format.HadoopFormatIOIT.deleteTable(HadoopFormatIOIT.java:194) at org.apache.beam.sdk.io.common.IOITHelper.executeWithRetry(IOITHelper.java:86) at org.apache.beam.sdk.io.common.IOITHelper.executeWithRetry(IOITHelper.java:66) at org.apache.beam.sdk.io.hadoop.format.HadoopFormatIOIT.tearDown(HadoopFormatIOIT.java:187) 2 tests completed, 2 failed Finished generating test XML results (0.019 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/sdks/java/io/hadoop-format/build/test-results/integrationTest> Generating HTML test report... Finished generating test html results (0.027 secs) into: <https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/sdks/java/io/hadoop-format/build/reports/tests/integrationTest> Watching 1585 directories to track changes Watching 1591 directories to track changes Watching 1592 directories to track changes :sdks:java:io:hadoop-format:integrationTest (Thread[Execution **** for ':' Thread 10,5,main]) completed. Took 46.389 secs. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:io:hadoop-format:integrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PerformanceTests_HadoopFormat/ws/src/sdks/java/io/hadoop-format/build/reports/tests/integrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1m 25s 123 actionable tasks: 76 executed, 47 from cache Watching 1592 directories to track changes Publishing build scan... https://gradle.com/s/u6o4j5d6xghei Stopped 1 **** daemon(s). Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
