See
<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/5778/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Revert "Revert "[BEAM-14038] Auto-startup for Python
expansion service.
[Robert Bradshaw] Skip failing test for now.
[noreply] [BEAM-14153] Reshuffled Row Coder PCollection used as Side Input cause
[noreply] delint go sdk (#17247)
[noreply] Merge pull request #16841 from [BEAM-8823] Make FnApiRunner work by
[noreply] [BEAM-14192] Update legacy container version (#17210)
------------------------------------------
[...truncated 371.25 KB...]
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at org.apache.hadoop.fs.FileSystem.<clinit>(FileSystem.java:132)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:356)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:183)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:77)
at org.apache.beam.sdk.io.FileSystems.create(FileSystems.java:243)
at
org.apache.beam.sdk.io.FileBasedSink$Writer.open(FileBasedSink.java:996)
at
org.apache.beam.sdk.io.WriteFiles$WriteUnshardedTempFilesFn.processElement(WriteFiles.java:569)
Apr 01, 2022 7:10:39 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-04-01T19:10:38.275Z: java.lang.NoClassDefFoundError: Could not
initialize class org.apache.hadoop.fs.FileSystem
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:356)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:183)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:77)
at org.apache.beam.sdk.io.FileSystems.create(FileSystems.java:243)
at
org.apache.beam.sdk.io.FileBasedSink$Writer.open(FileBasedSink.java:996)
at
org.apache.beam.sdk.io.WriteFiles$WriteUnshardedTempFilesFn.processElement(WriteFiles.java:569)
Apr 01, 2022 7:10:39 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-04-01T19:10:38.392Z: java.lang.UnsupportedClassVersionError:
org/apache/commons/logging/LogFactory has been compiled by a more recent
version of the Java Runtime (class file version 55.0), this version of the Java
Runtime only recognizes class file versions up to 52.0
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at org.apache.hadoop.fs.FileSystem.<clinit>(FileSystem.java:132)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:356)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:183)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:77)
at org.apache.beam.sdk.io.FileSystems.create(FileSystems.java:243)
at
org.apache.beam.sdk.io.FileBasedSink$Writer.open(FileBasedSink.java:996)
at
org.apache.beam.sdk.io.WriteFiles$WriteUnshardedTempFilesFn.processElement(WriteFiles.java:569)
Apr 01, 2022 7:10:39 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-04-01T19:10:38.401Z: java.lang.NoClassDefFoundError: Could not
initialize class org.apache.hadoop.fs.FileSystem
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:356)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:183)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:77)
at org.apache.beam.sdk.io.FileSystems.create(FileSystems.java:243)
at
org.apache.beam.sdk.io.FileBasedSink$Writer.open(FileBasedSink.java:996)
at
org.apache.beam.sdk.io.WriteFiles$WriteUnshardedTempFilesFn.processElement(WriteFiles.java:569)
Apr 01, 2022 7:10:39 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-04-01T19:10:38.444Z: java.lang.UnsupportedClassVersionError:
org/apache/commons/logging/LogFactory has been compiled by a more recent
version of the Java Runtime (class file version 55.0), this version of the Java
Runtime only recognizes class file versions up to 52.0
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at org.apache.hadoop.fs.FileSystem.<clinit>(FileSystem.java:132)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:356)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:183)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:77)
at org.apache.beam.sdk.io.FileSystems.create(FileSystems.java:243)
at
org.apache.beam.sdk.io.FileBasedSink$Writer.open(FileBasedSink.java:996)
at
org.apache.beam.sdk.io.WriteFiles$WriteUnshardedTempFilesFn.processElement(WriteFiles.java:569)
Apr 01, 2022 7:10:39 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-04-01T19:10:38.444Z: java.lang.NoClassDefFoundError: Could not
initialize class org.apache.hadoop.fs.FileSystem
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:356)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:183)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:77)
at org.apache.beam.sdk.io.FileSystems.create(FileSystems.java:243)
at
org.apache.beam.sdk.io.FileBasedSink$Writer.open(FileBasedSink.java:996)
at
org.apache.beam.sdk.io.WriteFiles$WriteUnshardedTempFilesFn.processElement(WriteFiles.java:569)
Apr 01, 2022 7:10:39 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-04-01T19:10:38.499Z: java.lang.NoClassDefFoundError: Could not
initialize class org.apache.hadoop.fs.FileSystem
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:356)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:183)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:77)
at org.apache.beam.sdk.io.FileSystems.create(FileSystems.java:243)
at
org.apache.beam.sdk.io.FileBasedSink$Writer.open(FileBasedSink.java:996)
at
org.apache.beam.sdk.io.WriteFiles$WriteUnshardedTempFilesFn.processElement(WriteFiles.java:569)
Apr 01, 2022 7:10:39 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-04-01T19:10:38.502Z: java.lang.UnsupportedClassVersionError:
org/apache/commons/logging/LogFactory has been compiled by a more recent
version of the Java Runtime (class file version 55.0), this version of the Java
Runtime only recognizes class file versions up to 52.0
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
at
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at org.apache.hadoop.fs.FileSystem.<clinit>(FileSystem.java:132)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:356)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:183)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:77)
at org.apache.beam.sdk.io.FileSystems.create(FileSystems.java:243)
at
org.apache.beam.sdk.io.FileBasedSink$Writer.open(FileBasedSink.java:996)
at
org.apache.beam.sdk.io.WriteFiles$WriteUnshardedTempFilesFn.processElement(WriteFiles.java:569)
Apr 01, 2022 7:10:42 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-04-01T19:10:42.284Z: java.lang.NoClassDefFoundError: Could not
initialize class org.apache.hadoop.fs.FileSystem
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:356)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:183)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:77)
at org.apache.beam.sdk.io.FileSystems.create(FileSystems.java:243)
at
org.apache.beam.sdk.io.FileBasedSink$Writer.open(FileBasedSink.java:996)
at
org.apache.beam.sdk.io.WriteFiles$WriteUnshardedTempFilesFn.processElement(WriteFiles.java:569)
Apr 01, 2022 7:10:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-04-01T19:10:43.980Z: java.lang.NoClassDefFoundError: Could not
initialize class org.apache.hadoop.fs.FileSystem
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:356)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:183)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:77)
at org.apache.beam.sdk.io.FileSystems.create(FileSystems.java:243)
at
org.apache.beam.sdk.io.FileBasedSink$Writer.open(FileBasedSink.java:996)
at
org.apache.beam.sdk.io.WriteFiles$WriteUnshardedTempFilesFn.processElement(WriteFiles.java:569)
Apr 01, 2022 7:10:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-04-01T19:10:45.168Z: java.lang.NoClassDefFoundError: Could not
initialize class org.apache.hadoop.fs.FileSystem
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:356)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:183)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:77)
at org.apache.beam.sdk.io.FileSystems.create(FileSystems.java:243)
at
org.apache.beam.sdk.io.FileBasedSink$Writer.open(FileBasedSink.java:996)
at
org.apache.beam.sdk.io.WriteFiles$WriteUnshardedTempFilesFn.processElement(WriteFiles.java:569)
Apr 01, 2022 7:10:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-04-01T19:10:45.273Z: java.lang.NoClassDefFoundError: Could not
initialize class org.apache.hadoop.fs.FileSystem
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:356)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:183)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:77)
at org.apache.beam.sdk.io.FileSystems.create(FileSystems.java:243)
at
org.apache.beam.sdk.io.FileBasedSink$Writer.open(FileBasedSink.java:996)
at
org.apache.beam.sdk.io.WriteFiles$WriteUnshardedTempFilesFn.processElement(WriteFiles.java:569)
Apr 01, 2022 7:10:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-04-01T19:10:45.330Z: java.lang.NoClassDefFoundError: Could not
initialize class org.apache.hadoop.fs.FileSystem
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:356)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:183)
at
org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:77)
at org.apache.beam.sdk.io.FileSystems.create(FileSystems.java:243)
at
org.apache.beam.sdk.io.FileBasedSink$Writer.open(FileBasedSink.java:996)
at
org.apache.beam.sdk.io.WriteFiles$WriteUnshardedTempFilesFn.processElement(WriteFiles.java:569)
Apr 01, 2022 7:10:45 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-01T19:10:45.697Z: Finished operation Generate
sequence/Read(BoundedCountingSource)+Produce text lines+Produce Avro
records+Collect start time+Write Avro records to
files/Write/RewindowIntoGlobal/Window.Assign+Write Avro records to
files/Write/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles+Write Avro
records to
files/Write/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow)+Write
Avro records to
files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify+Write Avro
records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write
Apr 01, 2022 7:10:48 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
SEVERE: 2022-04-01T19:10:45.859Z: Workflow failed. Causes: S02:Generate
sequence/Read(BoundedCountingSource)+Produce text lines+Produce Avro
records+Collect start time+Write Avro records to
files/Write/RewindowIntoGlobal/Window.Assign+Write Avro records to
files/Write/WriteUnshardedBundlesToTempFiles/WriteUnshardedBundles+Write Avro
records to
files/Write/GatherTempFileResults/View.AsList/ParDo(ToIsmRecordForGlobalWindow)+Write
Avro records to
files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Reify+Write Avro
records to files/Write/WriteUnshardedBundlesToTempFiles/GroupUnwritten/Write
failed., The job failed because a work item has failed 4 times. Look in
previous log entries for the cause of each one of the 4 failures. For more
information, see https://cloud.google.com/dataflow/docs/guides/common-errors.
The work item was attempted on these ****s:
avroioit0writethenreadall-04011208-vf1y-harness-pj7l
Root cause: Work item failed.,
avroioit0writethenreadall-04011208-vf1y-harness-wx0q
Root cause: Work item failed.,
avroioit0writethenreadall-04011208-vf1y-harness-95w9
Root cause: Work item failed.,
avroioit0writethenreadall-04011208-vf1y-harness-95w9
Root cause: Work item failed.
Apr 01, 2022 7:10:48 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-01T19:10:46.034Z: Cleaning up.
Apr 01, 2022 7:10:48 PM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2022-04-01T19:10:46.230Z: Stopping **** pool...
org.apache.beam.sdk.io.avro.AvroIOIT > writeThenReadAll SKIPPED
> Task :sdks:java:io:file-based-io-tests:integrationTest FAILED
:sdks:java:io:file-based-io-tests:integrationTest (Thread[Execution **** for
':' Thread 4,5,main]) completed. Took 4 mins 10.42 secs.
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> Process 'Gradle Test Executor 4' finished with non-zero exit value 143
This problem might be caused by incorrect test process configuration.
Please refer to the test execution section in the User Manual at
https://docs.gradle.org/7.3.2/userguide/java_testing.html#sec:test_execution
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m 28s
147 actionable tasks: 88 executed, 57 from cache, 2 up-to-date
Publishing build scan...
The message received from the daemon indicates that the daemon has disappeared.
Build request sent: Build{id=f9608ac3-3cb2-40cb-9f25-7b9430e75619,
currentDir=<https://ci-beam.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/src}>
Attempting to read last messages from the daemon log...
Daemon pid: 1200160
log file: /home/jenkins/.gradle/daemon/7.3.2/daemon-1200160.out.log
----- Last 20 lines from daemon log file - daemon-1200160.out.log -----
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:java:io:file-based-io-tests:integrationTest'.
> Process 'Gradle Test Executor 4' finished with non-zero exit value 143
This problem might be caused by incorrect test process configuration.
Please refer to the test execution section in the User Manual at
https://docs.gradle.org/7.3.2/userguide/java_testing.html#sec:test_execution
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
BUILD FAILED in 4m 28s
147 actionable tasks: 88 executed, 57 from cache, 2 up-to-date
Publishing build scan...
Daemon vm is shutting down... The daemon has exited normally or was terminated
in response to a user interrupt.
----- End of the daemon log -----
FAILURE: Build failed with an exception.
* What went wrong:
Gradle build daemon disappeared unexpectedly (it may have been killed or may
have crashed)
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
