Balaji Varadarajan created HUDI-988:
---------------------------------------
Summary: Fix unit test flakiness in Hudi
Key: HUDI-988
URL: https://issues.apache.org/jira/browse/HUDI-988
Project: Apache Hudi
Issue Type: Task
Components: Testing
Reporter: Balaji Varadarajan
Seeing flakiness in unit-tests in CI jobs caused due to OutOfMemory issues.
E:g
41866 2013419 [Thread-15141] ERROR
org.apache.zookeeper.server.NIOServerCnxnFactory - Thread
Thread[Thread-15141,5,main] died
41867 java.lang.OutOfMemoryError: GC overhead limit exceeded
41868 at java.util.zip.ZipCoder.getBytes(ZipCoder.java:80)
41869 at java.util.zip.ZipFile.getEntry(ZipFile.java:316)
41870 at java.util.jar.JarFile.getEntry(JarFile.java:240)
41871 at java.util.jar.JarFile.getJarEntry(JarFile.java:223)
41872 at
sun.misc.URLClassPath$JarLoader.getResource(URLClassPath.java:1054)
41873 at sun.misc.URLClassPath.getResource(URLClassPath.java:249)
41874 at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
41875 at java.net.URLClassLoader$1.run(URLClassLoader.java:363)
41876 at java.security.AccessController.doPrivileged(Native Method)
41877 at java.net.URLClassLoader.findClass(URLClassLoader.java:362)
41878 at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
41879 at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
41880 at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
41881 at java.lang.Class.forName0(Native Method)
.......
41980 [ERROR] Crashed tests:
41981 [ERROR] org.apache.hudi.client.TestMultiFS
41982 [ERROR] at
org.apache.maven.plugin.surefire.booterclient.ForkStarter.fork(ForkStarter.java:690)
41983 [ERROR] at
org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:285)
41984 [ERROR] at
org.apache.maven.plugin.surefire.booterclient.ForkStarter.run(ForkStarter.java:248)
41985 [ERROR] at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeProvider(AbstractSurefireMojo.java:1217)
41986 [ERROR] at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.executeAfterPreconditionsChecked(AbstractSurefireMojo.java:1063)
41987 [ERROR] at
org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:889)
41988 [ERROR] at
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:137)
41989 [ERROR] at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
41990 [ERROR] at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:154)
41991 [ERROR] at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:146)
41992 [ERROR] at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:117)
41993 [ERROR] at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:81)
41994 [ERROR] at
org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:56)
41995 [ERROR] at
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128)
41996 [ERROR] at
org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:305)
41997 [ERROR] at
org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:192)
41998 [ERROR] at
org.apache.maven.DefaultMaven.execute(DefaultMaven.java:105)
41999 [ERROR] at
org.apache.maven.cli.MavenCli.execute(MavenCli.java:954)
42000 [ERROR] at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288)
42001 [ERROR] at org.apache.maven.cli.MavenCli.main(MavenCli.java:192)
42002 [ERROR] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
42003 [ERROR] at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
42004 [ERROR] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
42005 [ERROR] at java.lang.reflect.Method.invoke(Method.java:498)
42006 [ERROR] at
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289)
42007 [ERROR] at
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229)
42008 [ERROR] at
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415)
42009 [ERROR] at
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356)
42010 [ERROR]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
