Re: Integration Testing Requirements
Funny. The specific IT passed locally for me. Seems more like a Jenkins setup to troubleshoot for us... Thanks for your help Ankit. On Wed, Feb 20, 2019 at 12:07 PM William Shen wrote: > Thanks Ankit. > > What is the difference between these hive tests > (e.g., org.apache.phoenix.hive.HiveTezIT) and other tests that also use a > mini cluster > (org.apache.phoenix.end2end.MigrateSystemTablesToSystemNamespaceIT), which > are passing? Specifically, what does it need from HADOOP_HOME? > > On Tue, Feb 19, 2019 at 11:39 AM Ankit Singhal > wrote: > >> you can check if HADOOP_HOME and JAVA_HOME are properly set in the >> environment. >> >> On Tue, Feb 19, 2019 at 11:23 AM William Shen > > >> wrote: >> >> > Hi everyone, >> > >> > I'm trying to set up the Jenkins job at work to build Phoenix and run >> the >> > integration tests. However, repeatedly I encounter issues with the hive >> > module when I run mvn verify. Does the hive integration tests require >> any >> > special set up for them to pass? The other modules passed integration >> > testing successfully. >> > >> > Attaching below is a sample failure trace. >> > >> > Thanks! >> > >> > - Will >> > >> > [ERROR] Tests run: 6, Failures: 6, Errors: 0, Skipped: 0, Time >> > elapsed: 48.302 s <<< FAILURE! - in >> > org.apache.phoenix.hive.HiveTezIT[ERROR] >> > simpleColumnMapTest(org.apache.phoenix.hive.HiveTezIT) Time elapsed: >> > 6.727 s <<< FAILURE!junit.framework.AssertionFailedError: >> > Unexpected exception java.lang.RuntimeException: >> > org.apache.tez.dag.api.SessionNotRunning: TezSession has already >> > shutdown. Application application_1550371508120_0001 failed 2 times >> > due to AM Container for appattempt_1550371508120_0001_02 exited >> > with exitCode: 127 >> > For more detailed output, check application tracking >> > page: >> > >> http://40a4dd0e8959:38843/cluster/app/application_1550371508120_0001Then, >> > click on links to logs of each attempt. >> > Diagnostics: Exception from container-launch. >> > Container id: container_1550371508120_0001_02_01 >> > Exit code: 127 >> > Stack trace: ExitCodeException exitCode=127: >> > at org.apache.hadoop.util.Shell.runCommand(Shell.java:545) >> > at org.apache.hadoop.util.Shell.run(Shell.java:456) >> > at >> > >> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722) >> > at >> > >> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211) >> > at >> > >> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302) >> > at >> > >> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82) >> > at java.util.concurrent.FutureTask.run(FutureTask.java:266) >> > at >> > >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) >> > at >> > >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) >> > at java.lang.Thread.run(Thread.java:748) >> > >> > >> > Container exited with a non-zero exit code 127 >> > Failing this attempt. Failing the application. >> > at >> > >> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:535) >> > at >> > org.apache.phoenix.hive.HiveTestUtil.cliInit(HiveTestUtil.java:637) >> > at >> > org.apache.phoenix.hive.HiveTestUtil.cliInit(HiveTestUtil.java:590) >> > at >> > >> org.apache.phoenix.hive.BaseHivePhoenixStoreIT.runTest(BaseHivePhoenixStoreIT.java:117) >> > at >> > >> org.apache.phoenix.hive.HivePhoenixStoreIT.simpleColumnMapTest(HivePhoenixStoreIT.java:103) >> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> > at >> > >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) >> > at >> > >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> > at java.lang.reflect.Method.invoke(Method.java:498) >> > at >> > >> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) >> > at >> > >> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) >> > at >> > >> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) >> > at >> > >> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) >> > at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) >> > at >> > >> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) >> > at >> > >> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) >> > at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) >> > at >> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) >> > at >> > org.ju
Re: Integration Testing Requirements
Thanks Ankit. What is the difference between these hive tests (e.g., org.apache.phoenix.hive.HiveTezIT) and other tests that also use a mini cluster (org.apache.phoenix.end2end.MigrateSystemTablesToSystemNamespaceIT), which are passing? Specifically, what does it need from HADOOP_HOME? On Tue, Feb 19, 2019 at 11:39 AM Ankit Singhal wrote: > you can check if HADOOP_HOME and JAVA_HOME are properly set in the > environment. > > On Tue, Feb 19, 2019 at 11:23 AM William Shen > wrote: > > > Hi everyone, > > > > I'm trying to set up the Jenkins job at work to build Phoenix and run the > > integration tests. However, repeatedly I encounter issues with the hive > > module when I run mvn verify. Does the hive integration tests require any > > special set up for them to pass? The other modules passed integration > > testing successfully. > > > > Attaching below is a sample failure trace. > > > > Thanks! > > > > - Will > > > > [ERROR] Tests run: 6, Failures: 6, Errors: 0, Skipped: 0, Time > > elapsed: 48.302 s <<< FAILURE! - in > > org.apache.phoenix.hive.HiveTezIT[ERROR] > > simpleColumnMapTest(org.apache.phoenix.hive.HiveTezIT) Time elapsed: > > 6.727 s <<< FAILURE!junit.framework.AssertionFailedError: > > Unexpected exception java.lang.RuntimeException: > > org.apache.tez.dag.api.SessionNotRunning: TezSession has already > > shutdown. Application application_1550371508120_0001 failed 2 times > > due to AM Container for appattempt_1550371508120_0001_02 exited > > with exitCode: 127 > > For more detailed output, check application tracking > > page: > > http://40a4dd0e8959:38843/cluster/app/application_1550371508120_0001Then > , > > click on links to logs of each attempt. > > Diagnostics: Exception from container-launch. > > Container id: container_1550371508120_0001_02_01 > > Exit code: 127 > > Stack trace: ExitCodeException exitCode=127: > > at org.apache.hadoop.util.Shell.runCommand(Shell.java:545) > > at org.apache.hadoop.util.Shell.run(Shell.java:456) > > at > > org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722) > > at > > > org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211) > > at > > > org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302) > > at > > > org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82) > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > > at > > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > > at > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > > at java.lang.Thread.run(Thread.java:748) > > > > > > Container exited with a non-zero exit code 127 > > Failing this attempt. Failing the application. > > at > > > org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:535) > > at > > org.apache.phoenix.hive.HiveTestUtil.cliInit(HiveTestUtil.java:637) > > at > > org.apache.phoenix.hive.HiveTestUtil.cliInit(HiveTestUtil.java:590) > > at > > > org.apache.phoenix.hive.BaseHivePhoenixStoreIT.runTest(BaseHivePhoenixStoreIT.java:117) > > at > > > org.apache.phoenix.hive.HivePhoenixStoreIT.simpleColumnMapTest(HivePhoenixStoreIT.java:103) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > > at > > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:498) > > at > > > org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) > > at > > > org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) > > at > > > org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) > > at > > > org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) > > at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) > > at > > > org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) > > at > > > org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) > > at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) > > at > org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) > > at > > org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) > > at > org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) > > at > org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) > > at > > > org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) > >
Re: Integration Testing Requirements
you can check if HADOOP_HOME and JAVA_HOME are properly set in the environment. On Tue, Feb 19, 2019 at 11:23 AM William Shen wrote: > Hi everyone, > > I'm trying to set up the Jenkins job at work to build Phoenix and run the > integration tests. However, repeatedly I encounter issues with the hive > module when I run mvn verify. Does the hive integration tests require any > special set up for them to pass? The other modules passed integration > testing successfully. > > Attaching below is a sample failure trace. > > Thanks! > > - Will > > [ERROR] Tests run: 6, Failures: 6, Errors: 0, Skipped: 0, Time > elapsed: 48.302 s <<< FAILURE! - in > org.apache.phoenix.hive.HiveTezIT[ERROR] > simpleColumnMapTest(org.apache.phoenix.hive.HiveTezIT) Time elapsed: > 6.727 s <<< FAILURE!junit.framework.AssertionFailedError: > Unexpected exception java.lang.RuntimeException: > org.apache.tez.dag.api.SessionNotRunning: TezSession has already > shutdown. Application application_1550371508120_0001 failed 2 times > due to AM Container for appattempt_1550371508120_0001_02 exited > with exitCode: 127 > For more detailed output, check application tracking > page: > http://40a4dd0e8959:38843/cluster/app/application_1550371508120_0001Then, > click on links to logs of each attempt. > Diagnostics: Exception from container-launch. > Container id: container_1550371508120_0001_02_01 > Exit code: 127 > Stack trace: ExitCodeException exitCode=127: > at org.apache.hadoop.util.Shell.runCommand(Shell.java:545) > at org.apache.hadoop.util.Shell.run(Shell.java:456) > at > org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722) > at > org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302) > at > org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82) > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) > at java.lang.Thread.run(Thread.java:748) > > > Container exited with a non-zero exit code 127 > Failing this attempt. Failing the application. > at > org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:535) > at > org.apache.phoenix.hive.HiveTestUtil.cliInit(HiveTestUtil.java:637) > at > org.apache.phoenix.hive.HiveTestUtil.cliInit(HiveTestUtil.java:590) > at > org.apache.phoenix.hive.BaseHivePhoenixStoreIT.runTest(BaseHivePhoenixStoreIT.java:117) > at > org.apache.phoenix.hive.HivePhoenixStoreIT.simpleColumnMapTest(HivePhoenixStoreIT.java:103) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) > at > org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) > at > org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) > at > org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) > at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) > at > org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) > at > org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) > at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) > at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) > at > org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) > at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) > at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) > at > org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) > at > org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) > at org.junit.runners.ParentRunner.run(ParentRunner.java:363) > at org.junit.runners.Suite.runChild(Suite.java:128) > at org.junit.runners.Suite.runChild(Suite.java:27) > at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) > at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) > at > org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) > at org.junit.runners.ParentRunner.access$000(ParentRunne
Integration Testing Requirements
Hi everyone, I'm trying to set up the Jenkins job at work to build Phoenix and run the integration tests. However, repeatedly I encounter issues with the hive module when I run mvn verify. Does the hive integration tests require any special set up for them to pass? The other modules passed integration testing successfully. Attaching below is a sample failure trace. Thanks! - Will [ERROR] Tests run: 6, Failures: 6, Errors: 0, Skipped: 0, Time elapsed: 48.302 s <<< FAILURE! - in org.apache.phoenix.hive.HiveTezIT[ERROR] simpleColumnMapTest(org.apache.phoenix.hive.HiveTezIT) Time elapsed: 6.727 s <<< FAILURE!junit.framework.AssertionFailedError: Unexpected exception java.lang.RuntimeException: org.apache.tez.dag.api.SessionNotRunning: TezSession has already shutdown. Application application_1550371508120_0001 failed 2 times due to AM Container for appattempt_1550371508120_0001_02 exited with exitCode: 127 For more detailed output, check application tracking page:http://40a4dd0e8959:38843/cluster/app/application_1550371508120_0001Then, click on links to logs of each attempt. Diagnostics: Exception from container-launch. Container id: container_1550371508120_0001_02_01 Exit code: 127 Stack trace: ExitCodeException exitCode=127: at org.apache.hadoop.util.Shell.runCommand(Shell.java:545) at org.apache.hadoop.util.Shell.run(Shell.java:456) at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722) at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302) at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) Container exited with a non-zero exit code 127 Failing this attempt. Failing the application. at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:535) at org.apache.phoenix.hive.HiveTestUtil.cliInit(HiveTestUtil.java:637) at org.apache.phoenix.hive.HiveTestUtil.cliInit(HiveTestUtil.java:590) at org.apache.phoenix.hive.BaseHivePhoenixStoreIT.runTest(BaseHivePhoenixStoreIT.java:117) at org.apache.phoenix.hive.HivePhoenixStoreIT.simpleColumnMapTest(HivePhoenixStoreIT.java:103) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.junit.runners.Suite.runChild(Suite.java:128) at org.junit.runners.Suite.runChild(Suite.java:27) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) at org.junit.runners.ParentRunner.run(ParentRunner.java:363) at org.apache.maven.surefire.junitcore.JUnitCore.run(JUnitCore.java:55) at org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRe
