Hi Pankaj, Mangirish, Is this intermittent or do you consistently get authentication issues? I am attaching my openrc file:
OS_PROJECT_DOMAIN_NAME=scigap OS_USER_DOMAIN_NAME=tacc OS_PROJECT_NAME=scigap OS_TENANT_NAME=scigap OS_USERNAME=scigap OS_PASSWORD=XXXXXXXXXXXXX OS_AUTH_URL=https://jblb.jetstream-cloud.org:35357/v3 OS_IDENTITY_API_VERSION=3 # Network Properties OS_FLOATING_IP_POOL=public OS_SUBNET_NAME=airavata To complicate the puzzle, I am consistently able to launch few hundred’s of instances within the past day without any issues. I just checked the code, I am using it out of the box and no local changes. Suresh > On Apr 22, 2016, at 3:18 PM, Pankaj Saha <[email protected]> wrote: > > Hello Everyone, > > I had a discussion with Mangirish today morning and we could figure out > through debugging that java code getting authentication exception when trying > to authenticate the user with openstack. > NOVA client for openstack did work well and I have also tested with > credentials to directly login into the portal. > I have replicated the same in another system in my same lab network and the > test case still failing for the same status-401, authentication error. > > I have followed these below steps: > generated rsa key > downloaded airavata from git, switched it to "develop" branch > changed the required property values for openstack. > run : mvn clean install from inside the cloud/cloud-provisioning module. > It's definitely not the firewall issue as its failing in the authentication > stage. I am attaching my property file for reference, please let me know if > you find anything wrong in this. > test_data.properties > > # Common properties > publicKeyFile=/home/psaha4/.ssh/id_rsa.pub > # Jetstream properties > jetstream_imageId=448636b0-450a-4b49-9bfe-b3135fc443e8 > jetstream_flavorId=3 > OS_PROJECT_DOMAIN_NAME=tacc > OS_USER_DOMAIN_NAME=tacc > OS_PROJECT_NAME=scigap > OS_TENANT_NAME=scigap > OS_USERNAME=scigap > OS_PASSWORD=<not exposing the password here> > OS_AUTH_URL=https://jblb.jetstream-cloud.org:35357/v3 > <https://jblb.jetstream-cloud.org:35357/v3> > OS_IDENTITY_API_VERSION=3 > # Network Properties > OS_FLOATING_IP_POOL=public > OS_SUBNET_NAME=airavata > > Can someone send me jetstream_openrc.properties and test_data.properties file > from a working environment in a separate email so that I can place them and > test from my system once. > > Thanks > Pankaj > > > On Thu, Apr 21, 2016 at 11:43 AM, Pankaj Saha <[email protected] > <mailto:[email protected]>> wrote: > Hi Shameera, > I have received the password from Mangirish and I am using the same details > as he has provided. > Regarding the jetstream keypair, my understanding is, during the test run it > fetches the public key from the properties file and send it to the jetstream > servers. Please let me know how I need to configure it separately. > > Thanks > Pankaj > > On Wed, Apr 20, 2016 at 8:48 PM, Shameera Rathnayaka <[email protected] > <mailto:[email protected]>> wrote: > Hi Pankaj, > > To work with your ssh keys you need to add them to jetstream keypair. Have > you done that part? > > also you are not providing correct the OS_PASSWORD value accordding to above > deatils. > > Shameera. > > > On Wed, Apr 20, 2016 at 3:42 PM Pankaj Saha <[email protected] > <mailto:[email protected]>> wrote: > I have just use maven to build the same project. here is thedetails > # Common properties > publicKeyFile=/home/psaha4/.ssh/id_rsa.pub > > # Jetstream properties > jetstream_imageId=448636b0-450a-4b49-9bfe-b3135fc443e8 > jetstream_flavorId=3 > > OS_PROJECT_DOMAIN_NAME=tacc > OS_USER_DOMAIN_NAME=tacc > OS_PROJECT_NAME=scigap > OS_TENANT_NAME=scigap > OS_USERNAME=scigap > OS_PASSWORD=<not exposing here> > OS_AUTH_URL=https://jblb.jetstream-cloud.org:35357/v3 > <https://jblb.jetstream-cloud.org:35357/v3> > OS_IDENTITY_API_VERSION=3 > > # Network Properties > OS_FLOATING_IP_POOL=public > OS_SUBNET_NAME=airavata > > The test case error that I am getting for the Test case is al below: > ------------------------------------------------------- > T E S T S > ------------------------------------------------------- > Running org.apache.airavata.cloud.test.CloudIntfTest > AuthenticationException{message=Unauthorized, status=401} > at > org.openstack4j.core.transport.HttpExceptionHandler.mapException(HttpExceptionHandler.java:36) > at > org.openstack4j.core.transport.HttpExceptionHandler.mapException(HttpExceptionHandler.java:23) > at > org.openstack4j.openstack.internal.OSAuthenticator.authenticateV3(OSAuthenticator.java:161) > at > org.openstack4j.openstack.internal.OSAuthenticator.invoke(OSAuthenticator.java:78) > at > org.openstack4j.openstack.client.OSClientBuilder$ClientV3.authenticate(OSClientBuilder.java:163) > at > org.openstack4j.openstack.client.OSClientBuilder$ClientV3.authenticate(OSClientBuilder.java:127) > at > org.apache.airavata.cloud.openstack.OS4JClientProvider.getOSClientV3(OS4JClientProvider.java:86) > at > org.apache.airavata.cloud.openstack.OS4JClientProvider.getOSClient(OS4JClientProvider.java:49) > at > org.apache.airavata.cloud.intf.impl.OpenstackIntfImpl.<init>(OpenstackIntfImpl.java:78) > at > org.apache.airavata.cloud.test.CloudIntfTest.jetstreamCreateDeleteServerTest(CloudIntfTest.java:77) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) > at > org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) > at > org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) > at > org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) > at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) > at > org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) > at > org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) > at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) > at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) > at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) > at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) > at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) > at org.junit.runners.ParentRunner.run(ParentRunner.java:363) > at > org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:283) > at > org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:173) > at > org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) > at > org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:128) > at > org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:203) > at > org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:155) > at > org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) > java.lang.NullPointerException > at > org.apache.airavata.cloud.intf.impl.OpenstackIntfImpl.getKeyPair(OpenstackIntfImpl.java:215) > at > org.apache.airavata.cloud.test.CloudIntfTest.jetstreamCreateDeleteServerTest(CloudIntfTest.java:92) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) > at > org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) > at > org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) > at > org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) > at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) > at > org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) > at > org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) > at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) > at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) > at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) > at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) > at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) > at org.junit.runners.ParentRunner.run(ParentRunner.java:363) > at > org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:283) > at > org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:173) > at > org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) > at > org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:128) > at > org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:203) > at > org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:155) > at > org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) > [main] ERROR org.apache.airavata.cloud.intf.impl.OpenstackIntfImpl - Failed > to retrieve keypair: testKey > java.lang.NullPointerException > at > org.apache.airavata.cloud.intf.impl.OpenstackIntfImpl.createKeyPair(OpenstackIntfImpl.java:197) > at > org.apache.airavata.cloud.test.CloudIntfTest.jetstreamCreateDeleteServerTest(CloudIntfTest.java:94) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) > at > org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) > at > org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) > at > org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) > at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) > at > org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) > at > org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) > at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) > at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) > at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) > at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) > at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) > at org.junit.runners.ParentRunner.run(ParentRunner.java:363) > at > org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:283) > at > org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:173) > at > org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) > at > org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:128) > at > org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:203) > at > org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:155) > at > org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) > [main] ERROR org.apache.airavata.cloud.intf.impl.OpenstackIntfImpl - Failed > to create keypair: testKey > java.lang.NullPointerException > at > org.apache.airavata.cloud.test.CloudIntfTest.jetstreamCreateDeleteServerTest(CloudIntfTest.java:97) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at > org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50) > at > org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) > at > org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) > at > org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) > at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325) > at > org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78) > at > org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57) > at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290) > at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71) > at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288) > at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58) > at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268) > at org.junit.runners.ParentRunner.run(ParentRunner.java:363) > at > org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:283) > at > org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:173) > at > org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) > at > org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:128) > at > org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:203) > at > org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:155) > at > org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) > Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.913 sec <<< > FAILURE! - in org.apache.airavata.cloud.test.CloudIntfTest > jetstreamCreateDeleteServerTest(org.apache.airavata.cloud.test.CloudIntfTest) > Time elapsed: 0.908 sec <<< FAILURE! > java.lang.AssertionError: null > at org.junit.Assert.fail(Assert.java:86) > at org.junit.Assert.fail(Assert.java:95) > at > org.apache.airavata.cloud.test.CloudIntfTest.jetstreamCreateDeleteServerTest(CloudIntfTest.java:128) > > > > On Wed, Apr 20, 2016 at 3:36 PM, Suresh Marru <[email protected] > <mailto:[email protected]>> wrote: > Thats nice. Few suggestions: > > * Eclipse or IDEA are good to write code, but to build and run tests from > maven, command line is the best option. > * Please use the mailing lists as much as possible so rest of us can also > contribute. If even you use hangouts, please take time to explain what the > issue is so it engages every one. > > I am able to run the test cases and am able to program against > OpenstackIntfImpl just fine. Can you elaborate on what is the authentication > issue you are running into? > > Suresh > >> On Apr 20, 2016, at 3:30 PM, Pankaj Saha <[email protected] >> <mailto:[email protected]>> wrote: >> >> Hi Suresh, >> >> I just had a hangout session with Mangirish regarding the same. It looks >> like an authentication issue with openstack which he is aware of. He has >> explained me his code and I am going to retry fixing the problem. >> >> I did not use maven to build his project instead I have export his project >> as eclipse (mvn eclipse:eclipse) and trying to run the junit test. >> >> Will update you once I find something new. >> >> Thanks >> Pankaj >> >> >> On Wed, Apr 20, 2016 at 3:21 PM, Suresh Marru <[email protected] >> <mailto:[email protected]>> wrote: >> Hi Pankaj, >> >> Can you please be more clear? What is failing? Did you try to build it using >> maven within the cloud provisioning directory itself? Did you change the >> public key file in the test_data.properties? >> >> Suresh >> >>> On Apr 20, 2016, at 2:56 PM, Pankaj Saha <[email protected] >>> <mailto:[email protected]>> wrote: >>> >>> I am able to get Mangirish's code in the develop branch. After making it an >>> eclipse project, when I am trying to run it as JUnit test, it's failing. >>> Need help to fix this, possibly some configuration changes in the >>> properties file or similar. >>> It will be great we can talk over a hangout session or at least a chat >>> session to make it work. >>> >>> On Wed, Apr 20, 2016 at 12:05 PM, Mangirish Wagle <[email protected] >>> <mailto:[email protected]>> wrote: >>> Hi Pankaj, >>> >>> You may find a sample test code for the module in this unit test file:- >>> >>> https://github.com/apache/airavata/blob/develop/modules/cloud/cloud-provisioning/src/test/java/org/apache/airavata/cloud/test/CloudIntfTest.java >>> >>> <https://github.com/apache/airavata/blob/develop/modules/cloud/cloud-provisioning/src/test/java/org/apache/airavata/cloud/test/CloudIntfTest.java> >>> >>> Also, if you want to test run the code, you may please follow this quick >>> README:- >>> >>> https://github.com/apache/airavata/blob/develop/modules/cloud/cloud-provisioning/README >>> >>> <https://github.com/apache/airavata/blob/develop/modules/cloud/cloud-provisioning/README> >>> >>> Please let me know if you need some more info or code walkthrough. Sending >>> you the jetstream openrc credentials separately. >>> >>> Thanks. >>> >>> Regards, >>> Mangirish >>> >>> On Wed, Apr 20, 2016 at 11:42 AM, Suresh Marru <[email protected] >>> <mailto:[email protected]>> wrote: >>> Hi Pankaj, >>> >>> Please switch to ‘develop’ branch and look for the cloud provisioning >>> module - >>> https://github.com/apache/airavata/tree/develop/modules/cloud/cloud-provisioning >>> >>> <https://github.com/apache/airavata/tree/develop/modules/cloud/cloud-provisioning> >>> >>> Suresh >>> >>>> On Apr 20, 2016, at 11:37 AM, Pankaj Saha <[email protected] >>>> <mailto:[email protected]>> wrote: >>>> >>>> Hello Mangirish, >>>> I have latest Airavata mater branch installed in my local system. Can you >>>> please give us some clue how to start creating the VMs through you >>>> application. Please specify where we can find your corresponding java >>>> code. Is it through PGA website? >>>> Please share the required password to me in a separate email. >>>> >>>> Thanks >>>> Pankaj >>> >>> >>> >> >> > > > -- > Shameera Rathnayaka > >
