[ https://issues.apache.org/jira/browse/CLOUDSTACK-3972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13726012#comment-13726012 ]
Sowmya Krishnan commented on CLOUDSTACK-3972: --------------------------------------------- Failure is not in deploying VM. Failure is happening while querying for the Async Job from Netscaler side. Description provides the output of the Netscaler provision server deamon which shows the failure while polling for the job: MSlog is just for reference to the job. debug: Parsing for xml tag //jobstatus/text() debug: Result (2 nodes): = node "text": type 3 debug: Exiting chunk (1) (2) (4) = node "text": type 3 debug: Exiting chunk (10) (3) (4) WARN: Job with job type (0) for Service Group (Cloud119d569d7a3b4b3aae22d8e6290b2954) -> Error : provserver_err_asynctaskpoll > [VPC] [Autoscale] Autoscaling fails for user configured VPC due to > queryAsyncJob task poll fail > ----------------------------------------------------------------------------------------------- > > Key: CLOUDSTACK-3972 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-3972 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) > Components: Management Server > Affects Versions: 4.2.0 > Environment: 4.2, Xen server, Netscaler as LB device > Reporter: Sowmya Krishnan > Assignee: Sowmya Krishnan > Priority: Blocker > Fix For: 4.2.0 > > Attachments: ms.log > > > Configure VPC as user with Netscaler as public LB device > Configure autoscale > Deploys VM but async job task poll fails and the VM fails to be added to the > LB rule. Consequently autoscaling fails. > Works fine outside VPC in a normal isolated guest network and also in an > admin configured VPC > Following is the error log from ns.log: > Jul 31 09:21:30 <local0.debug> ns provserverd[55624]: Generating Signature... > Jul 31 09:21:30 <local0.debug> ns provserverd[55624]: Signature : input > apikey=6xvsek_nszyvmntoo53s7mbocdfmuyy1vs6b7jq9uwktinxjpwagqaijzwrtd_zdd9jjcdknqktrc6jujhedlg&command=queryasyncjobresult&jobid=b5b50c33-bc61-4c72-85b6-072588f8fe62 > Jul 31 09:21:30 <local0.debug> ns provserverd[55624]: Signature : secret > yABnjqnBbn33TcUEWlMSK4JERNOLXgBr3ENstSlhpCFnB_gws8JEBxX6MMnhkeliMfY5ZR1JcMmtRAfZ_RnX6w > Jul 31 09:21:30 <local0.debug> ns provserverd[55624]: Signature : output > vGQt7yizi8ELMjIRjJNUOam0eYs= > Jul 31 09:21:30 <local0.debug> ns provserverd[55624]: Sending request URL: > http://10.102.192.203:8080/client/api?apiKey=6XvseK_nSZYvMntOO53s7MbOcDFMUYY1vs6B7JQ9UWKTINxjPWAGQAIJZWrTD_ZdD9JJcDKnQktrC6jUjHeDlg&command=queryAsyncJobResult&jobid=b5b50c33-bc61-4c72-85b6-072588f8fe62&signature=vGQt7yizi8ELMjIRjJNUOam0eYs%3d > Jul 31 09:21:30 <local0.debug> ns provserverd[55624]: Exiting chunk (<?xml > version="1.0" encoding="UTF-8"?><queryasyncjobresultresponse > cloud-stack-version="4.2.0-SNAPSHOT"><accountid>cffecf34-eefa-4c44-b282-2fda3768296f</accountid><userid>c0217a6f-cc03-461d-9f11-2c742e84f1cb</userid><cmd>org.apache.cloudstack.api.command.user.vm.DeployVMCmd</cmd><jobstatus>1</jobstatus><jobprocstatus>0</jobprocstatus><jobresultcode>0</jobresultcode><jobresulttype>object</jobresulttype><jobresult><virtualmachine><id>afd70adf-3f33-4ccb-90ef-a690012cef93</id><name>afd70adf-3f33-4ccb-90ef-a690012cef93</name><displayname>AutoScale-LB-user2lb</displayname><account>account2</account><domainid>53d08f2a-f9a3-11e2-96a9-ca9c098803af</domainid><domain>ROOT</domain><created>2013-07-31T14:57:02+0530</created><state>Running</state><haenable>false</haenable><zoneid>efdf2bd8-ef03-47e6-8277-4d7c267a9658</zoneid><zonename>BLR</zonename><templateid>83df72df-e499-491c-895c-0282e8fa6f07</templateid><templatename>rhel62</templatename><templatedisplaytext>Rhel6 > Jul 31 09:21:30 <local0.debug> ns provserverd[55624]: Parsing for xml tag > //jobstatus/text() > Jul 31 09:21:30 <local0.debug> ns provserverd[55624]: Result (2 nodes): > Jul 31 09:21:30 <local0.debug> ns provserverd[55624]: Exiting chunk (1) (2) > (4) > Jul 31 09:21:30 <local0.debug> ns provserverd[55624]: Exiting chunk (10) (3) > (4) > Jul 31 09:21:30 <local0.warn> ns provserverd[55624]: Job with job type (0) > for Service Group (Cloud119d569d7a3b4b3aae22d8e6290b2954) -> Error : > provserver_err_asynctaskpoll > Jul 31 09:21:30 <local0.debug> ns provserverd[55624]: executing rollback from > errorstore > Jul 31 09:21:30 <local0.debug> ns provserverd[55624]: emptying rollback_list > debug logs from provserverd: > debug: Generating Signature... > debug: Signature : input > apikey=6xvsek_nszyvmntoo53s7mbocdfmuyy1vs6b7jq9uwktinxjpwagqaijzwrtd_zdd9jjcdknqktrc6jujhedlg&command=deployvirtualmachine&displayname=autoscale-lb-user2lb&lbruleid=5497a5c1-5d43-4737-a67b-de024ca20978&networkids=16b37678-d804-45b2-af18-ee03998c0662&serviceofferingid=6c6434af-4d4e-4a52-bddd-7d998f84e5cf&templateid=83df72df-e499-491c-895c-0282e8fa6f07&zoneid=efdf2bd8-ef03-47e6-8277-4d7c267a9658 > debug: Signature : secret > yABnjqnBbn33TcUEWlMSK4JERNOLXgBr3ENstSlhpCFnB_gws8JEBxX6MMnhkeliMfY5ZR1JcMmtRAfZ_RnX6w > debug: Signature : output odqoWamYOVt9pLf9JN7Xq02ZjI4= > debug: Sending request URL: > http://10.102.192.203:8080/client/api?apiKey=6XvseK_nSZYvMntOO53s7MbOcDFMUYY1vs6B7JQ9UWKTINxjPWAGQAIJZWrTD_ZdD9JJcDKnQktrC6jUjHeDlg&command=deployVirtualMachine&zoneid=efdf2bd8-ef03-47e6-8277-4d7c267a9658&serviceofferingid=6c6434af-4d4e-4a52-bddd-7d998f84e5cf&templateid=83df72df-e499-491c-895c-0282e8fa6f07&displayname=AutoScale-LB-user2lb&networkids=16b37678-d804-45b2-af18-ee03998c0662&lbruleid=5497a5c1-5d43-4737-a67b-de024ca20978&signature=odqoWamYOVt9pLf9JN7Xq02ZjI4%3d > debug: Exiting chunk (<?xml version="1.0" > encoding="UTF-8"?><deployvirtualmachineresponse > cloud-stack-version="4.2.0-SNAPSHOT"><jobid>b5b50c33-bc61-4c72-85b6-072588f8fe62</jobid></deployvirtualmachineresponse>) > (188) (376) > debug: Parsing for xml tag //jobid/text() > debug: > Result (1 nodes): > = node "text": type 3 > debug: Exiting chunk (b5b50c33-bc61-4c72-85b6-072588f8fe62) (37) (74) > debug: Task id is b5b50c33-bc61-4c72-85b6-072588f8fe62 > debug: New Connection... > debug: Sending Heartbeat > debug: New Connection... > debug: Got EOF ... closing socket 11 > debug: New Connection... > debug: Got EOF ... closing socket 11 > debug: Got EOF ... closing socket 10 > debug: Sending Heartbeat > debug: Executing poll task for Service Group > (Cloud119d569d7a3b4b3aae22d8e6290b2954) async task > (b5b50c33-bc61-4c72-85b6-072588f8fe62) > debug: Exiting chunk (command=queryAsyncJobResult&jobid=) (35) (70) > debug: Exiting chunk > (command=queryAsyncJobResult&jobid=b5b50c33-bc61-4c72-85b6-072588f8fe62) (71) > (142) > debug: DATABASE: get statement is > ****select apikey, secretkey, url from servicegroup_info where svcgrp like > "%Cloud119d569d7a3b4b3aae22d8e6290b2954%"**** > debug: Generating Signature... > debug: Signature : input > apikey=6xvsek_nszyvmntoo53s7mbocdfmuyy1vs6b7jq9uwktinxjpwagqaijzwrtd_zdd9jjcdknqktrc6jujhedlg&command=queryasyncjobresult&jobid=b5b50c33-bc61-4c72-85b6-072588f8fe62 > debug: Signature : secret > yABnjqnBbn33TcUEWlMSK4JERNOLXgBr3ENstSlhpCFnB_gws8JEBxX6MMnhkeliMfY5ZR1JcMmtRAfZ_RnX6w > debug: Signature : output vGQt7yizi8ELMjIRjJNUOam0eYs= > debug: Sending request URL: > http://10.102.192.203:8080/client/api?apiKey=6XvseK_nSZYvMntOO53s7MbOcDFMUYY1vs6B7JQ9UWKTINxjPWAGQAIJZWrTD_ZdD9JJcDKnQktrC6jUjHeDlg&command=queryAsyncJobResult&jobid=b5b50c33-bc61-4c72-85b6-072588f8fe62&signature=vGQt7yizi8ELMjIRjJNUOam0eYs%3d > debug: Exiting chunk (<?xml version="1.0" > encoding="UTF-8"?><queryasyncjobresultresponse > cloud-stack-version="4.2.0-SNAPSHOT"><accountid>cffecf34-eefa-4c44-b282-2fda3768296f</accountid><userid>c0217a6f-cc03-461d-9f11-2c742e84f1cb</userid><cmd>org.apache.cloudstack.api.command.user.vm.DeployVMCmd</cmd><jobstatus>1</jobstatus><jobprocstatus>0</jobprocstatus><jobresultcode>0</jobresultcode><jobresulttype>object</jobresulttype><jobresult><virtualmachine><id>afd70adf-3f33-4ccb-90ef-a690012cef93</id><name>afd70adf-3f33-4ccb-90ef-a690012cef93</name><displayname>AutoScale-LB-user2lb</displayname><account>account2</account><domainid>53d08f2a-f9a3-11e2-96a9-ca9c098803af</domainid><domain>ROOT</domain><created>2013-07-31T14:57:02+0530</created><state>Running</state><haenable>false</haenable><zoneid>efdf2bd8-ef03-47e6-8277-4d7c267a9658</zoneid><zonename>BLR</zonename><templateid>83df72df-e499-491c-895c-0282e8fa6f07</templateid><templatename>rhel62</templatename><templatedisplaytext>Rhel62</templatedisplaytext><passwordenabled>false</passwordenabled><serviceofferingid>6c6434af-4d4e-4a52-bddd-7d998f84e5cf</serviceofferingid><serviceofferingname>Small > > Instance</serviceofferingname><cpunumber>1</cpunumber><cpuspeed>500</cpuspeed><memory>512</memory><guestosid>53f7cb58-f9a3-11e2-96a9-ca9c098803af</guestosid><rootdeviceid>0</rootdeviceid><rootdevicetype>ROOT</rootdevicetype><nic><id>05b210c4-36e5-4683-9ce6-08936852f4d0</id><networkid>16b37678-d804-45b2-af18-ee03998c0662</networkid><networkname>user2tier1</networkname><netmask>255.255.255.224</netmask><gateway>10.20.1.1</gateway><ipaddress>10.20.1.3</ipaddress><isolationuri>vlan://840</isolationuri><broadcasturi>vlan://840</broadcasturi><traffictype>Guest</traffictype><type>Isolated</type><isdefault>true</isdefault><macaddress>02:00:35:0e:00:07</macaddress></nic><hypervisor>XenServer</hypervisor><displayvm>true</displayvm><isdynamicallyscalable>false</isdynamicallyscalable><jobid>b5b50c33-bc61-4c72-85b6-072588f8fe62</jobid><jobstatus>0</jobstatus></virtualmachine></jobresult><created>2013-07-31T14:57:02+0530</created><jobid>b5b50c33-bc61-4c72-85b6-072588f8fe62</jobid></queryasyncjobresultresponse>) > (2145) (4290) > debug: Parsing for xml tag //jobstatus/text() > debug: > Result (2 nodes): > = node "text": type 3 > debug: Exiting chunk (1) (2) (4) > = node "text": type 3 > debug: Exiting chunk (10) (3) (4) > WARN: > Job with job type (0) for Service Group > (Cloud119d569d7a3b4b3aae22d8e6290b2954) -> Error : > provserver_err_asynctaskpoll > debug: executing rollback from errorstore > debug: emptying rollback_list > debug: Sending Heartbeat -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira