<!--
Verify first that your issue/request is not already reported on GitHub.
Also test if the latest release and master branch are affected too.
Always add information AFTER of these HTML comments, but no need to delete the
comments.
-->
##### ISSUE TYPE
<!-- Pick one below and delete the rest -->
* Bug Report
##### COMPONENT NAME
<!--
Categorize the issue, e.g. API, VR, VPN, UI, etc.
-->
~~~
VR
~~~
##### CLOUDSTACK VERSION
<!--
New line separated list of affected versions, commit ID for issues on master
branch.
-->
~~~
4.11.2
~~~
##### CONFIGURATION
<!--
Information about the configuration if relevant, e.g. basic network, advanced
networking, etc. N/A otherwise
-->
##### OS / ENVIRONMENT
<!--
Information about the environment if relevant, N/A otherwise
-->
##### SUMMARY
<!-- Explain the problem/feature briefly -->
~~~
2018-10-05 11:24:43,634 INFO [jobs.impl.AsyncJobMonitor]
(API-Job-Executor-1:ctx-2f1d201c job-32445) Add job-32445 into job monitoring
2018-10-05 11:24:43,637 DEBUG [jobs.impl.AsyncJobManagerImpl]
(API-Job-Executor-1:ctx-2f1d201c job-32445) Executing AsyncJobVO {id:32445,
userId: 2, accountId: 2, instanceType: None, instanceId: null, cmd:
org.apache.cloudstack.api.command.user.network.RestartNetworkCmd, cmdInfo:
{"makeredundant":"false","cleanup":"true","response":"json","ctxUserId":"2","httpmethod":"GET","ctxStartEventId":"1145358","id":"48df88b1-c2e2-432d-811a-681a2be74dde","ctxDetails":"{\"interface
com.cloud.network.Network\":\"48df88b1-c2e2-432d-811a-681a2be74dde\"}","ctxAccountId":"2","uuid":"48df88b1-c2e2-432d-811a-681a2be74dde","cmdEventType":"NETWORK.RESTART","_":"1538731483586"},
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result:
null, initMsid: 345050582394, completeMsid: null, lastUpdated: null,
lastPolled: null, created: null}
2018-10-05 11:24:43,664 DEBUG [engine.orchestration.NetworkOrchestrator]
(API-Job-Executor-1:ctx-2f1d201c job-32445 ctx-dd2ddecb) Restarting network
207...
2018-10-05 11:24:43,665 DEBUG [engine.orchestration.NetworkOrchestrator]
(API-Job-Executor-1:ctx-2f1d201c job-32445 ctx-dd2ddecb) Performing rolling
restart of routers of network Ntwk[207|Guest|8]
2018-10-05 11:24:43,677 DEBUG [engine.orchestration.NetworkOrchestrator]
(API-Job-Executor-1:ctx-2f1d201c job-32445 ctx-dd2ddecb) Asking VirtualRouter
to implemenet Ntwk[207|Guest|8]
2018-10-05 11:24:43,727 DEBUG [network.router.NetworkHelperImpl]
(API-Job-Executor-1:ctx-2f1d201c job-32445 ctx-dd2ddecb) Allocating the VR with
id=1604 in datacenter com.cloud.dc.DataCenterVO$$EnhancerByCGLIB$$2f0df801@1
with the hypervisor type VMware
2018-10-05 11:24:43,749 DEBUG [network.router.NetworkHelperImpl]
(API-Job-Executor-1:ctx-2f1d201c job-32445 ctx-dd2ddecb) Adding nic for Virtual
Router in Guest network Ntwk[207|Guest|8]
2018-10-05 11:24:43,749 DEBUG [network.router.NetworkHelperImpl]
(API-Job-Executor-1:ctx-2f1d201c job-32445 ctx-dd2ddecb) Adding nic for Virtual
Router in Control network
2018-10-05 11:24:43,756 DEBUG [engine.orchestration.NetworkOrchestrator]
(API-Job-Executor-1:ctx-2f1d201c job-32445 ctx-dd2ddecb) Found existing network
configuration for offering [Network Offering
[3-Control-System-Control-Network]: Ntwk[202|Control|3]
2018-10-05 11:24:43,756 DEBUG [engine.orchestration.NetworkOrchestrator]
(API-Job-Executor-1:ctx-2f1d201c job-32445 ctx-dd2ddecb) Releasing lock for
Acct[dff128d0-4e01-11e4-bb66-0050569e64b8-system]
2018-10-05 11:24:43,764 DEBUG [network.router.NetworkHelperImpl]
(API-Job-Executor-1:ctx-2f1d201c job-32445 ctx-dd2ddecb) Adding nic for Virtual
Router in Public network
2018-10-05 11:24:43,772 DEBUG [engine.orchestration.NetworkOrchestrator]
(API-Job-Executor-1:ctx-2f1d201c job-32445 ctx-dd2ddecb) Found existing network
configuration for offering [Network Offering [1-Public-System-Public-Network]:
Ntwk[200|Public|1]
2018-10-05 11:24:43,772 DEBUG [engine.orchestration.NetworkOrchestrator]
(API-Job-Executor-1:ctx-2f1d201c job-32445 ctx-dd2ddecb) Releasing lock for
Acct[dff128d0-4e01-11e4-bb66-0050569e64b8-system]
2018-10-05 11:24:43,783 INFO [network.router.NetworkHelperImpl]
(API-Job-Executor-1:ctx-2f1d201c job-32445 ctx-dd2ddecb) Use same MAC as
previous RvR, the MAC is 1e:00:6b:00:00:95
2018-10-05 11:24:43,785 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(API-Job-Executor-1:ctx-2f1d201c job-32445 ctx-dd2ddecb) Allocating entries for
VM: VM[DomainRouter|r-1604-VM]
2018-10-05 11:24:43,791 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(API-Job-Executor-1:ctx-2f1d201c job-32445 ctx-dd2ddecb) Allocating nics for
VM[DomainRouter|r-1604-VM]
2018-10-05 11:24:43,793 DEBUG [engine.orchestration.NetworkOrchestrator]
(API-Job-Executor-1:ctx-2f1d201c job-32445 ctx-dd2ddecb) Allocating nic for vm
VM[DomainRouter|r-1604-VM] in network Ntwk[207|Guest|8] with requested profile
NicProfile[0-0-null-10.1.1.1-vlan://1976
2018-10-05 11:24:43,808 DEBUG [cloud.network.NetworkModelImpl]
(API-Job-Executor-1:ctx-2f1d201c job-32445 ctx-dd2ddecb) Service SecurityGroup
is not supported in the network id=207
2018-10-05 11:24:43,810 DEBUG [engine.orchestration.NetworkOrchestrator]
(API-Job-Executor-1:ctx-2f1d201c job-32445 ctx-dd2ddecb) Allocating nic for vm
VM[DomainRouter|r-1604-VM] in network Ntwk[202|Control|3] with requested
profile null
2018-10-05 11:24:43,819 DEBUG [engine.orchestration.NetworkOrchestrator]
(API-Job-Executor-1:ctx-2f1d201c job-32445 ctx-dd2ddecb) Allocating nic for vm
VM[DomainRouter|r-1604-VM] in network Ntwk[200|Public|1] with requested profile
NicProfile[0-0-null-185.27.109.13-vlan://96
2018-10-05 11:24:43,830 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(API-Job-Executor-1:ctx-2f1d201c job-32445 ctx-dd2ddecb) Allocating disks for
VM[DomainRouter|r-1604-VM]
2018-10-05 11:24:43,845 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(API-Job-Executor-1:ctx-2f1d201c job-32445 ctx-dd2ddecb) Allocation completed
for VM: VM[DomainRouter|r-1604-VM]
2018-10-05 11:24:43,866 DEBUG [network.router.NetworkHelperImpl]
(API-Job-Executor-1:ctx-2f1d201c job-32445 ctx-dd2ddecb) Starting router
VM[DomainRouter|r-1604-VM]
2018-10-05 11:24:43,880 DEBUG [jobs.impl.AsyncJobManagerImpl]
(API-Job-Executor-1:ctx-2f1d201c job-32445 ctx-dd2ddecb) Sync job-32446
execution on object VmWorkJobQueue.1604
2018-10-05 11:27:51,739 DEBUG [network.router.NetworkHelperImpl]
(API-Job-Executor-1:ctx-2f1d201c job-32445 ctx-dd2ddecb) Attempting to destroy
router 1547
2018-10-05 11:27:51,755 DEBUG [db.Transaction.Transaction]
(API-Job-Executor-1:ctx-2f1d201c job-32445 ctx-dd2ddecb) Rolling back the
transaction: Time = 2 Name = API-Job-Executor-1; called by
-TransactionLegacy.rollback:890-TransactionLegacy.removeUpTo:833-TransactionLegacy.close:657-Transaction.execute:43-Transaction.execute:47-AsyncJobManagerImpl.submitAsyncJob:231-VirtualMachineManagerImpl.stopVmThroughJobQueue:4505-VirtualMachineManagerImpl.advanceStop:1600-VirtualMachineManagerImpl.advanceExpunge:513-VirtualMachineManagerImpl.advanceExpunge:502-VirtualMachineManagerImpl.expunge:491-NetworkHelperImpl.destroyRouter:253
2018-10-05 11:27:51,766 WARN [jobs.impl.AsyncJobManagerImpl]
(API-Job-Executor-1:ctx-2f1d201c job-32445 ctx-dd2ddecb) Unable to schedule
async job for command com.cloud.vm.VmWorkStop, unexpected exception.
2018-10-05 11:27:51,777 ERROR [cloud.api.ApiAsyncJobDispatcher]
(API-Job-Executor-1:ctx-2f1d201c job-32445) Unexpected exception while
executing org.apache.cloudstack.api.command.user.network.RestartNetworkCmd
2018-10-05 11:27:51,779 DEBUG [jobs.impl.AsyncJobManagerImpl]
(API-Job-Executor-1:ctx-2f1d201c job-32445) Complete async job-32445,
jobStatus: FAILED, resultCode: 530, result:
org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable
to schedule async job for command com.cloud.vm.VmWorkStop, unexpected
exception."}
2018-10-05 11:27:51,780 DEBUG [jobs.impl.AsyncJobManagerImpl]
(API-Job-Executor-1:ctx-2f1d201c job-32445) Publish async job-32445 complete on
message bus
2018-10-05 11:27:51,780 DEBUG [jobs.impl.AsyncJobManagerImpl]
(API-Job-Executor-1:ctx-2f1d201c job-32445) Wake up jobs related to job-32445
2018-10-05 11:27:51,780 DEBUG [jobs.impl.AsyncJobManagerImpl]
(API-Job-Executor-1:ctx-2f1d201c job-32445) Update db status for job-32445
2018-10-05 11:27:51,781 DEBUG [jobs.impl.AsyncJobManagerImpl]
(API-Job-Executor-1:ctx-2f1d201c job-32445) Wake up jobs joined with job-32445
and disjoin all subjobs created from job- 32445
2018-10-05 11:27:51,788 DEBUG [jobs.impl.AsyncJobManagerImpl]
(API-Job-Executor-1:ctx-2f1d201c job-32445) Done executing
org.apache.cloudstack.api.command.user.network.RestartNetworkCmd for job-32445
2018-10-05 11:27:51,788 INFO [jobs.impl.AsyncJobMonitor]
(API-Job-Executor-1:ctx-2f1d201c job-32445) Remove job-32445 from job monitoring
~~~
##### STEPS TO REPRODUCE
to be analysed
<!-- You can also paste gist.github.com links for larger files -->
##### EXPECTED RESULTS
<!-- What did you expect to happen when running the steps above? -->
~~~
single upgraded VR
~~~
##### ACTUAL RESULTS
<!-- What actually happened? -->
<!-- Paste verbatim command output between quotes below -->
~~~
2 VR for the same entwork claiming the same IP
~~~
[ Full content available at: https://github.com/apache/cloudstack/issues/2880 ]
This message was relayed via gitbox.apache.org for [email protected]
