On Thu, Jul 18, 2019 at 7:31 PM Vrgotic, Marko
<[email protected]> wrote:
>
> Hi Daniel,
>
> Is it possible that upgrade from 4.3.3 to 4.3.4  affected/reset/changed the 
> certificate for imageio?

Have you restarted the ovirt-imageio-proxy service after upgrading? It
should be restarted to reload the certificate.

>
> Reason why I am asking is that, while running 4.3.3 version, I was uploading 
> Ubuntu 16-18, CentOS 7 cloud images, and CentOS6 no issues.
> Now issue is with CentOS6.
> I have tried to upload centos6.5 image via Ansible ovirt_disk and than one 
> ended stuck in “Finalizing” state.
> Than I tried with to Upload same image from UI and that ended in “Paused” 
> state.
>
> I will try Test Connection and let you know.
>
> Sent from my iPhone
>
> > On 18 Jul 2019, at 16:13, Daniel Erez <[email protected]> wrote:
> >
> > Hi Marko,
> >
> > According to the log, it seems there's an issue with a secured
> > connection to the proxy.
> > Can you please try the 'Test Connection' button on upload disk dialog,
> > to ensure the certificate is properly installed?
> > Also, is the disk currently in 'Paused by System' status?
> >
> > Thanks,
> > Daniel
> >
> > On Thu, Jul 18, 2019 at 2:35 PM Vrgotic, Marko
> > <[email protected]> wrote:
> >>
> >> Hi Nir,
> >>
> >>
> >>
> >> Since this is already compressed file, I have added output of grep for 
> >> moment this command was issue and following 300lines.
> >>
> >>
> >>
> >> [root@ovirt-engine ovirt-engine]# zgrep "2019-07-17 13:36:11,121Z" 
> >> engine.log-20190* -A300
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,121Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Running command: 
> >> TransferDiskImageCommand internal: false. Entities affected :  ID: 
> >> 3452459d-aec6-430e-9509-1d9ca815b2d8 Type: DiskAction group 
> >> EDIT_DISK_PROPERTIES with role type USER
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,121Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Creating 
> >> ImageTransfer entity for command '28eda0c2-e36b-4e70-91ea-2ecf4a030d19'
> >>
> >> gzip: -A300.gz: No such file or directory
> >>
> >> [root@ovirt-engine ovirt-engine]# zgrep -A 300 "2019-07-17 13:36:11,121Z" 
> >> engine.log-20190*
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,121Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Running command: 
> >> TransferDiskImageCommand internal: false. Entities affected :  ID: 
> >> 3452459d-aec6-430e-9509-1d9ca815b2d8 Type: DiskAction group 
> >> EDIT_DISK_PROPERTIES with role type USER
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,121Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Creating 
> >> ImageTransfer entity for command '28eda0c2-e36b-4e70-91ea-2ecf4a030d19'
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,142Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Successfully 
> >> added Upload disk 'av-07-centos-65-base' (disk id: 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
> >> 'b44659a9-607a-4eeb-a255-99532fd4fce4') for image transfer command 
> >> '28eda0c2-e36b-4e70-91ea-2ecf4a030d19'
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,188Z INFO  
> >> [org.ovirt.engine.core.vdsbroker.vdsbroker.PrepareImageVDSCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] START, 
> >> PrepareImageVDSCommand(HostName = ovirt-hv-01.avinity.tv, 
> >> PrepareImageVDSCommandParameters:{hostId='e7e3f1dc-8037-4e74-a44c-442bdb02197d'}),
> >>  log id: 3bd84b38
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,351Z INFO  
> >> [org.ovirt.engine.core.vdsbroker.vdsbroker.PrepareImageVDSCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] FINISH, 
> >> PrepareImageVDSCommand, return: PrepareImageReturn:{status='Status 
> >> [code=0, message=Done]'}, log id: 3bd84b38
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,356Z INFO  
> >> [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeLegalityVDSCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] START, 
> >> SetVolumeLegalityVDSCommand( 
> >> SetVolumeLegalityVDSCommandParameters:{storagePoolId='10525aa0-839d-11e9-a016-00163e4f2a6d',
> >>  ignoreFailoverLimit='false', 
> >> storageDomainId='644aacaa-12e1-4fcd-b3aa-941678cf95bd', 
> >> imageGroupId='3452459d-aec6-430e-9509-1d9ca815b2d8', 
> >> imageId='b44659a9-607a-4eeb-a255-99532fd4fce4'}), log id: 5e0f7654
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,390Z INFO  
> >> [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeLegalityVDSCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] FINISH, 
> >> SetVolumeLegalityVDSCommand, return: , log id: 5e0f7654
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,394Z INFO  
> >> [org.ovirt.engine.core.vdsbroker.vdsbroker.AddImageTicketVDSCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] START, 
> >> AddImageTicketVDSCommand(HostName = ovirt-hv-01.avinity.tv, 
> >> AddImageTicketVDSCommandParameters:{hostId='e7e3f1dc-8037-4e74-a44c-442bdb02197d',
> >>  ticketId='10096b11-d10d-43aa-ad16-668b29a8c152', timeout='300', 
> >> operations='[write]', size='47244640256', 
> >> url='file:///rhev/data-center/mnt/172.17.28.5:_ovirt__production/644aacaa-12e1-4fcd-b3aa-941678cf95bd/images/3452459d-aec6-430e-9509-1d9ca815b2d8/b44659a9-607a-4eeb-a255-99532fd4fce4',
> >>  filename='null', sparse='true', 
> >> transferId='28eda0c2-e36b-4e70-91ea-2ecf4a030d19'}), log id: 3bf6b943
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,410Z INFO  
> >> [org.ovirt.engine.core.vdsbroker.vdsbroker.AddImageTicketVDSCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] FINISH, 
> >> AddImageTicketVDSCommand, return: StatusOnlyReturn [status=Status [code=0, 
> >> message=Done]], log id: 3bf6b943
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,411Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Started transfer 
> >> session with ticket id 10096b11-d10d-43aa-ad16-668b29a8c152, timeout 300 
> >> seconds
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,411Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Adding image 
> >> ticket to ovirt-imageio-proxy, id 10096b11-d10d-43aa-ad16-668b29a8c152
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,469Z ERROR 
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to add 
> >> image ticket to ovirt-imageio-proxy: javax.net.ssl.SSLHandshakeException: 
> >> sun.security.validator.ValidatorException: PKIX path building failed: 
> >> sun.security.provider.certpath.SunCertPathBuilderException: unable to find 
> >> valid certification path to requested target
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.security.ssl.Alerts.getSSLException(Alerts.java:192) 
> >> [jsse.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.security.ssl.SSLSocketImpl.fatal(SSLSocketImpl.java:1946) 
> >> [jsse.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.security.ssl.Handshaker.fatalSE(Handshaker.java:316) 
> >> [jsse.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.security.ssl.Handshaker.fatalSE(Handshaker.java:310) 
> >> [jsse.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.security.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1639)
> >>  [jsse.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.security.ssl.ClientHandshaker.processMessage(ClientHandshaker.java:223)
> >>  [jsse.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.security.ssl.Handshaker.processLoop(Handshaker.java:1037) 
> >> [jsse.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.security.ssl.Handshaker.process_record(Handshaker.java:965) 
> >> [jsse.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:1064) 
> >> [jsse.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1367)
> >>  [jsse.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1395) 
> >> [jsse.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1379) 
> >> [jsse.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.net.www.protocol.https.HttpsClient.afterConnect(HttpsClient.java:559) 
> >> [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:185)
> >>  [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.net.www.protocol.http.HttpURLConnection.getOutputStream0(HttpURLConnection.java:1334)
> >>  [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.net.www.protocol.http.HttpURLConnection.getOutputStream(HttpURLConnection.java:1309)
> >>  [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.net.www.protocol.https.HttpsURLConnectionImpl.getOutputStream(HttpsURLConnectionImpl.java:259)
> >>  [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand.addImageTicketToProxy(TransferDiskImageCommand.java:988)
> >>  [bll.jar:]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand.startImageTransferSession(TransferDiskImageCommand.java:911)
> >>  [bll.jar:]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand.handleImageIsReadyForTransfer(TransferDiskImageCommand.java:554)
> >>  [bll.jar:]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand.executeCommand(TransferDiskImageCommand.java:393)
> >>  [bll.jar:]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1157)
> >>  [bll.jar:]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1315)
> >>  [bll.jar:]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1964)
> >>  [bll.jar:]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:164)
> >>  [utils.jar:]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:103)
> >>  [utils.jar:]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1375) 
> >> [bll.jar:]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:419) 
> >> [bll.jar:]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.core.bll.executor.DefaultBackendActionExecutor.execute(DefaultBackendActionExecutor.java:13)
> >>  [bll.jar:]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.core.bll.Backend.runAction(Backend.java:451) [bll.jar:]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.core.bll.Backend.runActionImpl(Backend.java:433) 
> >> [bll.jar:]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.core.bll.Backend.runAction(Backend.java:388) [bll.jar:]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.reflect.GeneratedMethodAccessor775.invoke(Unknown Source) [:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >>  [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.ee.component.ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptor.java:52)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.weld.ejb.DelegatingInterceptorInvocationContext.proceed(DelegatingInterceptorInvocationContext.java:92)
> >>  [wildfly-weld-ejb-15.0.1.Final.jar:15.0.1.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.weld.interceptor.proxy.WeldInvocationContextImpl.interceptorChainCompleted(WeldInvocationContextImpl.java:107)
> >>  [weld-core-impl-3.0.5.Final.jar:3.0.5.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.weld.interceptor.proxy.WeldInvocationContextImpl.proceed(WeldInvocationContextImpl.java:126)
> >>  [weld-core-impl-3.0.5.Final.jar:3.0.5.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.core.common.di.interceptor.LoggingInterceptor.apply(LoggingInterceptor.java:12)
> >>  [common.jar:]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.reflect.GeneratedMethodAccessor59.invoke(Unknown Source) [:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >>  [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.weld.interceptor.reader.SimpleInterceptorInvocation$SimpleMethodInvocation.invoke(SimpleInterceptorInvocation.java:73)
> >>  [weld-core-impl-3.0.5.Final.jar:3.0.5.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.weld.interceptor.proxy.WeldInvocationContextImpl.invokeNext(WeldInvocationContextImpl.java:92)
> >>  [weld-core-impl-3.0.5.Final.jar:3.0.5.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.weld.interceptor.proxy.WeldInvocationContextImpl.proceed(WeldInvocationContextImpl.java:124)
> >>  [weld-core-impl-3.0.5.Final.jar:3.0.5.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.weld.bean.InterceptorImpl.intercept(InterceptorImpl.java:105) 
> >> [weld-core-impl-3.0.5.Final.jar:3.0.5.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.weld.ejb.DelegatingInterceptorInvocationContext.proceed(DelegatingInterceptorInvocationContext.java:82)
> >>  [wildfly-weld-ejb-15.0.1.Final.jar:15.0.1.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.weld.interceptors.EjbComponentInterceptorSupport.delegateInterception(EjbComponentInterceptorSupport.java:60)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:77)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.doMethodInterception(Jsr299BindingsInterceptor.java:89)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:102)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:63)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.core.bll.interceptors.CorrelationIdTrackerInterceptor.aroundInvoke(CorrelationIdTrackerInterceptor.java:13)
> >>  [bll.jar:]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.reflect.GeneratedMethodAccessor147.invoke(Unknown Source) [:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >>  [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptor.java:89)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeInterceptor.processInvocation(ExecutionTimeInterceptor.java:43)
> >>  [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45)
> >>  [wildfly-ee-15.0.1.Final.jar:15.0.1.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:40)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:52)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53)
> >>  [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:216)
> >>  [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:418) 
> >> [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:148)
> >>  [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:509)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.weld.module.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:81)
> >>  [weld-ejb-3.0.5.Final.jar:3.0.5.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:89)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41)
> >>  [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterceptor.processInvocation(WaitTimeInterceptor.java:47)
> >>  [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.ejb3.security.SecurityContextInterceptor.processInvocation(SecurityContextInterceptor.java:100)
> >>  [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.ejb3.deployment.processors.StartupAwaitInterceptor.processInvocation(StartupAwaitInterceptor.java:22)
> >>  [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.ejb3.component.interceptors.ShutDownInterceptorFactory$1.processInvocation(ShutDownInterceptorFactory.java:64)
> >>  [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:67)
> >>  [wildfly-ejb3-15.0.1.Final.jar:15.0.1.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:60)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:438)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.wildfly.security.manager.WildFlySecurityManager.doChecked(WildFlySecurityManager.java:618)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.AccessCheckingInterceptor.processInvocation(AccessCheckingInterceptor.java:57)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:422)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:53)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:198)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:185)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:81)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.core.common.interfaces.BackendLocal$$$view3.runAction(Unknown
> >>  Source) [common.jar:]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.api.restapi.resource.BackendResource.doAction(BackendResource.java:250)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.api.restapi.resource.AbstractBackendCollectionResource.doCreateEntity(AbstractBackendCollectionResource.java:233)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.api.restapi.resource.AbstractBackendCollectionResource.performCreate(AbstractBackendCollectionResource.java:144)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.api.restapi.resource.AbstractBackendCollectionResource.performCreate(AbstractBackendCollectionResource.java:134)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.api.restapi.resource.AbstractBackendCollectionResource.performCreate(AbstractBackendCollectionResource.java:153)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.api.restapi.resource.BackendImageTransfersResource.performCreate(BackendImageTransfersResource.java:70)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.api.restapi.resource.BackendImageTransfersResource.addForImage(BackendImageTransfersResource.java:39)
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
> >> [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> >>  [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >>  [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.api.resource.ImageTransfersResource.add(ImageTransfersResource.java:101)
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
> >> [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> >>  [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> >>  [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.resteasy.core.MethodInjectorImpl.invoke(MethodInjectorImpl.java:139)
> >>  [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.resteasy.core.ResourceMethodInvoker.internalInvokeOnTarget(ResourceMethodInvoker.java:509)
> >>  [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTargetAfterFilter(ResourceMethodInvoker.java:399)
> >>  [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.resteasy.core.ResourceMethodInvoker.lambda$invokeOnTarget$0(ResourceMethodInvoker.java:363)
> >>  [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
> >>  [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.resteasy.core.ResourceMethodInvoker.invokeOnTarget(ResourceMethodInvoker.java:365)
> >>  [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.resteasy.core.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:337)
> >>  [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.resteasy.core.ResourceLocatorInvoker.invokeOnTargetObject(ResourceLocatorInvoker.java:137)
> >>  [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.resteasy.core.ResourceLocatorInvoker.invoke(ResourceLocatorInvoker.java:100)
> >>  [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:439)
> >>  [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.resteasy.core.SynchronousDispatcher.lambda$invoke$4(SynchronousDispatcher.java:229)
> >>  [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.resteasy.core.SynchronousDispatcher.lambda$preprocess$0(SynchronousDispatcher.java:135)
> >>  [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.resteasy.core.interception.PreMatchContainerRequestContext.filter(PreMatchContainerRequestContext.java:355)
> >>  [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.resteasy.core.SynchronousDispatcher.preprocess(SynchronousDispatcher.java:138)
> >>  [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.resteasy.core.SynchronousDispatcher.invoke(SynchronousDispatcher.java:215)
> >>  [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.resteasy.plugins.server.servlet.ServletContainerDispatcher.service(ServletContainerDispatcher.java:227)
> >>  [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:56)
> >>  [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.resteasy.plugins.server.servlet.HttpServletDispatcher.service(HttpServletDispatcher.java:51)
> >>  [resteasy-jaxrs-3.6.2.Final.jar:3.6.2.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> javax.servlet.http.HttpServlet.service(HttpServlet.java:791) 
> >> [jboss-servlet-api_4.0_spec-1.0.0.Final.jar:1.0.0.Final]
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.ServletHandler.handleRequest(ServletHandler.java:74)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.FilterHandler.handleRequest(FilterHandler.java:81)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.ServletChain$1.handleRequest(ServletChain.java:68)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:274)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.ServletInitialHandler.dispatchToPath(ServletInitialHandler.java:209)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.spec.RequestDispatcherImpl.forwardImpl(RequestDispatcherImpl.java:223)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.spec.RequestDispatcherImpl.forwardImplSetup(RequestDispatcherImpl.java:149)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.spec.RequestDispatcherImpl.forward(RequestDispatcherImpl.java:111)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.api.restapi.invocation.VersionFilter.doFilter(VersionFilter.java:178)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.api.restapi.invocation.VersionFilter.doFilter(VersionFilter.java:98)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.api.restapi.invocation.CurrentFilter.doFilter(CurrentFilter.java:117)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.api.restapi.invocation.CurrentFilter.doFilter(CurrentFilter.java:72)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.core.aaa.filters.RestApiSessionMgmtFilter.doFilter(RestApiSessionMgmtFilter.java:78)
> >>  [aaa.jar:]
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.core.aaa.filters.EnforceAuthFilter.doFilter(EnforceAuthFilter.java:42)
> >>  [aaa.jar:]
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.core.aaa.filters.SsoRestApiNegotiationFilter.doFilter(SsoRestApiNegotiationFilter.java:84)
> >>  [aaa.jar:]
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.core.aaa.filters.SsoRestApiAuthFilter.doFilter(SsoRestApiAuthFilter.java:47)
> >>  [aaa.jar:]
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.core.aaa.filters.SessionValidationFilter.doFilter(SessionValidationFilter.java:59)
> >>  [aaa.jar:]
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.core.aaa.filters.RestApiSessionValidationFilter.doFilter(RestApiSessionValidationFilter.java:35)
> >>  [aaa.jar:]
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.api.restapi.security.CSRFProtectionFilter.doFilter(CSRFProtectionFilter.java:111)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.api.restapi.security.CSRFProtectionFilter.doFilter(CSRFProtectionFilter.java:102)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.ovirt.engine.core.utils.servlet.CORSSupportFilter.doFilter(CORSSupportFilter.java:283)
> >>  [utils.jar:]
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilter.java:61)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.doFilter(FilterHandler.java:131)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.FilterHandler.handleRequest(FilterHandler.java:84)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.security.ServletSecurityRoleHandler.handleRequest(ServletSecurityRoleHandler.java:62)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.ServletChain$1.handleRequest(ServletChain.java:68)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.ServletDispatchingHandler.handleRequest(ServletDispatchingHandler.java:36)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.wildfly.extension.undertow.security.SecurityContextAssociationHandler.handleRequest(SecurityContextAssociationHandler.java:78)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.security.SSLInformationAssociationHandler.handleRequest(SSLInformationAssociationHandler.java:132)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.security.ServletAuthenticationCallHandler.handleRequest(ServletAuthenticationCallHandler.java:57)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.security.handlers.AuthenticationConstraintHandler.handleRequest(AuthenticationConstraintHandler.java:53)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.security.handlers.AbstractConfidentialityHandler.handleRequest(AbstractConfidentialityHandler.java:46)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.security.ServletConfidentialityConstraintHandler.handleRequest(ServletConfidentialityConstraintHandler.java:64)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.security.ServletSecurityConstraintHandler.handleRequest(ServletSecurityConstraintHandler.java:59)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.security.handlers.AuthenticationMechanismsHandler.handleRequest(AuthenticationMechanismsHandler.java:60)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.security.CachedAuthenticatedSessionHandler.handleRequest(CachedAuthenticatedSessionHandler.java:77)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.security.handlers.NotificationReceiverHandler.handleRequest(NotificationReceiverHandler.java:50)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.security.handlers.AbstractSecurityContextAssociationHandler.handleRequest(AbstractSecurityContextAssociationHandler.java:43)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.wildfly.extension.undertow.security.jacc.JACCContextIdHandler.handleRequest(JACCContextIdHandler.java:61)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.server.handlers.PredicateHandler.handleRequest(PredicateHandler.java:43)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.ServletInitialHandler.handleFirstRequest(ServletInitialHandler.java:292)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.ServletInitialHandler.access$100(ServletInitialHandler.java:81)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:138)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.ServletInitialHandler$2.call(ServletInitialHandler.java:135)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.core.ServletRequestContextThreadSetupAction$1.call(ServletRequestContextThreadSetupAction.java:48)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.core.ContextClassLoaderSetupAction$1.call(ContextClassLoaderSetupAction.java:43)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.wildfly.extension.undertow.security.SecurityContextThreadSetupAction.lambda$create$0(SecurityContextThreadSetupAction.java:105)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1502)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1502)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.wildfly.extension.undertow.deployment.UndertowDeploymentInfoService$UndertowThreadSetupAction.lambda$create$0(UndertowDeploymentInfoService.java:1502)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.ServletInitialHandler.dispatchRequest(ServletInitialHandler.java:272)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.ServletInitialHandler.access$000(ServletInitialHandler.java:81)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.servlet.handlers.ServletInitialHandler$1.handleRequest(ServletInitialHandler.java:104)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.server.Connectors.executeRootHandler(Connectors.java:360)
> >>
> >> engine.log-20190718.gz:               at 
> >> io.undertow.server.HttpServerExchange$1.run(HttpServerExchange.java:830)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.threads.ContextClassLoaderSavingRunnable.run(ContextClassLoaderSavingRunnable.java:35)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.threads.EnhancedQueueExecutor.safeRun(EnhancedQueueExecutor.java:1985)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.threads.EnhancedQueueExecutor$ThreadBody.doRunTask(EnhancedQueueExecutor.java:1487)
> >>
> >> engine.log-20190718.gz:               at 
> >> org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1378)
> >>
> >> engine.log-20190718.gz:               at 
> >> java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:Caused by: 
> >> sun.security.validator.ValidatorException: PKIX path building failed: 
> >> sun.security.provider.certpath.SunCertPathBuilderException: unable to find 
> >> valid certification path to requested target
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:397) 
> >> [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.security.validator.PKIXValidator.engineValidate(PKIXValidator.java:302)
> >>  [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.security.validator.Validator.validate(Validator.java:262) 
> >> [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.security.ssl.X509TrustManagerImpl.validate(X509TrustManagerImpl.java:324)
> >>  [jsse.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.security.ssl.X509TrustManagerImpl.checkTrusted(X509TrustManagerImpl.java:229)
> >>  [jsse.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.security.ssl.X509TrustManagerImpl.checkServerTrusted(X509TrustManagerImpl.java:124)
> >>  [jsse.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.security.ssl.ClientHandshaker.serverCertificate(ClientHandshaker.java:1621)
> >>  [jsse.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               ... 224 more
> >>
> >> engine.log-20190718.gz:Caused by: 
> >> sun.security.provider.certpath.SunCertPathBuilderException: unable to find 
> >> valid certification path to requested target
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.security.provider.certpath.SunCertPathBuilder.build(SunCertPathBuilder.java:141)
> >>  [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.security.provider.certpath.SunCertPathBuilder.engineBuild(SunCertPathBuilder.java:126)
> >>  [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> java.security.cert.CertPathBuilder.build(CertPathBuilder.java:280) 
> >> [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               at 
> >> sun.security.validator.PKIXValidator.doBuild(PKIXValidator.java:392) 
> >> [rt.jar:1.8.0_201]
> >>
> >> engine.log-20190718.gz:               ... 230 more
> >>
> >> engine.log-20190718.gz:
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,495Z ERROR 
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to add 
> >> image ticket to ovirt-imageio-proxy
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,502Z ERROR 
> >> [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] EVENT_ID: 
> >> TRANSFER_IMAGE_STOPPED_BY_SYSTEM_FAILED_TO_ADD_TICKET_TO_PROXY(1,070), 
> >> Transfer was stopped by system. Reason: failed to add image ticket to 
> >> ovirt-imageio-proxy.
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,503Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.ImageTransferUpdater] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Updating image 
> >> transfer 28eda0c2-e36b-4e70-91ea-2ecf4a030d19 (image 
> >> 3452459d-aec6-430e-9509-1d9ca815b2d8) phase to Paused by System
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,506Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Returning from 
> >> proceedCommandExecution after starting transfer session for image transfer 
> >> command '28eda0c2-e36b-4e70-91ea-2ecf4a030d19'
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,520Z INFO  
> >> [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] EVENT_ID: 
> >> TRANSFER_IMAGE_INITIATED(1,031), Image Upload with disk 
> >> av-07-centos-65-base was initiated by [email protected]@ictv.com-authz.
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,562Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferImageStatusCommand] 
> >> (default task-376) [edda86b2-d78b-45ed-a523-18966af140f4] Running command: 
> >> TransferImageStatusCommand internal: false. Entities affected :  ID: 
> >> aaa00000-0000-0000-0000-123456789aaa Type: SystemAction group CREATE_DISK 
> >> with role type USER
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,563Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.ImageTransferUpdater] 
> >> (default task-376) [edda86b2-d78b-45ed-a523-18966af140f4] Updating image 
> >> transfer 28eda0c2-e36b-4e70-91ea-2ecf4a030d19 (image 
> >> 3452459d-aec6-430e-9509-1d9ca815b2d8) phase to Finalizing Success
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,610Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-60) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
> >> Upload disk 'av-07-centos-65-base' (disk id: 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
> >> 'b44659a9-607a-4eeb-a255-99532fd4fce4')
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,612Z WARN  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-60) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer 
> >> session. Ticket does not exist for image 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8'
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,613Z INFO  
> >> [org.ovirt.engine.core.sso.servlets.OAuthRevokeServlet] (default task-378) 
> >> [] User [email protected]@ictv.com successfully logged out
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,624Z INFO  
> >> [org.ovirt.engine.core.bll.aaa.TerminateSessionsForTokenCommand] (default 
> >> task-385) [2b577b1a] Running command: TerminateSessionsForTokenCommand 
> >> internal: true.
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,625Z INFO  
> >> [org.ovirt.engine.core.bll.aaa.SessionDataContainer] (default task-385) 
> >> [2b577b1a] Not removing session 
> >> 'IGb5NgFB7aK78R92aRxJYix9y4TVQJtzYtUW+EGiAanLfxkDb/CCEuU6pgN0e7EzOuki+mMK14LaJutl9Rhydw==',
> >>  session has running commands for user '[email protected]@ictv.com-authz'.
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:13,658Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-69) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
> >> Upload disk 'av-07-centos-65-base' (disk id: 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
> >> 'b44659a9-607a-4eeb-a255-99532fd4fce4')
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:13,659Z WARN  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-69) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer 
> >> session. Ticket does not exist for image 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8'
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:17,703Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-5) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
> >> Upload disk 'av-07-centos-65-base' (disk id: 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
> >> 'b44659a9-607a-4eeb-a255-99532fd4fce4')
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:17,703Z WARN  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-5) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer 
> >> session. Ticket does not exist for image 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8'
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:25,748Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-52) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
> >> Upload disk 'av-07-centos-65-base' (disk id: 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
> >> 'b44659a9-607a-4eeb-a255-99532fd4fce4')
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:25,748Z WARN  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-52) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer 
> >> session. Ticket does not exist for image 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8'
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:35,802Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-95) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
> >> Upload disk 'av-07-centos-65-base' (disk id: 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
> >> 'b44659a9-607a-4eeb-a255-99532fd4fce4')
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:35,802Z WARN  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-95) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer 
> >> session. Ticket does not exist for image 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8'
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:45,821Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-9) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
> >> Upload disk 'av-07-centos-65-base' (disk id: 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
> >> 'b44659a9-607a-4eeb-a255-99532fd4fce4')
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:45,821Z WARN  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-9) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer 
> >> session. Ticket does not exist for image 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8'
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:53,434Z INFO  
> >> [org.ovirt.engine.core.bll.aaa.SessionDataContainer] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-26) [] Not removing 
> >> session 
> >> 'IGb5NgFB7aK78R92aRxJYix9y4TVQJtzYtUW+EGiAanLfxkDb/CCEuU6pgN0e7EzOuki+mMK14LaJutl9Rhydw==',
> >>  session has running commands for user '[email protected]@ictv.com-authz'.
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:55,872Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-72) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
> >> Upload disk 'av-07-centos-65-base' (disk id: 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
> >> 'b44659a9-607a-4eeb-a255-99532fd4fce4')
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:55,872Z WARN  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-72) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer 
> >> session. Ticket does not exist for image 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8'
> >>
> >> engine.log-20190718.gz:2019-07-17 13:37:05,893Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-60) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
> >> Upload disk 'av-07-centos-65-base' (disk id: 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
> >> 'b44659a9-607a-4eeb-a255-99532fd4fce4')
> >>
> >> engine.log-20190718.gz:2019-07-17 13:37:05,894Z WARN  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-60) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer 
> >> session. Ticket does not exist for image 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8'
> >>
> >> engine.log-20190718.gz:2019-07-17 13:37:15,945Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-29) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
> >> Upload disk 'av-07-centos-65-base' (disk id: 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
> >> 'b44659a9-607a-4eeb-a255-99532fd4fce4')
> >>
> >> engine.log-20190718.gz:2019-07-17 13:37:15,945Z WARN  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-29) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer 
> >> session. Ticket does not exist for image 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8'
> >>
> >> engine.log-20190718.gz:2019-07-17 13:37:25,999Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-48) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
> >> Upload disk 'av-07-centos-65-base' (disk id: 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
> >> 'b44659a9-607a-4eeb-a255-99532fd4fce4')
> >>
> >> engine.log-20190718.gz:2019-07-17 13:37:25,999Z WARN  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-48) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer 
> >> session. Ticket does not exist for image 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8'
> >>
> >> engine.log-20190718.gz:2019-07-17 13:37:28,864Z INFO  
> >> [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-376) 
> >> [] User [email protected] successfully logged in with scopes: 
> >> ovirt-app-api ovirt-ext=token-info:authz-search 
> >> ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate 
> >> ovirt-ext=token:password-access
> >>
> >> engine.log-20190718.gz:2019-07-17 13:37:30,187Z INFO  
> >> [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-376) 
> >> [] User [email protected] successfully logged in with scopes: 
> >> ovirt-app-api ovirt-ext=token-info:authz-search 
> >> ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate 
> >> ovirt-ext=token:password-access
> >>
> >> engine.log-20190718.gz:2019-07-17 13:37:33,323Z INFO  
> >> [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-85) [] Setting new tasks 
> >> map. The map contains now 0 tasks
> >>
> >> engine.log-20190718.gz:2019-07-17 13:37:33,323Z INFO  
> >> [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-85) [] Cleared all tasks 
> >> of pool '10525aa0-839d-11e9-a016-00163e4f2a6d'.
> >>
> >> engine.log-20190718.gz:2019-07-17 13:37:35,547Z INFO  
> >> [org.ovirt.engine.core.sso.utils.AuthenticationUtils] (default task-376) 
> >> [] User [email protected] successfully logged in with scopes: 
> >> ovirt-app-api ovirt-ext=token-info:authz-search 
> >> ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate 
> >> ovirt-ext=token:password-access
> >>
> >> engine.log-20190718.gz:2019-07-17 13:37:35,599Z INFO  
> >> [org.ovirt.engine.core.bll.aaa.CreateUserSessionCommand] (default 
> >> task-376) [519046b4] Running command: CreateUserSessionCommand internal: 
> >> false.
> >>
> >> engine.log-20190718.gz:2019-07-17 13:37:35,614Z INFO  
> >> [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] 
> >> (default task-376) [519046b4] EVENT_ID: USER_VDC_LOGIN(30), User 
> >> [email protected]@ictv.com-authz connecting from '172.16.105.206' using 
> >> session 
> >> 'rhZQZDBy6kGp85btZDieKp2gQ5kQLWBcC7BOfXrU/fJHCVWyoyOvIwnwnaaD12f8YBK5HK3MOaQcYYptCMWRcA=='
> >>  logged in.
> >>
> >> engine.log-20190718.gz:2019-07-17 13:37:36,045Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-67) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
> >> Upload disk 'av-07-centos-65-base' (disk id: 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
> >> 'b44659a9-607a-4eeb-a255-99532fd4fce4')
> >>
> >> engine.log-20190718.gz:2019-07-17 13:37:36,045Z WARN  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-67) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer 
> >> session. Ticket does not exist for image 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8'
> >>
> >> engine.log-20190718.gz:2019-07-17 13:37:46,092Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-23) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
> >> Upload disk 'av-07-centos-65-base' (disk id: 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
> >> 'b44659a9-607a-4eeb-a255-99532fd4fce4')
> >>
> >> engine.log-20190718.gz:2019-07-17 13:37:46,093Z WARN  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-23) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer 
> >> session. Ticket does not exist for image 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8'
> >>
> >> engine.log-20190718.gz:2019-07-17 13:37:53,430Z INFO  
> >> [org.ovirt.engine.core.bll.aaa.SessionDataContainer] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-47) [] Not removing 
> >> session 
> >> 'IGb5NgFB7aK78R92aRxJYix9y4TVQJtzYtUW+EGiAanLfxkDb/CCEuU6pgN0e7EzOuki+mMK14LaJutl9Rhydw==',
> >>  session has running commands for user '[email protected]@ictv.com-authz'.
> >>
> >> engine.log-20190718.gz:2019-07-17 13:37:56,109Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-27) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
> >> Upload disk 'av-07-centos-65-base' (disk id: 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
> >> 'b44659a9-607a-4eeb-a255-99532fd4fce4')
> >>
> >> engine.log-20190718.gz:2019-07-17 13:37:56,110Z WARN  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-27) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer 
> >> session. Ticket does not exist for image 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8'
> >>
> >>
> >>
> >> From: Nir Soffer <[email protected]>
> >> Date: Thursday, 18 July 2019 at 13:14
> >> To: "Vrgotic, Marko" <[email protected]>
> >> Cc: users <[email protected]>, Daniel Erez <[email protected]>
> >> Subject: Re: [ovirt-users] Stuck in "Finalizing" disk upload phase
> >>
> >>
> >>
> >> On Thu, Jul 18, 2019 at 1:44 PM Vrgotic, Marko <[email protected]> 
> >> wrote:
> >>
> >> Hi Nir,
> >>
> >>
> >>
> >> Sure: here is the ovirt-engine/engine.log related to transaction:
> >>
> >> ...
> >>
> >> 2019-07-17 13:36:11,394Z INFO  
> >> [org.ovirt.engine.core.vdsbroker.vdsbroker.AddImageTicketVDSCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] START, 
> >> AddImageTicketVDSCommand(HostName = ovirt-hv-01.avinity.tv, 
> >> AddImageTicketVDSCommandParameters:{hostId='e7e3f1dc-8037-4e74-a44c-442bdb02197d',
> >>  ticketId='10096b11-d10d-43aa-ad16-668b29a8c152', timeout='300', 
> >> operations='[write]', size='47244640256', 
> >> url='file:///rhev/data-center/mnt/172.17.28.5:_ovirt__production/644aacaa-12e1-4fcd-b3aa-941678cf95bd/images/3452459d-aec6-430e-9509-1d9ca815b2d8/b44659a9-607a-4eeb-a255-99532fd4fce4',
> >>  filename='null', sparse='true', 
> >> transferId='28eda0c2-e36b-4e70-91ea-2ecf4a030d19'}), log id: 3bf6b943
> >>
> >>
> >>
> >> The transfer uuid is mentioned in this log:
> >>
> >>
> >>
> >> transferId='28eda0c2-e36b-4e70-91ea-2ecf4a030d19'
> >>
> >>
> >>
> >> Please attach complete engine.log since this line.
> >>
> >>
> >>
> >> You can see that the host used for upload was ovirt-hv-01.avinity.tv. 
> >> Please attach vdsm logs
> >>
> >> from this host from the time this ticket was added.
> >>
> >>
> >>
> >> Please attach imageio daemon logs from the same time on this host.
> >>
> >>
> >>
> >> — — —
> >> Met vriendelijke groet / Kind regards,
> >>
> >> Marko Vrgotic
> >>
> >>
> >>
> >>
> >>
> >> From: Nir Soffer <[email protected]>
> >> Date: Thursday, 18 July 2019 at 12:20
> >> To: "Vrgotic, Marko" <[email protected]>
> >> Cc: users <[email protected]>, Daniel Erez <[email protected]>
> >> Subject: Re: [ovirt-users] Stuck in "Finalizing" disk upload phase
> >>
> >>
> >>
> >> On Thu, Jul 18, 2019 at 10:49 AM Vrgotic, Marko 
> >> <[email protected]> wrote:
> >>
> >> Dear Nir,
> >>
> >>
> >>
> >> None of my Hosts has any updated left to be added, they are as up to date 
> >> as they can be.
> >>
> >> The imageio packages version installed is:
> >>
> >>
> >>
> >> Ovirt-imageio-common-1.5.1-0.el7.x86_64
> >>
> >> Ovirt-imageio-daemon-1.5.1-0.el7.x86_64
> >>
> >>
> >>
> >> We need logs to understand the issue.
> >>
> >>
> >>
> >> Can you share logs from the time the upload was started?
> >>
> >> - engine log (/var/log/ovirt-engine/engine.log)
> >>
> >> - vdsm log on the host that performed the upload (/var/log/vdsm/vdsm.log)
> >>
> >> - daemon logs on that host (/var/log/ovirt-imageio-daemon/daemon.log)
> >>
> >>
> >>
> >> To locate the right host you can grep for the transfer uuid that should be 
> >> mentioned in engine logs.
> >>
> >>
> >>
> >>
> >>
> >> Additional software info from Host
> >>
> >> OS Version:
> >>
> >> RHEL - 7 - 6.1810.2.el7.centos
> >>
> >> OS Description:
> >>
> >> CentOS Linux 7 (Core)
> >>
> >> Kernel Version:
> >>
> >> 3.10.0 - 957.21.3.el7.x86_64
> >>
> >> KVM Version:
> >>
> >> 2.12.0 - 18.el7_6.5.1
> >>
> >> LIBVIRT Version:
> >>
> >> libvirt-4.5.0-10.el7_6.12
> >>
> >> VDSM Version:
> >>
> >> vdsm-4.30.17-1.el7
> >>
> >> SPICE Version:
> >>
> >> 0.14.0 - 6.el7_6.1
> >>
> >> GlusterFS Version:
> >>
> >> [N/A]
> >>
> >> CEPH Version:
> >>
> >> librbd1-10.2.5-4.el7
> >>
> >> Open vSwitch Version:
> >>
> >> openvswitch-2.10.1-3.el7
> >>
> >> Kernel Features:
> >>
> >> PTI: 1, IBRS: 0, RETP: 1, SSBD: 3
> >>
> >>
> >>
> >> From: "Vrgotic, Marko" <[email protected]>
> >> Date: Thursday, 18 July 2019 at 08:03
> >> To: Nir Soffer <[email protected]>
> >> Cc: users <[email protected]>, Daniel Erez <[email protected]>
> >> Subject: Re: [ovirt-users] Stuck in "Finalizing" disk upload phase
> >>
> >>
> >>
> >> Hi Nir,
> >>
> >>
> >>
> >> Sure, i will check.
> >>
> >>
> >>
> >> Is there a way for Adminstrator to view tickets or close them by force?
> >>
> >> Sent from my iPhone
> >>
> >>
> >> On 18 Jul 2019, at 00:05, Nir Soffer <[email protected]> wrote:
> >>
> >>
> >>
> >> On Wed, Jul 17, 2019, 19:20 Vrgotic, Marko <[email protected]> 
> >> wrote:
> >>
> >> Dear oVIrt,
> >>
> >>
> >>
> >> I initiated upload of qcow2 disk image for Centos 6.5:
> >>
> >> It reached finalizing phase and than started throwing following errors:
> >>
> >>
> >>
> >> 2019-07-17 14:40:51,480Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-86) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
> >> Upload disk 'av-07-centos-65-base' (disk id: 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
> >> 'b44659a9-607a-4eeb-a255-99532fd4fce4')
> >>
> >> 2019-07-17 14:40:51,480Z WARN  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-86) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer 
> >> session. Ticket does not exist for image 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8'
> >>
> >>
> >>
> >> Old versions of ovirt-imageio-daemon were failing to remove a ticket if 
> >> the ticket does not exist, and engine did not handle this well.
> >>
> >>
> >>
> >> This was fixed in 4.2. Are you running the latest version on the hosts?
> >>
> >>
> >>
> >> Please update ovirt-imageio-daemon to latest version.
> >>
> >>
> >>
> >> Nir
> >>
> >>
> >>
> >> 2019-07-17 14:41:01,572Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-19) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
> >> Upload disk 'av-07-centos-65-base' (disk id: 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
> >> 'b44659a9-607a-4eeb-a255-99532fd4fce4')
> >>
> >> 2019-07-17 14:41:01,574Z WARN  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-19) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer 
> >> session. Ticket does not exist for image 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8'
> >>
> >> 2019-07-17 14:41:11,690Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-7) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
> >> Upload disk 'av-07-centos-65-base' (disk id: 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
> >> 'b44659a9-607a-4eeb-a255-99532fd4fce4')
> >>
> >> 2019-07-17 14:41:11,690Z WARN  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-7) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer 
> >> session. Ticket does not exist for image 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8'
> >>
> >> 2019-07-17 14:41:21,781Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-12) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
> >> Upload disk 'av-07-centos-65-base' (disk id: 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
> >> 'b44659a9-607a-4eeb-a255-99532fd4fce4')
> >>
> >> 2019-07-17 14:41:21,782Z WARN  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (EE-ManagedThreadFactory-engineScheduled-Thread-12) 
> >> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer 
> >> session. Ticket does not exist for image 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8'
> >>
> >>
> >>
> >> I can not cancel it, can not stop it, not via UI not via force option 
> >> using ovirt_disk module.
> >>
> >>
> >>
> >> Help!
> >>
> >>
> >>
> >> oVIrt 4.3.4.3-1 version running with CentOS 7.6 Hosts.
> >>
> >>
> >>
> >> Kindly awaiting your reply.
> >>
> >>
> >>
> >>
> >>
> >> — — —
> >> Met vriendelijke groet / Kind regards,
> >>
> >> Marko Vrgotic
> >>
> >> ActiveVideo
> >>
> >>
> >>
> >> _______________________________________________
> >> Users mailing list -- [email protected]
> >> To unsubscribe send an email to [email protected]
> >> Privacy Statement: https://www.ovirt.org/site/privacy-policy/
> >> oVirt Code of Conduct: 
> >> https://www.ovirt.org/community/about/community-guidelines/
> >> List Archives: 
> >> https://lists.ovirt.org/archives/list/[email protected]/message/LJPWK5A3346ZCDSWEAG6WU3JLRXEGX22/
_______________________________________________
Users mailing list -- [email protected]
To unsubscribe send an email to [email protected]
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/[email protected]/message/2NPT56SAORZPLX4S4BUMTSSTIA333YUU/

Reply via email to