[ovirt-users] Re: Stuck in "Finalizing" disk upload phase

2019-07-19 Thread Vrgotic, Marko
Hi Daniel,

Is it possible that upgrade from 4.3.3 to 4.3.4  affected/reset/changed the 
certificate for imageio?

Reason why I am asking is that, while running 4.3.3 version, I was uploading 
Ubuntu 16-18, CentOS 7 cloud images, and CentOS6 no issues.
Now issue is with CentOS6. 
I have tried to upload centos6.5 image via Ansible ovirt_disk and than one 
ended stuck in “Finalizing” state.
Than I tried with to Upload same image from UI and that ended in “Paused” state.

I will try Test Connection and let you know.

Sent from my iPhone

> On 18 Jul 2019, at 16:13, Daniel Erez  wrote:
> 
> Hi Marko,
> 
> According to the log, it seems there's an issue with a secured
> connection to the proxy.
> Can you please try the 'Test Connection' button on upload disk dialog,
> to ensure the certificate is properly installed?
> Also, is the disk currently in 'Paused by System' status?
> 
> Thanks,
> Daniel
> 
> On Thu, Jul 18, 2019 at 2:35 PM Vrgotic, Marko
>  wrote:
>> 
>> Hi Nir,
>> 
>> 
>> 
>> Since this is already compressed file, I have added output of grep for 
>> moment this command was issue and following 300lines.
>> 
>> 
>> 
>> [root@ovirt-engine ovirt-engine]# zgrep "2019-07-17 13:36:11,121Z" 
>> engine.log-20190* -A300
>> 
>> engine.log-20190718.gz:2019-07-17 13:36:11,121Z INFO  
>> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
>> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Running command: 
>> TransferDiskImageCommand internal: false. Entities affected :  ID: 
>> 3452459d-aec6-430e-9509-1d9ca815b2d8 Type: DiskAction group 
>> EDIT_DISK_PROPERTIES with role type USER
>> 
>> engine.log-20190718.gz:2019-07-17 13:36:11,121Z INFO  
>> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
>> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Creating 
>> ImageTransfer entity for command '28eda0c2-e36b-4e70-91ea-2ecf4a030d19'
>> 
>> gzip: -A300.gz: No such file or directory
>> 
>> [root@ovirt-engine ovirt-engine]# zgrep -A 300 "2019-07-17 13:36:11,121Z" 
>> engine.log-20190*
>> 
>> engine.log-20190718.gz:2019-07-17 13:36:11,121Z INFO  
>> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
>> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Running command: 
>> TransferDiskImageCommand internal: false. Entities affected :  ID: 
>> 3452459d-aec6-430e-9509-1d9ca815b2d8 Type: DiskAction group 
>> EDIT_DISK_PROPERTIES with role type USER
>> 
>> engine.log-20190718.gz:2019-07-17 13:36:11,121Z INFO  
>> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
>> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Creating 
>> ImageTransfer entity for command '28eda0c2-e36b-4e70-91ea-2ecf4a030d19'
>> 
>> engine.log-20190718.gz:2019-07-17 13:36:11,142Z INFO  
>> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
>> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Successfully added 
>> Upload disk 'av-07-centos-65-base' (disk id: 
>> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
>> 'b44659a9-607a-4eeb-a255-99532fd4fce4') for image transfer command 
>> '28eda0c2-e36b-4e70-91ea-2ecf4a030d19'
>> 
>> engine.log-20190718.gz:2019-07-17 13:36:11,188Z INFO  
>> [org.ovirt.engine.core.vdsbroker.vdsbroker.PrepareImageVDSCommand] (default 
>> task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] START, 
>> PrepareImageVDSCommand(HostName = ovirt-hv-01.avinity.tv, 
>> PrepareImageVDSCommandParameters:{hostId='e7e3f1dc-8037-4e74-a44c-442bdb02197d'}),
>>  log id: 3bd84b38
>> 
>> engine.log-20190718.gz:2019-07-17 13:36:11,351Z INFO  
>> [org.ovirt.engine.core.vdsbroker.vdsbroker.PrepareImageVDSCommand] (default 
>> task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] FINISH, 
>> PrepareImageVDSCommand, return: PrepareImageReturn:{status='Status [code=0, 
>> message=Done]'}, log id: 3bd84b38
>> 
>> engine.log-20190718.gz:2019-07-17 13:36:11,356Z INFO  
>> [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeLegalityVDSCommand] 
>> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] START, 
>> SetVolumeLegalityVDSCommand( 
>> SetVolumeLegalityVDSCommandParameters:{storagePoolId='10525aa0-839d-11e9-a016-00163e4f2a6d',
>>  ignoreFailoverLimit='false', 
>> storageDomainId='644aacaa-12e1-4fcd-b3aa-941678cf95bd', 
>> imageGroupId='3452459d-aec6-430e-9509-1d9ca815b2d8', 
>> imageId='b44659a9-607a-4eeb-a255-99532fd4fce4'}), log id: 5e0f7654
>> 
>> engine.log-20190718.gz:2019-07-17 13:36:11,390Z INFO  
>> [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeLegalityVDSCommand] 
>> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] FINISH, 
>> SetVolumeLegalityVDSCommand, return: , log id: 5e0f7654
>> 
>> engine.log-20190718.gz:2019-07-17 13:36:11,394Z INFO  
>> [org.ovirt.engine.core.vdsbroker.vdsbroker.AddImageTicketVDSCommand] 
>> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] START, 
>> AddImageTicketVDSCommand(HostName = ovirt-hv-01.avinity.tv, 
>> 

[ovirt-users] Re: Stuck in "Finalizing" disk upload phase

2019-07-18 Thread Vrgotic, Marko
Very good question,

Now that I think of it, I might have missed this step.
Most of the time/always after upgrade of oVirt packages is done, I update the 
rest of the system, both engine and hosts and reboot if required.
I do not think I did and system update of the engine this time, so for sure did 
not reboot it.
Will do that and report back.

Thank you Daniel.

Marko Vrgotic

Sent from my iPhone

> On 18 Jul 2019, at 18:33, Daniel Erez  wrote:
> 
> On Thu, Jul 18, 2019 at 7:31 PM Vrgotic, Marko
>  wrote:
>> 
>> Hi Daniel,
>> 
>> Is it possible that upgrade from 4.3.3 to 4.3.4  affected/reset/changed the 
>> certificate for imageio?
> 
> Have you restarted the ovirt-imageio-proxy service after upgrading? It
> should be restarted to reload the certificate.
> 
>> 
>> Reason why I am asking is that, while running 4.3.3 version, I was uploading 
>> Ubuntu 16-18, CentOS 7 cloud images, and CentOS6 no issues.
>> Now issue is with CentOS6.
>> I have tried to upload centos6.5 image via Ansible ovirt_disk and than one 
>> ended stuck in “Finalizing” state.
>> Than I tried with to Upload same image from UI and that ended in “Paused” 
>> state.
>> 
>> I will try Test Connection and let you know.
>> 
>> Sent from my iPhone
>> 
>>> On 18 Jul 2019, at 16:13, Daniel Erez  wrote:
>>> 
>>> Hi Marko,
>>> 
>>> According to the log, it seems there's an issue with a secured
>>> connection to the proxy.
>>> Can you please try the 'Test Connection' button on upload disk dialog,
>>> to ensure the certificate is properly installed?
>>> Also, is the disk currently in 'Paused by System' status?
>>> 
>>> Thanks,
>>> Daniel
>>> 
>>> On Thu, Jul 18, 2019 at 2:35 PM Vrgotic, Marko
>>>  wrote:
 
 Hi Nir,
 
 
 
 Since this is already compressed file, I have added output of grep for 
 moment this command was issue and following 300lines.
 
 
 
 [root@ovirt-engine ovirt-engine]# zgrep "2019-07-17 13:36:11,121Z" 
 engine.log-20190* -A300
 
 engine.log-20190718.gz:2019-07-17 13:36:11,121Z INFO  
 [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
 (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Running command: 
 TransferDiskImageCommand internal: false. Entities affected :  ID: 
 3452459d-aec6-430e-9509-1d9ca815b2d8 Type: DiskAction group 
 EDIT_DISK_PROPERTIES with role type USER
 
 engine.log-20190718.gz:2019-07-17 13:36:11,121Z INFO  
 [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
 (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Creating 
 ImageTransfer entity for command '28eda0c2-e36b-4e70-91ea-2ecf4a030d19'
 
 gzip: -A300.gz: No such file or directory
 
 [root@ovirt-engine ovirt-engine]# zgrep -A 300 "2019-07-17 13:36:11,121Z" 
 engine.log-20190*
 
 engine.log-20190718.gz:2019-07-17 13:36:11,121Z INFO  
 [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
 (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Running command: 
 TransferDiskImageCommand internal: false. Entities affected :  ID: 
 3452459d-aec6-430e-9509-1d9ca815b2d8 Type: DiskAction group 
 EDIT_DISK_PROPERTIES with role type USER
 
 engine.log-20190718.gz:2019-07-17 13:36:11,121Z INFO  
 [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
 (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Creating 
 ImageTransfer entity for command '28eda0c2-e36b-4e70-91ea-2ecf4a030d19'
 
 engine.log-20190718.gz:2019-07-17 13:36:11,142Z INFO  
 [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
 (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Successfully 
 added Upload disk 'av-07-centos-65-base' (disk id: 
 '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
 'b44659a9-607a-4eeb-a255-99532fd4fce4') for image transfer command 
 '28eda0c2-e36b-4e70-91ea-2ecf4a030d19'
 
 engine.log-20190718.gz:2019-07-17 13:36:11,188Z INFO  
 [org.ovirt.engine.core.vdsbroker.vdsbroker.PrepareImageVDSCommand] 
 (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] START, 
 PrepareImageVDSCommand(HostName = ovirt-hv-01.avinity.tv, 
 PrepareImageVDSCommandParameters:{hostId='e7e3f1dc-8037-4e74-a44c-442bdb02197d'}),
  log id: 3bd84b38
 
 engine.log-20190718.gz:2019-07-17 13:36:11,351Z INFO  
 [org.ovirt.engine.core.vdsbroker.vdsbroker.PrepareImageVDSCommand] 
 (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] FINISH, 
 PrepareImageVDSCommand, return: PrepareImageReturn:{status='Status 
 [code=0, message=Done]'}, log id: 3bd84b38
 
 engine.log-20190718.gz:2019-07-17 13:36:11,356Z INFO  
 [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeLegalityVDSCommand] 
 (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] START, 
 SetVolumeLegalityVDSCommand( 
 

[ovirt-users] Re: Stuck in "Finalizing" disk upload phase

2019-07-18 Thread Vrgotic, Marko
Dear Nir,

None of my Hosts has any updated left to be added, they are as up to date as 
they can be.
The imageio packages version installed is:

Ovirt-imageio-common-1.5.1-0.el7.x86_64
Ovirt-imageio-daemon-1.5.1-0.el7.x86_64

Additional software info from Host
OS Version:
RHEL - 7 - 6.1810.2.el7.centos
OS Description:
CentOS Linux 7 (Core)
Kernel Version:
3.10.0 - 957.21.3.el7.x86_64
KVM Version:
2.12.0 - 18.el7_6.5.1
LIBVIRT Version:
libvirt-4.5.0-10.el7_6.12
VDSM Version:
vdsm-4.30.17-1.el7
SPICE Version:
0.14.0 - 6.el7_6.1
GlusterFS Version:
[N/A]
CEPH Version:
librbd1-10.2.5-4.el7
Open vSwitch Version:
openvswitch-2.10.1-3.el7
Kernel Features:
PTI: 1, IBRS: 0, RETP: 1, SSBD: 3

From: "Vrgotic, Marko" 
Date: Thursday, 18 July 2019 at 08:03
To: Nir Soffer 
Cc: users , Daniel Erez 
Subject: Re: [ovirt-users] Stuck in "Finalizing" disk upload phase

Hi Nir,

Sure, i will check.

Is there a way for Adminstrator to view tickets or close them by force?
Sent from my iPhone

On 18 Jul 2019, at 00:05, Nir Soffer 
mailto:nsof...@redhat.com>> wrote:

On Wed, Jul 17, 2019, 19:20 Vrgotic, Marko 
mailto:m.vrgo...@activevideo.com>> wrote:
Dear oVIrt,

I initiated upload of qcow2 disk image for Centos 6.5:
It reached finalizing phase and than started throwing following errors:

2019-07-17 14:40:51,480Z INFO  
[org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
(EE-ManagedThreadFactory-engineScheduled-Thread-86) 
[a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
Upload disk 'av-07-centos-65-base' (disk id: 
'3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
'b44659a9-607a-4eeb-a255-99532fd4fce4')
2019-07-17 14:40:51,480Z WARN  
[org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
(EE-ManagedThreadFactory-engineScheduled-Thread-86) 
[a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. 
Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8'

Old versions of ovirt-imageio-daemon were failing to remove a ticket if the 
ticket does not exist, and engine did not handle this well.

This was fixed in 4.2. Are you running the latest version on the hosts?

Please update ovirt-imageio-daemon to latest version.

Nir

2019-07-17 14:41:01,572Z INFO  
[org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
(EE-ManagedThreadFactory-engineScheduled-Thread-19) 
[a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
Upload disk 'av-07-centos-65-base' (disk id: 
'3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
'b44659a9-607a-4eeb-a255-99532fd4fce4')
2019-07-17 14:41:01,574Z WARN  
[org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
(EE-ManagedThreadFactory-engineScheduled-Thread-19) 
[a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. 
Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8'
2019-07-17 14:41:11,690Z INFO  
[org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
(EE-ManagedThreadFactory-engineScheduled-Thread-7) 
[a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
Upload disk 'av-07-centos-65-base' (disk id: 
'3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
'b44659a9-607a-4eeb-a255-99532fd4fce4')
2019-07-17 14:41:11,690Z WARN  
[org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
(EE-ManagedThreadFactory-engineScheduled-Thread-7) 
[a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. 
Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8'
2019-07-17 14:41:21,781Z INFO  
[org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
(EE-ManagedThreadFactory-engineScheduled-Thread-12) 
[a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
Upload disk 'av-07-centos-65-base' (disk id: 
'3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
'b44659a9-607a-4eeb-a255-99532fd4fce4')
2019-07-17 14:41:21,782Z WARN  
[org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
(EE-ManagedThreadFactory-engineScheduled-Thread-12) 
[a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. 
Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8'

I can not cancel it, can not stop it, not via UI not via force option using 
ovirt_disk module.

Help!

oVIrt 4.3.4.3-1 version running with CentOS 7.6 Hosts.

Kindly awaiting your reply.


— — —
Met vriendelijke groet / Kind regards,

Marko Vrgotic
ActiveVideo

___
Users mailing list -- users@ovirt.org<mailto:users@ovirt.org>
To unsubscribe send an email to 
users-le...@ovirt.org<mailto:users-le...@ovirt.org>
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.

[ovirt-users] Re: Stuck in "Finalizing" disk upload phase

2019-07-18 Thread Daniel Erez
On Thu, Jul 18, 2019 at 7:31 PM Vrgotic, Marko
 wrote:
>
> Hi Daniel,
>
> Is it possible that upgrade from 4.3.3 to 4.3.4  affected/reset/changed the 
> certificate for imageio?

Have you restarted the ovirt-imageio-proxy service after upgrading? It
should be restarted to reload the certificate.

>
> Reason why I am asking is that, while running 4.3.3 version, I was uploading 
> Ubuntu 16-18, CentOS 7 cloud images, and CentOS6 no issues.
> Now issue is with CentOS6.
> I have tried to upload centos6.5 image via Ansible ovirt_disk and than one 
> ended stuck in “Finalizing” state.
> Than I tried with to Upload same image from UI and that ended in “Paused” 
> state.
>
> I will try Test Connection and let you know.
>
> Sent from my iPhone
>
> > On 18 Jul 2019, at 16:13, Daniel Erez  wrote:
> >
> > Hi Marko,
> >
> > According to the log, it seems there's an issue with a secured
> > connection to the proxy.
> > Can you please try the 'Test Connection' button on upload disk dialog,
> > to ensure the certificate is properly installed?
> > Also, is the disk currently in 'Paused by System' status?
> >
> > Thanks,
> > Daniel
> >
> > On Thu, Jul 18, 2019 at 2:35 PM Vrgotic, Marko
> >  wrote:
> >>
> >> Hi Nir,
> >>
> >>
> >>
> >> Since this is already compressed file, I have added output of grep for 
> >> moment this command was issue and following 300lines.
> >>
> >>
> >>
> >> [root@ovirt-engine ovirt-engine]# zgrep "2019-07-17 13:36:11,121Z" 
> >> engine.log-20190* -A300
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,121Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Running command: 
> >> TransferDiskImageCommand internal: false. Entities affected :  ID: 
> >> 3452459d-aec6-430e-9509-1d9ca815b2d8 Type: DiskAction group 
> >> EDIT_DISK_PROPERTIES with role type USER
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,121Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Creating 
> >> ImageTransfer entity for command '28eda0c2-e36b-4e70-91ea-2ecf4a030d19'
> >>
> >> gzip: -A300.gz: No such file or directory
> >>
> >> [root@ovirt-engine ovirt-engine]# zgrep -A 300 "2019-07-17 13:36:11,121Z" 
> >> engine.log-20190*
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,121Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Running command: 
> >> TransferDiskImageCommand internal: false. Entities affected :  ID: 
> >> 3452459d-aec6-430e-9509-1d9ca815b2d8 Type: DiskAction group 
> >> EDIT_DISK_PROPERTIES with role type USER
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,121Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Creating 
> >> ImageTransfer entity for command '28eda0c2-e36b-4e70-91ea-2ecf4a030d19'
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,142Z INFO  
> >> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Successfully 
> >> added Upload disk 'av-07-centos-65-base' (disk id: 
> >> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
> >> 'b44659a9-607a-4eeb-a255-99532fd4fce4') for image transfer command 
> >> '28eda0c2-e36b-4e70-91ea-2ecf4a030d19'
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,188Z INFO  
> >> [org.ovirt.engine.core.vdsbroker.vdsbroker.PrepareImageVDSCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] START, 
> >> PrepareImageVDSCommand(HostName = ovirt-hv-01.avinity.tv, 
> >> PrepareImageVDSCommandParameters:{hostId='e7e3f1dc-8037-4e74-a44c-442bdb02197d'}),
> >>  log id: 3bd84b38
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,351Z INFO  
> >> [org.ovirt.engine.core.vdsbroker.vdsbroker.PrepareImageVDSCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] FINISH, 
> >> PrepareImageVDSCommand, return: PrepareImageReturn:{status='Status 
> >> [code=0, message=Done]'}, log id: 3bd84b38
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,356Z INFO  
> >> [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeLegalityVDSCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] START, 
> >> SetVolumeLegalityVDSCommand( 
> >> SetVolumeLegalityVDSCommandParameters:{storagePoolId='10525aa0-839d-11e9-a016-00163e4f2a6d',
> >>  ignoreFailoverLimit='false', 
> >> storageDomainId='644aacaa-12e1-4fcd-b3aa-941678cf95bd', 
> >> imageGroupId='3452459d-aec6-430e-9509-1d9ca815b2d8', 
> >> imageId='b44659a9-607a-4eeb-a255-99532fd4fce4'}), log id: 5e0f7654
> >>
> >> engine.log-20190718.gz:2019-07-17 13:36:11,390Z INFO  
> >> [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeLegalityVDSCommand] 
> >> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] 

[ovirt-users] Re: Stuck in "Finalizing" disk upload phase

2019-07-18 Thread Vrgotic, Marko
851eaf7ce7] Updating image transfer 
28eda0c2-e36b-4e70-91ea-2ecf4a030d19 (image 
3452459d-aec6-430e-9509-1d9ca815b2d8) phase to Paused by System
2019-07-17 13:36:11,563Z INFO  
[org.ovirt.engine.core.bll.storage.disk.image.ImageTransferUpdater] (default 
task-376) [edda86b2-d78b-45ed-a523-18966af140f4] Updating image transfer 
28eda0c2-e36b-4e70-91ea-2ecf4a030d19 (image 
3452459d-aec6-430e-9509-1d9ca815b2d8) phase to Finalizing Success
2019-07-17 13:36:11,610Z INFO  
[org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
(EE-ManagedThreadFactory-engineScheduled-Thread-60) 
[a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
Upload disk 'av-07-centos-65-base' (disk id: 
'3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
'b44659a9-607a-4eeb-a255-99532fd4fce4')
2019-07-17 13:36:11,612Z WARN  
[org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
(EE-ManagedThreadFactory-engineScheduled-Thread-60) 
[a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. 
Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8'
2019-07-17 13:36:13,658Z INFO  
[org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
(EE-ManagedThreadFactory-engineScheduled-Thread-69) 
[a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
Upload disk 'av-07-centos-65-base' (disk id: 
'3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
'b44659a9-607a-4eeb-a255-99532fd4fce4')
2019-07-17 13:36:13,659Z WARN  
[org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
(EE-ManagedThreadFactory-engineScheduled-Thread-69) 
[a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. 
Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8'

Question regarding transfer UUID – is that one I marked green in the log lines 
above? Regarding Host that executed action, is in any way related to lines I 
marked in RED?

Kindly awaiting your reply.


— — —
Met vriendelijke groet / Kind regards,

Marko Vrgotic


From: Nir Soffer 
Date: Thursday, 18 July 2019 at 12:20
To: "Vrgotic, Marko" 
Cc: users , Daniel Erez 
Subject: Re: [ovirt-users] Stuck in "Finalizing" disk upload phase

On Thu, Jul 18, 2019 at 10:49 AM Vrgotic, Marko 
mailto:m.vrgo...@activevideo.com>> wrote:
Dear Nir,

None of my Hosts has any updated left to be added, they are as up to date as 
they can be.
The imageio packages version installed is:

Ovirt-imageio-common-1.5.1-0.el7.x86_64
Ovirt-imageio-daemon-1.5.1-0.el7.x86_64

We need logs to understand the issue.

Can you share logs from the time the upload was started?
- engine log (/var/log/ovirt-engine/engine.log)
- vdsm log on the host that performed the upload (/var/log/vdsm/vdsm.log)
- daemon logs on that host (/var/log/ovirt-imageio-daemon/daemon.log)

To locate the right host you can grep for the transfer uuid that should be 
mentioned in engine logs.


Additional software info from Host
OS Version:
RHEL - 7 - 6.1810.2.el7.centos
OS Description:
CentOS Linux 7 (Core)
Kernel Version:
3.10.0 - 957.21.3.el7.x86_64
KVM Version:
2.12.0 - 18.el7_6.5.1
LIBVIRT Version:
libvirt-4.5.0-10.el7_6.12
VDSM Version:
vdsm-4.30.17-1.el7
SPICE Version:
0.14.0 - 6.el7_6.1
GlusterFS Version:
[N/A]
CEPH Version:
librbd1-10.2.5-4.el7
Open vSwitch Version:
openvswitch-2.10.1-3.el7
Kernel Features:
PTI: 1, IBRS: 0, RETP: 1, SSBD: 3

From: "Vrgotic, Marko" 
mailto:m.vrgo...@activevideo.com>>
Date: Thursday, 18 July 2019 at 08:03
To: Nir Soffer mailto:nsof...@redhat.com>>
Cc: users mailto:users@ovirt.org>>, Daniel Erez 
mailto:de...@redhat.com>>
Subject: Re: [ovirt-users] Stuck in "Finalizing" disk upload phase

Hi Nir,

Sure, i will check.

Is there a way for Adminstrator to view tickets or close them by force?
Sent from my iPhone

On 18 Jul 2019, at 00:05, Nir Soffer 
mailto:nsof...@redhat.com>> wrote:

On Wed, Jul 17, 2019, 19:20 Vrgotic, Marko 
mailto:m.vrgo...@activevideo.com>> wrote:
Dear oVIrt,

I initiated upload of qcow2 disk image for Centos 6.5:
It reached finalizing phase and than started throwing following errors:

2019-07-17 14:40:51,480Z INFO  
[org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
(EE-ManagedThreadFactory-engineScheduled-Thread-86) 
[a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
Upload disk 'av-07-centos-65-base' (disk id: 
'3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
'b44659a9-607a-4eeb-a255-99532fd4fce4')
2019-07-17 14:40:51,480Z WARN  
[org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
(EE-ManagedThreadFactory-engineScheduled-Thread-86) 
[a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. 
Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8'

Old versions of ovirt-imageio-daemon were failing to remove a ticket if the 
ticket does not exist, and engine did not hand

[ovirt-users] Re: Stuck in "Finalizing" disk upload phase

2019-07-18 Thread Daniel Erez
Hi Marko,

According to the log, it seems there's an issue with a secured
connection to the proxy.
Can you please try the 'Test Connection' button on upload disk dialog,
to ensure the certificate is properly installed?
Also, is the disk currently in 'Paused by System' status?

Thanks,
Daniel

On Thu, Jul 18, 2019 at 2:35 PM Vrgotic, Marko
 wrote:
>
> Hi Nir,
>
>
>
> Since this is already compressed file, I have added output of grep for moment 
> this command was issue and following 300lines.
>
>
>
> [root@ovirt-engine ovirt-engine]# zgrep "2019-07-17 13:36:11,121Z" 
> engine.log-20190* -A300
>
> engine.log-20190718.gz:2019-07-17 13:36:11,121Z INFO  
> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Running command: 
> TransferDiskImageCommand internal: false. Entities affected :  ID: 
> 3452459d-aec6-430e-9509-1d9ca815b2d8 Type: DiskAction group 
> EDIT_DISK_PROPERTIES with role type USER
>
> engine.log-20190718.gz:2019-07-17 13:36:11,121Z INFO  
> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Creating 
> ImageTransfer entity for command '28eda0c2-e36b-4e70-91ea-2ecf4a030d19'
>
> gzip: -A300.gz: No such file or directory
>
> [root@ovirt-engine ovirt-engine]# zgrep -A 300 "2019-07-17 13:36:11,121Z" 
> engine.log-20190*
>
> engine.log-20190718.gz:2019-07-17 13:36:11,121Z INFO  
> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Running command: 
> TransferDiskImageCommand internal: false. Entities affected :  ID: 
> 3452459d-aec6-430e-9509-1d9ca815b2d8 Type: DiskAction group 
> EDIT_DISK_PROPERTIES with role type USER
>
> engine.log-20190718.gz:2019-07-17 13:36:11,121Z INFO  
> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Creating 
> ImageTransfer entity for command '28eda0c2-e36b-4e70-91ea-2ecf4a030d19'
>
> engine.log-20190718.gz:2019-07-17 13:36:11,142Z INFO  
> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Successfully added 
> Upload disk 'av-07-centos-65-base' (disk id: 
> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
> 'b44659a9-607a-4eeb-a255-99532fd4fce4') for image transfer command 
> '28eda0c2-e36b-4e70-91ea-2ecf4a030d19'
>
> engine.log-20190718.gz:2019-07-17 13:36:11,188Z INFO  
> [org.ovirt.engine.core.vdsbroker.vdsbroker.PrepareImageVDSCommand] (default 
> task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] START, 
> PrepareImageVDSCommand(HostName = ovirt-hv-01.avinity.tv, 
> PrepareImageVDSCommandParameters:{hostId='e7e3f1dc-8037-4e74-a44c-442bdb02197d'}),
>  log id: 3bd84b38
>
> engine.log-20190718.gz:2019-07-17 13:36:11,351Z INFO  
> [org.ovirt.engine.core.vdsbroker.vdsbroker.PrepareImageVDSCommand] (default 
> task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] FINISH, 
> PrepareImageVDSCommand, return: PrepareImageReturn:{status='Status [code=0, 
> message=Done]'}, log id: 3bd84b38
>
> engine.log-20190718.gz:2019-07-17 13:36:11,356Z INFO  
> [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeLegalityVDSCommand] 
> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] START, 
> SetVolumeLegalityVDSCommand( 
> SetVolumeLegalityVDSCommandParameters:{storagePoolId='10525aa0-839d-11e9-a016-00163e4f2a6d',
>  ignoreFailoverLimit='false', 
> storageDomainId='644aacaa-12e1-4fcd-b3aa-941678cf95bd', 
> imageGroupId='3452459d-aec6-430e-9509-1d9ca815b2d8', 
> imageId='b44659a9-607a-4eeb-a255-99532fd4fce4'}), log id: 5e0f7654
>
> engine.log-20190718.gz:2019-07-17 13:36:11,390Z INFO  
> [org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeLegalityVDSCommand] 
> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] FINISH, 
> SetVolumeLegalityVDSCommand, return: , log id: 5e0f7654
>
> engine.log-20190718.gz:2019-07-17 13:36:11,394Z INFO  
> [org.ovirt.engine.core.vdsbroker.vdsbroker.AddImageTicketVDSCommand] (default 
> task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] START, 
> AddImageTicketVDSCommand(HostName = ovirt-hv-01.avinity.tv, 
> AddImageTicketVDSCommandParameters:{hostId='e7e3f1dc-8037-4e74-a44c-442bdb02197d',
>  ticketId='10096b11-d10d-43aa-ad16-668b29a8c152', timeout='300', 
> operations='[write]', size='47244640256', 
> url='file:///rhev/data-center/mnt/172.17.28.5:_ovirt__production/644aacaa-12e1-4fcd-b3aa-941678cf95bd/images/3452459d-aec6-430e-9509-1d9ca815b2d8/b44659a9-607a-4eeb-a255-99532fd4fce4',
>  filename='null', sparse='true', 
> transferId='28eda0c2-e36b-4e70-91ea-2ecf4a030d19'}), log id: 3bf6b943
>
> engine.log-20190718.gz:2019-07-17 13:36:11,410Z INFO  
> [org.ovirt.engine.core.vdsbroker.vdsbroker.AddImageTicketVDSCommand] (default 
> task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] FINISH, 
> AddImageTicketVDSCommand, return: StatusOnlyReturn 

[ovirt-users] Re: Stuck in "Finalizing" disk upload phase

2019-07-18 Thread Vrgotic, Marko
I think I found it:

In the vdsm log we need to search by UUID before START and in imageio daemon 
via image folder UUID:

[root@ovirt-hv-01 vdsm]# xzgrep e935c4cd-c171-40fa-9204-db59f11ac013 
vdsm.log.*xz
vdsm.log.22.xz:2019-07-17 13:36:09,219+ INFO  (jsonrpc/1) [vdsm.api] START 
prepareImage(sdUUID=u'644aacaa-12e1-4fcd-b3aa-941678cf95bd', 
spUUID=u'10525aa0-839d-11e9-a016-00163e4f2a6d', 
imgUUID=u'3452459d-aec6-430e-9509-1d9ca815b2d8', 
leafUUID=u'b44659a9-607a-4eeb-a255-99532fd4fce4', allowIllegal=True) 
from=:::172.17.29.10,52964, flow_id=e935c4cd-c171-40fa-9204-db59f11ac013, 
task_id=d7eb8ef8-0216-4338-ac5e-07ff41ba5ace (api:48)
vdsm.log.22.xz:2019-07-17 13:36:09,416+ INFO  (jsonrpc/1) [vdsm.api] FINISH 
prepareImage return={'info': {'path': 
u'/rhev/data-center/mnt/172.17.28.5:_ovirt__production/644aacaa-12e1-4fcd-b3aa-941678cf95bd/images/3452459d-aec6-430e-9509-1d9ca815b2d8/b44659a9-607a-4eeb-a255-99532fd4fce4',
 'type': 'file'}, 'path': 
u'/rhev/data-center/mnt/172.17.28.5:_ovirt__production/644aacaa-12e1-4fcd-b3aa-941678cf95bd/images/3452459d-aec6-430e-9509-1d9ca815b2d8/b44659a9-607a-4eeb-a255-99532fd4fce4',
 'imgVolumesInfo': [{'domainID': u'644aacaa-12e1-4fcd-b3aa-941678cf95bd', 
'leaseOffset': 0, 'path': 
u'/rhev/data-center/mnt/172.17.28.5:_ovirt__production/644aacaa-12e1-4fcd-b3aa-941678cf95bd/images/3452459d-aec6-430e-9509-1d9ca815b2d8/b44659a9-607a-4eeb-a255-99532fd4fce4',
 'volumeID': u'b44659a9-607a-4eeb-a255-99532fd4fce4', 'leasePath': 
u'/rhev/data-center/mnt/172.17.28.5:_ovirt__production/644aacaa-12e1-4fcd-b3aa-941678cf95bd/images/3452459d-aec6-430e-9509-1d9ca815b2d8/b44659a9-607a-4eeb-a255-99532fd4fce4.lease',
 'imageID': u'3452459d-aec6-430e-9509-1d9ca815b2d8'}]} 
from=:::172.17.29.10,52964, flow_id=e935c4cd-c171-40fa-9204-db59f11ac013, 
task_id=d7eb8ef8-0216-4338-ac5e-07ff41ba5ace (api:54)
vdsm.log.22.xz:2019-07-17 13:36:09,422+ INFO  (jsonrpc/6) [vdsm.api] START 
getQemuImageInfo(sdUUID=u'644aacaa-12e1-4fcd-b3aa-941678cf95bd', 
spUUID=u'10525aa0-839d-11e9-a016-00163e4f2a6d', 
imgUUID=u'3452459d-aec6-430e-9509-1d9ca815b2d8', 
volUUID=u'b44659a9-607a-4eeb-a255-99532fd4fce4', options=None) 
from=:::172.17.29.10,52964, flow_id=e935c4cd-c171-40fa-9204-db59f11ac013, 
task_id=aa11989c-d308-491a-ab80-935c642fb758 (api:48)
vdsm.log.22.xz:2019-07-17 13:36:09,522+ INFO  (jsonrpc/6) [vdsm.api] FINISH 
getQemuImageInfo return={'info': {'compat': u'1.1', 'clustersize': 65536, 
'actualsize': 204800, 'virtualsize': 42949672960, 'format': u'qcow2'}} 
from=:::172.17.29.10,52964, flow_id=e935c4cd-c171-40fa-9204-db59f11ac013, 
task_id=aa11989c-d308-491a-ab80-935c642fb758 (api:54)
vdsm.log.22.xz:2019-07-17 13:36:09,528+ INFO  (jsonrpc/3) [vdsm.api] START 
teardownImage(sdUUID=u'644aacaa-12e1-4fcd-b3aa-941678cf95bd', 
spUUID=u'10525aa0-839d-11e9-a016-00163e4f2a6d', 
imgUUID=u'3452459d-aec6-430e-9509-1d9ca815b2d8', volUUID=None) 
from=:::172.17.29.10,52964, flow_id=e935c4cd-c171-40fa-9204-db59f11ac013, 
task_id=a806250b-875a-42a3-bac8-a58388f86af3 (api:48)
vdsm.log.22.xz:2019-07-17 13:36:09,529+ INFO  (jsonrpc/3) [vdsm.api] FINISH 
teardownImage return=None from=:::172.17.29.10,52964, 
flow_id=e935c4cd-c171-40fa-9204-db59f11ac013, 
task_id=a806250b-875a-42a3-bac8-a58388f86af3 (api:54)

[root@ovirt-hv-01 ovirt-imageio-daemon]# grep 
3452459d-aec6-430e-9509-1d9ca815b2d daemon.log
2019-07-17 13:36:11,407 INFO(Thread-1) [tickets] [local] ADD 
ticket={u'uuid': u'10096b11-d10d-43aa-ad16-668b29a8c152', u'ops': [u'write'], 
u'url': 
u'file:///rhev/data-center/mnt/172.17.28.5:_ovirt__production/644aacaa-12e1-4fcd-b3aa-941678cf95bd/images/3452459d-aec6-430e-9509-1d9ca815b2d8/b44659a9-607a-4eeb-a255-99532fd4fce4',
 u'sparse': True, u'timeout': 300, u'transfer_id': 
u'28eda0c2-e36b-4e70-91ea-2ecf4a030d19', u'size': 47244640256}




From: "Vrgotic, Marko" 
Date: Thursday, 18 July 2019 at 12:44
To: Nir Soffer 
Cc: users , Daniel Erez 
Subject: Re: [ovirt-users] Stuck in "Finalizing" disk upload phase

Hi Nir,

Sure: here is the ovirt-engine/engine.log related to transaction:

[root@ovirt-engine ovirt-engine]# zgrep "3452459d-aec6-430e-9509-1d9ca815b2d8" 
/var/log/ovirt-engine/engine.log-20190718.gz | head -n 40
2019-07-17 13:36:01,634Z INFO  
[org.ovirt.engine.core.vdsbroker.irsbroker.CreateImageVDSCommand] (default 
task-376) [e935c4cd-c171-40fa-9204-db59f11ac013] START, CreateImageVDSCommand( 
CreateImageVDSCommandParameters:{storagePoolId='10525aa0-839d-11e9-a016-00163e4f2a6d',
 ignoreFailoverLimit='false', 
storageDomainId='644aacaa-12e1-4fcd-b3aa-941678cf95bd', 
imageGroupId='3452459d-aec6-430e-9509-1d9ca815b2d8', 
imageSizeInBytes='42949672960', volumeFormat='COW', 
newImageId='b44659a9-607a-4eeb-a255-99532fd4fce4', imageType='Sparse', 
newImageDescription='{"DiskAlias":"av-07-centos-65-base","DiskDescription":""}',
 imageIn

[ovirt-users] Re: Stuck in "Finalizing" disk upload phase

2019-07-18 Thread Nir Soffer
On Thu, Jul 18, 2019 at 1:44 PM Vrgotic, Marko 
wrote:

> Hi Nir,
>
>
>
> Sure: here is the ovirt-engine/engine.log related to transaction:
>
...

> 2019-07-17 13:36:11,394Z INFO
> [org.ovirt.engine.core.vdsbroker.vdsbroker.AddImageTicketVDSCommand]
> (default task-376) [a43180ec-afc7-429e-9f30-9e851eaf7ce7] START,
> AddImageTicketVDSCommand(HostName = ovirt-hv-01.avinity.tv,
> AddImageTicketVDSCommandParameters:{hostId='e7e3f1dc-8037-4e74-a44c-442bdb02197d',
> ticketId='10096b11-d10d-43aa-ad16-668b29a8c152', timeout='300',
> operations='[write]', size='47244640256',
> url='file:///rhev/data-center/mnt/172.17.28.5:_ovirt__production/644aacaa-12e1-4fcd-b3aa-941678cf95bd/images/3452459d-aec6-430e-9509-1d9ca815b2d8/b44659a9-607a-4eeb-a255-99532fd4fce4',
> filename='null', sparse='true', 
> transferId='28eda0c2-e36b-4e70-91ea-2ecf4a030d19'}),
> log id: 3bf6b943
>

The transfer uuid is mentioned in this log:

transferId='28eda0c2-e36b-4e70-91ea-2ecf4a030d19'

Please attach complete engine.log since this line.

You can see that the host used for upload was ovirt-hv-01.avinity.tv.
Please attach vdsm logs
from this host from the time this ticket was added.

Please attach imageio daemon logs from the same time on this host.

— — —
> Met vriendelijke groet / Kind regards,
>
> *Marko Vrgotic*
>
>
>
>
>
> *From: *Nir Soffer 
> *Date: *Thursday, 18 July 2019 at 12:20
> *To: *"Vrgotic, Marko" 
> *Cc: *users , Daniel Erez 
> *Subject: *Re: [ovirt-users] Stuck in "Finalizing" disk upload phase
>
>
>
> On Thu, Jul 18, 2019 at 10:49 AM Vrgotic, Marko 
> wrote:
>
> Dear Nir,
>
>
>
> None of my Hosts has any updated left to be added, they are as up to date
> as they can be.
>
> The imageio packages version installed is:
>
>
>
> Ovirt-imageio-common-1.5.1-0.el7.x86_64
>
> Ovirt-imageio-daemon-1.5.1-0.el7.x86_64
>
>
>
> We need logs to understand the issue.
>
>
>
> Can you share logs from the time the upload was started?
>
> - engine log (/var/log/ovirt-engine/engine.log)
>
> - vdsm log on the host that performed the upload (/var/log/vdsm/vdsm.log)
>
> - daemon logs on that host (/var/log/ovirt-imageio-daemon/daemon.log)
>
>
>
> To locate the right host you can grep for the transfer uuid that should be
> mentioned in engine logs.
>
>
>
>
>
> Additional software info from Host
>
> OS Version:
>
> RHEL - 7 - 6.1810.2.el7.centos
>
> OS Description:
>
> CentOS Linux 7 (Core)
>
> Kernel Version:
>
> 3.10.0 - 957.21.3.el7.x86_64
>
> KVM Version:
>
> 2.12.0 - 18.el7_6.5.1
>
> LIBVIRT Version:
>
> libvirt-4.5.0-10.el7_6.12
>
> VDSM Version:
>
> vdsm-4.30.17-1.el7
>
> SPICE Version:
>
> 0.14.0 - 6.el7_6.1
>
> GlusterFS Version:
>
> [N/A]
>
> CEPH Version:
>
> librbd1-10.2.5-4.el7
>
> Open vSwitch Version:
>
> openvswitch-2.10.1-3.el7
>
> Kernel Features:
>
> PTI: 1, IBRS: 0, RETP: 1, SSBD: 3
>
>
>
> *From: *"Vrgotic, Marko" 
> *Date: *Thursday, 18 July 2019 at 08:03
> *To: *Nir Soffer 
> *Cc: *users , Daniel Erez 
> *Subject: *Re: [ovirt-users] Stuck in "Finalizing" disk upload phase
>
>
>
> Hi Nir,
>
>
>
> Sure, i will check.
>
>
>
> Is there a way for Adminstrator to view tickets or close them by force?
>
> Sent from my iPhone
>
>
> On 18 Jul 2019, at 00:05, Nir Soffer  wrote:
>
>
>
> On Wed, Jul 17, 2019, 19:20 Vrgotic, Marko 
> wrote:
>
> Dear oVIrt,
>
>
>
> I initiated upload of qcow2 disk image for Centos 6.5:
>
> It reached finalizing phase and than started throwing following errors:
>
>
>
> 2019-07-17 14:40:51,480Z INFO
> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand]
> (EE-ManagedThreadFactory-engineScheduled-Thread-86)
> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for
> Upload disk 'av-07-centos-65-base' (disk id:
> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id:
> 'b44659a9-607a-4eeb-a255-99532fd4fce4')
>
> 2019-07-17 14:40:51,480Z WARN
> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand]
> (EE-ManagedThreadFactory-engineScheduled-Thread-86)
> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer
> session. Ticket does not exist for image
> '3452459d-aec6-430e-9509-1d9ca815b2d8'
>
>
>
> Old versions of ovirt-imageio-daemon were failing to remove a ticket if
> the ticket does not exist, and engine did not handle this well.
>
>
>
> This was fixed in 4.2. Are you running the latest version on the hosts?
>
>
>
> Please update ovirt-imageio-daemo

[ovirt-users] Re: Stuck in "Finalizing" disk upload phase

2019-07-18 Thread Nir Soffer
On Thu, Jul 18, 2019 at 10:49 AM Vrgotic, Marko 
wrote:

> Dear Nir,
>
>
>
> None of my Hosts has any updated left to be added, they are as up to date
> as they can be.
>
> The imageio packages version installed is:
>
>
>
> Ovirt-imageio-common-1.5.1-0.el7.x86_64
>
> Ovirt-imageio-daemon-1.5.1-0.el7.x86_64
>

We need logs to understand the issue.

Can you share logs from the time the upload was started?
- engine log (/var/log/ovirt-engine/engine.log)
- vdsm log on the host that performed the upload (/var/log/vdsm/vdsm.log)
- daemon logs on that host (/var/log/ovirt-imageio-daemon/daemon.log)

To locate the right host you can grep for the transfer uuid that should be
mentioned in engine logs.


>
>
> Additional software info from Host
>
> OS Version:
>
> RHEL - 7 - 6.1810.2.el7.centos
>
> OS Description:
>
> CentOS Linux 7 (Core)
>
> Kernel Version:
>
> 3.10.0 - 957.21.3.el7.x86_64
>
> KVM Version:
>
> 2.12.0 - 18.el7_6.5.1
>
> LIBVIRT Version:
>
> libvirt-4.5.0-10.el7_6.12
>
> VDSM Version:
>
> vdsm-4.30.17-1.el7
>
> SPICE Version:
>
> 0.14.0 - 6.el7_6.1
>
> GlusterFS Version:
>
> [N/A]
>
> CEPH Version:
>
> librbd1-10.2.5-4.el7
>
> Open vSwitch Version:
>
> openvswitch-2.10.1-3.el7
>
> Kernel Features:
>
> PTI: 1, IBRS: 0, RETP: 1, SSBD: 3
>
>
>
> *From: *"Vrgotic, Marko" 
> *Date: *Thursday, 18 July 2019 at 08:03
> *To: *Nir Soffer 
> *Cc: *users , Daniel Erez 
> *Subject: *Re: [ovirt-users] Stuck in "Finalizing" disk upload phase
>
>
>
> Hi Nir,
>
>
>
> Sure, i will check.
>
>
>
> Is there a way for Adminstrator to view tickets or close them by force?
>
> Sent from my iPhone
>
>
> On 18 Jul 2019, at 00:05, Nir Soffer  wrote:
>
>
>
> On Wed, Jul 17, 2019, 19:20 Vrgotic, Marko 
> wrote:
>
> Dear oVIrt,
>
>
>
> I initiated upload of qcow2 disk image for Centos 6.5:
>
> It reached finalizing phase and than started throwing following errors:
>
>
>
> 2019-07-17 14:40:51,480Z INFO
> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand]
> (EE-ManagedThreadFactory-engineScheduled-Thread-86)
> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for
> Upload disk 'av-07-centos-65-base' (disk id:
> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id:
> 'b44659a9-607a-4eeb-a255-99532fd4fce4')
>
> 2019-07-17 14:40:51,480Z WARN
> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand]
> (EE-ManagedThreadFactory-engineScheduled-Thread-86)
> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer
> session. Ticket does not exist for image
> '3452459d-aec6-430e-9509-1d9ca815b2d8'
>
>
>
> Old versions of ovirt-imageio-daemon were failing to remove a ticket if
> the ticket does not exist, and engine did not handle this well.
>
>
>
> This was fixed in 4.2. Are you running the latest version on the hosts?
>
>
>
> Please update ovirt-imageio-daemon to latest version.
>
>
>
> Nir
>
>
>
> 2019-07-17 14:41:01,572Z INFO
> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand]
> (EE-ManagedThreadFactory-engineScheduled-Thread-19)
> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for
> Upload disk 'av-07-centos-65-base' (disk id:
> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id:
> 'b44659a9-607a-4eeb-a255-99532fd4fce4')
>
> 2019-07-17 14:41:01,574Z WARN
> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand]
> (EE-ManagedThreadFactory-engineScheduled-Thread-19)
> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer
> session. Ticket does not exist for image
> '3452459d-aec6-430e-9509-1d9ca815b2d8'
>
> 2019-07-17 14:41:11,690Z INFO
> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand]
> (EE-ManagedThreadFactory-engineScheduled-Thread-7)
> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for
> Upload disk 'av-07-centos-65-base' (disk id:
> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id:
> 'b44659a9-607a-4eeb-a255-99532fd4fce4')
>
> 2019-07-17 14:41:11,690Z WARN
> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand]
> (EE-ManagedThreadFactory-engineScheduled-Thread-7)
> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer
> session. Ticket does not exist for image
> '3452459d-aec6-430e-9509-1d9ca815b2d8'
>
> 2019-07-17 14:41:21,781Z INFO
> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand]
> (EE-ManagedThreadFactory-engineScheduled-Thread-12)
> [a43180ec-afc7-429e-9f30-9e851e

[ovirt-users] Re: Stuck in "Finalizing" disk upload phase

2019-07-18 Thread Vrgotic, Marko
Hi Nir,

Sure, i will check.

Is there a way for Adminstrator to view tickets or close them by force?

Sent from my iPhone

On 18 Jul 2019, at 00:05, Nir Soffer 
mailto:nsof...@redhat.com>> wrote:



On Wed, Jul 17, 2019, 19:20 Vrgotic, Marko 
mailto:m.vrgo...@activevideo.com>> wrote:
Dear oVIrt,

I initiated upload of qcow2 disk image for Centos 6.5:
It reached finalizing phase and than started throwing following errors:

2019-07-17 14:40:51,480Z INFO  
[org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
(EE-ManagedThreadFactory-engineScheduled-Thread-86) 
[a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
Upload disk 'av-07-centos-65-base' (disk id: 
'3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
'b44659a9-607a-4eeb-a255-99532fd4fce4')
2019-07-17 14:40:51,480Z WARN  
[org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
(EE-ManagedThreadFactory-engineScheduled-Thread-86) 
[a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. 
Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8'

Old versions of ovirt-imageio-daemon were failing to remove a ticket if the 
ticket does not exist, and engine did not handle this well.

This was fixed in 4.2. Are you running the latest version on the hosts?

Please update ovirt-imageio-daemon to latest version.

Nir

2019-07-17 14:41:01,572Z INFO  
[org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
(EE-ManagedThreadFactory-engineScheduled-Thread-19) 
[a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
Upload disk 'av-07-centos-65-base' (disk id: 
'3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
'b44659a9-607a-4eeb-a255-99532fd4fce4')
2019-07-17 14:41:01,574Z WARN  
[org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
(EE-ManagedThreadFactory-engineScheduled-Thread-19) 
[a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. 
Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8'
2019-07-17 14:41:11,690Z INFO  
[org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
(EE-ManagedThreadFactory-engineScheduled-Thread-7) 
[a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
Upload disk 'av-07-centos-65-base' (disk id: 
'3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
'b44659a9-607a-4eeb-a255-99532fd4fce4')
2019-07-17 14:41:11,690Z WARN  
[org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
(EE-ManagedThreadFactory-engineScheduled-Thread-7) 
[a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. 
Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8'
2019-07-17 14:41:21,781Z INFO  
[org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
(EE-ManagedThreadFactory-engineScheduled-Thread-12) 
[a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for 
Upload disk 'av-07-centos-65-base' (disk id: 
'3452459d-aec6-430e-9509-1d9ca815b2d8', image id: 
'b44659a9-607a-4eeb-a255-99532fd4fce4')
2019-07-17 14:41:21,782Z WARN  
[org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand] 
(EE-ManagedThreadFactory-engineScheduled-Thread-12) 
[a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer session. 
Ticket does not exist for image '3452459d-aec6-430e-9509-1d9ca815b2d8'

I can not cancel it, can not stop it, not via UI not via force option using 
ovirt_disk module.

Help!

oVIrt 4.3.4.3-1 version running with CentOS 7.6 Hosts.

Kindly awaiting your reply.


— — —
Met vriendelijke groet / Kind regards,

Marko Vrgotic
ActiveVideo

___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to 
users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/LJPWK5A3346ZCDSWEAG6WU3JLRXEGX22/
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/4JLP3BLJ3CFWTXYNWFK7TKZQ6RN4SXJ3/


[ovirt-users] Re: Stuck in "Finalizing" disk upload phase

2019-07-17 Thread Nir Soffer
On Wed, Jul 17, 2019, 19:20 Vrgotic, Marko 
wrote:

> Dear oVIrt,
>
>
>
> I initiated upload of qcow2 disk image for Centos 6.5:
>
> It reached finalizing phase and than started throwing following errors:
>
>
>
> 2019-07-17 14:40:51,480Z INFO
> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand]
> (EE-ManagedThreadFactory-engineScheduled-Thread-86)
> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for
> Upload disk 'av-07-centos-65-base' (disk id:
> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id:
> 'b44659a9-607a-4eeb-a255-99532fd4fce4')
>
> 2019-07-17 14:40:51,480Z WARN
> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand]
> (EE-ManagedThreadFactory-engineScheduled-Thread-86)
> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer
> session. Ticket does not exist for image
> '3452459d-aec6-430e-9509-1d9ca815b2d8'
>

Old versions of ovirt-imageio-daemon were failing to remove a ticket if the
ticket does not exist, and engine did not handle this well.

This was fixed in 4.2. Are you running the latest version on the hosts?

Please update ovirt-imageio-daemon to latest version.

Nir

2019-07-17 14:41:01,572Z INFO
> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand]
> (EE-ManagedThreadFactory-engineScheduled-Thread-19)
> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for
> Upload disk 'av-07-centos-65-base' (disk id:
> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id:
> 'b44659a9-607a-4eeb-a255-99532fd4fce4')
>
> 2019-07-17 14:41:01,574Z WARN
> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand]
> (EE-ManagedThreadFactory-engineScheduled-Thread-19)
> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer
> session. Ticket does not exist for image
> '3452459d-aec6-430e-9509-1d9ca815b2d8'
>
> 2019-07-17 14:41:11,690Z INFO
> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand]
> (EE-ManagedThreadFactory-engineScheduled-Thread-7)
> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for
> Upload disk 'av-07-centos-65-base' (disk id:
> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id:
> 'b44659a9-607a-4eeb-a255-99532fd4fce4')
>
> 2019-07-17 14:41:11,690Z WARN
> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand]
> (EE-ManagedThreadFactory-engineScheduled-Thread-7)
> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer
> session. Ticket does not exist for image
> '3452459d-aec6-430e-9509-1d9ca815b2d8'
>
> 2019-07-17 14:41:21,781Z INFO
> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand]
> (EE-ManagedThreadFactory-engineScheduled-Thread-12)
> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Finalizing successful transfer for
> Upload disk 'av-07-centos-65-base' (disk id:
> '3452459d-aec6-430e-9509-1d9ca815b2d8', image id:
> 'b44659a9-607a-4eeb-a255-99532fd4fce4')
>
> 2019-07-17 14:41:21,782Z WARN
> [org.ovirt.engine.core.bll.storage.disk.image.TransferDiskImageCommand]
> (EE-ManagedThreadFactory-engineScheduled-Thread-12)
> [a43180ec-afc7-429e-9f30-9e851eaf7ce7] Failed to stop image transfer
> session. Ticket does not exist for image
> '3452459d-aec6-430e-9509-1d9ca815b2d8'
>
>
>
> I can not cancel it, can not stop it, not via UI not via force option
> using ovirt_disk module.
>
>
>
> Help!
>
>
>
> oVIrt 4.3.4.3-1 version running with CentOS 7.6 Hosts.
>
>
>
> Kindly awaiting your reply.
>
>
>
>
>
> — — —
> Met vriendelijke groet / Kind regards,
>
> *Marko Vrgotic*
>
> ActiveVideo
>
>
> ___
> Users mailing list -- users@ovirt.org
> To unsubscribe send an email to users-le...@ovirt.org
> Privacy Statement: https://www.ovirt.org/site/privacy-policy/
> oVirt Code of Conduct:
> https://www.ovirt.org/community/about/community-guidelines/
> List Archives:
> https://lists.ovirt.org/archives/list/users@ovirt.org/message/LJPWK5A3346ZCDSWEAG6WU3JLRXEGX22/
>
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/ZUVWDVKQVDK36D2W2GCZK5ETGYICJXCZ/