Bug#743824: digikam: Digikam no longer displays any album thumbnails

[Michael Haag]

The problem has indeed disappeared.

> 
> From: Steve Robbins 
> Sent: Thu Nov 22 05:20:27 CET 2018
> To: Simon Frei 
> Cc: Michael Haag , <743...@bugs.debian.org>
> Subject: Re: Bug#743824: digikam: Digikam no longer displays any album 
> thumbnails
> 
> 
> On Monday, April 16, 2018 6:28:01 AM CST you wrote:
> > On 16/04/18 04:02, Michael Haag wrote:
> > > On Mon, Apr 16, 2018, at 05:07, Simon Frei wrote:
> > >> This is 99% a problem with qt >=5.9.3, which was fixed in 5.7.0:
> > >> https://bugs.kde.org/show_bug.cgi?id=387373
> > > 
> > > So the bug has been reintroduced? I'm on Qt 5.10.1.
> > 
> > Ah I see the ambiguity in my statement: Problem exists with version
> > 5.9.3 and newer of QT and 5.6.0 and older of digikam. So you (and debian
> > testing) being on QT 5.10.1 and digikam 5.6.0 are affected. Now that
> > Steve uploaded digikam 5.9.0 to unstable, this problem will soon
> > disappear in testing too.
> 
> Dare I ask: did the problem disappear?
> I am running 5.9.0 and cannot reproduce.
> 
> Thanks,
> -Steve
> 
> 
> 
> 
> 

Bug#743824: digikam: Digikam no longer displays any album thumbnails

[Steve Robbins]

On Monday, April 16, 2018 6:28:01 AM CST you wrote:
> On 16/04/18 04:02, Michael Haag wrote:
> > On Mon, Apr 16, 2018, at 05:07, Simon Frei wrote:
> >> This is 99% a problem with qt >=5.9.3, which was fixed in 5.7.0:
> >> https://bugs.kde.org/show_bug.cgi?id=387373
> > 
> > So the bug has been reintroduced? I'm on Qt 5.10.1.
> 
> Ah I see the ambiguity in my statement: Problem exists with version
> 5.9.3 and newer of QT and 5.6.0 and older of digikam. So you (and debian
> testing) being on QT 5.10.1 and digikam 5.6.0 are affected. Now that
> Steve uploaded digikam 5.9.0 to unstable, this problem will soon
> disappear in testing too.

Dare I ask: did the problem disappear?
I am running 5.9.0 and cannot reproduce.

Thanks,
-Steve

Bug#743824: digikam: Digikam no longer displays any album thumbnails

[Simon Frei]

On 16/04/18 04:02, Michael Haag wrote:
> On Mon, Apr 16, 2018, at 05:07, Simon Frei wrote:
>> This is 99% a problem with qt >=5.9.3, which was fixed in 5.7.0:
>> https://bugs.kde.org/show_bug.cgi?id=387373
>>
> So the bug has been reintroduced? I'm on Qt 5.10.1.

Ah I see the ambiguity in my statement: Problem exists with version
5.9.3 and newer of QT and 5.6.0 and older of digikam. So you (and debian
testing) being on QT 5.10.1 and digikam 5.6.0 are affected. Now that
Steve uploaded digikam 5.9.0 to unstable, this problem will soon
disappear in testing too.
TLDR: No need to do any further debugging on your problem ;)



signature.asc
Description: OpenPGP digital signature

Bug#743824: digikam: Digikam no longer displays any album thumbnails

[Michael Haag]

On Mon, Apr 16, 2018, at 05:07, Simon Frei wrote:
> This is 99% a problem with qt >=5.9.3, which was fixed in 5.7.0:
> https://bugs.kde.org/show_bug.cgi?id=387373
> 

So the bug has been reintroduced? I'm on Qt 5.10.1.

Bug#743824: digikam: Digikam no longer displays any album thumbnails

[Michael Haag]

See answers below. All caps are simply to make it easier to seem them.

On Mon, Apr 16, 2018, at 00:14, Steve Robbins wrote:
> On Sunday, April 15, 2018 5:01:48 AM CDT MH wrote:
> > Package: digikam
> > Version: 4:5.6.0-4+b2
> > Followup-For: Bug #743824
> > 
> > Dear Maintainer,
> > 
> > Digikam v. 5.6.0 in Debian Buster (Build date: Dec 21 2017 (target: Debian))
> > no longer displays thumbnails under any of the albums in my collection. As
> > far as I can tell, there has been no recent update of digikam and it has
> > been functioning normally.
> 
> 1. When you say "it has been functioning normally" -- do you mean to say that 
> you had been running 5.6.0-4+b2 (the December 21 build) and it was showing 
> the 
> thumbnails but then suddenly STOPPED showing thumbnails?  

YES.

> 
> 2. If so, was there any change to dependency packages on or near the day it 
> stopped working?

NOT THAT I'M AWARE OF.

> 
> > I tried deleting the databases, rebuilding thumbnails, purging digikam and
> > reinstalling. Problem remains. No error messages displayed at any time.
> 
> 3. Is digikam configured with external SQL database?

NO. IT'S CONFIGURED TO USE THE BUILT-IN DEFAULT.

> 
> Thanks,
> -Steve
> Email had 1 attachment:
> + signature.asc
>   1k (application/pgp-signature)

Bug#743824: digikam: Digikam no longer displays any album thumbnails

[Simon Frei]

This is 99% a problem with qt >=5.9.3, which was fixed in 5.7.0:
https://bugs.kde.org/show_bug.cgi?id=387373



signature.asc
Description: OpenPGP digital signature

Bug#743824: digikam: Digikam no longer displays any album thumbnails

[Steve Robbins]

On Sunday, April 15, 2018 5:01:48 AM CDT MH wrote:
> Package: digikam
> Version: 4:5.6.0-4+b2
> Followup-For: Bug #743824
> 
> Dear Maintainer,
> 
> Digikam v. 5.6.0 in Debian Buster (Build date: Dec 21 2017 (target: Debian))
> no longer displays thumbnails under any of the albums in my collection. As
> far as I can tell, there has been no recent update of digikam and it has
> been functioning normally.

1. When you say "it has been functioning normally" -- do you mean to say that 
you had been running 5.6.0-4+b2 (the December 21 build) and it was showing the 
thumbnails but then suddenly STOPPED showing thumbnails?  

2. If so, was there any change to dependency packages on or near the day it 
stopped working?

> I tried deleting the databases, rebuilding thumbnails, purging digikam and
> reinstalling. Problem remains. No error messages displayed at any time.

3. Is digikam configured with external SQL database?

Thanks,
-Steve


signature.asc
Description: This is a digitally signed message part.

Bug#743824: digikam: Digikam no longer displays any album thumbnails

[MH]

Package: digikam
Version: 4:5.6.0-4+b2
Followup-For: Bug #743824

Dear Maintainer,

Digikam v. 5.6.0 in Debian Buster (Build date: Dec 21 2017 (target: Debian)) no 
longer displays
thumbnails under any of the albums in my collection. As far as I can tell, 
there has been no
recent update of digikam and it has been functioning normally.

I tried deleting the databases, rebuilding thumbnails, purging digikam and 
reinstalling.
Problem remains. No error messages displayed at any time.

-- System Information:
Debian Release: buster/sid
  APT prefers testing
  APT policy: (500, 'testing')
Architecture: amd64 (x86_64)
Foreign Architectures: i386

Kernel: Linux 4.15.0-2-amd64 (SMP w/4 CPU cores)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8), LANGUAGE=en_US 
(charmap=UTF-8)
Shell: /bin/sh linked to /usr/bin/dash
Init: systemd (via /run/systemd/system)
LSM: AppArmor: enabled

Versions of packages digikam depends on:
ii  digikam-data  4:5.6.0-4
ii  digikam-private-libs  4:5.6.0-4+b2
ii  kipi-plugins  4:5.6.0-4+b2
ii  libc6 2.27-3
ii  libgcc1   1:8-20180402-1
ii  libkf5configcore5 5.44.0-1
ii  libkf5coreaddons5 5.44.0-1
ii  libkf5filemetadata3   5.44.0-1
ii  libkf5i18n5   5.44.0-1
ii  libqt5core5a  5.10.1+dfsg-5
ii  libqt5gui55.10.1+dfsg-5
ii  libqt5sql55.10.1+dfsg-5
ii  libqt5sql5-mysql  5.10.1+dfsg-5
ii  libqt5sql5-sqlite 5.10.1+dfsg-5
ii  libqt5widgets55.10.1+dfsg-5
ii  libstdc++68-20180402-1
ii  perl  5.26.1-5

Versions of packages digikam recommends:
ii  ffmpegthumbs   4:17.08.3-1
ii  firefox-esr [www-browser]  52.7.3esr-1
ii  konqueror [www-browser]4:17.08.3-2

Versions of packages digikam suggests:
ii  digikam-doc 4:5.6.0-4
ii  systemsettings  4:5.12.4-1

-- no debconf information

Bug#743824: digikam: Digikam no longer displays any album thumbnails

[Stig Inge Lea Bjørnsen]

On Sun, 23 Oct 2016 20:03:54 +0200 Simon Frei  wrote:

Can you try a more recent version, ideally version 5, to see whether
this problem persists? The mysql database has been revised a lot in
version 5.


After upgrading to Digikam 5 in Debian unstable, I don't think I've had 
any thumbnails disappear.


Simon: I didn't receive a copy of your message but was notified by the 
followup message from Ryan.


--
Stig Inge Lea Bjørnsen
stigi...@pvv.org

Bug#743824: digikam: Digikam no longer displays any album thumbnails

[Ryan Kavanagh]

Hi Simon,

On Thu, Jan 12, 2017 at 10:05:14PM +0100, Simon Frei wrote:
> Thanks a lot for the very detailed report. Can you check in Settings ->
> Configure digiKam... -> Image Editor -> Versioning at the bottom in the
> "In main view" section, whether you have any of the "Always show..."
> options set?

It was unset. Setting it made the images appear in the Thumbnails view.

> I assume that the case in the screenshot of just one image is only
> reproducible by moving images around outside of digikam?

I was not able to reproduce it by editing the image within Digikam and
saving as a new version, that's to say, both the original image and the
new version were visible in the Thumbnails view despite having "Always
show..." unchecked. This behaviour seems to contradict the message in
the info box explaining the option ("If the image has been edited, only
the current versions will be shown in the main thumbnail view. [...]"),
which would have lead me to believe that the original image would be
hidden in the Thumbnails view.

Best wishes,
Ryan

-- 
|_)|_/  Ryan Kavanagh  | GPG: 4E46 9519 ED67 7734 268F
| \| \  https://ryanak.ca/ |  BD95 8F7B F8FC 4A11 C97A


signature.asc
Description: PGP signature

Bug#743824: digikam: Digikam no longer displays any album thumbnails

[Simon Frei]

Hi Ryan,

Thanks a lot for the very detailed report. Can you check in Settings ->
Configure digiKam... -> Image Editor -> Versioning at the bottom in the
"In main view" section, whether you have any of the "Always show..."
options set?
This could explain why some images are missing, but not why there is a
discrepancy between thumbnail and table view. I assume that the case in
the screenshot of just one image is only reproducible by moving images
around outside of digikam?
All in all it clearly sounds like an upstream issue. If you don't mind
answering my questions, I will open the upstream bugtracker issues once
we fleshed the problem out.



signature.asc
Description: OpenPGP digital signature

Bug#743824: digikam: Digikam no longer displays any album thumbnails

[Ryan Kavanagh]

Dear Simon,

On Wed, Jan 11, 2017 at 10:41:08PM +0100, Simon Frei wrote:
> When you say missing, it's just the actual thumbnail missing, meaning
> file infos are there, but just some kind of empty frame or is there no
> trace at all of those images?

There is no trace at all of those images. To illustrate, I created an
album containing one of the affected images and only that image[0].
Clicking first on the "Thumbnails" button in the menu bar, one is given
a blank window[1]: there is no sign of any image existing in the album.
Then clicking on the "Table" button, one sees the previously missing
image[2]. Double clicking on the image in this view brings you to
"Prevew Image", where one can see a preview of the image, but one
notices that there are no images in the image selector above it[3]. This
is in contrast to the usual view of "Preview Image", where one can see
thumbnails for the current image and other images in the album, e.g.,
[4]. (Note that I only expect there to be one thumbnail in [3], that is,
the thumbnail for the current image.)

> Are any of the images grouped or were edited with the digikam editor
> (i.e. versioning is used)?

They were edited by Digikam without using the editor's built-in
versioning. I don't know if all of the ones experiencing this problem
were edited, but at least many of them were.  In essence, I'm working
with scans of multiple (n) pictures, and so I wrote a script that would
make n copies of the original scan using cp, each with a different
filename.  I would then edit (crop/rotate) the copies using Digikam. It
seems to be that the originals don't appear in the Thumbnails view,
though they do in the Table view. Moreover, the modified copies appear
in the "Thumbnails view" and they all appear as versions in the same
image history. See, for example, [5] and [6].

Please let me know if I can provide any further information.

—RAK

[0] https://people.debian.org/~rak/bug_743824/0198.tiff
[1] 
https://people.debian.org/~rak/bug_743824/2017-01-12-115747_943x699_scrot.png
[2] 
https://people.debian.org/~rak/bug_743824/2017-01-12-115756_943x699_scrot.png
[3] 
https://people.debian.org/~rak/bug_743824/2017-01-12-115802_943x699_scrot.png
[4] 
https://people.debian.org/~rak/bug_743824/2017-01-12-120623_1016x699_scrot.png
[5] 
https://people.debian.org/~rak/bug_743824/2017-01-12-142116_1161x649_scrot.png
[6] 
https://people.debian.org/~rak/bug_743824/2017-01-12-142155_1206x890_scrot.png

-- 
|_)|_/  Ryan Kavanagh  | GPG: 4E46 9519 ED67 7734 268F
| \| \  https://ryanak.ca/ |  BD95 8F7B F8FC 4A11 C97A


signature.asc
Description: PGP signature

Bug#743824: digikam: Digikam no longer displays any album thumbnails

[Simon Frei]

Hi Ryan,

Thanks for the heads up regarding the frankly weird mailing distribution.

Are any of the images grouped or were edited with the digikam editor
(i.e. versioning is used)?
When you say missing, it's just the actual thumbnail missing, meaning
file infos are there, but just some kind of empty frame or is there no
trace at all of those images?

Cheers,
Simon



signature.asc
Description: OpenPGP digital signature

Bug#743824: digikam: Digikam no longer displays any album thumbnails

[Ryan Kavanagh]

Package: digikam
Version: 4:5.3.0-1
Followup-For: Bug #743824

On Sun, Oct 23, 2016 at 08:03:54PM +0200, Simon Frei wrote:
> Can you try a more recent version, ideally version 5, to see whether
> this problem persists? The mysql database has been revised a lot in
> version 5.

I can still reproduce this bug. Interestingly, images are missing in the
"Thumbnails" view (for a particular album it only shows 210 images), but
they all appear in the "Table" view (the same album shows all 368
images). Moreover, this seems to be image specific: renaming the image
file and moving it to another directory has no effect on whether or not
the image appears in the "Thumbnails" view. Rebuilding thumbnails for
the affected albums (via Tools -> Maintenance) does not solve the
problem.

Best wishes,
Ryan

PS: Simon, Stig likely didn't receive a copy of your message; see
https://lists.debian.org/debian-devel/2016/12/msg00613.html .


-- System Information:
Debian Release: stretch/sid
  APT prefers unstable-debug
  APT policy: (500, 'unstable-debug'), (500, 'unstable'), (1, 
'experimental-debug'), (1, 'experimental')
Architecture: amd64 (x86_64)
Foreign Architectures: i386

Kernel: Linux 4.8.0-2-amd64 (SMP w/4 CPU cores)
Locale: LANG=en_CA.UTF-8, LC_CTYPE=en_CA.UTF-8 (charmap=UTF-8) (ignored: LC_ALL 
set to en_CA.UTF-8)
Shell: /bin/sh linked to /bin/dash
Init: systemd (via /run/systemd/system)

Versions of packages digikam depends on:
ii  digikam-data  4:5.3.0-1
ii  digikam-private-libs  4:5.3.0-1
ii  kipi-plugins  4:5.3.0-1
ii  libc6 2.24-8
ii  libgcc1   1:6.3.0-2
ii  libkf5configcore5 5.28.0-1
ii  libkf5coreaddons5 5.28.0-1
ii  libkf5filemetadata3   5.28.0-1
ii  libkf5i18n5   5.28.0-1
ii  libqt5core5a  5.7.1+dfsg-2
ii  libqt5gui55.7.1+dfsg-2
ii  libqt5sql55.7.1+dfsg-2
ii  libqt5sql5-mysql  5.7.1+dfsg-2
ii  libqt5sql5-sqlite 5.7.1+dfsg-2
ii  libqt5widgets55.7.1+dfsg-2
ii  libstdc++66.3.0-2
pn  perl:any  

Versions of packages digikam recommends:
ii  chromium [www-browser]  55.0.2883.75-3
pn  ffmpegthumbs
ii  firefox-esr [www-browser]   45.6.0esr-1
ii  google-chrome-stable [www-browser]  55.0.2883.87-1
ii  lynx [www-browser]  2.8.9dev11-1
ii  w3m [www-browser]   0.5.3-34

Versions of packages digikam suggests:
pn  digikam-doc 
pn  systemsettings  

-- no debconf information

-- 
|_)|_/  Ryan Kavanagh  | GPG: 4E46 9519 ED67 7734 268F
| \| \  https://ryanak.ca/ |  BD95 8F7B F8FC 4A11 C97A


signature.asc
Description: PGP signature

Bug#743824: digikam: Digikam no longer displays any album thumbnails

[Simon Frei]

Can you try a more recent version, ideally version 5, to see whether
this problem persists? The mysql database has been revised a lot in
version 5.

Bug#743824: digikam: Digikam no longer displays any album thumbnails

[Stig Inge Lea Bjørnsen]

Package: digikam
Version: 4:3.5.0-3+b3
Severity: normal
Tags: upstream

Dear Maintainer,

Digikam no longer displays any album thumbnails (icons). I run Digikam
on Sid with a MySQL database running on Wheezy i386 (.deb mysql-server
5.5.35+dfsg-0+wheezy1).

Here follows a description of the error situation in my Digikam
database.

Data for one of the affected albums:

mysql select * from Albums where relativePath like '%Foo'\G
  id: 634
   albumRoot: 1
relativePath: /2014/2014-01-23 Foo
date: 2014-01-23
 caption: 
  collection: Bar
icon: 32366

mysql select * from Images where id=32366\G
  id: 32366
   album: NULL
name: IMG_1185.JPG
  status: 3
category: 1
modificationDate: 2014-01-25 13:09:08
fileSize: 2615231
  uniqueHash: 1398e937cee377df7fc61536023cbd01

mysql select * from Images where id=32366 or name='IMG_1185.JPG'\G
*** 1. row ***
  id: 34478
   album: 634
name: IMG_1185.JPG
  status: 1
category: 1
modificationDate: 2014-01-25 13:09:08
fileSize: 2615231
  uniqueHash: 1398e937cee377df7fc61536023cbd01
*** 2. row ***
  id: 32366
   album: NULL
name: IMG_1185.JPG
  status: 3
category: 1
modificationDate: 2014-01-25 13:09:08
fileSize: 2615231
  uniqueHash: 1398e937cee377df7fc61536023cbd01

We see that there exists two rows for the icon in the Images
tables. The image with status=1 is the one that is currently in the
album. The problem is that the album's icon points to the image with
status=3 which is no longer in the album.

The query that Digikam uses for finding album icons requires that the
icon image is in the album. From
http://api.kde.org/extragear-api/graphics-apidocs/digikam/html/albumdb_8cpp_source.html#l00252:

d-db-execSql(SELECT A.albumRoot, A.id, A.relativePath, A.date, A.caption, 
A.collection, B.albumRoot, B.relativePath, I.name \n 
  FROM Albums AS A \n 
   LEFT JOIN Images AS I ON A.icon=I.id \n
   LEFT JOIN Albums AS B ON B.id=I.album \n
   WHERE A.albumRoot != 0;, // exclude stale albums
  values);

I don't know what causes Digikam to create multiple rows for images
and have them differ by their status. But it should preserve album
icons.

An affected Digikam database can be repaired by following the
instructions below.

Backup the databases:

$ mysqldump digikam  ~/digikam-$(date +%F).sql
$ mysqldump digikamthumbnails  ~/digikamthumbnails-$(date +%F).sql

List the albums with missing icons where the icon exists as another
image in the database:

mysql select A.id, A.relativePath, I.id, I.status, I.name, I2.id,
  I2.status, I2.name, I2.album from Albums as A
  join Images as I on A.icon = I.id
  join Images as I2 on I.uniqueHash = I2.uniqueHash and I.id  I2.id and 
I2.album = A.id
  where I.album is null order by A.relativePath;

Generate update statements for the albums with repairable icons:

mysql select concat('update Albums set icon=', I2.id, ' where id=', A.id, ';')
  from Albums as A
  join Images as I on A.icon = I.id
  join Images as I2 on I.uniqueHash = I2.uniqueHash and I.id  I2.id and 
I2.album = A.id
  where I.album is null order by A.relativePath
  into outfile '/tmp/digikam-fix-album-icons.sql';

Run the generated updates:

$ mysql digikam  /tmp/digikam-fix-album-icons.sql

-- System Information:
Debian Release: jessie/sid
  APT prefers unstable
  APT policy: (500, 'unstable')
Architecture: amd64 (x86_64)
Foreign Architectures: i386

Kernel: Linux 3.13-1-amd64 (SMP w/8 CPU cores)
Locale: LANG=en_US.utf8, LC_CTYPE=en_US.utf8 (charmap=UTF-8) (ignored: LC_ALL 
set to en_US.utf8)
Shell: /bin/sh linked to /bin/dash

Versions of packages digikam depends on:
ii  digikam-data  4:3.5.0-3
ii  digikam-private-libs  4:3.5.0-3+b3
ii  kde-runtime   4:4.11.5-1
ii  libc6 2.18-4
ii  libgcc1   1:4.8.2-19
ii  libgphoto2-6  2.5.3.1-1
ii  libgphoto2-port10 2.5.3.1-1
ii  libkdcraw22   4:4.11.5-1
ii  libkdecore5   4:4.11.5-1
ii  libkdeui5 4:4.11.5-1
ii  libkexiv2-11  4:4.11.5-2
ii  libkhtml5 4:4.11.5-1
ii  libkio5   4:4.11.5-1
ii  libkipi11 4:4.11.5-1
ii  libknotifyconfig4 4:4.11.5-1
ii  libkparts44:4.11.5-1
ii  libphonon44:4.7.1-1
ii  libqt4-dbus   4:4.8.5+git242-g0315971+dfsg-2
ii  libqt4-sql4:4.8.5+git242-g0315971+dfsg-2
ii  libqt4-sql-sqlite 4:4.8.5+git242-g0315971+dfsg-2
ii  libqt4-xml4:4.8.5+git242-g0315971+dfsg-2
ii  libqtcore44:4.8.5+git242-g0315971+dfsg-2
ii  libqtgui4 4:4.8.5+git242-g0315971+dfsg-2
ii  libsolid4 4:4.11.5-1
ii  libstdc++64.8.2-19
ii  libthreadweaver4  4:4.11.5-1
ii  perl  5.18.2-2+b1
ii  phonon