[Touch-packages] [Bug 1559522] Re: Thumbnailer fails to fetch thumbnails from Internet
Hi Dario, it's definitely not dash.ubuntu.com that's responsible. It simply looks like some quirk in 7digital's implementation. I'm trying to find out whether we have a channel that we can use to report the problem to 7digital. If so, I'll do that. In the mean time, there is nothing we can do to fix this particular issue. I'll close this bug as invalid for now. Please feel free to re-open if you disagree or come across any other strange behavior. ** Changed in: thumbnailer (Ubuntu) Status: Confirmed => Invalid -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to thumbnailer in Ubuntu. https://bugs.launchpad.net/bugs/1559522 Title: Thumbnailer fails to fetch thumbnails from Internet Status in thumbnailer package in Ubuntu: Invalid Bug description: I used Sound Juicer and ripperX to extract MP3s from my CDs. I copied my album to the phone, and I expected to see all album art in the Music scope and in the Music app, for every album in the phone. But, in some case Thumbnailer failed fetching album art from Internet (7Digital, I guess), and so Music scope is full of empty folders (see attachment). Device: BQ Aquaris E4.5 with Ubuntu 15.04 - OTA9.1 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/thumbnailer/+bug/1559522/+subscriptions -- Mailing list: https://launchpad.net/~touch-packages Post to : touch-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~touch-packages More help : https://help.launchpad.net/ListHelp
[Touch-packages] [Bug 1559522] Re: Thumbnailer fails to fetch thumbnails from Internet
BTW, this section in the log you attached shows the story: thumbnailer-service: [16:55:45.415] "artist: R.E.M./Accelerate (234,0): 2.197007 [q: 0.03, d: 2.121933] sec (MISS)" thumbnailer-service: [16:56:01.413] "album: R.E.M./Accelerate (70,0): 1.232549 [q: 0.05, d: 1.230182] sec (NO ARTWORK)" thumbnailer-service: [16:56:01.415] "album: R.E.M./Accelerate (71,0): 0.836174 sec (FAILED PREVIOUSLY)" The first line is a request for *artist* art for "R.E.M." with the album "Accelerate". The MISS trace indicates that we didn't have a thumbnail yet, retrieved an image successfully, and then added it to the cache. The second line is a request for *album* art for "R.E.M." with the album "Accelerate". The NO ARTWORK indicates that we didn't have a thumbnail yet, tried to retrieve an image, and received an authoritative "no artwork is available" response. The third line is another request for the same album art. The FAILED PREVIOUSLY trace indicates that we tried to retrieve this image previously, were told that no artwork is available and, therefore, didn't try again to retrieve that image (because doing so would be futile). If you wait a week, you will see the same thing again because the failure times out after a week. -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to thumbnailer in Ubuntu. https://bugs.launchpad.net/bugs/1559522 Title: Thumbnailer fails to fetch thumbnails from Internet Status in thumbnailer package in Ubuntu: Confirmed Bug description: I used Sound Juicer and ripperX to extract MP3s from my CDs. I copied my album to the phone, and I expected to see all album art in the Music scope and in the Music app, for every album in the phone. But, in some case Thumbnailer failed fetching album art from Internet (7Digital, I guess), and so Music scope is full of empty folders (see attachment). Device: BQ Aquaris E4.5 with Ubuntu 15.04 - OTA9.1 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/thumbnailer/+bug/1559522/+subscriptions -- Mailing list: https://launchpad.net/~touch-packages Post to : touch-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~touch-packages More help : https://help.launchpad.net/ListHelp
[Touch-packages] [Bug 1559522] Re: Thumbnailer fails to fetch thumbnails from Internet
Hi Dario, thanks for the follow-up! Well, I suspect there is essentially nothing we can do about this. dash.ubuntu.com almost certainly passes the request through to 7digital without tinkering with it, so I suspect what you have found is a problem in 7digital's API. It looks like it can handle the dots for artist art, but not for album art. You can try this yourself: https://dash.ubuntu.com/musicproxy/v1/artist- art?artist=R.E.M.==0f450aa882a6125ebcbfb3d7f7aa25bc This works. https://dash.ubuntu.com/musicproxy/v1/artist- art?artist=REM==0f450aa882a6125ebcbfb3d7f7aa25bc This works too. https://dash.ubuntu.com/musicproxy/v1/album- art?artist=REM=Document=0f450aa882a6125ebcbfb3d7f7aa25bc This works. https://dash.ubuntu.com/musicproxy/v1/album- art?artist=R.E.M.=Document=0f450aa882a6125ebcbfb3d7f7aa25bc This fails. This proves that nothing on the thumbnailer side is responsible. It could be that dash.ubuntu.com is responsible for somehow mangling the artist ID in the cover art request (although it seems unlikely). I'll ask our dash.ubuntu.com guru and report back. Thanks for taking the time to let us know about this! ** Changed in: thumbnailer (Ubuntu) Status: Incomplete => Confirmed -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to thumbnailer in Ubuntu. https://bugs.launchpad.net/bugs/1559522 Title: Thumbnailer fails to fetch thumbnails from Internet Status in thumbnailer package in Ubuntu: Confirmed Bug description: I used Sound Juicer and ripperX to extract MP3s from my CDs. I copied my album to the phone, and I expected to see all album art in the Music scope and in the Music app, for every album in the phone. But, in some case Thumbnailer failed fetching album art from Internet (7Digital, I guess), and so Music scope is full of empty folders (see attachment). Device: BQ Aquaris E4.5 with Ubuntu 15.04 - OTA9.1 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/thumbnailer/+bug/1559522/+subscriptions -- Mailing list: https://launchpad.net/~touch-packages Post to : touch-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~touch-packages More help : https://help.launchpad.net/ListHelp
[Touch-packages] [Bug 1559522] Re: Thumbnailer fails to fetch thumbnails from Internet
Here's the attachment! :-P ** Attachment added: "R.E.M. artist and album thumbnails." https://bugs.launchpad.net/ubuntu/+source/thumbnailer/+bug/1559522/+attachment/4620397/+files/Thumbnail-REM.jpg -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to thumbnailer in Ubuntu. https://bugs.launchpad.net/bugs/1559522 Title: Thumbnailer fails to fetch thumbnails from Internet Status in thumbnailer package in Ubuntu: Incomplete Bug description: I used Sound Juicer and ripperX to extract MP3s from my CDs. I copied my album to the phone, and I expected to see all album art in the Music scope and in the Music app, for every album in the phone. But, in some case Thumbnailer failed fetching album art from Internet (7Digital, I guess), and so Music scope is full of empty folders (see attachment). Device: BQ Aquaris E4.5 with Ubuntu 15.04 - OTA9.1 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/thumbnailer/+bug/1559522/+subscriptions -- Mailing list: https://launchpad.net/~touch-packages Post to : touch-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~touch-packages More help : https://help.launchpad.net/ListHelp
[Touch-packages] [Bug 1559522] Re: Thumbnailer fails to fetch thumbnails from Internet
Hi, I found (part of) the problem, at the least the one concerning R.E.M. thumbnails. The problem seems to be the... dots! I've modified "artist" tags in the MP3 files, cleaning-up "dots" in the "R.E.M." artist name. Without them, fetching 7digital works! It recognize "REM", but not "R.E.M." So I've made a copy of two songs, leaving a copy with "dotted" tags and the others without dots, wipe the cache, and you can see in the attached picture the result. Still: artist thumbnail works both with "R.E.M." and "REM", so the problem is only when fetching album thumbnail. On the attached picture attached you can see. I think that is only part of the problem, because other artists don't have dots or any other special char on their name. I'm testing those MP3 files, I think I can get some result in the next days. Here's the dbus.log file Activating service name='com.canonical.Thumbnailer' thumbnailer-service: [12:31:09.305] Initializing thumbnailer-service: [12:31:09.561] DBusInterface(): adjusted max-extractions to 1 for Arm Successfully activated service 'com.canonical.Thumbnailer' thumbnailer-service: [12:31:09.587] image cache: 226 entries, 13888283 bytes, hit rate 0.06 (99/1627), avg hit run 1.87, avg miss run 30.70 thumbnailer-service: [12:31:09.589] thumbnail cache: 1629 entries, 23964993 bytes, hit rate 0.63 (2906/1726), avg hit run 5.44, avg miss run 3.23 thumbnailer-service: [12:31:09.589] failure cache: 76 entries, 4555 bytes, hit rate 0.27 (514/1388), avg hit run 5.30, avg miss run 14.46 thumbnailer-service: [12:31:10.290] cleared all caches ** (zeitgeist-fts:3316): WARNING **: Unable to get info on application ://ubuntu-app-launch.desktop ** (zeitgeist-fts:3316): WARNING **: Unable to get info on application://com.ubuntu.terminal_terminal.desktop thumbnailer-service: [12:31:34.957] "album: REM/Document (195,0): 1.968088 [q: 0.05, d: 1.848318] sec (MISS)" thumbnailer-service: [12:31:36.153] "artist: REM/Document (529,0): 1.433097 [q: 0.06, d: 1.363376] sec (MISS)" thumbnailer-service: [12:31:36.271] "artist: R.E.M./Document (529,0): 1.548588 [q: 0.08, d: 1.453808] sec (MISS)" thumbnailer-service: [12:31:40.654] "album: R.E.M./Monster (322,0): 0.344867 [q: 0.03, d: 0.328462] sec (NO ARTWORK)" thumbnailer-service: [12:31:40.921] "album: R.E.M./Document (322,0): 0.600728 [q: 0.04, d: 0.515879] sec (NO ARTWORK)" thumbnailer-service: [12:31:41.480] "album: REM/Monster (322,0): 1.257248 [q: 0.05, d: 1.125985] sec (MISS)" thumbnailer-service: [12:32:11.600] Idle timeout reached. thumbnailer-service: [12:32:11.613] Exiting -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to thumbnailer in Ubuntu. https://bugs.launchpad.net/bugs/1559522 Title: Thumbnailer fails to fetch thumbnails from Internet Status in thumbnailer package in Ubuntu: Incomplete Bug description: I used Sound Juicer and ripperX to extract MP3s from my CDs. I copied my album to the phone, and I expected to see all album art in the Music scope and in the Music app, for every album in the phone. But, in some case Thumbnailer failed fetching album art from Internet (7Digital, I guess), and so Music scope is full of empty folders (see attachment). Device: BQ Aquaris E4.5 with Ubuntu 15.04 - OTA9.1 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/thumbnailer/+bug/1559522/+subscriptions -- Mailing list: https://launchpad.net/~touch-packages Post to : touch-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~touch-packages More help : https://help.launchpad.net/ListHelp
[Touch-packages] [Bug 1559522] Re: Thumbnailer fails to fetch thumbnails from Internet
You can do thumbnailer-admin clear That will wipe the cache completely, as if the thumbnailer had never run before. If the *same* albums always fail, it may well be because 7digital simply does not have artwork for those albums. Or, possibly, because some of the tags contain spelling errors. At any rate, you can do the following to start with a clean slate: $ cd ~phablet/.cache/upstart $ rm dbus* $ thumbnailer-admin clear Then start using your music collection as you normally would. If you keep an eye on dbus.log, it will tell you what happens for each thumbnail request. -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to thumbnailer in Ubuntu. https://bugs.launchpad.net/bugs/1559522 Title: Thumbnailer fails to fetch thumbnails from Internet Status in thumbnailer package in Ubuntu: Incomplete Bug description: I used Sound Juicer and ripperX to extract MP3s from my CDs. I copied my album to the phone, and I expected to see all album art in the Music scope and in the Music app, for every album in the phone. But, in some case Thumbnailer failed fetching album art from Internet (7Digital, I guess), and so Music scope is full of empty folders (see attachment). Device: BQ Aquaris E4.5 with Ubuntu 15.04 - OTA9.1 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/thumbnailer/+bug/1559522/+subscriptions -- Mailing list: https://launchpad.net/~touch-packages Post to : touch-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~touch-packages More help : https://help.launchpad.net/ListHelp
[Touch-packages] [Bug 1559522] Re: Thumbnailer fails to fetch thumbnails from Internet
Hi Michi, only this morning I've understood your request for the zipped dbus logs - I didn't realize of those files before, sorry. Well, now I saw there are seven of that kind of file, but only in one of them (see attachment) I found something interesting (let me know if you want me to upload the others). If I want to do a test, how can I force refreshing the thumbnail cache before the one week term? I really don't know if it's a temporary error from 7digital, but I always have the same problem with specific album artworks, while others always work. Thanks, Dario ** Attachment added: "dbus log" https://bugs.launchpad.net/ubuntu/+source/thumbnailer/+bug/1559522/+attachment/4609481/+files/dbus.log.4 -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to thumbnailer in Ubuntu. https://bugs.launchpad.net/bugs/1559522 Title: Thumbnailer fails to fetch thumbnails from Internet Status in thumbnailer package in Ubuntu: Incomplete Bug description: I used Sound Juicer and ripperX to extract MP3s from my CDs. I copied my album to the phone, and I expected to see all album art in the Music scope and in the Music app, for every album in the phone. But, in some case Thumbnailer failed fetching album art from Internet (7Digital, I guess), and so Music scope is full of empty folders (see attachment). Device: BQ Aquaris E4.5 with Ubuntu 15.04 - OTA9.1 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/thumbnailer/+bug/1559522/+subscriptions -- Mailing list: https://launchpad.net/~touch-packages Post to : touch-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~touch-packages More help : https://help.launchpad.net/ListHelp
[Touch-packages] [Bug 1559522] Re: Thumbnailer fails to fetch thumbnails from Internet
I can only see a few most recent entries in the log, most likely because the log was rolled over and earlier entries are now in an archived and compressed log. Could you also attach any compressed dbus logs that are kicking around? Looking through what I can see, there are a number of "FAILED PREVIOUSLY" entries, including one for "Friday Night in San Francisco", for which we know that 7digital indeed has artwork. The FAILED PREVIOUSLY entries come about because, on a previous attempt to retrieve artwork, 7digital has *authoritatively* told us that it does not have artwork for this album (by returning a 404 HTTP error). Unfortunately, 7digital has a habit of doing that when part of its index is down. The error code we get is wrong; 7digital should return a temporary error instead of an authoritative error in this case. Unfortunately, 7digital also returns the same 404 error for albums for which it truly does not have artwork, so we cannot distinguish a temporary failure from a permanent one. To avoid hammering the radio and network quota with futile attempts to get artwork that does not exist, we remember the 404 error; if we get a request for the same album again, we immediately return FAILED PREVIOUSLY. However, these failure entries time out after one week, and we try to retrieve artwork for a failed album again once the timeout expires. The upshot of all this is that the problem will fix itself aftera week (assuming that 7digital has artwork at the time the next attempt is made). So, there is no bug here. Given what 7digital is telling us, the behavior is exactly as intended, and the problem will rectify itself automatically. The only thing we could do is shorten the retry timeout. There is trade- off involved here: a shorter retry timeout means that the problem will fix itself sooner, but it also means that we will try more often to get artwork for albums that indeed do not exist on 7digital (and, most likely, never will). Note that, once a request to 7digital succeeds, we cache it and, thereafter, the album art will kick around pretty much forever, unless you have truly gigantic media collection. (But, even then, artwork is cached in LRU order, so anything you look at reasonably frequently will always be in the cache.) I'll leave this bug open for now. Please let me know whether the problem rectifies itself after a week. -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to thumbnailer in Ubuntu. https://bugs.launchpad.net/bugs/1559522 Title: Thumbnailer fails to fetch thumbnails from Internet Status in thumbnailer package in Ubuntu: Incomplete Bug description: I used Sound Juicer and ripperX to extract MP3s from my CDs. I copied my album to the phone, and I expected to see all album art in the Music scope and in the Music app, for every album in the phone. But, in some case Thumbnailer failed fetching album art from Internet (7Digital, I guess), and so Music scope is full of empty folders (see attachment). Device: BQ Aquaris E4.5 with Ubuntu 15.04 - OTA9.1 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/thumbnailer/+bug/1559522/+subscriptions -- Mailing list: https://launchpad.net/~touch-packages Post to : touch-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~touch-packages More help : https://help.launchpad.net/ListHelp
[Touch-packages] [Bug 1559522] Re: Thumbnailer fails to fetch thumbnails from Internet
Attachment: dbus.log file zipped. Let me know if you need something else. Thanks! Dario ** Attachment added: "dbus.log file of my Aquaris E4.5" https://bugs.launchpad.net/ubuntu/+source/thumbnailer/+bug/1559522/+attachment/4605515/+files/dbus.log.zip -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to thumbnailer in Ubuntu. https://bugs.launchpad.net/bugs/1559522 Title: Thumbnailer fails to fetch thumbnails from Internet Status in thumbnailer package in Ubuntu: Incomplete Bug description: I used Sound Juicer and ripperX to extract MP3s from my CDs. I copied my album to the phone, and I expected to see all album art in the Music scope and in the Music app, for every album in the phone. But, in some case Thumbnailer failed fetching album art from Internet (7Digital, I guess), and so Music scope is full of empty folders (see attachment). Device: BQ Aquaris E4.5 with Ubuntu 15.04 - OTA9.1 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/thumbnailer/+bug/1559522/+subscriptions -- Mailing list: https://launchpad.net/~touch-packages Post to : touch-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~touch-packages More help : https://help.launchpad.net/ListHelp
[Touch-packages] [Bug 1559522] Re: Thumbnailer fails to fetch thumbnails from Internet
I've tried refreshing Music scope several times, at different hours. I've just tried once again, this time I copied another working album to the phone, and it worked only for that album (see attachment). I uploaded some of the MP3 to my clowd storage at this address https://app.box.com/s/ph4enj33aj5z7u3dgo3qzo4h84wopyzp I'll delete them as soon as the bug will be solved. ** Attachment added: "Music scope with one working album art" https://bugs.launchpad.net/ubuntu/+source/thumbnailer/+bug/1559522/+attachment/4605507/+files/screenshot20160320_125032793.png -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to thumbnailer in Ubuntu. https://bugs.launchpad.net/bugs/1559522 Title: Thumbnailer fails to fetch thumbnails from Internet Status in thumbnailer package in Ubuntu: Incomplete Bug description: I used Sound Juicer and ripperX to extract MP3s from my CDs. I copied my album to the phone, and I expected to see all album art in the Music scope and in the Music app, for every album in the phone. But, in some case Thumbnailer failed fetching album art from Internet (7Digital, I guess), and so Music scope is full of empty folders (see attachment). Device: BQ Aquaris E4.5 with Ubuntu 15.04 - OTA9.1 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/thumbnailer/+bug/1559522/+subscriptions -- Mailing list: https://launchpad.net/~touch-packages Post to : touch-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~touch-packages More help : https://help.launchpad.net/ListHelp
[Touch-packages] [Bug 1559522] Re: Thumbnailer fails to fetch thumbnails from Internet
7digital has artwork for at least one of the albums you showed as not working: https://dash.ubuntu.com/musicproxy/v1/album- art?artist==Friday%20Night%20in%20San%20Francisco=0f450aa882a6125ebcbfb3d7f7aa25bc Given this, the problem should rectify itself automatically after some time. Most likely, part of 7digital's index was down at the time you tried this. -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to thumbnailer in Ubuntu. https://bugs.launchpad.net/bugs/1559522 Title: Thumbnailer fails to fetch thumbnails from Internet Status in thumbnailer package in Ubuntu: Incomplete Bug description: I used Sound Juicer and ripperX to extract MP3s from my CDs. I copied my album to the phone, and I expected to see all album art in the Music scope and in the Music app, for every album in the phone. But, in some case Thumbnailer failed fetching album art from Internet (7Digital, I guess), and so Music scope is full of empty folders (see attachment). Device: BQ Aquaris E4.5 with Ubuntu 15.04 - OTA9.1 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/thumbnailer/+bug/1559522/+subscriptions -- Mailing list: https://launchpad.net/~touch-packages Post to : touch-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~touch-packages More help : https://help.launchpad.net/ListHelp
[Touch-packages] [Bug 1559522] Re: Thumbnailer fails to fetch thumbnails from Internet
Can you please attach one of the songs that does not work for you? Failing that, can you please provide the value of that artist and album title tags? (We need the *exact* spelling of the artist and album.) The most likely cause for your problem is that, at the time, you either did not have network connectivity, or 7digital was down. In either scenario, the thumbnailer will back off and retry after some time. If you try again in an hour or so, and the remote service is working again, the thumbnails should appear by themselves. Also, if you could attach /home/phablet/.cache/upstart/dbus.log (plus and compressed archived version of that log), that would help us identify the cause. ** Changed in: thumbnailer (Ubuntu) Status: New => Incomplete ** Changed in: thumbnailer (Ubuntu) Assignee: (unassigned) => Michi Henning (michihenning) ** Changed in: thumbnailer (Ubuntu) Importance: Undecided => High -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to thumbnailer in Ubuntu. https://bugs.launchpad.net/bugs/1559522 Title: Thumbnailer fails to fetch thumbnails from Internet Status in thumbnailer package in Ubuntu: Incomplete Bug description: I used Sound Juicer and ripperX to extract MP3s from my CDs. I copied my album to the phone, and I expected to see all album art in the Music scope and in the Music app, for every album in the phone. But, in some case Thumbnailer failed fetching album art from Internet (7Digital, I guess), and so Music scope is full of empty folders (see attachment). Device: BQ Aquaris E4.5 with Ubuntu 15.04 - OTA9.1 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/thumbnailer/+bug/1559522/+subscriptions -- Mailing list: https://launchpad.net/~touch-packages Post to : touch-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~touch-packages More help : https://help.launchpad.net/ListHelp
