[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #236 from Peter Humphrey --- I think the real problem in KMail is in the handling of locally stored emails. Since I installed a local server to fetch POP3 mails from my ISP and serve them to KMail as IMAP4, the problem has largely gone away. The problem was still present at in interim stage when I was downloading all mails from my IMAP4 server, but now that I leave them on the server I don't see the problem any more. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 coolmanfam changed: What|Removed |Added Version Fixed In|4.2.2 |4.2.9 -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #235 from coolmanfam --- Comment on attachment 74538 --> https://bugs.kde.org/attachment.cgi?id=74538 filter log, a duplicated message is fetched > > >-- >[11:48:19] Evaluerer filterregler: (match all of the following) > Subject contains Dit kreditkort blev brugt > pï¿Šbï¿Årnepornografi site >[11:48:19] 0 = Subject >contains Dit kreditkort blev brugt pï¿Šbï¿Årnepornografi >site (Donación de la Hermana Alice Jahab) >[11:48:19] Evaluerer filterregler: (match all of the following) > List-Id contains > nepomuk.kde.org >[11:48:19] 0 = List-Id >contains nepomuk.kde.org () >[11:48:19] Evaluerer filterregler: (match all of the following) > Subject contains Beskyt dit Visa kort ved > internethandel >[11:48:19] 0 = Subject >contains Beskyt dit Visa kort ved internethandel >(Donación de la Hermana Alice Jahab) >[11:48:19] Evaluerer filterregler: (match all of the following) > From contains has...@technique.dk >[11:48:19] 0 = From contains >has...@technique.dk (alice jahab >alice.jah...@voila.fr) >[11:48:19] Evaluerer filterregler: (match all of the following) > Subject contains aktivering af nye > sikkerheds >[11:48:19] 0 = Subject >contains aktivering af nye sikkerheds (Donación de la >Hermana Alice Jahab) >[11:48:19] Evaluerer filterregler: (match all of the following) > Subject contains venligst din > opdatering >[11:48:19] 0 = Subject >contains venligst din opdatering (Donación de la >Hermana Alice Jahab) >[11:48:19] Evaluerer filterregler: (match all of the following) > List-Id contains > openseamap-maps.lists.sourceforge.net >[11:48:19] 0 = List-Id >contains openseamap-maps.lists.sourceforge.net >() >[11:48:19] Evaluerer filterregler: (match all of the following) > List-Id contains > marble-devel.kde.org >[11:48:19] 0 = List-Id >contains marble-devel.kde.org () >[11:48:19] Evaluerer filterregler: (match all of the following) > List-Id contains > kde-core-devel.kde.org >[11:48:19] 0 = List-Id >contains kde-core-devel.kde.org () >[11:48:19] Evaluerer filterregler: (match all of the following) > List-Id contains > digikam-users.kde.org >[11:48:19] 0 = List-Id >contains digikam-users.kde.org () >[11:48:19] Evaluerer filterregler: (match all of the following) > List-Id contains > talk-dk.openstreetmap.org >[11:48:19] 0 = List-Id >contains talk-dk.openstreetmap.org () >[11:48:19] Evaluerer filterregler: (match all of the following) > List-Id contains > kde-pim.kde.org >[11:48:19] 0 = List-Id >contains kde-pim.kde.org () >[11:48:19] Evaluerer filterregler: (match all of the following) > List-Id contains > openseamap-develop.lists.sourceforge.net >[11:48:19] 0 = List-Id >contains openseamap-develop.lists.sourceforge.net >() >[11:48:19] Evaluerer filterregler: (match all of the following) > List-Id contains > kde-doc-english.kde.org >[11:48:19] 0 = List-Id >contains kde-doc-english.kde.org () >[11:48:19] Evaluerer filterregler: (match all of the following) > List-Id contains > kdepim-users.kde.org >[11:48:19] 0 = List-Id >contains kdepim-users.kde.org () >[11:48:19] Evaluerer filterregler: (match all of the following) > List-Id contains > kwrite-devel.kde.org >[11:48:19] 0 = List-Id >contains kwrite-devel.kde.org () >[11:48:19] Evaluerer filterregler: (match all of the following) > List-Post contains > mailto:bug-cont...@bugs.kde.org; >[11:48:19] 0 = List-Post >contains mailto:bug-cont...@bugs.kde.org; >() >[11:48:19] Evaluerer filterregler: (match all of the following) > any header contains @kde.org >[11:48:19] 0 = any header >contains @kde.org >[11:48:19] Evaluerer filterregler: (match all of the following) > size greater 0 >[11:48:19] 1 = size >greater 0 ( 14414 ) >[11:48:19] Filterregler er blevet matchet. >[11:48:19] Applying filter action: Pipe Through bogofilter -p >-e >[11:48:28] Evaluerer filterregler: (match any of the following) > X-Bogosity regexp (yes)|(spam\b) >[11:48:28] 1 = X-Bogosity >regexp (yes)|(spam\b) (Spam, tests=bogofilter, >spamicity=1.00, version=1.2.2) >[11:48:28] Filterregler er blevet matchet. >[11:48:28] Applying filter action: Move Into Folder Lokale >mapper/affald >[11:48:28] Applying filter action: Mark As Spam >[11:48:28] Applying filter action: Mark As Read >-- >[11:56:47] Evaluerer filterregler: (match all of the following) > Subject contains Dit kreditkort blev brugt > pï¿Šbï¿Årnepornografi site >[11:56:47] 0 = Subject >contains Dit kreditkort blev brugt pï¿Šbï¿Årnepornografi >site ([Bug 283548] Only first filter in chain works for incoming >messages) >[11:56:47] Evaluerer filterregler: (match all of the following) > List-Id contains > nepomuk.kde.org >[11:56:47] 0 = List-Id >contains nepomuk.kde.org () >[11:56:47] Evaluerer filterregler: (match all of the
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 coolmanfam changed: What|Removed |Added Version Fixed In|4.9.3 |4.2.2 CC||dcriego...@gmail.com -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Bug Janitor Service changed: What|Removed |Added Priority|NOR |VHI -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Alexander Neundorf changed: What|Removed |Added CC||neund...@kde.org --- Comment #234 from Alexander Neundorf --- Here on a current openSuse Tumbleweed it happens too, akonadi 5.22.1 (22.12.1). Or at least the old duplicates are still here, not sure whether new ones have appeared this week already. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #233 from Peter Humphrey --- New symptom. I have a local server that fetches POP3 mail from my ISP and serves it as IMAP4. I've had only rare duplicates since setting this arrangement up a few years ago. I discovered yesterday that creating a KMail POP3 account led immediately to numerous duplicates, as half-expected, but the key point here is that duplicates kept occurring, even after I'd deleted the POP3 account and rebooted. This is KMail version 5.20.3 (22.04.3) on Gentoo stable, Plasma version 5.24.6-r1. I tried postgres several years ago but it didn't improve anything, so I'm sticking with mariadb. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Christoph Thielecke changed: What|Removed |Added CC||criss...@gmx.de --- Comment #232 from Christoph Thielecke --- Still valid in akonadi 21.12.3 on Kubuntu 22.04. I think akonadi should automatically handle this problem. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #231 from BingMyBong --- (In reply to r.kunschke from comment #228) > The problem is still present in kmail for a long time. I have filters for > using bogofilter in kmail. > Is there any workaround or something? Or a filter for kmail which removes > all duplicates? > And is there any explanation why this is happenning? There is an option on the "Folder" menu to remove duplicates that works reasonably well. I used to have this issue but its now pretty much gone since i changed from 1. POP3 to Imap and 2. Mysql to Postgresql for the backend, its very very rare for me to get a duplicate now -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #230 from Christian Hilberg --- Am Mittwoch, 27. April 2022, 10:57:26 CEST schrieb ederag: > https://bugs.kde.org/show_bug.cgi?id=283682 > > --- Comment #229 from ederag --- > (In reply to r.kunschke from comment #228) > > Is there any workaround or something? > > Adding this filter helped a lot here: > - match all messages > - Executed Command: /usr/bin/sleep 1, Depending on how quick the IMAP server is, this had little to no effect for me when I tried, so YMMV. (bye)^2 -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #229 from ederag --- (In reply to r.kunschke from comment #228) > Is there any workaround or something? Adding this filter helped a lot here: - match all messages - Executed Command: /usr/bin/sleep 1, -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 r.kunsc...@googlemail.com changed: What|Removed |Added CC||r.kunsc...@googlemail.com --- Comment #228 from r.kunsc...@googlemail.com --- The problem is still present in kmail for a long time. I have filters for using bogofilter in kmail. Is there any workaround or something? Or a filter for kmail which removes all duplicates? And is there any explanation why this is happenning? -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #227 from ederag --- (In reply to Alexandre Bonneau from comment #226) > For info (I posted that info in another related issue already), I found out > that I only get duplicates when I have 2 computers running akonadi-server. Here also, two computers once concurrently ran akonadi with the same configuration (synchronized with unison). But duplicates do appear, even when the other akonadi is stopped. (pgrep akonadi yields nothing on the other computer) [akonadictl 5.16.1 (20.12.0)] -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #226 from Alexandre Bonneau --- (In reply to Alexandre Bonneau from comment #210) > On my end, I'm currently using Kmail 5.9.3 (Debian buster), and am seeing no > duplicates using imap only. > Some very rare times I can see a few duplicates, but they disappear by > themselves pretty quicly. For info (I posted that info in another related issue already), I found out that I only get duplicates when I have 2 computers running akonadi-server. For instance it happens when I'm on my main rig, then casually open my laptop. Then mails are duplicated a lot...until I close one of the akonadi server (usually the one from the laptop). -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #225 from ederag --- Well, only half a day before a duplicate is back. (again, from lists.gnu.org) Same status as in comment #221. And nothing suspicious in mysql.err (no ERROR). -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #224 from linux...@posteo.de --- the log file is /var/log/mysql/mysqld.err However, digging deeper, the problem might be related to two instances of mariadb being present. pgrep -af mysqld yields 2402 /usr/sbin/mysqld --defaults-file=/etc/mysql/my.cnf 2881 /usr/sbin/mysqld --defaults-file=/home/linuxfan/.local/share/akonadi/mysql.conf --datadir=/home/linuxfan/.local/share/akonadi/db_data/ --socket=/run/user/10001/akonadi/mysql.socket --pid-file=/run/user/1000/akonadi/mysql.pid While /var/log/mysql/mysqld.err is now clear, in /home/linuxfan/.local/share/akonadi/db_data/mysql.err I can see two further errors and some warnings: [ERROR] Can't open and lock privilege tables: Table 'mysql.servers' doesn't exist [Warning] Can't open and lock time zone table: Table 'mysql.time_zone_leap_second' doesn't exist trying to live without them [Warning] Failed to load slave replication state from table mysql.gtid_slave_pos: 1017: Can't find file: './mysql/' (errno: 2 "No such file or directory") [Note] Reading of all Master_info entries succeeded [Note] Added new Master_info '' to hash table [Note] /usr/sbin/mysqld: ready for connections. Version: '10.4.12-MariaDB' socket: '/run/user/1000/akonadi/mysql.socket' port: 0 Source distribution [ERROR] InnoDB: Table `mysql`.`innodb_table_stats` not found. what is more important, I believe, is that akonadi seems to start the second mysql instance but some of the data is actually going to my main mysql server instead and its data directory /home/mysql_data/ while other parts are ending up in the akonadi-instance of mysql. After disabling the stand-alone server, I found that ~/.config/akonadi/akonadiserverrc still contained the line Options="UNIX_SOCKET=/var/run/mysql/mysqld.socket" pointing to the main server socket. Clearing this up, everything seems to end up in the akonadi-version of mysql (with the above warnings/errors, not sure what that means). I am unsure, why some of the data still went to the akonadi-version of mysql, though. >From my point of view, I seem to have had some mess in the config files as I have been dragging/upgrading my /home/ directory with me since 1997 (and yes, I have been using KDE ever since the original beta1) -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #223 from BingMyBong --- (In reply to Peter Humphrey from comment #222) > (In reply to ederag from comment #221) > > > grep -i error /home/ederag/.local/share/akonadi/db_data/mysql.err > > > > Here, I see: > > $ grep -i error .local/share/akonadi/db_data/mysql.err > 2020-05-08 13:12:10 0 [ERROR] Can't open and lock privilege tables: Table > 'mysql.servers' doesn't exist > 2020-05-08 13:12:10 9 [ERROR] InnoDB: Table `mysql`.`innodb_table_stats` not > found. > > I don't know how long that's been happening, because I haven't had any > duplicates for quite a long time. I remember, though, that when I was > getting them, that error log had numerous errors of various types. I've been using postgresql and i've hardly seen any since but as of today i got duplicates by the bucket load. opensuse:tumbleweed:20200506 Qt: 5.14.1 KDE Frameworks: 5.69.0 - KDE Plasma: 5.18.4 - kwin 5.18.4 kmail2 5.14.0 (20.04.0) - akonadiserver 5.14.0 (20.04.0) - -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #222 from Peter Humphrey --- (In reply to ederag from comment #221) > grep -i error /home/ederag/.local/share/akonadi/db_data/mysql.err > Here, I see: $ grep -i error .local/share/akonadi/db_data/mysql.err 2020-05-08 13:12:10 0 [ERROR] Can't open and lock privilege tables: Table 'mysql.servers' doesn't exist 2020-05-08 13:12:10 9 [ERROR] InnoDB: Table `mysql`.`innodb_table_stats` not found. I don't know how long that's been happening, because I haven't had any duplicates for quite a long time. I remember, though, that when I was getting them, that error log had numerous errors of various types. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #221 from ederag --- (In reply to linuxfan from comment #220) > for ages there has been an error message in my mysql/mariadb log-file: > > [ERROR] Incorrect definition of table mysql.event: expected column > 'sql_mode' at position 14 to have type set ... Thanks for sharing. In which log file exactly did you find this error ? /var/log/mysql/ is empty here, so pgrep -af mysqld /usr/sbin/mysqld --defaults-file=/home/ederag/.local/share/akonadi/mysql.conf --datadir=/home/ederag/.local/share/akonadi/db_data/ --socket=/tmp/akonadi-ederag.Yqlbg1/mysql.socket --pid-file=/tmp/akonadi-ederag.Yqlbg1/mysql.pid grep -1 "error log" /home/ederag/.local/share/akonadi/mysql.conf # # error log file name, relative to datadir (default:hostname.err) log_error=mysql.err grep -i error /home/ederag/.local/share/akonadi/db_data/mysql.err That was with the "1 s" delay filter active, just deactivated; we'll see. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 linux...@posteo.de changed: What|Removed |Added CC||linux...@posteo.de --- Comment #220 from linux...@posteo.de --- Version KMail 5.13.3 (19.12.3) OS Gentoo Linux I have been plagued by this bug for a very long time. Today I found out, that for ages there has been an error message in my mysql/mariadb log-file: [ERROR] Incorrect definition of table mysql.event: expected column 'sql_mode' at position 14 to have type set ... This is the first time I saw this error, as there is no other application than akonadi using mariadb on my pc and akonadi was never complaining. This mariadb-error could be fixed by running mysql_upgrade (google it to find an explanation, this is due to an incomplete upgrade of the mariadb-package) After fixing the database, kmail has not been showing duplicated mails any longer. Also filters have been working flawlessly. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #219 from Peter Humphrey --- > Please consider that it is very hard for maintainers > to fix a bug that is not reproducible on their setup. True, but there's nothing to stop them from enlisting help from knowledgeable users (at least a few have offered, including me). They won't do it though; I can only speculate as to why not. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #218 from ederag --- With a working link: bug #388869 -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #217 from ederag --- (In reply to graham from comment #216) > Was a KMail for what seems like forever (~2000?) (I've been a KDE user since > it first came out in '96), but after dealing with workarounds and hacks for > two+ years I eventually gave in and abandoned KMail back in mid-2017. There was a commit in 2017-05-04 https://phabricator.kde.org/R206:43f2cde61f98317eb13d98222a57bc6df323a308 that was about this bug. And indeed in openSUSE Leap-15 (kdepim-runtime 17.12.3), there are much fewer duplicates than before. There is now a related bug about unreachable duplicates that has already been reported as #388869. (In reply to Tobias Leupold from comment #214) > I think one should rather wonder if this even can be fixed > inside this Akonadi monster I personally wouldn't even dare to look at > the code, or if one should reconsider the whole thing. kmail/akonadi handle my > 15GB maildir gracefully, which is quite a performance. Congratulations ! So it is not perfect, but to me it is an amazing piece of software. Please consider that it is very hard for maintainers to fix a bug that is not reproducible on their setup. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #216 from gra...@howlingfrog.com --- (In reply to Tristan Miller from comment #202) > Is this problem still reproducible in the latest version of KMail? There > haven't been any comments on this bug in over a year; I'm wondering if > that's because the problem has been fixed or because it has driven most of > the user base away. Driven away. Was a KMail for what seems like forever (~2000?) (I've been a KDE user since it first came out in '96), but after dealing with workarounds and hacks for two+ years I eventually gave in and abandoned KMail back in mid-2017. Took me multiple weeks to get all of my mail (~12GB) imported into Thunderbird, get my 200+ mail filters set up again, and to remove all of the duplicates and junk that various KMail bugs had done to my mail. Was the most painful thing I'd done in years, and I knew the switch was going to suck bad so I held out as long as I could. KMail eventually just got unusable, period. I'd have to do workarounds and restart akonadi every single time I picked up my POP mail, which just made KMail effectively useless. After realizing I was using Alpine to read all of my new mail and delete junk _before_ fetching it into KMail, I finally gave in and switched. LOVED KMail, but THIS bug led me to finally throw in the towel and give it up. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #215 from BingMyBong --- (In reply to Tristan Miller from comment #202) > Is this problem still reproducible in the latest version of KMail? There > haven't been any comments on this bug in over a year; I'm wondering if > that's because the problem has been fixed or because it has driven most of > the user base away. I'd love to return to using KMail but can't as long as > this message duplication problem persists. (I was getting dozens of > duplicated messages every day, which was too much to put up with.) The way i reduced the duplicates to a point where it hardly happens (maybe once a week) is to stop filtering on incoming messages and only apply the filters manually once all emails are in. I'm using IMAP but I think the POP3 still has a lot of issues. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #214 from Tobias Leupold --- I've been using IMAP for some years now, and I don't get duplicates anymore when filtering. In the case my filters ever do filter, which is roughly the case in 80 % of the mails they should work on (otherwise, nothing happens). After almost eight years and more than 200 comments, I think one should rather wonder if this even can be fixed inside this Akonadi monster I personally wouldn't even dare to look at the code, or if one should reconsider the whole thing. Only thing I can't understand is that the KMail guys are not annoyed themselves by this ... I mean, I don't think they use Trojitá, do they?! But no harm meant, remarkably enough I still stick to KMail ;-) -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #213 from Árpi --- (In reply to Tristan Miller from comment #207) > (In reply to Árpi from comment #206) > > I did get numerous duplicates when I installed kmail 5.7.x (I think, x=3), > > that came with Ubuntu 18.04. Then I started using the workaround from > > comment #118. > > Lucky you; that workaround did nothing for me. > > Is there some sort of bug bounty program for KDE? If so I wouldn't mind > chipping in €20 or so towards a fix for this issue. I checked my filters; what I am doing is not exactly as described in comment #118, but instead, I added an extra action, to execute /bin/sleep 1 to each of my filters. Since then, no duplicates. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #212 from Frits Spieker --- (In reply to Eric Depagne from comment #203) > (In reply to Tristan Miller from comment #202) > > Is this problem still reproducible in the latest version of KMail? There > > haven't been any comments on this bug in over a year; I'm wondering if > > that's because the problem has been fixed or because it has driven most of > > the user base away. I'd love to return to using KMail but can't as long as > > this message duplication problem persists. (I was getting dozens of > > duplicated messages every day, which was too much to put up with.) > > It has been fixed I believe, since it disappeared from my kmail in 2015. Most definitely not fixed. Still run into it multiple times per day with some messages showing up 5 or more times. Sometimes I just delete the entire folder and filter and just set everything up again. Sometimes seems to do the trick. I have been unable to find any logic behind why some messages get duplicated where others don't (in the same folder). -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #211 from Joachim Wagner --- (In reply to Tristan Miller from comment #202) > [...] because the problem has been fixed or because it has driven most of > the user base away. I'd love to return to using KMail [...] I didn't stop using KMail. I stopped using filters. If I find time to explore alternatives and find something suitable I may switch. Also possible I will use two mail clients in parallel. Coincidentally, I am well positioned to test alternatives as I moved away from using folders under "Local Folders" to using a local imap server a while ago (because, at that time, KMail stored messages in a database instead of a maildir). This should make it easy to use multiple clients in parallel. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #210 from Alexandre Bonneau --- On my end, I'm currently using Kmail 5.9.3 (Debian buster), and am seeing no duplicates using imap only. Some very rare times I can see a few duplicates, but they disappear by themselves pretty quicly. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #209 from Graeme Hewson --- Apologies. akonadictl start akonadictl fsck is the correct order. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #208 from Graeme Hewson --- I haven't seen the problem for a while, maybe two years. I use POP3 only, not IMAP. I run Kubuntu; currently I'm on 19.04. Sometimes kmail crashes, and I wonder if the way I clean up is related to my not seeing duplicate filtered messages. When kmail crashes, I stop akonadi ("akonadictl stop") and look in the maildir structure like this: cd .local/share/.local-mail.directory ls */new/*S The S indicates messages which have been Seen, and according to the Maildir specification the files should not be in a"new" subdirectory; they should have been moved to a "cur" subdirectory. I therefore move them while akonadi is stopped. E.g., mv -i wastebin/new/*S wastebin/cur I then run "akonadictl fsck" and restart akonadi ("akonadictl start"). As I say, it's pure speculation that this is why I don't see duplicate messages now. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #207 from Tristan Miller --- (In reply to Árpi from comment #206) > I did get numerous duplicates when I installed kmail 5.7.x (I think, x=3), > that came with Ubuntu 18.04. Then I started using the workaround from > comment #118. Lucky you; that workaround did nothing for me. Is there some sort of bug bounty program for KDE? If so I wouldn't mind chipping in €20 or so towards a fix for this issue. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #206 from Árpi --- I did get numerous duplicates when I installed kmail 5.7.x (I think, x=3), that came with Ubuntu 18.04. Then I started using the workaround from comment #118. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #205 from Peter Humphrey --- (In reply to Eric Depagne from comment #203) > (In reply to Tristan Miller from comment #202) > > Is this problem still reproducible in the latest version of KMail? There > > haven't been any comments on this bug in over a year; I'm wondering if > > that's because the problem has been fixed or because it has driven most of > > the user base away. I'd love to return to using KMail but can't as long as > > this message duplication problem persists. (I was getting dozens of > > duplicated messages every day, which was too much to put up with.) > > It has been fixed I believe, since it disappeared from my kmail in 2015. It certainly hasn't. I still get numerous duplicates daily on this Gentoo box. I think the comments dried up because (a) there was nothing new to add; (b) users grew tired of banging on to no avail. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #204 from Tristan Miller --- (In reply to Eric Depagne from comment #203) > It has been fixed I believe, since it disappeared from my kmail in 2015. And yet there are plenty of comments here from 2015 to 2018 claiming the problem still exists. I would prefer to hear from someone who was experiencing the problem more recently (say, 2018) who can confirm that it is no longer reproducible. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Eric Depagne changed: What|Removed |Added CC||e...@depagne.org --- Comment #203 from Eric Depagne --- (In reply to Tristan Miller from comment #202) > Is this problem still reproducible in the latest version of KMail? There > haven't been any comments on this bug in over a year; I'm wondering if > that's because the problem has been fixed or because it has driven most of > the user base away. I'd love to return to using KMail but can't as long as > this message duplication problem persists. (I was getting dozens of > duplicated messages every day, which was too much to put up with.) It has been fixed I believe, since it disappeared from my kmail in 2015. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Tristan Miller changed: What|Removed |Added CC||psychon...@nothingisreal.co ||m --- Comment #202 from Tristan Miller --- Is this problem still reproducible in the latest version of KMail? There haven't been any comments on this bug in over a year; I'm wondering if that's because the problem has been fixed or because it has driven most of the user base away. I'd love to return to using KMail but can't as long as this message duplication problem persists. (I was getting dozens of duplicated messages every day, which was too much to put up with.) -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Eric Depagnechanged: What|Removed |Added CC|e...@depagne.org| -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Médéric Boquienchanged: What|Removed |Added CC|mboqu...@free.fr| -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Lukas Polacekchanged: What|Removed |Added CC|lu...@ksp.sk| -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 xda...@ngi.it changed: What|Removed |Added CC|xda...@ngi.it | -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Roger Larssonchanged: What|Removed |Added CC||roger.lars...@e-gatan.se --- Comment #201 from Roger Larsson --- I have also seen this (and my wife on her setup - similar to mine) and I wonder if some of this is due to the huge number of options and the more complex environment. I want to be able to read mails both on my computer and on my mobile. I want the computer to be the primary storage of my mails. POP/IMAP account - using IMAP for both Computer - copied new messages locally using filters into correct folder - filters that mark a message, resulted in two copies (one shadow - not readable) the updated state could be seen from mobile too... - had "download for offline processing" enabled (trying with it off now) noticed that it - push on - recheck 5 minutes ... I wonder if my settings caused numerous rereads, store on disk with different generations of each mail... -rw-r--r-- 1 roger users 4589 11 mar 00.20 /home/roger/.local/share/akonadi/file_db_data/99/822899_r0 -rw-r--r-- 1 roger users 4100 6 apr 18.29 /home/roger/.local/share/akonadi/file_db_data/99/827899_r61 -rw-r--r-- 1 roger users 6372 6 apr 18.29 /home/roger/.local/share/akonadi/file_db_data/99/828199_r1360 -rw-r--r-- 1 roger users 4348 6 apr 18.30 /home/roger/.local/share/akonadi/file_db_data/99/831799_r1359 -rw-r--r-- 1 roger users 4126 6 apr 18.30 /home/roger/.local/share/akonadi/file_db_data/99/833599_r61 -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 DeMuschanged: What|Removed |Added CC||jan.muss...@gmail.com --- Comment #200 from DeMus --- I can confirm this bug with both an IMAP and a POP account. Mails are sometimes (not always, filters don't always work well) transferred from the inbox to the correct folder and a little bit later the mails are also back in the inbox. This can go on forever. When I delete them from the inbox it is over and they don't appear anymore. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 ederagchanged: What|Removed |Added CC||ed...@gmx.fr -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Árpichanged: What|Removed |Added CC||lukacs.ar...@gmail.com --- Comment #199 from Árpi --- With upgrading to version 5.5.3 on Kmail, the duplication problem got worse in my case. I have a rather large (~ 1) collection of messages. It happens after filtering, it can be "fixed" by clearing akonadi cache with akonadiconsole, but it appears again. Adding a filter on top of the filter list, that executes "/usr/bin/sleep 15" did not help. I could not find out if it happens with the folders that contain many messages, or in all of them (i think the latter). What did change with the new version (compared to the one there was in kubuntu 14.04) is that now I get an error message when trying to access the folder with the duplicate messages, that kmail cannot fetch the message because of multiple candidates. Previously, i could erase one. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Lukas Polacekchanged: What|Removed |Added CC||lu...@ksp.sk -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Allan Sandfeldchanged: What|Removed |Added CC||k...@carewolf.com --- Comment #197 from Allan Sandfeld --- Just hit the same. I noted that the duplicated messages, were messages never fully moved in the first place. They ghosted in the original folder, and the ghosts were copied. The folders this happens to also does not have working folder properties. Nothing you change in folder properties have ANY effect and are immediately lost --- Comment #198 from Allan Sandfeld --- Just hit the same. I noted that the duplicated messages, were messages never fully moved in the first place. They ghosted in the original folder, and the ghosts were copied. The folders this happens to also does not have working folder properties. Nothing you change in folder properties have ANY effect and are immediately lost -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Allan Sandfeldchanged: What|Removed |Added CC||k...@carewolf.com --- Comment #197 from Allan Sandfeld --- Just hit the same. I noted that the duplicated messages, were messages never fully moved in the first place. They ghosted in the original folder, and the ghosts were copied. The folders this happens to also does not have working folder properties. Nothing you change in folder properties have ANY effect and are immediately lost --- Comment #198 from Allan Sandfeld --- Just hit the same. I noted that the duplicated messages, were messages never fully moved in the first place. They ghosted in the original folder, and the ghosts were copied. The folders this happens to also does not have working folder properties. Nothing you change in folder properties have ANY effect and are immediately lost -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #196 from Alexandre Bonneau--- Created attachment 107642 --> https://bugs.kde.org/attachment.cgi?id=107642=edit Duplicated mails in Kmail 5.2.3 -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #195 from Alexandre Bonneau--- Kmail version 5.2.3 (in Debian Stable) is definitely showing this bug (see the attached screenshot). -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Anguochanged: What|Removed |Added CC||kde_b...@overshoot.tv -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 csbugschanged: What|Removed |Added CC||b...@clearingstelle-eeg.de -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Ewald Müllerchanged: What|Removed |Added CC||emu...@netscape.net -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 BingMyBongchanged: What|Removed |Added CC||bingmyb...@btinternet.com --- Comment #194 from BingMyBong --- (In reply to Martin Koller from comment #191) > I am currently looking into this and have already implemented some patches > which hopefully improve the situation (although I have no final fix yet). > E.g. https://phabricator.kde.org/D5667 > It's very complicated and has to do with timing of messages between 3 > processes ... Thanks Martin, your work on this and other bugs will be most appreciated by lots of users -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #193 from gra...@howlingfrog.com --- Agreed! Exciting to see progress, as KMail is close to unusable at this point. MUCH appreciated! -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #192 from Frits Spieker--- Excellent! Good to know there is some progress. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #191 from Martin Koller--- I am currently looking into this and have already implemented some patches which hopefully improve the situation (although I have no final fix yet). E.g. https://phabricator.kde.org/D5667 It's very complicated and has to do with timing of messages between 3 processes ... -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #190 from Frits Spieker--- But is one of the developers actually looking at this? The duplication of the messages, combined with the akonadi hanging itself out to dry when deleting messages (resulting in the famous "retrieving folder content" screen) makes KMail basically unusable. I'm really baffled how such a crucial piece of software (unless developers use other program to read email) can be so broken for so long. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #189 from megalithic--- I've switched to filtering after the messages come in by clicking 'Folder - Apply All filters on Folder' on the Inbox. Just to confirm this has totally stopped the duplication in my case. Great to see we might be getting somewhere on this - thanks folks -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #188 from ianse...@btinternet.com --- For me, manual filtering means using the "Apply All Filters on Folder" menu item or as i have done, put it as a button on the toolbar. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #187 from Andreas Mahel--- As per my comment above (comment #179), it would be "running the filters manually (via Ctrl-J)". I haven't yet reverted to not using filters at all and dispatching several mailing lists to their respective sub folders by using the "Move to folder" functionality. I can also confirm that automatic filtering leads to considerably more duplicate entries than manual filtering. I have set up a VM with a simple mail setup (one POP3 resource receiving messages from 3 mailing lists), and with automatic filtering, the issue was clearly visible with about 10 to 20% of mails affected. I have reset that one now, and switched to manual filtering, to see if I catch any duplicates here as well. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #186 from Joachim Wagner--- As to "manually filtered" (comment #185), please distinguish between "manually applied filters (menu: Message --> Apply Filter)" and "manually filtered by moving messages between folders (menu: Message --> Move Message To)". Some comments report duplication even in the later case. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #185 from gra...@howlingfrog.com --- (In reply to Martin Koller from comment #182) Martin... if that's the case, then this "duplicates" issue would _only_ happen for messages being auto-filtered, correct? Instead, if messages were first picked up and dropped into a folder and then _manually_ filtered, the events would reorder such that the "trigger the filter, and move the msg" doesn't happen until after the maildir resource had finished accepting the message. (just wrapping my brain around it, and wanted to confirm that the above sounds reasonable) -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #184 from Martin Koller--- In fact I sent this information back then directly to Daniel but he obviously did not have time to look into it or does not see it as important. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #183 from BingMyBong--- On Wednesday, 5 April 2017 08:53:00 BST you wrote: > https://bugs.kde.org/show_bug.cgi?id=283682 > > --- Comment #182 from Martin Koller --- > Just for the records, I once tried to dig into the Akonadi code to find the > bug. > I put my analysis to the other bug report, which is now set to a duplicate > of this. > https://bugs.kde.org/show_bug.cgi?id=362398#c5 > Just that it does not get lost, and I still think my findings are correct, > here is it again: > > I'm hunting the "duplicate mail bug" and I think I've found a bug in the > Akonadi Server. > What happens here is the following: > - a resource adds a new mail item (id=3, collection=17) > - Akonadi sends "Item added" to the filter agent > - filter agent sends a "move" command to move item id=3 from collection=17 > to collection=19 > - Akonadi sends "item added" to the maildir resource (this is the first > "added" message from the creation, so the > item still has id=3 collection=17) > - I'd say in the Akonadi DB the collectionId of item=3 is now 19 (after the > move) > - Now the maildir resource gets triggered by its internal file watcher and > triggers a sync > - maildir gets called with retrieveItems and lists what it has on disc, > which is the item (id=3) in the collection=17 > - Akonadi receives this and inside Merge::parseStream() there the bad thing > happens: > It hits this "if" branch (server/src/handler/merge.cpp Line 301) > // No item with such GID/RID exists, so call AkAppend::insert() and > behave > // like if this was a new item > and INSERTS the item AGAIN into collection=17 with a new id=4 > Now I have the same mail item twice in the DB > Since the maildir "itemsRetrieved" answer contains for the first time the > RID, the newly inserted item gets this RID, > and the previously intserted one id=3 does not and is left alone with a > NULL RID > > > Someone more knowledgeable about the Akonadi internals should have a look, > please. Good work. You could post this to kdepim-users list as Daniel Vrátil, who i think is the prime dev on akonadi, appears to frequent this list. Or if you are not a member i can forward for you. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #182 from Martin Koller--- Just for the records, I once tried to dig into the Akonadi code to find the bug. I put my analysis to the other bug report, which is now set to a duplicate of this. https://bugs.kde.org/show_bug.cgi?id=362398#c5 Just that it does not get lost, and I still think my findings are correct, here is it again: I'm hunting the "duplicate mail bug" and I think I've found a bug in the Akonadi Server. What happens here is the following: - a resource adds a new mail item (id=3, collection=17) - Akonadi sends "Item added" to the filter agent - filter agent sends a "move" command to move item id=3 from collection=17 to collection=19 - Akonadi sends "item added" to the maildir resource (this is the first "added" message from the creation, so the item still has id=3 collection=17) - I'd say in the Akonadi DB the collectionId of item=3 is now 19 (after the move) - Now the maildir resource gets triggered by its internal file watcher and triggers a sync - maildir gets called with retrieveItems and lists what it has on disc, which is the item (id=3) in the collection=17 - Akonadi receives this and inside Merge::parseStream() there the bad thing happens: It hits this "if" branch (server/src/handler/merge.cpp Line 301) // No item with such GID/RID exists, so call AkAppend::insert() and behave // like if this was a new item and INSERTS the item AGAIN into collection=17 with a new id=4 Now I have the same mail item twice in the DB Since the maildir "itemsRetrieved" answer contains for the first time the RID, the newly inserted item gets this RID, and the previously intserted one id=3 does not and is left alone with a NULL RID Someone more knowledgeable about the Akonadi internals should have a look, please. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Frits Spiekerchanged: What|Removed |Added CC||s.pa...@spiekerbros.com --- Comment #181 from Frits Spieker --- (In reply to Andreas Mahel from comment #179) > I'm experiencing email duplication after filter activity as well (openSUSE > Tumbleweed, most recent versions). > > The filters move mainly mailing list traffic from a POP3 account into local > sub folders. > > Duplication happens both for automatic filtering as well as executing the > filters manually. > > In most cases, the duplicated entry shows a different size than the original > one (but not always). > > On top, selecting any of the two entries will result in Kmail endlessly > waiting for Akonadi. > > A akonadictl fsck and vacuum does not remove the duplicates; also a "Remove > duplicate emails" from the "Folder" menu does'nt, and ends with an error > message. > > In the meantime I have deleted the Akonadi database several times, as well > as re-created the filters manually, to no avail. > > As a workaround for myself I've written a short SQL script to show / delete > the offending rows from the database (from within akonadiconsole) - this is > tedious, but at least allows me to read all mails. > > (How) can I gather more information about what exactly is going on? Both > Kmail and Akonadi are kind of cryptic in their output - is there a way to > increase verbosity? Exactly as you describe. Sometimes I can get things going again for a short time by doing a restart of akonadi, but lately more often than not this causes akonadi to crash. Weird thing though; in some sub-folders the "delete duplicates" functionality works fine, in other sub-folders (underneath the same account) it will indeed hang everything solid with an error message at the end, just like you describe. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #180 from ianse...@btinternet.com --- (In reply to Andreas Mahel from comment #179) > I'm experiencing email duplication after filter activity as well (openSUSE > Tumbleweed, most recent versions). > > The filters move mainly mailing list traffic from a POP3 account into local > sub folders. > > Duplication happens both for automatic filtering as well as executing the > filters manually. > > In most cases, the duplicated entry shows a different size than the original > one (but not always). > > On top, selecting any of the two entries will result in Kmail endlessly > waiting for Akonadi. > > A akonadictl fsck and vacuum does not remove the duplicates; also a "Remove > duplicate emails" from the "Folder" menu does'nt, and ends with an error > message. > > In the meantime I have deleted the Akonadi database several times, as well > as re-created the filters manually, to no avail. > > As a workaround for myself I've written a short SQL script to show / delete > the offending rows from the database (from within akonadiconsole) - this is > tedious, but at least allows me to read all mails. > > (How) can I gather more information about what exactly is going on? Both > Kmail and Akonadi are kind of cryptic in their output - is there a way to > increase verbosity? Since I posted my change to manual filtering, i've only had 3 emails duplicated so there is still a problem but not as bad as it was on filtering on incoming messages. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 tick...@tsiboboka.de changed: What|Removed |Added CC||tick...@tsiboboka.de -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Andreas Mahelchanged: What|Removed |Added CC||andr...@mahel.net --- Comment #179 from Andreas Mahel --- I'm experiencing email duplication after filter activity as well (openSUSE Tumbleweed, most recent versions). The filters move mainly mailing list traffic from a POP3 account into local sub folders. Duplication happens both for automatic filtering as well as executing the filters manually. In most cases, the duplicated entry shows a different size than the original one (but not always). On top, selecting any of the two entries will result in Kmail endlessly waiting for Akonadi. A akonadictl fsck and vacuum does not remove the duplicates; also a "Remove duplicate emails" from the "Folder" menu does'nt, and ends with an error message. In the meantime I have deleted the Akonadi database several times, as well as re-created the filters manually, to no avail. As a workaround for myself I've written a short SQL script to show / delete the offending rows from the database (from within akonadiconsole) - this is tedious, but at least allows me to read all mails. (How) can I gather more information about what exactly is going on? Both Kmail and Akonadi are kind of cryptic in their output - is there a way to increase verbosity? -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 NSLWchanged: What|Removed |Added CC|lukasz.wojnilow...@gmail.co | |m | -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #178 from ianse...@btinternet.com --- Correction of last message typing screwup "ont he Inbos foler" = on the Inbox folder -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #177 from ianse...@btinternet.com --- (In reply to megalithic from comment #176) > (In reply to ianseeks from comment #167) > > (In reply to megalithic from comment #166) > > > Hello, it happens for me on mail coming in via POP so not IMAP related in > > > my > > > case - more details of my experience above on Comment 148 megalithic > > > 2015-11-05 22:00:56 UTC > > > > Try uncheck the "Apply filter to incoming messages" on each filter. Now > > just click on the inbox and click 'Folders/Apply all filters on Folder'. It > > has so far not produced a duplicate email for so its looking like filters on > > incoming emails is the culprit. > > Hello - if I do that my filters won't work (will they)? Do you want me to > try a test? The filters won't work as the emails come into the Inbox. Wait until the download of emails has finished then you click ont he Inbos foler to highlight it and then select "Apply All Filters on Folder" from the Folder menu (or add this option to the tool bar) > In my case I only get duplicates when moving messages into some subfolders > and not others. I also only get duplicates on some messages. I can send a > screen shot of this. Interestingly the two duplicate/filtered messages come > through with different file sizes. eg the first is 5.1KB and the second is > 8.7KB. But they are the same message duplicated with the same time stamp. > (not sent twice accidentally) I didn't get duplicates on all emails either but i don't get any duplicates at all now because of the way i do it as described. Its just temporary until the devs fix filtering, there are a few more problems with filtering other than duplication of emails. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #176 from megalithic--- (In reply to ianseeks from comment #167) > (In reply to megalithic from comment #166) > > Hello, it happens for me on mail coming in via POP so not IMAP related in my > > case - more details of my experience above on Comment 148 megalithic > > 2015-11-05 22:00:56 UTC > > Try uncheck the "Apply filter to incoming messages" on each filter. Now > just click on the inbox and click 'Folders/Apply all filters on Folder'. It > has so far not produced a duplicate email for so its looking like filters on > incoming emails is the culprit. Hello - if I do that my filters won't work (will they)? Do you want me to try a test? In my case I only get duplicates when moving messages into some subfolders and not others. I also only get duplicates on some messages. I can send a screen shot of this. Interestingly the two duplicate/filtered messages come through with different file sizes. eg the first is 5.1KB and the second is 8.7KB. But they are the same message duplicated with the same time stamp. (not sent twice accidentally) -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Daniel Vrátilchanged: What|Removed |Added CC||pe...@prh.myzen.co.uk --- Comment #175 from Daniel Vrátil --- *** Bug 346695 has been marked as a duplicate of this bug. *** -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #174 from Daniel Vrátil--- *** Bug 333035 has been marked as a duplicate of this bug. *** -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Daniel Vrátilchanged: What|Removed |Added CC||lukasz.wojnilow...@gmail.co ||m --- Comment #172 from Daniel Vrátil --- *** Bug 323980 has been marked as a duplicate of this bug. *** -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #173 from Daniel Vrátil--- *** Bug 362398 has been marked as a duplicate of this bug. *** -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Daniel Vrátilchanged: What|Removed |Added CC||xda...@ngi.it --- Comment #171 from Daniel Vrátil --- *** Bug 293918 has been marked as a duplicate of this bug. *** -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Daniel Vrátilchanged: What|Removed |Added CC||kol...@aon.at --- Comment #170 from Daniel Vrátil --- *** Bug 322676 has been marked as a duplicate of this bug. *** -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Daniel Vrátilchanged: What|Removed |Added CC||gugs...@free.fr --- Comment #169 from Daniel Vrátil --- *** Bug 377344 has been marked as a duplicate of this bug. *** -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #168 from Daniel Vrátil--- *** Bug 322126 has been marked as a duplicate of this bug. *** -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 ianse...@btinternet.com changed: What|Removed |Added CC||ianse...@btinternet.com --- Comment #167 from ianse...@btinternet.com --- (In reply to megalithic from comment #166) > Hello, it happens for me on mail coming in via POP so not IMAP related in my > case - more details of my experience above on Comment 148 megalithic > 2015-11-05 22:00:56 UTC Try uncheck the "Apply filter to incoming messages" on each filter. Now just click on the inbox and click 'Folders/Apply all filters on Folder'. It has so far not produced a duplicate email for so its looking like filters on incoming emails is the culprit. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Thomas Zellchanged: What|Removed |Added CC||t.z...@gmx.de -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #166 from megalithic--- Hello, it happens for me on mail coming in via POP so not IMAP related in my case - more details of my experience above on Comment 148 megalithic 2015-11-05 22:00:56 UTC -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #165 from Christian Hilberg--- Update to behaviour of Kmail 5.2.3 (KDEPIM 16.04.3) on Debian/Testing: Currently, I do not get any more dupes while pipe-through-filtering. Changes in setup (now: working, before: dupes): * IMAP now Dovecot (instead of ye olde Binc IMAP used before) * Filtering now spamc+daemon (instead of spamassassin-perl before) The spambayes filter is used in addition, which is the same as before. Seems the bug could be triggered depending on the IMAP server implementation used. I tend to rule out the spamassassin-perl vs. smapc+daemon thing, as I've played with manually injecting sleeps at various steps in the filter processing, to no avail. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #164 from Christian Hilberg--- (In reply to Eric Depagne from comment #163) > (In reply to Christian Hilberg from comment #160) > Hi Christian, > I am a bit embarrassed, because I answered the wrong bug report. Thus, my > message has really nothing to do with this one! Seems there has been some confusion about local mail filtering inside Kmail and the general idea of "activities" (which I haven't fully grokked myself, still need to find my own use case for that). So... > Sorry about that. ...nothing to worry about! :-) > Éric. Christian > > @Eric: While it might be true that activities do the trick for mail > > filtering, I guess we're talking about a bug in the existing Kmail2 mail > > filter functionality. > > > > Testing with Kmail 5.2.3 (KDEPIM 16.04.3) on Debian/Sid shows a slightly > > different behaviour. Simple "move to" filters do not duplicate any filtered > > emails for me any longer. > > > > However, messages filtered with the "pipe through" filter, as used by the > > anti-spam filters do get duplicated inside the destination folder if that > > folder resides on my IMAP server. If the destination folder is a local > > maildir, then the duplication does not occur. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Eric Depagnechanged: What|Removed |Added CC||e...@depagne.org --- Comment #163 from Eric Depagne --- (In reply to Christian Hilberg from comment #160) Hi Christian, I am a bit embarrassed, because I answered the wrong bug report. Thus, my message has really nothing to do with this one! Sorry about that. Éric. > @Eric: While it might be true that activities do the trick for mail > filtering, I guess we're talking about a bug in the existing Kmail2 mail > filter functionality. > > Testing with Kmail 5.2.3 (KDEPIM 16.04.3) on Debian/Sid shows a slightly > different behaviour. Simple "move to" filters do not duplicate any filtered > emails for me any longer. > > However, messages filtered with the "pipe through" filter, as used by the > anti-spam filters do get duplicated inside the destination folder if that > folder resides on my IMAP server. If the destination folder is a local > maildir, then the duplication does not occur. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #162 from Joachim Wagner--- Note that testing for a few hours might not be enough. Last time I tried, the bug only showed after 2-3 weeks of daily use. That's also why I'm hesitant about trying it again. It would be nice if somebody with good knowledge of the inner working of KMail reviewed the workarounds suggested in this thread and posted a commented summary and recommendations for users (and possibly recommendations for developers). -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #161 from Christian Hilberg--- Okay, there is still some duplication in KMail 5.2.3 with the pipe-through ... if the filtered message is *not* spam, then it gets dupe'd inside the folder it resides, typically INBOX. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #160 from Christian Hilberg--- @Eric: While it might be true that activities do the trick for mail filtering, I guess we're talking about a bug in the existing Kmail2 mail filter functionality. Testing with Kmail 5.2.3 (KDEPIM 16.04.3) on Debian/Sid shows a slightly different behaviour. Simple "move to" filters do not duplicate any filtered emails for me any longer. However, messages filtered with the "pipe through" filter, as used by the anti-spam filters do get duplicated inside the destination folder if that folder resides on my IMAP server. If the destination folder is a local maildir, then the duplication does not occur. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Tony O'Bryanchanged: What|Removed |Added CC|k...@tonyobryan.com | -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Eric Depagnechanged: What|Removed |Added CC|e...@depagne.org| -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #159 from Eric Depagne--- The activities, once you get used to use them do exactly what is missing. Unvotting for this bug and removing my email from the list. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 Eikechanged: What|Removed |Added CC|eike.sa...@web.de | -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #158 from Christian Hilberg--- @Dennis: Hum, that setting does not change anything for me regarding dupes. Even when activated, the dupes appear. Confirming that the bug persists for me (newly created IMAP kmail account, newly created filters) as of kmail 5.2.2, KDE SC 16.04.02, KF 5.23.0, on Debian/Sid. -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #157 from Dennis Andress--- I had this bug a couple of years ago. It is more like a feature that can be turned on and off. Tools>Configure KMail>Accounts>Select Account>Modify On the Advanced tab check Automatically compact folders (expunges deleted messages) -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #156 from Christian Hilberg--- Any updates on this regarding KF5-based KDEPIM 16.04? Has the issue been resolved? -- You are receiving this mail because: You are watching all bug changes.
[Akonadi] [Bug 283682] KMail duplicates filtered messages
https://bugs.kde.org/show_bug.cgi?id=283682 --- Comment #155 from Mike Goodwin--- I just got hit by this Duplicated 17,000 messages, all did was hit the "apply all filters on folder" button, and then noticed that my phone was freaking out due to all the dupes. kmail-libs-4.14.10-10.fc23.x86_64 baloo-akonadi-4.14.3-5.fc23.x86_64 akonadi-mysql-1.13.0-20.fc23.x86_64 akonadi-1.13.0-20.fc23.x86_64 kdepimlibs-akonadi-4.14.10-8.fc23.x86_64 kmail-4.14.10-10.fc23.x86_64 On Fedora 23. Not happy, rest of the day is going to be fixing this mess -- You are receiving this mail because: You are watching all bug changes.