Re: [gentoo-user] Kmail2 - I have not given up ... yet
On Friday, January 01, 2016 03:58:18 PM Peter Humphrey wrote: > On Friday 01 January 2016 14:25:17 Mick wrote: > > On Friday 01 Jan 2016 13:06:55 Peter Humphrey wrote: > > > Thanks for your thoughts Mick. I think most of my problems have > > > persisted > > > through many iterations from the early days of KMail-2. At any rate, > > > I've > > > just deleted the whole KMail structure once more and reimported from > > > archive and so far I've no duplicates. I used to get duplicates in > > > certain folders even from the import process. > > > > Perhaps the latest version of KDE fixed this problem of duplicate > > messages. I noticed that on Kmail2 there is a menu option: > > > > /Folder/Remove Duplicate Messages Ctrl+* > > > > I haven't used it, but you may want to give this a spin if the problem > > returns. > > I've tried it many times, with no discernible effect at all - not even on > CPU use. I have and it does work. Especially handy when merging dealing with mailboxes created by importing PST- files. (For the uninitiated, these are files created by Outlook to store archived emails locally) Often, emails are duplicated over multiple of these. Simplest solution: 1) Move them all into a single folder 2) Tell Kmail to remove duplicates I've managed to quickly clean up large amounts of duplicates without loosing a single real email. (Emails from my wife, if one would have been missing, I'd have heard it by now) -- Joost
Re: [gentoo-user] Kmail2 - I have not given up ... yet
On Friday 01 January 2016 14:25:17 Mick wrote: > On Friday 01 Jan 2016 13:06:55 Peter Humphrey wrote: > > Thanks for your thoughts Mick. I think most of my problems have > > persisted > > through many iterations from the early days of KMail-2. At any rate, > > I've > > just deleted the whole KMail structure once more and reimported from > > archive and so far I've no duplicates. I used to get duplicates in > > certain folders even from the import process. > > Perhaps the latest version of KDE fixed this problem of duplicate > messages. I noticed that on Kmail2 there is a menu option: > > /Folder/Remove Duplicate Messages Ctrl+* > > I haven't used it, but you may want to give this a spin if the problem > returns. I've tried it many times, with no discernible effect at all - not even on CPU use. -- Rgds Peter
Re: [gentoo-user] Kmail2 - I have not given up ... yet
On Friday 01 Jan 2016 13:06:55 Peter Humphrey wrote: > Thanks for your thoughts Mick. I think most of my problems have persisted > through many iterations from the early days of KMail-2. At any rate, I've > just deleted the whole KMail structure once more and reimported from > archive and so far I've no duplicates. I used to get duplicates in certain > folders even from the import process. Perhaps the latest version of KDE fixed this problem of duplicate messages. I noticed that on Kmail2 there is a menu option: /Folder/Remove Duplicate Messages Ctrl+* I haven't used it, but you may want to give this a spin if the problem returns. -- Regards, Mick signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] Kmail2 - I have not given up ... yet
On Friday 01 January 2016 11:47:16 Mick wrote: > On Friday 01 Jan 2016 10:41:40 Peter Humphrey wrote: > > On Friday 01 January 2016 10:26:05 Mick wrote: > > > ... my kmail2 still seems to be functioning properly and without any > > > major problems so far. :-) > > > > What, not even duplicates? I'm still getting a dozen a day. > > Hi Peter, > > I think your problem with duplicates is specific to the Kmail2's POP3 > implementation. That does seem likely, yes. > I noticed this too in the early days of Kmail2, on an old > PC which was having great trouble running akonadi. POP3 messages were > being duplicated back then and every time I deleted any duplicates they > were magically being recreated afresh. I never nailed it down to a > particular cause, because the old PC could not run Kmail2 effectively for > daily usage - it was being pegged at 100% of CPU most of the time, > corrupting its akonadi driven mysql database as it was going along. I > tried half a dozen times to perform get it running successfully, but > eventually gave up in frustration of the ever propagating duplicate > messages. IMAP4 was also not very reliable back then, messages in the > Sent folder were not shown at all. However, this was a problem with the > IMAP4 server I was using at the time and needed some change in the > default IMAP4 configuration of Kmail2 to fix it. The current version of > my IMAP4 servers seem to work fine with Kmail2. My ISP doesn't offer IMAP, and in any case I'd rather have my e-mails under my own control. > I can confirm at present I am not having any duplicate messages showing up > with IMAP4 on 3 different PCs, with multiple email accounts, either with > embedded mysql or on my most recent installation with a stand alone > postgresql. I can also confirm that on my laptop even gkrellms is using > more CPU (0.7%) than Kmail2 (0.3%), just as I am writing this email. :-) No great load here either. I'd be worried if there were, though. > I recall from a previous thread that you tried different things to resolve > the duplicate messages problem, including creating a new Kmail account > and starting afresh. I don't know how much basic troubleshooting you may > have done. On the client side, did you try running a new stand alone > database (not embedded in akonadi) in case this is a database problem? > > Also, did you try a different POP3 mail account, from a different provider > to check this is not server specific? > > Otherwise, it may be some error incurred during the 'message-number' > exchange between your mailserver and the Kmail2 POP3 client, or how these > message- numbers are stored/refreshed by akonadi. You could try > troubleshooting POP3 packet exchanges with the server using wireshark to > see what flies on the wire, then doing some open heart surgery on the > mysql tables to find out what is the matter with the 'message-number' > stored/used by akonadi. The aconadiconsole may be useful for this > purpose, or good ol' mysql commands on a terminal. Thanks for your thoughts Mick. I think most of my problems have persisted through many iterations from the early days of KMail-2. At any rate, I've just deleted the whole KMail structure once more and reimported from archive and so far I've no duplicates. I used to get duplicates in certain folders even from the import process. I followed the instructions here, about two-thirds down the page: https://userbase.kde.org/KMail/FAQs_Hints_and_Tips#Get_more_screen_space_in_KMail Yes, really! I'd better submit a bug report to get that text moved to somewhere more suitable. -- Rgds Peter
Re: [gentoo-user] Kmail2 - I have not given up ... yet
On Friday 01 Jan 2016 10:41:40 Peter Humphrey wrote: > On Friday 01 January 2016 10:26:05 Mick wrote: > > ... my kmail2 still seems to be functioning properly and without any major > > problems so far. :-) > > What, not even duplicates? I'm still getting a dozen a day. Hi Peter, I think your problem with duplicates is specific to the Kmail2's POP3 implementation. I noticed this too in the early days of Kmail2, on an old PC which was having great trouble running akonadi. POP3 messages were being duplicated back then and every time I deleted any duplicates they were magically being recreated afresh. I never nailed it down to a particular cause, because the old PC could not run Kmail2 effectively for daily usage - it was being pegged at 100% of CPU most of the time, corrupting its akonadi driven mysql database as it was going along. I tried half a dozen times to perform get it running successfully, but eventually gave up in frustration of the ever propagating duplicate messages. IMAP4 was also not very reliable back then, messages in the Sent folder were not shown at all. However, this was a problem with the IMAP4 server I was using at the time and needed some change in the default IMAP4 configuration of Kmail2 to fix it. The current version of my IMAP4 servers seem to work fine with Kmail2. I can confirm at present I am not having any duplicate messages showing up with IMAP4 on 3 different PCs, with multiple email accounts, either with embedded mysql or on my most recent installation with a stand alone postgresql. I can also confirm that on my laptop even gkrellms is using more CPU (0.7%) than Kmail2 (0.3%), just as I am writing this email. :-) I recall from a previous thread that you tried different things to resolve the duplicate messages problem, including creating a new Kmail account and starting afresh. I don't know how much basic troubleshooting you may have done. On the client side, did you try running a new stand alone database (not embedded in akonadi) in case this is a database problem? Also, did you try a different POP3 mail account, from a different provider to check this is not server specific? Otherwise, it may be some error incurred during the 'message-number' exchange between your mailserver and the Kmail2 POP3 client, or how these message- numbers are stored/refreshed by akonadi. You could try troubleshooting POP3 packet exchanges with the server using wireshark to see what flies on the wire, then doing some open heart surgery on the mysql tables to find out what is the matter with the 'message-number' stored/used by akonadi. The aconadiconsole may be useful for this purpose, or good ol' mysql commands on a terminal. -- Regards, Mick signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] Kmail2 - I have not given up ... yet
"J. Roeleveld" writes: > On Wednesday, December 30, 2015 09:32:55 PM lee wrote: >> "J. Roeleveld" writes: >> > On Tuesday, December 29, 2015 08:03:25 PM Mick wrote: >> >> On Tuesday 29 Dec 2015 17:37:25 lee wrote: >> >> > Are we at the point where users are accepting to have to install and >> >> > maintain a fully fledged RDBMS just for a single application which >> >> > doesn't even need a database in the first place? >> >> >> >> Yes, a sad state of affairs indeed. I was hoping for the last 5-6 years >> >> that someone who can code would come to their senses with this >> >> application >> >> and agree that not all desktop application use cases require some >> >> enterprise level database back end architecture, when a few flat data >> >> files >> >> have served most users perfectly fine for years. I mean, do I *really* >> >> need a database for less that 60 entries in my address book?!! >> > >> > I'm no longer convinced a database isn't needed. >> > Kmail1 was slower than kmail2 is these days. >> >> We are talking here about a single application. Are users nowadays >> generally willing, inclined and in the position to deploy a RDBMS just >> in order to use a single application? Can they be expected to run >> several RDBMSs when the next application comes along and suggests mysql >> instead of postgresql? > > Most applications use a database of one type or another. > Flatfiles are a bad idea when performance is important with large datasets. Then why don't they all use postgresql or mysql? It might then make sense to install either of them. > My email is a large dataset. Not every large dataset is suited to be stored in a database like mysql or postgresql. That's particularly true for email. >> Ironically, in this case you require the RDBMS to be able to use an >> application which is too unstable to be used even without one. Why not >> use a better application for the same purpose instead? You wouldn't >> have to worry about your emails then. > > I don't worry about my emails. > I find kmail2 to be more stable and usable then kmail1. I'm surprised you're not worried when it seems not unusual that kmail becomes unstable and even randomly deletes email.
Re: [gentoo-user] Kmail2 - I have not given up ... yet
On Friday 01 January 2016 10:26:05 Mick wrote: > ... my kmail2 still seems to be functioning properly and without any major > problems so far. :-) What, not even duplicates? I'm still getting a dozen a day. -- Rgds Peter
Re: [gentoo-user] Kmail2 - I have not given up ... yet
On Thursday 31 Dec 2015 16:28:36 J. Roeleveld wrote: > On Thursday, December 31, 2015 01:50:43 PM Mick wrote: > > On Thursday 31 Dec 2015 11:14:48 J. Roeleveld wrote: > > So, I'm reading the fine manual again, but I find myself asking questions > > like ... how do I do this MySQL command on postgres; e.g. on MySQL I set > > up a mysql root user passwd before I do anything else. Isn't this the > > case with postgres? > > Not really. > The following is based on the default when using Postgresql on Gentoo. > > When following the post-inst steps emerge tells you, the database is > initialised to run as "postgres". > It also auto-creates a "postgres" user in the database. This user has full > privileges. Yes, I did just so: 'emerge --config dev-db/postgresql:9.4' > I only use that user to create additional users and databases. No other > user, on my installations, has permissions to add users/databases. > Usually I do give them full permissions within the databases. I used the postgres user to create ROLE michael, and made michael OWNER of the akonadidb and GRANTed him ALL PRIVILEGES on akonadidb. However I did not give michael's ROLE any LOGIN. Apparently, had I created USER instead of ROLE, it would automatically have LOGIN rights. As it was I had to run: ALTER ROLE michael WITH LOGIN SUPERUSER PASSWORD 'somepasswd'; I am not sure if SUPERUSER is an overkill or a security weakness. Perhaps I should reduce it to ADMIN? In any case, now akonadi can login with michael without any problems. :-) > > PS. Would any postgresql gurus know why I can't login with some arbitrary > > name/passwd in the postgres database? > > Yes :) > > But this is a bit OT for this thread, so keeping it brief: > > 1) The createuser and createdb commands I posted are to be run as the > "postgres" user. > 2) The user you create needs to be allowed to connect > (/etc/postgresql-???/pg_hba.conf ) I have left the default method "trust" in the pg_hba.conf and thought that this didn't even need a passwd, but as I explained above I had to explicitly set LOGIN rights for ROLE michael. It seems that I have some reading to do to freshen up on postgres including how to back up properly. Thanks again Joost, my kmail2 still seems to be functioning properly and without any major problems so far. :-) -- Regards, Mick signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] Kmail2 - I have not given up ... yet
On Thursday, December 31, 2015 01:50:43 PM Mick wrote: > On Thursday 31 Dec 2015 11:14:48 J. Roeleveld wrote: > > On Wednesday, December 30, 2015 07:30:49 PM Mick wrote: > > > Having been away from postgres for the best part of 7 years now, it is a > > > struggle to find my feet again. As a result I have been chasing my tail > > > on > > > this task today, not making much progress. :-( > > > > I was actually under the impression you had recent experience. > > In this case, I would suggest to use the default, eg. let akonadi handle > > the full database. > > Unfortunately, my world moved over to MySQL and I stopped using postgres. > So, I'm reading the fine manual again, but I find myself asking questions > like ... how do I do this MySQL command on postgres; e.g. on MySQL I set > up a mysql root user passwd before I do anything else. Isn't this the case > with postgres? Not really. The following is based on the default when using Postgresql on Gentoo. When following the post-inst steps emerge tells you, the database is initialised to run as "postgres". It also auto-creates a "postgres" user in the database. This user has full privileges. I only use that user to create additional users and databases. No other user, on my installations, has permissions to add users/databases. Usually I do give them full permissions within the databases. > Or, > > On MySQL I create a new user and grant him privileges on a database and then > that user can login and run whatever calls I have allowed on the database. > With postgres I got this '"FATAL: role "michael" is not permitted to log > in' error. :-/ You need to specifically allow a user to login. You need to create a "michael" user inside postgresql, before you can login locally using that user. > > > This is my akonadiserverrc at the moment: > > > > > > [%General] > > > Driver=QPSQL > > > SizeThreshold=4096 > > > ExternalPayload=false > > > > > > [QPSQL] > > > Name=akonadidb > > > Host=localhost > > > User=postgres > > > Password= > > > Options= > > > ServerPath=/usr/bin/pg_ctl > > > InitDbPath=/usr/bin/initdb > > > StartServer=false > > > Port=5432 > > > > Yipes! > > > :-) > : > > Seriously, unless you know what you are doing, let akonadi do it itself. > > Stop akonadi, wipe the files, and restart akonadi. > > > > Eg. run de database embedded. > > With the above set up using the default 'postgres' user, without a passwd, > akonadi is able to connect to the database and do its thing. > > After some initial hickups with Kmail2 being too clever for it is own good > (there was some clash with akonadi resources of sorts, it could detect > another local mailer, etc.) I managed to configure two new IMAP4 accounts > and I am now using them quite successfully! :-) > > Initial impressions (have not rebooted yet) is that this migration was much > less fraught with problems compared to previous attempts. I'll wait to see > how stable it will prove in daily usage. > > Thank's again Joost for your kind help to get kmail2 going! :-) > > PS. Would any postgresql gurus know why I can't login with some arbitrary > name/passwd in the postgres database? Yes :) But this is a bit OT for this thread, so keeping it brief: 1) The createuser and createdb commands I posted are to be run as the "postgres" user. 2) The user you create needs to be allowed to connect (/etc/postgresql-???/pg_hba.conf ) -- Joost
Re: [gentoo-user] Kmail2 - I have not given up ... yet
On Thursday 31 Dec 2015 11:14:48 J. Roeleveld wrote: > On Wednesday, December 30, 2015 07:30:49 PM Mick wrote: > > Having been away from postgres for the best part of 7 years now, it is a > > struggle to find my feet again. As a result I have been chasing my tail > > on > > this task today, not making much progress. :-( > > I was actually under the impression you had recent experience. > In this case, I would suggest to use the default, eg. let akonadi handle the > full database. Unfortunately, my world moved over to MySQL and I stopped using postgres. So, I'm reading the fine manual again, but I find myself asking questions like ... how do I do this MySQL command on postgres; e.g. on MySQL I set up a mysql root user passwd before I do anything else. Isn't this the case with postgres? Or, On MySQL I create a new user and grant him privileges on a database and then that user can login and run whatever calls I have allowed on the database. With postgres I got this '"FATAL: role "michael" is not permitted to log in' error. :-/ > > This is my akonadiserverrc at the moment: > > > > [%General] > > Driver=QPSQL > > SizeThreshold=4096 > > ExternalPayload=false > > > > [QPSQL] > > Name=akonadidb > > Host=localhost > > User=postgres > > Password= > > Options= > > ServerPath=/usr/bin/pg_ctl > > InitDbPath=/usr/bin/initdb > > StartServer=false > > Port=5432 > > Yipes! :-) > Seriously, unless you know what you are doing, let akonadi do it itself. > Stop akonadi, wipe the files, and restart akonadi. > > Eg. run de database embedded. With the above set up using the default 'postgres' user, without a passwd, akonadi is able to connect to the database and do its thing. After some initial hickups with Kmail2 being too clever for it is own good (there was some clash with akonadi resources of sorts, it could detect another local mailer, etc.) I managed to configure two new IMAP4 accounts and I am now using them quite successfully! :-) Initial impressions (have not rebooted yet) is that this migration was much less fraught with problems compared to previous attempts. I'll wait to see how stable it will prove in daily usage. Thank's again Joost for your kind help to get kmail2 going! :-) PS. Would any postgresql gurus know why I can't login with some arbitrary name/passwd in the postgres database? -- Regards, Mick
Re: [gentoo-user] Kmail2 - I have not given up ... yet
On Wednesday, December 30, 2015 09:32:55 PM lee wrote: > "J. Roeleveld" writes: > > On Tuesday, December 29, 2015 08:03:25 PM Mick wrote: > >> On Tuesday 29 Dec 2015 17:37:25 lee wrote: > >> > Are we at the point where users are accepting to have to install and > >> > maintain a fully fledged RDBMS just for a single application which > >> > doesn't even need a database in the first place? > >> > >> Yes, a sad state of affairs indeed. I was hoping for the last 5-6 years > >> that someone who can code would come to their senses with this > >> application > >> and agree that not all desktop application use cases require some > >> enterprise level database back end architecture, when a few flat data > >> files > >> have served most users perfectly fine for years. I mean, do I *really* > >> need a database for less that 60 entries in my address book?!! > > > > I'm no longer convinced a database isn't needed. > > Kmail1 was slower than kmail2 is these days. > > We are talking here about a single application. Are users nowadays > generally willing, inclined and in the position to deploy a RDBMS just > in order to use a single application? Can they be expected to run > several RDBMSs when the next application comes along and suggests mysql > instead of postgresql? Most applications use a database of one type or another. Flatfiles are a bad idea when performance is important with large datasets. My email is a large dataset. > Ironically, in this case you require the RDBMS to be able to use an > application which is too unstable to be used even without one. Why not > use a better application for the same purpose instead? You wouldn't > have to worry about your emails then. I don't worry about my emails. I find kmail2 to be more stable and usable then kmail1. -- Joost
Re: [gentoo-user] Kmail2 - I have not given up ... yet
On Wednesday, December 30, 2015 07:30:49 PM Mick wrote: > On 29 December 2015 at 17:51, J. Roeleveld wrote: > > On Tuesday, December 29, 2015 04:34:33 PM Mick wrote: > > > Can you please advise what GRANTS did you use to create a dedicated > > > postgresql user for akonadi? > > > > Grants? > > Yes, in the sense that the akonadi user will have certain privileges > granted to be able to create tables, edit them, etc. I assume your > commands grant all privileges. Within that database, yes. > I did the following: > > % createuser -P > > (NOTE: You need to set a password, which is why I use the "-P" option) > > > > % createdb -E UTF8 -O > > > > My config for this is: > > > > % cat .config/akonadi/akonadiserverrc > > [%General] > > Driver=QPSQL > > > > [QPSQL] > > Name= > > Host=localhost > > Options= > > ServerPath=/usr/bin/pg_ctl > > InitDbPath=/usr/bin/initdb > > StartServer=false > > User= > > Password= > > Port=5432 > > > > [Debug] > > Tracer=null > > > > -- > > Joost > > Having been away from postgres for the best part of 7 years now, it is a > struggle to find my feet again. As a result I have been chasing my tail on > this task today, not making much progress. :-( I was actually under the impression you had recent experience. In this case, I would suggest to use the default, eg. let akonadi handle the full database. > Ideally, I'd like to keep any akonadi databases in ~/.local/share/akonadi/ > for simplicity of backups. I tried creating a symlink from the default > directory /var/lib/postgresql/9.4/data, but all sort of fs access problems > ensued when I tried to run 'emerge --config dev-db/postgresql:9.4'. I > tried different ownerships and access rights and eventually I abandoned > this idea just to get things going. I let pg to install its files in the > default data directory. I run postgresql under a different user and use the backup tools of the database to generate backup files. I prefer not to have a full database inside my home directory. > Then I created a database and user. The initial user (akonadidbuser) could > not access the database, so I created a different user the same as my unix > user (michael): > > $ psql -U postgres -d postgres > psql (9.4.5) > Type "help" for help. > postgres=# \l >List of databases >Name| Owner | Encoding | Collate |Ctype| > Access privileges > ---+---+--+-+-+- > akonadidb | michael | UTF8 | C | en_GB.UTF-8 > | =Tc/michael + > > michael=CTc/michael > postgres | postgres | UTF8 | C | en_GB.UTF-8 | > template0 | postgres | UTF8 | C | en_GB.UTF-8 | > =c/postgres+ > > postgres=CTc/postgres > template1 | postgres | UTF8 | C | en_GB.UTF-8 | > =c/postgres+ > > postgres=CTc/postgres > (4 rows) > > > However, when I try to start akonadi it fails because michael is not > allowed to login ...: > > Failed to use database "akonadidb" > Database error: "FATAL: role "michael" is not permitted to log in > QPSQL: Unable to connect" > Trying to create database now... > QSqlDatabasePrivate::removeDatabase: connection 'initConnection' is still > in use, all queries will cease to work. > Database error: Cannot open database. > Last driver error: "QPSQL: Unable to connect" > Last database error: "FATAL: role "michael" is not permitted to log in > " > Unable to open database "FATAL: role "michael" is not permitted to log in > QPSQL: Unable to connect" > > > So eventually, I setup user 'postgres' in > ~/.config/akonadi/akonadiserverrc, with no passwd and akonadi was able to > start. Can you please help me to configure this correctly, so that the > database is saved in my ~/.local fs and akonadi can use it? > > This is my akonadiserverrc at the moment: > > [%General] > Driver=QPSQL > SizeThreshold=4096 > ExternalPayload=false > > [QPSQL] > Name=akonadidb > Host=localhost > User=postgres > Password= > Options= > ServerPath=/usr/bin/pg_ctl > InitDbPath=/usr/bin/initdb > StartServer=false > Port=5432 Yipes! Seriously, unless you know what you are doing, let akonadi do it itself. Stop akonadi, wipe the files, and restart akonadi. Eg. run de database embedded. You're making things far more complicated than necessary by trying to change settings away from the default this much. -- Joost
Re: [gentoo-user] Kmail2 - I have not given up ... yet
"J. Roeleveld" writes: > On Tuesday, December 29, 2015 08:03:25 PM Mick wrote: >> On Tuesday 29 Dec 2015 17:37:25 lee wrote: >> > Are we at the point where users are accepting to have to install and >> > maintain a fully fledged RDBMS just for a single application which >> > doesn't even need a database in the first place? >> >> Yes, a sad state of affairs indeed. I was hoping for the last 5-6 years >> that someone who can code would come to their senses with this application >> and agree that not all desktop application use cases require some >> enterprise level database back end architecture, when a few flat data files >> have served most users perfectly fine for years. I mean, do I *really* >> need a database for less that 60 entries in my address book?!! > > I'm no longer convinced a database isn't needed. > Kmail1 was slower than kmail2 is these days. We are talking here about a single application. Are users nowadays generally willing, inclined and in the position to deploy a RDBMS just in order to use a single application? Can they be expected to run several RDBMSs when the next application comes along and suggests mysql instead of postgresql? Ironically, in this case you require the RDBMS to be able to use an application which is too unstable to be used even without one. Why not use a better application for the same purpose instead? You wouldn't have to worry about your emails then.
Re: [gentoo-user] Kmail2 - I have not given up ... yet
On 29 December 2015 at 17:51, J. Roeleveld wrote: > On Tuesday, December 29, 2015 04:34:33 PM Mick wrote: > > > Can you please advise what GRANTS did you use to create a dedicated > > postgresql user for akonadi? > > Grants? > Yes, in the sense that the akonadi user will have certain privileges granted to be able to create tables, edit them, etc. I assume your commands grant all privileges. I did the following: > % createuser -P > (NOTE: You need to set a password, which is why I use the "-P" option) > > % createdb -E UTF8 -O > > My config for this is: > > % cat .config/akonadi/akonadiserverrc > [%General] > Driver=QPSQL > > [QPSQL] > Name= > Host=localhost > Options= > ServerPath=/usr/bin/pg_ctl > InitDbPath=/usr/bin/initdb > StartServer=false > User= > Password= > Port=5432 > > [Debug] > Tracer=null > > -- > Joost Having been away from postgres for the best part of 7 years now, it is a struggle to find my feet again. As a result I have been chasing my tail on this task today, not making much progress. :-( Ideally, I'd like to keep any akonadi databases in ~/.local/share/akonadi/ for simplicity of backups. I tried creating a symlink from the default directory /var/lib/postgresql/9.4/data, but all sort of fs access problems ensued when I tried to run 'emerge --config dev-db/postgresql:9.4'. I tried different ownerships and access rights and eventually I abandoned this idea just to get things going. I let pg to install its files in the default data directory. Then I created a database and user. The initial user (akonadidbuser) could not access the database, so I created a different user the same as my unix user (michael): $ psql -U postgres -d postgres psql (9.4.5) Type "help" for help. postgres=# \l List of databases Name| Owner | Encoding | Collate |Ctype| Access privileges ---+---+--+-+-+- akonadidb | michael | UTF8 | C | en_GB.UTF-8 | =Tc/michael + | | | | | michael=CTc/michael postgres | postgres | UTF8 | C | en_GB.UTF-8 | template0 | postgres | UTF8 | C | en_GB.UTF-8 | =c/postgres+ | | | | | postgres=CTc/postgres template1 | postgres | UTF8 | C | en_GB.UTF-8 | =c/postgres+ | | | | | postgres=CTc/postgres (4 rows) However, when I try to start akonadi it fails because michael is not allowed to login ...: Failed to use database "akonadidb" Database error: "FATAL: role "michael" is not permitted to log in QPSQL: Unable to connect" Trying to create database now... QSqlDatabasePrivate::removeDatabase: connection 'initConnection' is still in use, all queries will cease to work. Database error: Cannot open database. Last driver error: "QPSQL: Unable to connect" Last database error: "FATAL: role "michael" is not permitted to log in " Unable to open database "FATAL: role "michael" is not permitted to log in QPSQL: Unable to connect" So eventually, I setup user 'postgres' in ~/.config/akonadi/akonadiserverrc, with no passwd and akonadi was able to start. Can you please help me to configure this correctly, so that the database is saved in my ~/.local fs and akonadi can use it? This is my akonadiserverrc at the moment: [%General] Driver=QPSQL SizeThreshold=4096 ExternalPayload=false [QPSQL] Name=akonadidb Host=localhost User=postgres Password= Options= ServerPath=/usr/bin/pg_ctl InitDbPath=/usr/bin/initdb StartServer=false Port=5432 -- Regards, Mick
Re: [gentoo-user] Kmail2 - I have not given up ... yet
On Tuesday, December 29, 2015 08:03:25 PM Mick wrote: > On Tuesday 29 Dec 2015 17:37:25 lee wrote: > > Are we at the point where users are accepting to have to install and > > maintain a fully fledged RDBMS just for a single application which > > doesn't even need a database in the first place? > > Yes, a sad state of affairs indeed. I was hoping for the last 5-6 years > that someone who can code would come to their senses with this application > and agree that not all desktop application use cases require some > enterprise level database back end architecture, when a few flat data files > have served most users perfectly fine for years. I mean, do I *really* > need a database for less that 60 entries in my address book?!! I'm no longer convinced a database isn't needed. Kmail1 was slower than kmail2 is these days. A mail client will need a database, either it's a collection of emails that need to be parsed everytime you open the mailbox or it's stored in a pre- parsed format somewhere else. Flatfiles are ok if the amount of data is small, but how do you organize the data? What do you do if you find you need to add an extra field? Or need a larger text field to fit the values? I have over 400 adresses in my addressbook and this is likely to grow. I also have mailboxes with more than 10,000 messages each. With kmail1 I had to split these over multiple just to keep the performance acceptable. With a database storing all the metadata, I no longer need to keep splitting the mailboxes. > I can stick with Kmail-1 until circumstances force a change upon me, or I > can try once more to migrate to it now (previous attempts failed for > various reasons). The only reason I am having a go at it again during my > holidays, is because I don't want to have to try a forced migration in the > middle of some other crisis during a working week. Usually a good reason to do it during off-days. The migration is a lot simpler if you have the emails already stored in an IMAP server. I NEVER tried to "migrate" from kmail1 to kmail2. I wiped the entire kmail config and set kmail2 up with a clean slate. > > Quite a few times I've been thinking it would be nice to have a database > > to implement a particular feature for an application, and I've always > > decided not to do it because it seems to be a totally unreasonable > > requirement, and because it seems rather unlikely that any user would be > > willing to do it. It would make some sense if an RDBMS were a > > requirement already, used by all kinds of software --- though I'm > > finding it very questionable if we should go there (and find ourselves > > with a single point of failure and bottleneck). > > You are wise and evidently not affected by the EU project which funded all > this semantic KDE desktop PoC exercise, that foisted the akonadi on us as if > it was the best thing a desktop would ever need ... madness! I don't use the semantic KDE stuff either, only the kdepim stuff. I do see where it can be useful. But for that, I'd prefer it to be stored centrally to avoid every desktop and laptop to want to built it's own index. > Perhaps this was Europe's response to the MSWindows desktop monopoly in the > enterprise sector, but IMHO they started too late and ended up fighting the > wars of the previous decade. Perhaps, but it does mean that a Linux desktop is far easier to work with than what MS is doing with their desktops. > > A MUA must be doing something very wrong to have such a requirement. > > And what kind of performance can you expect with a laptop that has only > > 4GB and is already overloaded with KDE? > > I don't actually run the full KDE desktop. I run e17 with some KDE apps, > like Kmail. Kmail has been and still is the best mail client for my needs > and habits. I do run the full KDE desktop. It does run with 4GB, but it also depends what else you want to use it for. I tested it not too long ago with 2GB in a VM accessing via VNC. The biggest problem was the bandwidth requirement for VNC to make it look even half decent. Problems start when you also want to start other applications, like libreoffice or firefox. This is why I don't have anything with less than 8GB and all new desktop/laptops need to have at least 16GB to be considered usable. I looked into 32GB laptops recently as my wife wants that. She decided against it when I showed her the prices and size of those. Guess she needs to wait a little longer. -- Joost signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] Kmail2 - I have not given up ... yet
On Tuesday, December 29, 2015 07:43:07 PM Mick wrote: > On Tuesday 29 Dec 2015 18:49:03 J. Roeleveld wrote: > > On 29 December 2015 19:40:58 CET, Mick wrote: > > No. You are trying to emerge 'emerge'. > > (Check the commandline :) ) > > > > -- > > Joost > > Oops! Apologies for the noise. > > Against my wife's advice (she knows better of course) I am trying to multi- > task a number of chores which have suddenly descended upon me ... I'll get > on with completing the tax return first, before I return to Kmail2. Hehe :) Good luck with the tax return. Multi-tasking is possible, as long as only 1 requires full attention at a time. I usually prepare a simple script and start that before moving my attention to something else. Most scripts are reusable at a later time. -- Joost signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] Kmail2 - I have not given up ... yet
On Tuesday 29 Dec 2015 17:37:25 lee wrote: > Are we at the point where users are accepting to have to install and > maintain a fully fledged RDBMS just for a single application which > doesn't even need a database in the first place? Yes, a sad state of affairs indeed. I was hoping for the last 5-6 years that someone who can code would come to their senses with this application and agree that not all desktop application use cases require some enterprise level database back end architecture, when a few flat data files have served most users perfectly fine for years. I mean, do I *really* need a database for less that 60 entries in my address book?!! I can stick with Kmail-1 until circumstances force a change upon me, or I can try once more to migrate to it now (previous attempts failed for various reasons). The only reason I am having a go at it again during my holidays, is because I don't want to have to try a forced migration in the middle of some other crisis during a working week. > Quite a few times I've been thinking it would be nice to have a database > to implement a particular feature for an application, and I've always > decided not to do it because it seems to be a totally unreasonable > requirement, and because it seems rather unlikely that any user would be > willing to do it. It would make some sense if an RDBMS were a > requirement already, used by all kinds of software --- though I'm > finding it very questionable if we should go there (and find ourselves > with a single point of failure and bottleneck). You are wise and evidently not affected by the EU project which funded all this semantic KDE desktop PoC exercise, that foisted the akonadi on us as if it was the best thing a desktop would ever need ... madness! Perhaps this was Europe's response to the MSWindows desktop monopoly in the enterprise sector, but IMHO they started too late and ended up fighting the wars of the previous decade. > A MUA must be doing something very wrong to have such a requirement. > And what kind of performance can you expect with a laptop that has only > 4GB and is already overloaded with KDE? I don't actually run the full KDE desktop. I run e17 with some KDE apps, like Kmail. Kmail has been and still is the best mail client for my needs and habits. -- Regards, Mick signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] Kmail2 - I have not given up ... yet
On Tuesday 29 Dec 2015 18:49:03 J. Roeleveld wrote: > On 29 December 2015 19:40:58 CET, Mick wrote: > >On Tuesday 29 Dec 2015 17:51:32 J. Roeleveld wrote: > >> On Tuesday, December 29, 2015 04:34:33 PM Mick wrote: > >> > On Tuesday 29 Dec 2015 14:18:20 J. Roeleveld wrote: > >> > > sqlite is nice, for single threaded applications. > >> > > For anything more advanced, either a wrapper is required or > > > >something > > > >> > > more advanced needs to be used. > >> > > >> > I like sqlite because it is self-contained, embedded in the > > > >application > > > >> > that uses it and accesses the data directly with functional calls, > >> > rather than looping around port/socket interfaces to speak to a > > > >server. > > > >> > This is why I kept it, since with Kmail1 it is not used much. > >> > >> SQLite never was reliable with akonadi. That might be why so many > > > >people > > > >> had all those issues. > >> > >> > With Kmail2 the database will be hammered so as you say will need > >> > something that can process things in parallel at speed and in > > > >higher > > > >> > volumes. So, I'm planning to install postgresql for this purpose, > > > >since > > > >> > in my experience mysql has had a number of hickups with akonadi. > >> > >> My experience as well, which is why I switched to Postgresql. > >> > >> > Can you please advise what GRANTS did you use to create a dedicated > >> > postgresql user for akonadi? > >> > >> Grants? > >> I did the following: > >> % createuser -P > >> (NOTE: You need to set a password, which is why I use the "-P" > > > >option) > > > >> % createdb -E UTF8 -O > >> > >> My config for this is: > >> > >> % cat .config/akonadi/akonadiserverrc > >> [%General] > >> Driver=QPSQL > >> > >> [QPSQL] > >> Name= > >> Host=localhost > >> Options= > >> ServerPath=/usr/bin/pg_ctl > >> InitDbPath=/usr/bin/initdb > >> StartServer=false > >> User= > >> Password= > >> Port=5432 > >> > >> [Debug] > >> Tracer=null > >> > >> > Will the same user be used for Baloo indexing, or is this an > > > >additional > > > >> > database role? > >> > >> Afaik, no. Baloo uses it's own database engine. > >> > >> For the USE-flags: > >> > >> app-office/akonadi-server postgresql qt4 > >> (all other USE-flags disabled) > >> > >> -- > >> Joost > > > >Thank you very much Joost for holding my hand on this. Last question > >for the > >day: It seems that postgresql wants to install xemacs as a dependency > >... o_O > > > > > ># emerge -uaDv emerge dev-db/postgresql > > > >These are the packages that would be merged, in order: > > > >Calculating dependencies... done! > >[ebuild N ] app-eselect/eselect-postgresql-1.2.1::gentoo 4 KiB > >[ebuild N ] app-eselect/eselect-ctags-1.18::gentoo 9 KiB > >[ebuild N ] app-eselect/eselect-emacs-1.18::gentoo 0 KiB > >[ebuild N ] dev-db/postgresql-9.4.5-r1:9.4::gentoo USE="ldap nls > >pam > >readline server ssl xml zlib -doc -kerberos (-libressl) -perl - > >pg_legacytimestamp -python (-selinux) -static-libs -tcl -threads -uuid" > > > >LINGUAS="en -af -cs -de -es -fa -fr -hr -hu -it -ko -nb -pl -pt_BR -ro > >-ru -sk > >-sl -sv -tr -zh_CN -zh_TW" PYTHON_SINGLE_TARGET="python2_7 -python3_4" > >PYTHON_TARGETS="python2_7 python3_4" 17,248 KiB > >[ebuild N ] app-editors/xemacs-21.4.24::gentoo USE="X berkdb gdbm > >gif > >gpm jpeg ldap png tiff -Xaw3d -athena -canna -dnd -eolconv -freewnn > >-motif - > >mule -nas -neXt -pop -postgres -xface -xim" 8,383 KiB > >[ebuild N ] app-xemacs/xemacs-base-2.27::gentoo 524 KiB > >[ebuild N ] app-xemacs/emerge-1.11::gentoo 60 KiB > > > >Total: 7 packages (7 new), Size of downloads: 26,225 KiB > > > >Would you like to merge these packages? [Yes/No] > > > > > >Why is this? > > No. You are trying to emerge 'emerge'. > (Check the commandline :) ) > > -- > Joost Oops! Apologies for the noise. Against my wife's advice (she knows better of course) I am trying to multi- task a number of chores which have suddenly descended upon me ... I'll get on with completing the tax return first, before I return to Kmail2. -- Regards, Mick signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] Kmail2 - I have not given up ... yet
On 29 December 2015 19:40:58 CET, Mick wrote: >On Tuesday 29 Dec 2015 17:51:32 J. Roeleveld wrote: >> On Tuesday, December 29, 2015 04:34:33 PM Mick wrote: >> > On Tuesday 29 Dec 2015 14:18:20 J. Roeleveld wrote: >> > > sqlite is nice, for single threaded applications. >> > > For anything more advanced, either a wrapper is required or >something >> > > more advanced needs to be used. >> > >> > I like sqlite because it is self-contained, embedded in the >application >> > that uses it and accesses the data directly with functional calls, >> > rather than looping around port/socket interfaces to speak to a >server. >> > This is why I kept it, since with Kmail1 it is not used much. >> >> SQLite never was reliable with akonadi. That might be why so many >people >> had all those issues. >> >> > With Kmail2 the database will be hammered so as you say will need >> > something that can process things in parallel at speed and in >higher >> > volumes. So, I'm planning to install postgresql for this purpose, >since >> > in my experience mysql has had a number of hickups with akonadi. >> >> My experience as well, which is why I switched to Postgresql. >> >> > Can you please advise what GRANTS did you use to create a dedicated >> > postgresql user for akonadi? >> >> Grants? >> I did the following: >> % createuser -P >> (NOTE: You need to set a password, which is why I use the "-P" >option) >> >> % createdb -E UTF8 -O >> >> My config for this is: >> >> % cat .config/akonadi/akonadiserverrc >> [%General] >> Driver=QPSQL >> >> [QPSQL] >> Name= >> Host=localhost >> Options= >> ServerPath=/usr/bin/pg_ctl >> InitDbPath=/usr/bin/initdb >> StartServer=false >> User= >> Password= >> Port=5432 >> >> [Debug] >> Tracer=null >> >> > Will the same user be used for Baloo indexing, or is this an >additional >> > database role? >> >> Afaik, no. Baloo uses it's own database engine. >> >> For the USE-flags: >> >> app-office/akonadi-server postgresql qt4 >> (all other USE-flags disabled) >> >> -- >> Joost > >Thank you very much Joost for holding my hand on this. Last question >for the >day: It seems that postgresql wants to install xemacs as a dependency >... o_O > > ># emerge -uaDv emerge dev-db/postgresql > >These are the packages that would be merged, in order: > >Calculating dependencies... done! >[ebuild N ] app-eselect/eselect-postgresql-1.2.1::gentoo 4 KiB >[ebuild N ] app-eselect/eselect-ctags-1.18::gentoo 9 KiB >[ebuild N ] app-eselect/eselect-emacs-1.18::gentoo 0 KiB >[ebuild N ] dev-db/postgresql-9.4.5-r1:9.4::gentoo USE="ldap nls >pam >readline server ssl xml zlib -doc -kerberos (-libressl) -perl - >pg_legacytimestamp -python (-selinux) -static-libs -tcl -threads -uuid" > >LINGUAS="en -af -cs -de -es -fa -fr -hr -hu -it -ko -nb -pl -pt_BR -ro >-ru -sk >-sl -sv -tr -zh_CN -zh_TW" PYTHON_SINGLE_TARGET="python2_7 -python3_4" >PYTHON_TARGETS="python2_7 python3_4" 17,248 KiB >[ebuild N ] app-editors/xemacs-21.4.24::gentoo USE="X berkdb gdbm >gif >gpm jpeg ldap png tiff -Xaw3d -athena -canna -dnd -eolconv -freewnn >-motif - >mule -nas -neXt -pop -postgres -xface -xim" 8,383 KiB >[ebuild N ] app-xemacs/xemacs-base-2.27::gentoo 524 KiB >[ebuild N ] app-xemacs/emerge-1.11::gentoo 60 KiB > >Total: 7 packages (7 new), Size of downloads: 26,225 KiB > >Would you like to merge these packages? [Yes/No] > > >Why is this? No. You are trying to emerge 'emerge'. (Check the commandline :) ) -- Joost -- Sent from my Android device with K-9 Mail. Please excuse my brevity.
Re: [gentoo-user] Kmail2 - I have not given up ... yet
On Tue, Dec 29, 2015 at 06:40:58PM +, Mick wrote: > > Thank you very much Joost for holding my hand on this. Last question for the > day: It seems that postgresql wants to install xemacs as a dependency ... o_O > > > # emerge -uaDv emerge dev-db/postgresql emerge is trying to install app-xemacs/emerge, which depends on xemacs (presumably). Your command is: emerge [flags] emerge ... Just a simple typo. Alec
Re: [gentoo-user] Kmail2 - I have not given up ... yet
On Tuesday 29 Dec 2015 17:51:32 J. Roeleveld wrote: > On Tuesday, December 29, 2015 04:34:33 PM Mick wrote: > > On Tuesday 29 Dec 2015 14:18:20 J. Roeleveld wrote: > > > sqlite is nice, for single threaded applications. > > > For anything more advanced, either a wrapper is required or something > > > more advanced needs to be used. > > > > I like sqlite because it is self-contained, embedded in the application > > that uses it and accesses the data directly with functional calls, > > rather than looping around port/socket interfaces to speak to a server. > > This is why I kept it, since with Kmail1 it is not used much. > > SQLite never was reliable with akonadi. That might be why so many people > had all those issues. > > > With Kmail2 the database will be hammered so as you say will need > > something that can process things in parallel at speed and in higher > > volumes. So, I'm planning to install postgresql for this purpose, since > > in my experience mysql has had a number of hickups with akonadi. > > My experience as well, which is why I switched to Postgresql. > > > Can you please advise what GRANTS did you use to create a dedicated > > postgresql user for akonadi? > > Grants? > I did the following: > % createuser -P > (NOTE: You need to set a password, which is why I use the "-P" option) > > % createdb -E UTF8 -O > > My config for this is: > > % cat .config/akonadi/akonadiserverrc > [%General] > Driver=QPSQL > > [QPSQL] > Name= > Host=localhost > Options= > ServerPath=/usr/bin/pg_ctl > InitDbPath=/usr/bin/initdb > StartServer=false > User= > Password= > Port=5432 > > [Debug] > Tracer=null > > > Will the same user be used for Baloo indexing, or is this an additional > > database role? > > Afaik, no. Baloo uses it's own database engine. > > For the USE-flags: > > app-office/akonadi-server postgresql qt4 > (all other USE-flags disabled) > > -- > Joost Thank you very much Joost for holding my hand on this. Last question for the day: It seems that postgresql wants to install xemacs as a dependency ... o_O # emerge -uaDv emerge dev-db/postgresql These are the packages that would be merged, in order: Calculating dependencies... done! [ebuild N ] app-eselect/eselect-postgresql-1.2.1::gentoo 4 KiB [ebuild N ] app-eselect/eselect-ctags-1.18::gentoo 9 KiB [ebuild N ] app-eselect/eselect-emacs-1.18::gentoo 0 KiB [ebuild N ] dev-db/postgresql-9.4.5-r1:9.4::gentoo USE="ldap nls pam readline server ssl xml zlib -doc -kerberos (-libressl) -perl - pg_legacytimestamp -python (-selinux) -static-libs -tcl -threads -uuid" LINGUAS="en -af -cs -de -es -fa -fr -hr -hu -it -ko -nb -pl -pt_BR -ro -ru -sk -sl -sv -tr -zh_CN -zh_TW" PYTHON_SINGLE_TARGET="python2_7 -python3_4" PYTHON_TARGETS="python2_7 python3_4" 17,248 KiB [ebuild N ] app-editors/xemacs-21.4.24::gentoo USE="X berkdb gdbm gif gpm jpeg ldap png tiff -Xaw3d -athena -canna -dnd -eolconv -freewnn -motif - mule -nas -neXt -pop -postgres -xface -xim" 8,383 KiB [ebuild N ] app-xemacs/xemacs-base-2.27::gentoo 524 KiB [ebuild N ] app-xemacs/emerge-1.11::gentoo 60 KiB Total: 7 packages (7 new), Size of downloads: 26,225 KiB Would you like to merge these packages? [Yes/No] Why is this? -- Regards, Mick signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] Kmail2 - I have not given up ... yet
Mick writes: > On Tuesday 29 Dec 2015 14:18:20 J. Roeleveld wrote: > >> sqlite is nice, for single threaded applications. >> For anything more advanced, either a wrapper is required or something more >> advanced needs to be used. > > I like sqlite because it is self-contained, embedded in the application that > uses it and accesses the data directly with functional calls, rather than > looping around port/socket interfaces to speak to a server. This is why I > kept it, since with Kmail1 it is not used much. > > With Kmail2 the database will be hammered so as you say will need something > that can process things in parallel at speed and in higher volumes. So, I'm > planning to install postgresql for this purpose, since in my experience mysql > has had a number of hickups with akonadi. Are we at the point where users are accepting to have to install and maintain a fully fledged RDBMS just for a single application which doesn't even need a database in the first place? Quite a few times I've been thinking it would be nice to have a database to implement a particular feature for an application, and I've always decided not to do it because it seems to be a totally unreasonable requirement, and because it seems rather unlikely that any user would be willing to do it. It would make some sense if an RDBMS were a requirement already, used by all kinds of software --- though I'm finding it very questionable if we should go there (and find ourselves with a single point of failure and bottleneck). A MUA must be doing something very wrong to have such a requirement. And what kind of performance can you expect with a laptop that has only 4GB and is already overloaded with KDE?
Re: [gentoo-user] Kmail2 - I have not given up ... yet
On Tuesday, December 29, 2015 04:34:33 PM Mick wrote: > On Tuesday 29 Dec 2015 14:18:20 J. Roeleveld wrote: > > sqlite is nice, for single threaded applications. > > For anything more advanced, either a wrapper is required or something more > > advanced needs to be used. > > I like sqlite because it is self-contained, embedded in the application that > uses it and accesses the data directly with functional calls, rather than > looping around port/socket interfaces to speak to a server. This is why I > kept it, since with Kmail1 it is not used much. SQLite never was reliable with akonadi. That might be why so many people had all those issues. > With Kmail2 the database will be hammered so as you say will need something > that can process things in parallel at speed and in higher volumes. So, I'm > planning to install postgresql for this purpose, since in my experience > mysql has had a number of hickups with akonadi. My experience as well, which is why I switched to Postgresql. > Can you please advise what GRANTS did you use to create a dedicated > postgresql user for akonadi? Grants? I did the following: % createuser -P (NOTE: You need to set a password, which is why I use the "-P" option) % createdb -E UTF8 -O My config for this is: % cat .config/akonadi/akonadiserverrc [%General] Driver=QPSQL [QPSQL] Name= Host=localhost Options= ServerPath=/usr/bin/pg_ctl InitDbPath=/usr/bin/initdb StartServer=false User= Password= Port=5432 [Debug] Tracer=null > Will the same user be used for Baloo indexing, or is this an additional > database role? Afaik, no. Baloo uses it's own database engine. For the USE-flags: app-office/akonadi-server postgresql qt4 (all other USE-flags disabled) -- Joost signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] Kmail2 - I have not given up ... yet
On Tuesday 29 Dec 2015 14:18:20 J. Roeleveld wrote: > sqlite is nice, for single threaded applications. > For anything more advanced, either a wrapper is required or something more > advanced needs to be used. I like sqlite because it is self-contained, embedded in the application that uses it and accesses the data directly with functional calls, rather than looping around port/socket interfaces to speak to a server. This is why I kept it, since with Kmail1 it is not used much. With Kmail2 the database will be hammered so as you say will need something that can process things in parallel at speed and in higher volumes. So, I'm planning to install postgresql for this purpose, since in my experience mysql has had a number of hickups with akonadi. Can you please advise what GRANTS did you use to create a dedicated postgresql user for akonadi? Will the same user be used for Baloo indexing, or is this an additional database role? -- Regards, Mick signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] Kmail2 - I have not given up ... yet
On Tuesday, December 29, 2015 01:16:08 PM Mick wrote: > On Tuesday 29 Dec 2015 12:39:18 J. Roeleveld wrote: > > On Tuesday, December 29, 2015 10:51:57 AM Mick wrote: > > > On Tuesday 29 Dec 2015 10:20:23 J. Roeleveld wrote: > > > > On Tuesday, December 29, 2015 09:53:24 AM Mick wrote: > > > This is good to know. An earlier akonadi bug would actually delete > > > files > > > on the server. O_O > > > > Hmm... must have missed that one... > > Are you sure that also affected IMAP connections? > > Yes, I remember reading about some bug between akonadi and mysql. akonadi > would push its corruption to the IMAP4 server, deleting a tonne of messages. > > I also remember a Mr A McKinnon having a well earned rant on this same M/L > when he was trying out Kmail2, quite likely still in ~arch at the time. I never used a ~arch kmail. Only use that for a very small set of applications. Office-like applications are not in that set. > > > I take this to mean that the Kmail interface does not freeze up and you > > > can continue to read/delete messages, change folders, etc.? > > > > Yes, with only the following comment: When moving large (1000+) amounts of > > messages to a different folder, let the interface show it as finished > > before doing something else with KMail. > > Cool, so as long I delete a few messages at a time, it should be OK. Then you shouldn't notice anything. You do get a status update in the bottom bar indicating how much it wants to do in total and how many it did. It's quite quick on my laptop. > > > Thank you Joost, this is very useful to know. What do you mean by > > > "haven't had to restart the mail cache"? Do you mean you did not have > > > to delete the akonadi database(s) and restart it? > > > > Yes, restarting the mail cache is: delete everything and start over > > > > Don't forget, akonadi-storage has 2 parts: > > 1) The database (mysql or postgresql) > > 2) Files > > > > The 2 are linked and need to be kept in sync. > > This is important for backups and cleanup. > > Yes, there are a number of files and databases in my current setup (Kmail1 > with sqlite3) under .local/share/ including akonadi, baloo, et al. sqlite is nice, for single threaded applications. For anything more advanced, either a wrapper is required or something more advanced needs to be used. -- Joost signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] Kmail2 - I have not given up ... yet
On Tuesday 29 Dec 2015 12:39:18 J. Roeleveld wrote: > On Tuesday, December 29, 2015 10:51:57 AM Mick wrote: > > On Tuesday 29 Dec 2015 10:20:23 J. Roeleveld wrote: > > > On Tuesday, December 29, 2015 09:53:24 AM Mick wrote: > > This is good to know. An earlier akonadi bug would actually delete files > > on the server. O_O > > Hmm... must have missed that one... > Are you sure that also affected IMAP connections? Yes, I remember reading about some bug between akonadi and mysql. akonadi would push its corruption to the IMAP4 server, deleting a tonne of messages. I also remember a Mr A McKinnon having a well earned rant on this same M/L when he was trying out Kmail2, quite likely still in ~arch at the time. > > I take this to mean that the Kmail interface does not freeze up and you > > can continue to read/delete messages, change folders, etc.? > > Yes, with only the following comment: When moving large (1000+) amounts of > messages to a different folder, let the interface show it as finished > before doing something else with KMail. Cool, so as long I delete a few messages at a time, it should be OK. > > Thank you Joost, this is very useful to know. What do you mean by > > "haven't had to restart the mail cache"? Do you mean you did not have > > to delete the akonadi database(s) and restart it? > > Yes, restarting the mail cache is: delete everything and start over > > Don't forget, akonadi-storage has 2 parts: > 1) The database (mysql or postgresql) > 2) Files > > The 2 are linked and need to be kept in sync. > This is important for backups and cleanup. Yes, there are a number of files and databases in my current setup (Kmail1 with sqlite3) under .local/share/ including akonadi, baloo, et al. -- Regards, Mick signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] Kmail2 - I have not given up ... yet
On Tuesday, December 29, 2015 10:51:57 AM Mick wrote: > On Tuesday 29 Dec 2015 10:20:23 J. Roeleveld wrote: > > On Tuesday, December 29, 2015 09:53:24 AM Mick wrote: > > > Have you been able to use Kmail2 reliably on a *laptop*? What problems > > > have you experienced? Has intermittent network availability caused loss > > > of messages? Any gotchas and workarounds? Any suggestions? > > > > I have been using Kmail2 for a couple of years now (ever since it became > > stable in portage) > > I had some issues over this time as well, but as I had already switched > > over to IMAP over 10 years ago, I never actually lost any emails and could > > easily fix this by deleting the local file-cache and database. > > This is good to know. An earlier akonadi bug would actually delete files on > the server. O_O Hmm... must have missed that one... Are you sure that also affected IMAP connections? > > Currently I run it on my laptop (quad-core, 16GB ram, SSD) succesfully. > > Hmm ... my laptop is also quad-core, but has only 4G RAM. I hope this is > not going to be a problem. 4GB? Not sure, it's lower then my desktop: quad-core, 8GB, spinning rust The desktop also manages to run it all. Personally, I wouldn't use a system with less than 8GB anymore. I only settled for 16GB for my laptop as the 32GB versions were too bulky and expensive. (Mind you, I do run VMs on this laptop) % free -m totalusedfree shared buff/cache available Mem: 160101333 737 414 13939 14157 Swap: 17407 196 17211 % uptime 13:38:21 up 5 days, 22:07, 3 users, load average: 0.23, 0.23, 0.41 (I tend to hibernate/suspend-to-disk my laptop when not using it) > > Here is how I set it up: > > 1) Run Postgresql > > 2) I run the DB "natively" (eg. do NOT let akonadi start an "embedded" db) > > 3) Configure mail accounts (including GMail) as IMAP > > 4) Configure mail accounts to keep a copy locally > > > > Apart from a lengthy synchronize period (I do have emails dating back to > > 1997 on the server) and occasionally a process going up to 100%, it > > doesn't prevent me from actually using the laptop for other things. > > I take this to mean that the Kmail interface does not freeze up and you can > continue to read/delete messages, change folders, etc.? Yes, with only the following comment: When moving large (1000+) amounts of messages to a different folder, let the interface show it as finished before doing something else with KMail. > Thank you Joost, this is very useful to know. What do you mean by "haven't > had to restart the mail cache"? Do you mean you did not have to delete the > akonadi database(s) and restart it? Yes, restarting the mail cache is: delete everything and start over Don't forget, akonadi-storage has 2 parts: 1) The database (mysql or postgresql) 2) Files The 2 are linked and need to be kept in sync. This is important for backups and cleanup. In this respect, it's similar to other applications that work with databases and files, like Gallery (2 and 3), Piwigo, some large BI applications made by large corporations, -- Joost signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] Kmail2 - I have not given up ... yet
On Tuesday 29 Dec 2015 10:20:23 J. Roeleveld wrote: > On Tuesday, December 29, 2015 09:53:24 AM Mick wrote: > > Have you been able to use Kmail2 reliably on a *laptop*? What problems > > have you experienced? Has intermittent network availability caused loss > > of messages? Any gotchas and workarounds? Any suggestions? > > I have been using Kmail2 for a couple of years now (ever since it became > stable in portage) > I had some issues over this time as well, but as I had already switched > over to IMAP over 10 years ago, I never actually lost any emails and could > easily fix this by deleting the local file-cache and database. This is good to know. An earlier akonadi bug would actually delete files on the server. O_O > Currently I run it on my laptop (quad-core, 16GB ram, SSD) succesfully. Hmm ... my laptop is also quad-core, but has only 4G RAM. I hope this is not going to be a problem. > Here is how I set it up: > 1) Run Postgresql > 2) I run the DB "natively" (eg. do NOT let akonadi start an "embedded" db) > 3) Configure mail accounts (including GMail) as IMAP > 4) Configure mail accounts to keep a copy locally > > Apart from a lengthy synchronize period (I do have emails dating back to > 1997 on the server) and occasionally a process going up to 100%, it > doesn't prevent me from actually using the laptop for other things. I take this to mean that the Kmail interface does not freeze up and you can continue to read/delete messages, change folders, etc.? > As I take it along to customers as well, I am dependent on their WIFI > systems. These are not the best, eg. I have experienced networking issues > a lot. Not lost any messages and haven't had to restart the mail cache for > a year now. (Since I switched away from embedded Mysql to "native" > Postgresql) > > -- > Joost Thank you Joost, this is very useful to know. What do you mean by "haven't had to restart the mail cache"? Do you mean you did not have to delete the akonadi database(s) and restart it? -- Regards, Mick signature.asc Description: This is a digitally signed message part.
Re: [gentoo-user] Kmail2 - I have not given up ... yet
On Tuesday, December 29, 2015 09:53:24 AM Mick wrote: > Have you been able to use Kmail2 reliably on a *laptop*? What problems have > you experienced? Has intermittent network availability caused loss of > messages? Any gotchas and workarounds? Any suggestions? I have been using Kmail2 for a couple of years now (ever since it became stable in portage) I had some issues over this time as well, but as I had already switched over to IMAP over 10 years ago, I never actually lost any emails and could easily fix this by deleting the local file-cache and database. Currently I run it on my laptop (quad-core, 16GB ram, SSD) succesfully. Here is how I set it up: 1) Run Postgresql 2) I run the DB "natively" (eg. do NOT let akonadi start an "embedded" db) 3) Configure mail accounts (including GMail) as IMAP 4) Configure mail accounts to keep a copy locally Apart from a lengthy synchronize period (I do have emails dating back to 1997 on the server) and occasionally a process going up to 100%, it doesn't prevent me from actually using the laptop for other things. As I take it along to customers as well, I am dependent on their WIFI systems. These are not the best, eg. I have experienced networking issues a lot. Not lost any messages and haven't had to restart the mail cache for a year now. (Since I switched away from embedded Mysql to "native" Postgresql) -- Joost signature.asc Description: This is a digitally signed message part.
