Re: [SOGo] Mass export to ldif and ics
Hello Paul, The calendars (ics) and addressbooks (ldif) of many users. The sogo backup files are quite simple, so i would write a perl script which writes all data between every "BEGIN VCALENDAR" and "END VCALENDAR" occurences into an ics-File and for VCARD into a ldif-File, looping over the backup files of all users. Mit freundlichem Gruß i. A. Hubert Gilch Systemadministrator SEP Logistik AG Ziegelstr. 2 83629 Weyarn Tel.: +49 8020 905-214 Fax: +49 8020 905-100 E-Mail: h...@sepag.de <mailto:h...@sepag.de> Web: www.sepag.de <http://www.sepag.de/> Sitz der Gesellschaft: Weyarn Rechtsform: Aktiengesellschaft Amtsgericht München: HRB 119679 Vorstand: Professor Dr.-Ing. Franz Demmelmeier (Vorsitzender), Dipl.-Ing. Konrad Schneider, MBA, Dipl.-Ing. Markus Fischbacher Aufsichtsratsvorsitzender Michael Pelzer -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] sogo-tool restore
I tested it myself, sogo-tool restore just adds items that are not in sogo anymore and doesn't delete anything. Mit freundlichem Gruß i. A. Hubert Gilch Systemadministrator SEP Logistik AG Ziegelstr. 2 83629 Weyarn Tel.: +49 8020 905-214 Fax: +49 8020 905-100 E-Mail: h...@sepag.de <mailto:h...@sepag.de> Web: www.sepag.de <http://www.sepag.de/> Sitz der Gesellschaft: Weyarn Rechtsform: Aktiengesellschaft Amtsgericht München: HRB 119679 Vorstand: Professor Dr.-Ing. Franz Demmelmeier (Vorsitzender), Dipl.-Ing. Konrad Schneider, MBA, Dipl.-Ing. Markus Fischbacher Aufsichtsratsvorsitzender Michael Pelzer Am 28.03.2017 um 10:12 schrieb Hubert Gilch (h...@sepag.de): Good morning, when i restore a users data, will information entered after the backup was created deleted or just the information appended that is not in sogo anymore. Background: A user has accidently deleted some addresses and i want to restore them from backup without deleting any new data. Thank you. -- Mit freundlichem Gruß i. A. Hubert Gilch Systemadministrator SEP Logistik AG Ziegelstr. 2 83629 Weyarn Tel.: +49 8020 905-214 Fax: +49 8020 905-100 E-Mail: h...@sepag.de <mailto:h...@sepag.de> Web: www.sepag.de <http://www.sepag.de/> Sitz der Gesellschaft: Weyarn Rechtsform: Aktiengesellschaft Amtsgericht München: HRB 119679 Vorstand: Professor Dr.-Ing. Franz Demmelmeier (Vorsitzender), Dipl.-Ing. Konrad Schneider, MBA, Dipl.-Ing. Markus Fischbacher Aufsichtsratsvorsitzender Michael Pelzer -- users@sogo.nu https://inverse.ca/sogo/lists -- users@sogo.nu https://inverse.ca/sogo/lists
[SOGo] sogo-tool restore
Good morning, when i restore a users data, will information entered after the backup was created deleted or just the information appended that is not in sogo anymore. Background: A user has accidently deleted some addresses and i want to restore them from backup without deleting any new data. Thank you. -- Mit freundlichem Gruß i. A. Hubert Gilch Systemadministrator SEP Logistik AG Ziegelstr. 2 83629 Weyarn Tel.: +49 8020 905-214 Fax: +49 8020 905-100 E-Mail: h...@sepag.de <mailto:h...@sepag.de> Web: www.sepag.de <http://www.sepag.de/> Sitz der Gesellschaft: Weyarn Rechtsform: Aktiengesellschaft Amtsgericht München: HRB 119679 Vorstand: Professor Dr.-Ing. Franz Demmelmeier (Vorsitzender), Dipl.-Ing. Konrad Schneider, MBA, Dipl.-Ing. Markus Fischbacher Aufsichtsratsvorsitzender Michael Pelzer -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] time-zone dependencies
Hello Alex, it will be correct unless I have and use invite attendees, then it ALWAYS in the body of the email change the time (this happens in outlook and gmail calendaring as well)... in the actual calendar it is correct. Just wondering is there a way to vary this work correctly? did you set SOGoTimeZone = Europe/Berlin; in /etc/sogo/sogo.conf correctly for your location? Mit freundlichem Gruß i. A. Hubert Gilch Systemadministrator -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] SOGo ActiveSync processes hanging in the same request
Hello Florian, SOGoMaximumSyncWindowSize seems to be tricky: I had similar problems (SOGo V2.8) with it. When set > 0, SOGo will use this value regardless what the client wants. Outlook seems to request something small and when it more items than it requests the whole fetch will be descarded and startet from the beginning. For me it worked when SOGoMaximumSyncWindowSize is unset in the configuration file, then SOGo respects what the client is requesting. Setting it to 0 should be the same, but only when unset it worked in my case. Mit freundlichem Gruß i. A. Hubert Gilch Systemadministrator SEP Logistik AG Am 12.04.2016 um 12:27 schrieb Florian Unger (florian.un...@intego.de): With settings SOGoMaximumSyncResponseSize = 10240; SOGoMaximumSyncWindowSize = 256; I still have the same issue. Best regards Florian On 12.04.2016 11:11, Florian Unger (florian.un...@intego.de) wrote: Hi, all the topics I found on the net spoke about setting small values for sync to solve issues so I tried these settings: SOGoMaximumSyncResponseSize = 512; SOGoMaximumSyncWindowSize = 256; which did not not help. I will try your configuration with a large response size and see if that is doing the trick. Thanks Florian On 11.04.2016 15:51, Christian Jensen (cmjscrip...@outlook.dk) wrote: Hi. have you tried setting 'SOGoMaximumSync' i had almost the same issue and after setting them Office 2013 synchronized just fine. SOGoMaximumSyncResponseSize = 10240; SOGoMaximumSyncWindowSize = 256; Regards Christian Den 11-04-2016 kl. 15:35 skrev Florian Unger (florian.un...@intego.de): Hi, I am having some trouble with a small scale SOGo installation (less than 10 users) using SOGo 3.0.2 with ActiveSync and Outlook 2013 clients. I have SOGo configured for 15 workers and these are the ActiveSync specific settings I am using: WOWorkersCount = 15; SOGoMaximumPingInterval = 600; SOGoMaximumSyncInterval = 600; SOGoInternalSyncInterval = 30; WOWatchDogRequestTimeout = 6; SxVMemLimit = 768; /* Debug */ SOGoEASDebugEnabled = YES; After some time processes keep hanging in the same request until all workers are occupied and I get error "[WOWatchDog]> No child available to handle incoming request!" At the end is an example of the log file of process 6808 and the last requests it got. I also made backtraces with gdb from that process (see attachment) - the process was either in function NGDescriptorRecv or in a sleep from SOGoActiveSyncDispatcher. I tried increasing timeouts up to 1 hour as suggested in the Active Sync tuning hints from the manual, but that did not help. Processes were sitting just longer until they got killed by the watch dog. Any hint how to resolve this issue would be great. Best regards Florian -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] Problems with EAS - Outlook 2013 and Android
Hello all, with the help of Thomas Führer i could fix the problem. It seems that with SOGoMaximumSyncWindowSize = 0 (SOGo default) phones and Outlook cannot cope with the many (512 max) changes sent by SOGo at a time. Setting it to 1 makes sync slower, but it now works, in case of Outlook very slow. Many thanks to Thomas for his help. best regards, Hubert -- users@sogo.nu https://inverse.ca/sogo/lists
[SOGo] Error: initializing a SOGoObject when using sogo-tool manage-eas
Hi, when using sogo-tool manage-eas i get strange Errors: root@sogo:/etc/sogo# sogo-tool manage-eas listfolders hubert SEC1552252F9CF67 <0x0x1918668[SOGoCache]> Cache cleanup interval set every 300.00 seconds <0x0x1918668[SOGoCache]> Using host(s) '127.0.0.1' as server(s) <0x018DA538[SOGoCacheGCSObject]:(null)> Error: initializing a SOGoObject (named 0) without wocontext Folder Key: SEC1552252F9CF67+foldersogo_sepag_intra_3e24_1b2587ac_0 <0x01982958[SOGoCacheGCSObject]:(null)> Error: initializing a SOGoObject (named SEC1552252F9CF67+foldersogo_sepag_intra_3e24_1b2587ac_0) without wocontext Folder Name: INBOX Folder Key: SEC1552252F9CF67+foldersogo_sepag_intra_3e24_1b2587ac_10 <0x0198D1A8[SOGoCacheGCSObject]:(null)> Error: initializing a SOGoObject (named SEC1552252F9CF67+foldersogo_sepag_intra_3e24_1b2587ac_10) without wocontext Folder Name: INBOX/cvs-doku [ ... ] It looks memcached-related but mecached is running and has connections from various sogod. Has somebody an idea what could cause this error or can it be safely ignored? SOGo version is 2.3.8 Thanks, Hubert -- users@sogo.nu https://inverse.ca/sogo/lists
[SOGo] Problems with EAS - Outlook 2013 and Android
Hello, we have massive problems with EAS. When you start with an account with just a few mails, contacts and calendar items, everything works, even when more and more items are added. But an initial sync of an account with thousands of mails and calendar items is not possible, there are no items arriving at the phone (Samsung Galaxy S4), whereas the same account works for a long time with an old Nokia E7. I have one account where sync of calendar and mail works, but no contacts are synced (contact sync was initially disabled on the phone). Resetdevice with sogo-tool does not change anything. Using this account on a different phone shows the same symtoms :-( Sogo-configuration (EAS part): SxVMemLimit = 1024; SOGoEASDebugEnabled = YES; /* EAS */ WOWorkersCount = 35; SOGoMaximumPingInterval = 3540; SOGoMaximumSyncInterval = 3540; SOGoInternalSyncInterval = 60; WOWatchDogRequestTimeout = 60; SOGoMaximumSyncResponseSize = 51200; SOGoMaximumSyncWindowSize = 0; Apache is running on a different machine (in DMZ, whereas sogo runs in our internal network without access from external): ProxyPass /Microsoft-Server-ActiveSync \ http://sogo.sepag.intra:2/SOGo/Microsoft-Server-ActiveSync \ retry=60 connectiontimeout=5 timeout=3600 IMAP is cyrus, running on the same machine as sogo. The sogo machine has 8 virtual cpus with 16GB of RAM, 35 sogod are running (about 10 people are using EAS at the moment). We are not using Outlook with EAS, we sync with CalDavSynchronizer. Can somebody tell me if this should work and probably point to where my error could lie? Thank you. -- Mit freundlichem Gruß i. A. Hubert Gilch Systemadministrator SEP Logistik AG -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] sogod eats all memory and gets terminated by kernel
Hello Thomas, Try to sync with following parameter set: SOGoMaximumSyncResponseSize = 2048 This is much better. Outlook 2013 now syncs Emails, but we still have problems :-( * calendar is not synced * contacts are not synced * when we try to move mails into another folder, there is an error * when mails are moved on the imap server, it seems that all mails in the folder are transfered again (folder is emptied and the mails come in one after the other) Mit freundlichem Gruß i. A. Hubert Gilch Systemadministrator SEP Logistik AG Ziegelstr. 2 D-83629 Weyarn Tel.: +49 8020 905-214 Fax: +49 8020 905-100 Email: h...@sepag.de <mailto:h...@sepag.de> Web: www.sepag.de <http://www.sepag.de/> Sitz der Gesellschaft: Weyarn Rechtsform: Aktiengesellschaft Amtsgericht München: HRB 119679 Vorstand: Professor Dr.-Ing. Franz Demmelmeier (Vorsitzender), Dipl.-Ing. Konrad Schneider, MBA, Dipl.-Ing. Markus Fischbacher Aufsichtsratsvorsitzender Michael Pelzer -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] sogod eats all memory and gets terminated by kernel
Thank you, Thomas, i will try this. SOGoMaximumSyncResponseSize = 2048 The user who is my "crash test dummy" is not in the office today, so i will report back on monday if it works. Mit freundlichem Gruß i. A. Hubert Gilch Systemadministrator SEP Logistik AG Ziegelstr. 2 D-83629 Weyarn Tel.: +49 8020 905-214 Fax: +49 8020 905-100 Email: h...@sepag.de <mailto:h...@sepag.de> Web: www.sepag.de <http://www.sepag.de/> Sitz der Gesellschaft: Weyarn Rechtsform: Aktiengesellschaft Amtsgericht München: HRB 119679 Vorstand: Professor Dr.-Ing. Franz Demmelmeier (Vorsitzender), Dipl.-Ing. Konrad Schneider, MBA, Dipl.-Ing. Markus Fischbacher Aufsichtsratsvorsitzender Michael Pelzer -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] sogod eats all memory and gets terminated by kernel
Hello Ludovic, thank you for your answer. Have you tuned a bit the default SOGo configuration for EAS? Yes, i did: WOWorkersCount = 35; SOGoMaximumPingInterval = 3540; SOGoMaximumSyncInterval = 3540; SOGoInternalSyncInterval = 30; WOWatchDogRequestTimeout = 60; SxVMemLimit = 384; SOGoMemcachedHost = 127.0.0.1; Also, the upcoming v2.3.3 release has a lot of optimizations and we no longer rewrite messages to before sending them to Outlook when using EAS. So the memory usage is considerably reduced (when sync'ing large folders in big chunks) and things are about 3 times faster than what they used to. If you want to try the latest nightly builds, it has all the fixes. They should be stable since we're just about to release. I switched to nightly builds and memory consumtion is considerably lower. However, there is still one process at a time using some GBs of memory, but it is not always the same. The one on top of the memory usage is logging constantly lines like this (EAS Debug is enabled): Nov 05 11:48:30 sogod [7564]: <0x0x7fe756e896e8[SOGoActiveSyncDispatcher]> EAS - Dealing with cacheObject: 131-0 Nov 05 11:48:30 sogod [7564]: <0x0x7fe756e896e8[SOGoActiveSyncDispatcher]> EAS - ADD! Nov 05 11:48:30 sogod [7564]: <0x0x7fe756e896e8[SOGoActiveSyncDispatcher]> EAS - Dealing with cacheObject: 132-0 Nov 05 11:48:30 sogod [7564]: <0x0x7fe756e896e8[SOGoActiveSyncDispatcher]> EAS - ADD! Nov 05 11:48:30 sogod [7564]: <0x0x7fe756e896e8[SOGoActiveSyncDispatcher]> EAS - Dealing with cacheObject: 133-0 Nov 05 11:48:30 sogod [7564]: <0x0x7fe756e896e8[SOGoActiveSyncDispatcher]> EAS - ADD! Nov 05 11:48:30 sogod [7564]: <0x0x7fe756e896e8[SOGoActiveSyncDispatcher]> EAS - Dealing with cacheObject: 134-0 Nov 05 11:48:30 sogod [7564]: <0x0x7fe756e896e8[SOGoActiveSyncDispatcher]> EAS - ADD! The ID (131-0 etc.) is changing, but sometimes also starting from 1-0 again. Outlook is still waiting for the first sync to succeed :-( Mit freundlichem Gruß i. A. Hubert Gilch Systemadministrator SEP Logistik AG Ziegelstr. 2 D-83629 Weyarn Tel.: +49 8020 905-214 Fax: +49 8020 905-100 Email: h...@sepag.de <mailto:h...@sepag.de> Web: www.sepag.de <http://www.sepag.de/> Sitz der Gesellschaft: Weyarn Rechtsform: Aktiengesellschaft Amtsgericht München: HRB 119679 Vorstand: Professor Dr.-Ing. Franz Demmelmeier (Vorsitzender), Dipl.-Ing. Konrad Schneider, MBA, Dipl.-Ing. Markus Fischbacher Aufsichtsratsvorsitzender Michael Pelzer -- users@sogo.nu https://inverse.ca/sogo/lists
[SOGo] sogod eats all memory and gets terminated by kernel
Hi, i have some sogod processes eating very much memory. I suspect those are Active Sync processes trying to initially sync to Outlook 2013 (and failing), specifically with large mailboxes. One for instance is about 5GB. On mobile phones, Active sync works, perhaps because they sync only the last few weeks of mail and not everything. Even with only 2 Outlook Active Sync users there are four sogod processes using more than 1 GB of memory: top - 15:15:28 up 1:39, 2 users, load average: 0.96, 1.04, 1.20 Tasks: 317 total, 3 running, 314 sleeping, 0 stopped, 0 zombie %Cpu(s): 7.6 us, 15.2 sy, 0.0 ni, 75.2 id, 1.9 wa, 0.0 hi, 0.0 si, 0.1 st KiB Mem: 27431536 total, 27272844 used, 158692 free, 14188 buffers KiB Swap: 1046524 total, 441524 used, 605000 free. 2637840 cached Mem PID USER PR NIVIRTRESSHR S %CPU %MEM TIME+ COMMAND 4837 sogo 20 0 11.629g 9.267g 9976 R 57.8 35.4 5:48.16 sogod 6350 sogo 20 0 7885520 5.797g 3748 S 9.0 22.2 4:48.54 sogod 6700 sogo 20 0 6129028 4.535g 21888 R 100.0 17.3 2:38.61 sogod 6348 sogo 20 0 3712224 2.567g 3820 S 8.0 9.8 1:28.07 sogod 1854 sogo 20 0 436792 82700 2040 S 0.0 0.3 0:01.95 sogod 1786 sogo 20 0 389036 56828 3464 S 0.0 0.2 0:01.16 sogod 1789 sogo 20 0 382412 52232 4132 S 0.0 0.2 0:01.15 sogod 4313 sogo 20 0 382044 48380 3548 S 0.0 0.2 0:02.24 sogod 5659 sogo 20 0 380736 50240 2376 S 0.0 0.2 0:00.92 sogod 1799 sogo 20 0 380520 52476 4152 S 0.0 0.2 0:05.36 sogod 1800 sogo 20 0 380112 52136 4360 S 0.3 0.2 0:03.12 sogod [ ... ] When the kernel runs out of memory, sogod processes get killed: root@sogo:/var/log# grep memory syslog|tail -n 20 Nov 4 13:36:23 sogo kernel: [0.016680] Initializing cgroup subsys memory Nov 4 13:36:23 sogo kernel: [0.208078] Freeing initrd memory: 50924K (880002404000 - 8800055bf000) Nov 4 13:36:23 sogo kernel: [0.208688] Scanning for low memory corruption every 60 seconds Nov 4 13:36:23 sogo kernel: [1.319371] Freeing unused kernel memory: 1336K (81d2 - 81e6e000) Nov 4 13:36:23 sogo kernel: [1.322504] Freeing unused kernel memory: 784K (88000173c000 - 88000180) Nov 4 13:36:23 sogo kernel: [1.322805] Freeing unused kernel memory: 680K (880001b56000 - 880001c0) Nov 4 14:08:08 sogo kernel: [ 1908.886756] [] out_of_memory+0x414/0x450 Nov 4 14:08:08 sogo kernel: [ 1908.887156] Out of memory: Kill process 1867 (sogod) score 292 or sacrifice child Nov 4 14:17:09 sogo kernel: [ 2448.420769] [] out_of_memory+0x414/0x450 Nov 4 14:17:09 sogo kernel: [ 2448.421149] Out of memory: Kill process 1875 (sogod) score 389 or sacrifice child Nov 4 14:25:45 sogo kernel: [ 2965.605540] [] out_of_memory+0x414/0x450 Nov 4 14:25:45 sogo kernel: [ 2965.605978] Out of memory: Kill process 1783 (sogod) score 384 or sacrifice child Nov 4 14:41:22 sogo kernel: [ 3899.622133] [] out_of_memory+0x414/0x450 Nov 4 14:41:22 sogo kernel: [ 3899.622584] Out of memory: Kill process 1806 (sogod) score 344 or sacrifice child Nov 4 14:49:08 sogo kernel: [ 4367.114391] [] out_of_memory+0x414/0x450 Nov 4 14:49:08 sogo kernel: [ 4367.114815] Out of memory: Kill process 1787 (sogod) score 373 or sacrifice child Nov 4 15:01:02 sogo kernel: [ 5082.782386] [] out_of_memory+0x414/0x450 Nov 4 15:01:02 sogo kernel: [ 5082.782763] Out of memory: Kill process 1861 (sogod) score 404 or sacrifice child Nov 4 15:09:19 sogo kernel: [ 5579.656254] [] out_of_memory+0x414/0x450 Nov 4 15:09:19 sogo kernel: [ 5579.656905] Out of memory: Kill process 1781 (sogod) score 376 or sacrifice child Does anybody know how to configure sogo that Active Sync with Outlook 2013 works with large mailboxes (small mailboxes work)? sogo 2.3.2, cyrus 2.4.17 on Ubuntu 14.04 Thank you. -- Mit freundlichem Gruß i. A. Hubert Gilch Systemadministrator SEP Logistik AG Ziegelstr. 2 D-83629 Weyarn Tel.: +49 8020 905-214 Fax: +49 8020 905-100 Email: h...@sepag.de <mailto:h...@sepag.de> Web: www.sepag.de <http://www.sepag.de/> Sitz der Gesellschaft: Weyarn Rechtsform: Aktiengesellschaft Amtsgericht München: HRB 119679 Vorstand: Professor Dr.-Ing. Franz Demmelmeier (Vorsitzender), Dipl.-Ing. Konrad Schneider, MBA, Dipl.-Ing. Markus Fischbacher Aufsichtsratsvorsitzender Michael Pelzer -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] Samba 4 missing on ZEG 2.0.0rc1
Hello Wolfgang, i installed the virtual appliance ZEG 2.0.0rc1 to test outlook integration. Unfortunately, i found that samba 4 is missing although the download page says that it is integrated in ZEG. Is this an error or did i miss something? thanks, Hubert What makes you think it is missing? provision is not in PATH, then i did a find / -name smbd, which found nothing :-( If you do a dpkg -l samba4, it should appear in the resulting list Yes now i see. This is my very first contact with samba4, so i didn't know there is no smbd. With dpkg -L i think i found all i need. Thank you. Hubert -- users@sogo.nu https://inverse.ca/sogo/lists