Re: Re: [SOGo] samba dies with outlook 2012 [and 2010]
Hi, the error got fixed for me but now I have a different one: Feb 21 10:13:23 samba [3546]: MAPIStoreMailMessage:0x209d7a0:(null) METHOD '-[MAPIStoreMessage init]' (142) (34199456) 2013-02-21 10:13:23.106 samba[3546] returning wrapper: 0x2331b70; object: 0x209d7a0 2013-02-21 10:13:23.180 samba[3546] returning wrapper: 0x2ddeb90; object: 0x1ee1b70 2013-02-21 10:13:23.194 samba[3546] returning wrapper: 0x30f35d0; object: 0x24f9bf0 [2013/02/21 10:13:23, 0] mapiproxy/servers/default/emsmdb/dcesrv_exchange_emsmdb.c:682(EcDoRpc_process_transaction) MAPI Rop: 0x07 (1024) Feb 21 10:13:23 samba [3546]: [WARN] MAPIStoreMailMessage:0x209d7a0:2003.eml attempting to get predecessor change list by synchronising folder... /usr/sbin/samba: Uncaught exception NSInvalidArgumentException, reason: Tried to add nil value for key '' to dictionary Best, Sven -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] samba dies with outlook 2012 [and 2010]
Hello, Hopefully the issues pretty much all of you were having (regarding crashes or excessive slowdowns with large mailboxes) with Outlook will be gone now. Please test the upcoming nightly builds. Thanks, -- Ludovic Marcotte +1.514.755.3630 :: www.inverse.ca Inverse inc. :: Leaders behind SOGo (www.sogo.nu) and PacketFence (www.packetfence.org) -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] samba dies with outlook 2012 [and 2010]
On 11/02/13 08:53, Gerhard W. Recher (privat) wrote: any chance to shed some ligth on this without invoking debugger ? No. -- Ludovic Marcotte +1.514.755.3630 :: www.inverse.ca Inverse inc. :: Leaders behind SOGo (www.sogo.nu) and PacketFence (www.packetfence.org) -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] samba dies with outlook 2012 [and 2010]
Am 11.02.2013 14:58, schrieb Ludovic Marcotte: On 11/02/13 08:53, Gerhard W. Recher (privat) wrote: any chance to shed some ligth on this without invoking debugger ? No. so shall i debug sugod or samba ? -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] samba dies with outlook 2012 [and 2010]
On 11/02/13 09:18, Gerhard W. Recher (privat) wrote: so shall i debug sugod or samba ? samba - see the debugging instructions I posted a few days ago. Thanks! -- Ludovic Marcotte +1.514.755.3630 :: www.inverse.ca Inverse inc. :: Leaders behind SOGo (www.sogo.nu) and PacketFence (www.packetfence.org) -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] samba dies with outlook 2012 [and 2010]
Am 11.02.2013 14:58, schrieb Ludovic Marcotte: On 11/02/13 08:53, Gerhard W. Recher (privat) wrote: any chance to shed some ligth on this without invoking debugger ? No. no luck to get this work I installed dbg packes according to your faq... http://www.sogo.nu/english/nc/support/faq/article/how-do-i-debug-sogo.html i use these sources: cat /etc/apt/sources.list # deb http://ftp-stud.hs-esslingen.de/debian/ squeeze main non-free contrib deb-src http://ftp-stud.hs-esslingen.de/debian/ squeeze main non-free contrib deb http://security.debian.org/ squeeze/updates main non-free contrib deb-src http://security.debian.org/ squeeze/updates main non-free contrib deb http://packages.dotdeb.org squeeze all deb-src http://packages.dotdeb.org squeeze all deb http://packages.dotdeb.org squeeze-php54 all deb-src http://packages.dotdeb.org squeeze-php54 all # squeeze-updates, previously known as 'volatile' deb http://ftp-stud.hs-esslingen.de/debian/ squeeze-updates main contrib non-free deb-src http://ftp-stud.hs-esslingen.de/debian/ squeeze-updates main contrib non-free #ogo deb http://xi.rename-it.nl/debian/ stable-auto/dovecot-2.1 main deb http://inverse.ca/debian-nightly squeeze squeeze deb http://backports.debian.org/debian-backports squeeze-backports main result of debugger: su sogo sogo@sogo:/root$ gdb --args /usr/sbin/sogod -WOUseWatchDog NO -WONoDetach YES -WOPort 2 -WOWorkersCount 1 -WOLogFile - -WOPidFile /tmp/sogo.pid GNU gdb (GDB) 7.0.1-debian Copyright (C) 2009 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later http://gnu.org/licenses/gpl.html This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type show copying and show warranty for details. This GDB was configured as x86_64-linux-gnu. For bug reporting instructions, please see: http://www.gnu.org/software/gdb/bugs/... warning: The current binary is a PIE (Position Independent Executable), which GDB does NOT currently support. Most debugger features will fail if used in this session. Reading symbols from /usr/sbin/sogod...Reading symbols from /usr/lib/debug/usr/sbin/sogod...done. (no debugging symbols found)...done. (gdb) c The program is not being run. (gdb) quit dpkg --list sogo* ||/ Name Version Beschreibung +++-==-==- ii sogo 2.0.0.20130211-1 a modern and scalable groupware ii sogo-dbg 2.0.0.20130211-1 a modern and scalable groupware - debugging symbols ii sogo-openchange2.0.0.20130211-1 a modern and scalable groupware - OpenChange backend -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] samba dies with outlook 2012 [and 2010]
Am 11.02.2013 15:18, schrieb Ludovic Marcotte: On 11/02/13 09:18, Gerhard W. Recher (privat) wrote: so shall i debug sugod or samba ? samba - see the debugging instructions I posted a few days ago. Thanks! I see no debug package for samba4 apt-cache search samba4 libsamba-hostconfig-dev - Samba host configuration library - development files libsamba-hostconfig0 - Samba host configuration library samba4 - SMB/CIFS file, NT domain and active directory server (version 4) samba4-clients - client utilities from Samba 4 samba4-common-bin - Samba 4 common files used by both the server and the client samba4-dev - tools for extending Samba samba4-testsuite - test suite from Samba 4 root@sogo:~# -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] samba dies with outlook 2012 [and 2010]
On 05/02/13 17:17, Ludovic Marcotte wrote: I'll write tomorrow morning a small FAQ entry on how to debug this. Please read carefully this FAQ entry: http://www.sogo.nu/english/nc/support/faq/article/how-do-i-debug-sogo.html -- Ludovic Marcotte +1.514.755.3630 :: www.inverse.ca Inverse inc. :: Leaders behind SOGo (www.sogo.nu) and PacketFence (www.packetfence.org) -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] samba dies with outlook 2012 [and 2010]
Il 29/01/2013 19:14, Ludovic Marcotte ha scritto: On 29/01/13 09:54, Marco Coli wrote: /usr/sbin/samba: Uncaught exception NSInvalidArgumentException, reason: Tried to add nil to array Install the SOGo/SOPE/GNUstep debugging packages, run samba inside gdb using a single process, set a breakpoint on 'raise' and produce a nice looking stacktrace. Sorry for late answer. Unfortunately I have very little time in this month. I finally manage to solve the problem. I discovered that there was an authentication problem for that user in the cyrus imapd service. The openchange message Uncaught exception NSInvalidArgumentException, reason: Tried to add nil to array was not helping in finding the real problem, but the cyrus log was. My fault. Anyway, I found a litte dangerous that in situations like that one, samba dies, leaving the whole AD infrastracture upside-down. Now I am testing, before to go to production, the environment, and I did find that is quite easy to create a problem in openchange and cause samba to die. For example, a few minute ago I create a new user, create an outlook profile, all ok. then 1) I create a new folder Test in web 2) Sync outlook, Test appears as expeceted 3) Create a Subfolder of Test, named Test1 via web 4) Sync outlook, no test1 appears. The same closing and restarting 5) play a litte moving one message back and forth via web from test an test1. No change in Outlook (i see the message when in test, not being able to see test1) 6) create a new subfolder ot test, named test2, in outlook. 7) after first sync, outlook crashes and samba panic. In 5 minute I created a system crisis! I had to close outlook, clean the oc user, restart samba, and recreate local outlook profile The main problem, for me of course, is that a problem with a user paralizes the whole infrastracture. -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] samba dies with outlook 2012 [and 2010]
On 05.02.2013 14:20, Marco Coli wrote: The main problem, for me of course, is that a problem with a user paralizes the whole infrastracture. I agree ... it would be nice if errors wouldn't so easily lead to termination of the entire domain controller. Unfortunately, my experiments with Outlook 2010 aren't really promsing either. The nice folks at inverse have upated their packages to sama 4.0.1 and openchange 2.0 - and the good news is that quite a few bugs seem to have been fixed. The bad news is, all that means in my test case is that it takes a few seconds longer to crash, and it now does so in a different context :) I completely removed the profiles and re-added the user (both server and client side) but samba still goes belly up whenever I even get close to anything calendar or contact related in Outlook. I'd love to help debug these conditions ... but I have no clue where to start, or what kind of information people here would need to even make an educated guess ... -- Mit freundlichen Grüßen Sven Tegethoff EDV-Team _ UDO BÄR GmbH Co. KG Fürstenstraße 18 47051 Duisburg Tel.: +49 (0) 203 28117-142 Fax: +49 (0) 203 28117-151 E-Mail: tegeth...@udobaer.de Ust.-Idnr.: DE119562189, HRA 6056, Sitz der Gesellschaft: Duisburg, Gerichtsstand: Duisburg Geschäftsführer: Bodo Badnowitz, Jürgen Dietz Ein Unternehmen der BTI Gruppe: www.bti-group.com Diese E-Mail enthält vertrauliche und/oder rechtlich geschützte Informationen. Wenn Sie nicht der richtige Adressat sind oder diese E-Mail irrtümlich erhalten haben, informieren Sie bitte sofort den Absender und vernichten Sie diese E-Mail. Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser E-Mail ist nicht gestattet. This e-mail may contain confidential and/or privileged information. If you are not the intended recipient (or have received this e-mail in error) please notify the sender immediately and destroy this e-mail. Any unauthorized copying, disclosure or distribution of the material in this e-mail is strictly forbidden. -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] samba dies with outlook 2012 [and 2010]
Il 05/02/2013 15:12, Sven Tegethoff ha scritto:
Unfortunately, my experiments with Outlook 2010 aren't really promsing
either. The nice folks at inverse have upated their packages to sama
4.0.1 and openchange 2.0 - and the good news is that quite a few bugs
seem to have been fixed. The bad news is, all that means in my test
case is that it takes a few seconds longer to crash, and it now does
so in a different context :)
Sorry to add bad news, but my tests continue and the results are very
sad...
Trying to move a bunch of mail from existing pop account to new
openchange one cause other panics after some messages:
Feb 05 15:35:37 samba [2462]:
MAPIStoreMailVolatileMessage:0x1e40c48:99E-5880-5B-6A3E9F00 METHOD
'-[MAPIStoreMessage saveMessage]' (493)
2013-02-05 15:35:37.627 samba[2462] NGMimeMultipartBodyGenerator.m:237
Assertion failed in NGMimeMessageMultipartBodyGenerator(instance),
method generateBodyOfPart:additionalHeaders:delegate:.
NGMimeMultipartBodyGenerator expect a NGMimeMultipartBody as body of part
part: NGMimeBodyPart[0x0x168a628]: header={content-disposition =
attachment; content-type = multipart/signed; }
bodyClass=NSDataMalloc body[len=678370]
/usr/sbin/samba: Uncaught exception NSInternalInconsistencyException,
reason: NGMimeMultipartBodyGenerator.m:237 Assertion failed in
NGMimeMessageMultipartBodyGenerator(instance), method
generateBodyOfPart:additionalHeaders:delegate:.
NGMimeMultipartBodyGenerator expect a NGMimeMultipartBody as body of part
part: NGMimeBodyPart[0x0x168a628]: header={content-disposition =
attachment; content-type = multipart/signed; }
bodyClass=NSDataMalloc body[len=678370]
[2013/02/05 15:35:37, 0] ../lib/util/fault.c:72(fault_report)
===
[2013/02/05 15:35:37, 0] ../lib/util/fault.c:73(fault_report)
INTERNAL ERROR: Signal 6 in pid 2462 (4.0.1-4.centos6.1)
Please read the Trouble-Shooting section of the Samba HOWTO
[2013/02/05 15:35:37, 0] ../lib/util/fault.c:75(fault_report)
===
[2013/02/05 15:35:37, 0] ../lib/util/fault.c:144(smb_panic_default)
PANIC: internal error
--
users@sogo.nu
https://inverse.ca/sogo/lists
Re: [SOGo] samba dies with outlook 2012 [and 2010]
On 05/02/13 10:15, Marco Coli wrote: Sorry to add bad news, but my tests continue and the results are very sad... Trying to move a bunch of mail from existing pop account to new openchange one cause other panics after some messages: These mails would likely break in SOGo itself too (the webmail interface). Identify them and file a bug report for them. -- Ludovic Marcotte +1.514.755.3630 :: www.inverse.ca Inverse inc. :: Leaders behind SOGo (www.sogo.nu) and PacketFence (www.packetfence.org) -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] samba dies with outlook 2012 [and 2010]
On Tue, 2013-02-05 at 14:20 +0100, Marco Coli wrote: Sorry for late answer. Unfortunately I have very little time in this month. I finally manage to solve the problem. I discovered that there was an authentication problem for that user in the cyrus imapd service. The openchange message Uncaught exception NSInvalidArgumentException, reason: Tried to add nil to array was not helping in finding the real problem, but the cyrus log was. My fault. Hi Marco, I understand it is currently difficult for final users like you to figure out where one's problem lies within the OpenChange/SOGo stack and looks reasonable to take the shortest path for blaming. In the end it doesn't really matter OpenChange is not at fault here because the visible result for you is Samba dying and your AD getting down. It makes everyone nervous and we both agree that is not acceptable when running in production. This is not a dead end and that can be improved quickly. See below. Anyway, I found a litte dangerous that in situations like that one, samba dies, leaving the whole AD infrastracture upside-down. I agree with you. Initially the abort() cases - that causes samba to die on purpose - were restricted to a very limited set of cases and situations that should not or could not happen. This was used as a safety guard when we reached leaves of the graph. We almost never reach these cases anymore. This model however got extended to less critical paths for development convenience but introduced the side effects you unfortunately experienced. We can fix this easily: 1. chase the abort() used in non critical paths and remove/replace them with termination or error code + add more logging. 2. Rework the logging so you can identify where the problem initially lies and helps reporting issues in a way that is relevant both for you and OpenChange/SOGo. In this case, one's feature may not be working but that won't impact the overall system and still provide a way to find the cause. Now I am testing, before to go to production, the environment, and I did find that is quite easy to create a problem in openchange and cause samba to die. For example, a few minute ago I create a new user, create an outlook profile, all ok. then 1) I create a new folder Test in web 2) Sync outlook, Test appears as expeceted 3) Create a Subfolder of Test, named Test1 via web 4) Sync outlook, no test1 appears. The same closing and restarting 4) is a known issue for quite some time. OpenChange has the infrastructure to fix this bug but SOGo wasn't using it yet. This is something afaik they are working on this for next release. This being said - and from my experience - I'm doubtful on the relevance of tests mixing Outlook and web interface. I don't argue on the path to abort() that needs to be less pedantic - we agreed on this - but generally users either use Outlook or web interface, not both at the same time. Kind Regards, Julien. -- Julien Kerihuel j.kerih...@openchange.org OpenChange Project Founder Twitter: http://www.twitter.com/jkerihuel GPG Fingerprint: 0B55 783D A781 6329 108A B609 7EF6 FE11 A35F 1F79 -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] samba dies with outlook 2012 [and 2010]
On Tue, 2013-02-05 at 15:12 +0100, Sven Tegethoff wrote: I completely removed the profiles and re-added the user (both server and client side) but samba still goes belly up whenever I even get close to anything calendar or contact related in Outlook. I'd love to help debug these conditions ... but I have no clue where to start, or what kind of information people here would need to even make an educated guess ... Quick pointer that *may help* solving the problem: Did you clean up socfs table for the user within the postgresql/mysql database? Your help would be appreciated here to figure out whether remaining/old data set is at fault or if it's reproducible. Kind Regards, Julien. -- Julien Kerihuel j.kerih...@openchange.org OpenChange Project Founder Twitter: http://www.twitter.com/jkerihuel GPG Fingerprint: 0B55 783D A781 6329 108A B609 7EF6 FE11 A35F 1F79 -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] samba dies with outlook 2012 [and 2010]
Il 05/02/2013 16:23, Ludovic Marcotte ha scritto: On 05/02/13 10:15, Marco Coli wrote: Sorry to add bad news, but my tests continue and the results are very sad... Trying to move a bunch of mail from existing pop account to new openchange one cause other panics after some messages: These mails would likely break in SOGo itself too (the webmail interface). Identify them and file a bug report for them. I can assure you is not the case. I eventually deleted the openchange account on the outlook client, I did an imap account pointing to the same server, and I transfered all mails (a few thousands, in some folders) to the server in a fraction of time I was experimenting with the oc mapi account. Now I have the mail visible in sogo (web) as well, as expected. -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] samba dies with outlook 2012 [and 2010]
Thank you for your answer. Please remind my critics are intented for a better product. Il 05/02/2013 16:28, Julien Kerihuel ha scritto: Initially the abort() cases - that causes samba to die on purpose - were restricted to a very limited set of cases and situations that should not or could not happen. This was used as a safety guard when we reached leaves of the graph. We almost never reach these cases anymore. This model however got extended to less critical paths for development convenience but introduced the side effects you unfortunately experienced. We can fix this easily: 1. chase the abort() used in non critical paths and remove/replace them with termination or error code + add more logging. 2. Rework the logging so you can identify where the problem initially lies and helps reporting issues in a way that is relevant both for you and OpenChange/SOGo. In this case, one's feature may not be working but that won't impact the overall system and still provide a way to find the cause. Ok, I am looking forward to see these changes. Strange, however, you did not reach cases like mine, I did find them continously. Unfortunately, the Sogo/OC project at this company has been stopped beacuse of these dead ends. For now we will use imap/sogoweb/mobiles. For the time being, we will try some caldav/carddav extensions to outlook ($), I will propose to switch to thunderbird. But I really look forward to see improvements in OpenChange, in the future I will certainly need this. I do not blame anyone but me. I should have tested better the environment, but time was limited, and I had faith in sogo, provided several previous success story I implemented in different companies (from 10 to 40/50 clients with sogo/mobile/thunderbird/funanmbol), but this was the first one with outlook mapi integration. 4) is a known issue for quite some time. OpenChange has the infrastructure to fix this bug but SOGo wasn't using it yet. This is something afaik they are working on this for next release. This being said - and from my experience - I'm doubtful on the relevance of tests mixing Outlook and web interface. I don't argue on the path to abort() that needs to be less pedantic - we agreed on this - but generally users either use Outlook or web interface, not both at the same time. Kind Regards, Julien. I disagree. I have a lot of people in this company which use Outlook at work, web at home or outside the company, mobile, and they expect to create folders and manipulate their data wherever they can reach them. I did not know there was this issue. Is that documented, and I did miss it? Thank you for your efforts, I will continue to follow, as a user and a consultant, the project of openchange, and I will report my on-the-field experience (this time only in testing environment!!) -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] samba dies with outlook 2012 [and 2010]
Il 05/02/2013 16:56, Julien Kerihuel ha scritto: Quick pointer that *may help* solving the problem: Did you clean up socfs table for the user within the postgresql/mysql database? Oh, yes I did! Everytime I repeated all cleaning steps with attention. (my db is postgres) -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] samba dies with outlook 2012 [and 2010]
Hi Marco I have same problems here and i posted several times but got no answer so far .. fresh install of all stuff, clean xp client with outlook 2012 outlook with imp to sogo no problem outlook to oc sync is very slow and produce a die of samba after aprox 20.000 Mails out of 70.000 of a particular account. all mails are fine in sogo web interface or in imap client. I'm also stuck in my project for a patent atorny It would be much help if someone can say how to debug this and which stuff to report back to this list. -- Gerhard Her my squeeze 64 bit virtuall maschine: dpkg --list samba4* ||/ Name Version Beschreibung +++-==-==- ii samba4 4.0.1+dfsg1-1 SMB/CIFS file, NT domain and active directory server (version 4) un samba4-clients keine(keine Beschreibung vorhanden) un samba4-common keine(keine Beschreibung vorhanden) ii samba4-common-bin 4.0.1+dfsg1-1 Samba 4 common files used by both the server and the client root@sogo:~# dpkg --list sogo* ||/ Name Version Beschreibung +++-==-==- ii sogo 2.0.0.20130205-1 a modern and scalable groupware ii sogo-openchange2.0.0.20130205-1 a modern and scalable groupware - OpenChange backend root@sogo:~# dpkg --list dov* ||/ Name Version Beschreibung +++-==-==- un dovecotkeine(keine Beschreibung vorhanden) rc dovecot-common 1:1.2.15-7 secure mail server that supports mbox and maildir mailboxes ii dovecot-core 2:2.1.14-0~auto+5 secure mail server that supports mbox, maildir, dbox and mdbox mailboxes un dovecot-gssapi keine(keine Beschreibung vorhanden) ii dovecot-imapd 2:2.1.14-0~auto+5 secure IMAP server that supports mbox, maildir, dbox and mdbox mailboxes rc dovecot-ldap 2:2.1.10-0~auto+45 LDAP support for Dovecot un dovecot-lmtpd keine(keine Beschreibung vorhanden) ii dovecot-managesieved 2:2.1.14-0~auto+5 secure ManageSieve server for Dovecot ii dovecot-mysql 2:2.1.14-0~auto+5 MySQL support for Dovecot un dovecot-pgsql keine(keine Beschreibung vorhanden) ii dovecot-pop3d 2:2.1.14-0~auto+5 secure POP3 server that supports mbox, maildir, dbox and mdbox mailboxes ii dovecot-sieve 2:2.1.14-0~auto+5 sieve filters support for Dovecot un dovecot-solr keine(keine Beschreibung vorhanden) un dovecot-sqlite keine(keine Beschreibung vorhanden) root@sogo:~# dpkg --list opencha* ||/ Name Version Beschreibung +++-==-==- ii openchange-ocsmanager 1:2.0.r3641-1~inverse1.0 Working instance of python-ocsmanager ii openchange-rpcproxy1:2.0.r3641-1~inverse1.0 A RPC-over-HTTP implementation for Samba, using wsgi ii openchangeproxy1:2.0.r3641-1~inverse1.0 Experimental MAPI (Exchange/Outlook) proxy ii openchangeserver 1:2.0.r3641-1~inverse1.0 Experimental MAPI (Exchange/Outlook) server root@sogo:~# dpkg --list samba* Gewünscht=Unbekannt/Installieren/R=Entfernen/P=Vollständig Löschen/Halten | Status=Nicht/Installiert/Config/U=Entpackt/halb konFiguriert/ Halb installiert/Trigger erWartet/Trigger anhängig |/ Fehler?=(kein)/R=Neuinstallation notwendig (Status, Fehler: GROSS=schlecht) ||/ Name Version Beschreibung +++-==-==- un samba keine(keine Beschreibung vorhanden) un samba-client keine(keine Beschreibung vorhanden) ii samba-common 2:3.6.6-5~bpo60+1
Re: [SOGo] samba dies with outlook 2012 [and 2010]
On 05/02/13 14:03, Gerhard W. Recher (privat) wrote: outlook to oc sync is very slow and produce a die of samba after aprox 20.000 Mails out of 70.000 of a particular account. I'll write tomorrow morning a small FAQ entry on how to debug this. That way, people having issues syncing emails with Outlook (or other issues with SOGo in general) will be able to provide us relevant data. It looks like it is sensitive to some mails. -- Ludovic Marcotte +1.514.755.3630 :: www.inverse.ca Inverse inc. :: Leaders behind SOGo (www.sogo.nu) and PacketFence (www.packetfence.org) -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] samba dies with outlook 2012 [and 2010]
Il 29/01/2013 19:14, Ludovic Marcotte ha scritto: On 29/01/13 09:54, Marco Coli wrote: /usr/sbin/samba: Uncaught exception NSInvalidArgumentException, reason: Tried to add nil to array Install the SOGo/SOPE/GNUstep debugging packages, run samba inside gdb using a single process, set a breakpoint on 'raise' and produce a nice looking stacktrace. Ok, I'll provide this data asap -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] samba dies with outlook 2012 [and 2010]
Il 25/01/2013 19:59, Marco Coli ha scritto: Il 25/01/2013 14:12, Julien Kerihuel ha scritto: In your case, you need to: 1. use a recent build. This has been fixed long ago in git repositories and builds based on samba4 beta5 have been deprecated a while ago. 2. After updating, use the openchange_cleanup.sh script available in SOGo 2. remove your Outlook profile 3. rerun samba4 Thank you Julien for your detailed and precious indications. Using nightly builds, which means: samba4-4.0.1-4.centos6.1.x86_64 sogo-openchange-backend-2.0_20130124-1.centos6.x86_64 openchange-rpcproxy-1.0.0.20130123.sogo-1.centos6.x86_64 openchange-ocsmanager-1.0.0.20130123.sogo-1.centos6.x86_64 openchange-1.0.0.20130123.sogo-1.centos6.x86_64 and after cleaning, finally no more samba panic! I am very, very happy, I had to install the system with 40+ clients, and I was quite sure to quit the project because of the outlook/openchange problems. So, we can say that the combination of samba/openchange distributed on redhat/CentOS stable repository of sogo is broken. Today I am in production and I am again with the Panic problem!!! [2013/01/29 15:48:18, 0] MAPIStoreSOGo.m:154(sogo_backend_create_context) [SOGo: sogo_backend_create_context:154] 2013-01-29 15:48:18.418 samba[6466] METHOD '+[MAPIStoreContext openContext:withURI:connectionInfo:andTDBIndexing:]' (227) -- uri: 'utente2:utente2@outbox/folderDrafts/' 2013-01-29 15:48:18.418 samba[6466] returning wrapper: 0x4231340; object: 0x2c42e78 2013-01-29 15:48:18.419 samba[6466] returning wrapper: 0x42bf9d0; object: 0x1f37978 /usr/sbin/samba: Uncaught exception NSInvalidArgumentException, reason: Tried to add nil to array Those are packages installed: [root@mail private]# rpm -qa|grep openchange openchange-ocsmanager-2.0.r3641.sogo-1.centos6.x86_64 openchange-2.0.r3641.sogo-1.centos6.x86_64 openchange-rpcproxy-2.0.r3641.sogo-1.centos6.x86_64 sogo-openchange-backend-2.0_20130129-1.centos6.x86_64 [root@mail private]# rpm -qa|grep sogo openchange-ocsmanager-2.0.r3641.sogo-1.centos6.x86_64 sogo-slapd-sockd-2.0_20130129-1.centos6.x86_64 openchange-2.0.r3641.sogo-1.centos6.x86_64 sogo-2.0_20130129-1.centos6.x86_64 sogo-tool-2.0_20130129-1.centos6.x86_64 openchange-rpcproxy-2.0.r3641.sogo-1.centos6.x86_64 sogo-openchange-backend-2.0_20130129-1.centos6.x86_64 sogo-ealarms-notify-2.0_20130129-1.centos6.x86_64 [root@mail private]# rpm -qa|grep sope sope49-gdl1-4.9-20130129_1664.el6.1.x86_64 sope49-gdl1-postgresql-4.9-20130129_1664.el6.1.x86_64 sope49-sbjson-2.3.1-20130129_1664.el6.1.x86_64 sope49-xml-4.9-20130129_1664.el6.1.x86_64 sope49-ldap-4.9-20130129_1664.el6.1.x86_64 sope49-cards-2.0_20130129-1.centos6.x86_64 sope49-core-4.9-20130129_1664.el6.1.x86_64 sope49-mime-4.9-20130129_1664.el6.1.x86_64 sope49-appserver-4.9-20130129_1664.el6.1.x86_64 sope49-gdl1-contentstore-2.0_20130129-1.centos6.x86_64 samba4-4.0.1-4.centos6.1.x86_64 I tried to create a brand new user, ok via web and all other features, samba panic as soon as I send a mail. The mail appears in outlook sent not in imap sent. The only difference with the test machine I used before are: 1) New nigthly packages (are there bugs??) 2) realm now different intranet.name.local (instead of name.test like it was on test machine) I am stuck now... -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] samba dies with outlook 2012 [and 2010]
On 29/01/13 09:54, Marco Coli wrote: /usr/sbin/samba: Uncaught exception NSInvalidArgumentException, reason: Tried to add nil to array Install the SOGo/SOPE/GNUstep debugging packages, run samba inside gdb using a single process, set a breakpoint on 'raise' and produce a nice looking stacktrace. -- Ludovic Marcotte +1.514.755.3630 :: www.inverse.ca Inverse inc. :: Leaders behind SOGo (www.sogo.nu) and PacketFence (www.packetfence.org) -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] samba dies with outlook 2012 [and 2010]
Il 25/01/2013 20:23, Jean Raby ha scritto: On 13-01-25 1:59 PM, Marco Coli wrote: and after cleaning, finally no more samba panic! I am very, very happy, I had to install the system with 40+ clients, and I was quite sure to quit the project because of the outlook/openchange problems. So, we can say that the combination of samba/openchange distributed on redhat/CentOS stable repository of sogo is broken. this will change (real) soon I am very glad to read this. 3) I noticed that samba log is huge, it seems every tiny outlook event is logged with much detail, and now I am only experimenting with a client. I am worried about how many lines will be generated with 40 clients... I will have to buy a san storage only for /var partition! There is a way to reduce verbosity, when in production? What debug level are you using in smb.conf? Oh, I thought the responsible was openchange and not samba I am not sure if samba4 has the same directive of samba3 about log verbosity... I had no entry in smb.conf, I tried to add, in [global], debug level = 1, restarted samba, and now log seems more than before, but a lot of messages are blocks with no date/time information... I need to read log for a while to understand better... However, which debug level do you suggest? Thank you, have a nice day. -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] samba dies with outlook 2012 [and 2010]
Il 08/11/2012 17:20, Gerhard W. Recher (abuse) ha scritto: [2012/11/08 17:08:08, 0] MAPIStoreSOGo.m:153(sogo_backend_create_context) [SOGo: sogo_backend_create_context:153] 2012-11-08 17:08:08.644 samba[25720] METHOD '+[MAPIStoreContext openContext:withURI:connectionInfo:andTDBIndexing:]' (227) -- uri: 'gerhard:gerhard@outbox/folderINBOX.Drafts/' /usr/sbin/samba: Uncaught exception NSInvalidArgumentException, reason: Tried to add nil to array [2012/11/08 17:08:08, 0] mapiproxy/servers/default/nspi/dcesrv_exchange_nsp.c:1394(dcesrv_exchange_nsp_unbind) dcesrv_exchange_nsp_unbind any ideas ? -- Gerhard Hi, I have same problem, constantly and repeatedly happening when sending mail from Outlook 2010: 2013-01-24 11:01:12.081 samba[30491] METHOD '+[MAPIStoreContext openContext:withURI:connectionInfo:andTDBIndexing:]' (227) -- uri: 'test:test@outbox/folderDrafts/' 2013-01-24 11:01:12.081 samba[30491] returning wrapper: 0x35b8f60; object: 0x47d88f8 2013-01-24 11:01:12.082 samba[30491] returning wrapper: 0x4401a90; object: 0x2980668 /usr/sbin/samba: Uncaught exception NSInvalidArgumentException, reason: Tried to add nil to array [2013/01/24 11:01:12, 0] ../lib/util/fault.c:72(fault_report) === [2013/01/24 11:01:12, 0] ../lib/util/fault.c:73(fault_report) INTERNAL ERROR: Signal 6 in pid 30491 (4.0.0beta5-4.centos6.1) Please read the Trouble-Shooting section of the Samba HOWTO [2013/01/24 11:01:12, 0] ../lib/util/fault.c:75(fault_report) === [2013/01/24 11:01:12, 0] ../lib/util/fault.c:144(smb_panic_default) PANIC: internal error Similar when exploring calendar: [2013/01/25 09:47:03, 0] mapiproxy/servers/default/emsmdb/oxcfxics.c:2635(oxcfxics_check_cnset) inconsistency: idset range for 'cnset_seen' is referencing a change number that has not been issued yet: 1a0 = 7b ... and panic Server Platform: CentOS 6.3 All packages from sogo repository, so: samba4-4.0.0beta5-4.centos6.1.x86_64 sogo-2.0.3a-1.centos6.x86_64 openchange-1.0.0.20121206.sogo-1.centos6.x86_64 openchange-rpcproxy-1.0.0.20121206.sogo-1.centos6.x86_64 openchange-ocsmanager-1.0.0.20121206.sogo-1.centos6.x86_64 and so on sogo from web is ok, the problem is with outlook 2010, which panics samba4 The environment is in italian language, could this be an office localization problems? I tried everything, restart from scratch with a minimal install with nightly packages, all the same. I use cyrus-imad from years, never a problem, I installed several Sogo environments with thunderbird, no problem (the product is very weel documented), this is the first installation with outlook, but for me openchange/outlook is a living hell! Some ideas? Thank you. -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] samba dies with outlook 2012 [and 2010]
Hi Marco, Gerhard, On Fri, 2013-01-25 at 10:24 +0100, Marco Coli wrote: The environment is in italian language, could this be an office localization problems? No its not. I tried everything, restart from scratch with a minimal install with nightly packages, all the same. In your case, you need to: 1. use a recent build. This has been fixed long ago in git repositories and builds based on samba4 beta5 have been deprecated a while ago. 2. After updating, use the openchange_cleanup.sh script available in SOGo 2. remove your Outlook profile 3. rerun samba4 The cleanup script will wipe some postgresql tables SOGo uses for indexing. This does not have any incidence or impact on your existing data. Removing the outlook profile will get ride of the existing PST and initial indexing, preventing from conflict while indexing the data again. Your problem is unrelated to the Outlook version getting used. This being said, Outlook 2012 has not yet been included in our matrix of compatibility. For the past few weeks - and while preparing our next forthcoming release - we have been doing OpenChange dogfooding and have not experienced any crash or panic but one in SOGo backend which we've fixed. Hope it helps. Kind Regards, Julien. -- Julien Kerihuel j.kerih...@openchange.org OpenChange Project Founder GPG Fingerprint: 0B55 783D A781 6329 108A B609 7EF6 FE11 A35F 1F79 -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] samba dies with outlook 2012 [and 2010]
On 25.01.2013 10:24, Marco Coli wrote: I use cyrus-imad from years, never a problem, I installed several Sogo environments with thunderbird, no problem (the product is very weel documented), this is the first installation with outlook, but for me openchange/outlook is a living hell! Some ideas? Thank you. I can only second this. Openchange ist VERY unstable. I've not managed to get a stable connection with Outlook 2010 at all. I get so far that it lets me log in, starts synchinc the mailbox, but it always crashes after a few seconds, with something like this: Jan 22 12:40:17 samba [26787]: 0x0x2ca72e0[MAPIStoreFAIMessageTable] restriction set to EOQualifier: 1703967 'IPM.Configuration.' Jan 22 12:40:17 samba [26787]: 0x0x4a74550[EOKeyValueQualifier] evaluating object '0x03918600[SOGoMAPIDBObject]: name=5BC8-50A4B180-5-75ADEF00.plist container=0x025B8710/personal' Jan 22 12:40:17 samba [26787]: 0x0x4a74550[EOKeyValueQualifier] evaluation result: 1 Jan 22 12:40:17 samba [26787]: 0x0x4a74550[EOKeyValueQualifier] evaluating object '0x03338AC0[SOGoMAPIDBObject]: name=5BC8-50A4B180-9-75ADEF00.plist container=0x025B8710/personal' Jan 22 12:40:17 samba [26787]: 0x0x4a74550[EOKeyValueQualifier] evaluation result: 1 Jan 22 12:40:17 samba [26787]: 0x0x4a74550[EOKeyValueQualifier] evaluating object '0x03AE8DF0[SOGoMAPIDBObject]: name=5BC8-50A4B200-17-75ADEF00.plist container=0x025B8710/personal' Jan 22 12:40:17 samba [26787]: 0x0x4a74550[EOKeyValueQualifier] evaluation result: 1 Jan 22 12:40:17 samba [26787]: 0x0x4a74550[EOKeyValueQualifier] evaluating object '0x02E9CC70[SOGoMAPIDBObject]: name=5BC8-50A4B180-7-75ADEF00.plist container=0x025B8710/personal' Jan 22 12:40:17 samba [26787]: 0x0x4a74550[EOKeyValueQualifier] evaluation result: 1 Jan 22 12:40:17 samba [26787]: 0x0x4a74550[EOKeyValueQualifier] evaluating object '0x043145C0[SOGoMAPIDBObject]: name=4AD5-50B89580-B-F247C40.plist container=0x025B8710/personal' Jan 22 12:40:17 samba [26787]: 0x0x4a74550[EOKeyValueQualifier] evaluation result: 1 Jan 22 12:40:17 samba [26787]: MAPIStoreFAIMessage:0x34537e0:(null) METHOD '-[MAPIStoreMessage init]' (142) (54867936) Jan 22 12:40:17 samba [26787]: MAPIStoreFAIMessage:0x34537e0:5BC8-50A4B180-5-75ADEF00.plist METHOD '-[MAPIStoreMessage dealloc]' (156) (54867936) Jan 22 12:40:17 samba [26787]: 0x0x2ca72e0[MAPIStoreFAIMessageTable] restriction unset (was 1703967 'IPM.Configuration.') [2013/01/22 12:40:17, 0] mapiproxy/servers/default/nspi/dcesrv_exchange_nsp.c:1278(dcesrv_exchange_nsp_dispatch) dcesrv_exchange_nsp_dispatch [2013/01/22 12:40:17, 0] ../lib/util/util.c:455(dump_data) [] 87 00 00 00 86 BE D4 E3 B4 A5 3C 42 92 B9 77 BF ..B..w. [0010] 7F 4D 9C 41 01 00 00 00 00 00 00 00 02 50 00 00 .M.A .P.. [2013/01/22 12:40:17, 0] ../lib/util/util.c:455(dump_data) [] 02 50 00 00 .P.. [2013/01/22 12:40:17, 0] ../lib/util/util.c:455(dump_data) [] 87 00 00 00 86 BE D4 E3 B4 A5 3C 42 92 B9 77 BF ..B..w. [0010] 7F 4D 9C 41 01 00 00 00 00 00 00 00 03 50 00 00 .M.A .P.. [2013/01/22 12:40:17, 0] ../lib/util/util.c:455(dump_data) [] 03 50 00 00 .P.. [2013/01/22 12:40:17, 0] ../lib/util/util.c:455(dump_data) [] 87 00 00 00 86 BE D4 E3 B4 A5 3C 42 92 B9 77 BF ..B..w. [0010] 7F 4D 9C 41 01 00 00 00 00 00 00 00 01 50 00 00 .M.A .P.. [2013/01/22 12:40:17, 0] ../lib/util/util.c:455(dump_data) [] 01 50 00 00 .P.. [2013/01/22 12:40:17, 0] ../lib/util/util.c:455(dump_data) [] 87 00 00 00 86 BE D4 E3 B4 A5 3C 42 92 B9 77 BF ..B..w. [0010] 7F 4D 9C 41 01 00 00 00 00 00 00 00 04 50 00 00 .M.A .P.. [2013/01/22 12:40:17, 0] ../lib/util/util.c:455(dump_data) [] 04 50 00 00 .P.. [2013/01/22 12:40:17, 0] mapiproxy/servers/default/nspi/dcesrv_exchange_nsp.c:1278(dcesrv_exchange_nsp_dispatch) dcesrv_exchange_nsp_dispatch [2013/01/22 12:40:17, 0] ../lib/util/fault.c:72(fault_report) === [2013/01/22 12:40:17, 0] ../lib/util/fault.c:73(fault_report) INTERNAL ERROR: Signal 11 in pid 26787 (4.0.0beta5) Please read the Trouble-Shooting section of the Samba HOWTO [2013/01/22 12:40:17, 0] ../lib/util/fault.c:75(fault_report) === This happens even with an empty mailbox. I have no idea what to do. I've essentially shelved the project for the time being. -- Mit freundlichen Grüßen Sven Tegethoff EDV-Team _ UDO BÄR GmbH Co. KG Fürstenstraße 18 47051 Duisburg Tel.: +49 (0) 203 28117-142 Fax: +49 (0) 203 28117-151 E-Mail: tegeth...@udobaer.de Ust.-Idnr.: DE119562189, HRA 6056, Sitz der Gesellschaft:
Re: [SOGo] samba dies with outlook 2012 [and 2010]
On Fri, 2013-01-25 at 14:14 +0100, Sven Tegethoff wrote: On 25.01.2013 10:24, Marco Coli wrote: I use cyrus-imad from years, never a problem, I installed several Sogo environments with thunderbird, no problem (the product is very weel documented), this is the first installation with outlook, but for me openchange/outlook is a living hell! Some ideas? Thank you. I can only second this. Openchange ist VERY unstable. I've not managed to get a stable connection with Outlook 2010 at all. I get so far that it lets me log in, starts synchinc the mailbox, but it always crashes after a few seconds, with something like this: I can only share and understand your concerns if your installation relies on deprecated samba and openchange code. I can't provide you further help to this regards unless new packages are available or you build the environment. Fortunately you may not have to wait very long! At OpenChange, we feel embarrassed your experience with openchange server and outlook connectivity got tainted with these frustrating issues and gave you a negative opinion on the project. I'll see how things can be improved with regards to this matter. Kind Regards, Julien. -- Julien Kerihuel j.kerih...@openchange.org OpenChange Project Founder Twitter: https://twitter.com/jkerihuel GPG Fingerprint: 0B55 783D A781 6329 108A B609 7EF6 FE11 A35F 1F79 -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] samba dies with outlook 2012 [and 2010]
On 13-01-25 1:59 PM, Marco Coli wrote: Il 25/01/2013 14:12, Julien Kerihuel ha scritto: In your case, you need to: 1. use a recent build. This has been fixed long ago in git repositories and builds based on samba4 beta5 have been deprecated a while ago. 2. After updating, use the openchange_cleanup.sh script available in SOGo 2. remove your Outlook profile 3. rerun samba4 Thank you Julien for your detailed and precious indications. Using nightly builds, which means: samba4-4.0.1-4.centos6.1.x86_64 sogo-openchange-backend-2.0_20130124-1.centos6.x86_64 openchange-rpcproxy-1.0.0.20130123.sogo-1.centos6.x86_64 openchange-ocsmanager-1.0.0.20130123.sogo-1.centos6.x86_64 openchange-1.0.0.20130123.sogo-1.centos6.x86_64 and after cleaning, finally no more samba panic! I am very, very happy, I had to install the system with 40+ clients, and I was quite sure to quit the project because of the outlook/openchange problems. So, we can say that the combination of samba/openchange distributed on redhat/CentOS stable repository of sogo is broken. this will change (real) soon Your problem is unrelated to the Outlook version getting used. This being said, Outlook 2012 has not yet been included in our matrix of compatibility. For the past few weeks - and while preparing our next forthcoming release - we have been doing OpenChange dogfooding and have not experienced any crash or panic but one in SOGo backend which we've fixed. Some questions, at this point: 1) the sogo openchange nightly version is fresh enough or you suggest to build from source? the openchange nightly build we distribute are really that: nightly builds of openchange. Unless the build breaks, we're building from git master branch. This week is a bit of an exception, as I've been breaking^Wtuning the build scripts. 2) in this build there is no openchange_cleanup.sh script, but I used instead python openchange_cleanup.py user password. It is the same? the python script should be used (it was written based on the sh script). it will do the following: - remove the user's directory under mapistore/ and mapistore/SOGo - cleanup Junk Folders and Sync Issues imap folders - Delete the socfs_ table for the username. 3) I noticed that samba log is huge, it seems every tiny outlook event is logged with much detail, and now I am only experimenting with a client. I am worried about how many lines will be generated with 40 clients... I will have to buy a san storage only for /var partition! There is a way to reduce verbosity, when in production? What debug level are you using in smb.conf? Hope it helps. Indeed! Thank you for your precious tips! Have a nice day Marco -- Jean Raby jr...@inverse.ca :: +1.514.447.4918 (x120) :: www.inverse.ca Inverse inc. :: Leaders behind SOGo (www.sogo.nu) and PacketFence (www.packetfence.org) -- users@sogo.nu https://inverse.ca/sogo/lists
