Re: [SOGo] Problem with activesync, outlook 2013 and middle size or big size mailbox
Hello, find below the result of xmllint --format on one of my .data file : --- /tmp/sogotest_ilex-si_com_6d4_18f2db70_0.data:404510: parser error : error parsing attribute name ndee_EmailAttendee_Name xmlns=Calendar:Olivier Gouranton Olivier.Gouranton ^ /tmp/sogotest_ilex-si_com_6d4_18f2db70_0.data:404510: parser error : attributes construct error ndee_EmailAttendee_Name xmlns=Calendar:Olivier Gouranton Olivier.Gouranton ^ /tmp/sogotest_ilex-si_com_6d4_18f2db70_0.data:404510: parser error : Couldn't find end of Start Tag Olivier.Gouranton line 404510 ndee_EmailAttendee_Name xmlns=Calendar:Olivier Gouranton Olivier.Gouranton ^ /tmp/sogotest_ilex-si_com_6d4_18f2db70_0.data:1626644: error: xmlSAX2Characters: huge text node: out of memory lt;http://img.dell.com/images/us/segments/dhs=5Fodg/emea/secondary.gifgt; ^ /tmp/sogotest_ilex-si_com_6d4_18f2db70_0.data:1626644: parser error : Extra content at the end of the document lt;http://img.dell.com/images/us/segments/dhs=5Fodg/emea/secondary.gifgt; ^ --- It seem that I have reach another memory limit ! libxml2 since 2.7.0 have a XML_PARSE_HUGE option that may be useful ? regards *Philippe Brangier * Administrateur systèmes et réseaux Ilex 51, boulevard Voltaire 92600 Asnières-sur-Seine *philippe.brang...@ilex.fr mailto:philippe.brang...@ilex.fr* Tél // +33 (0)1 46 88 03 40 Fax // +33 (0)1 46 88 03 41 http://www.ilex.fr/ Le 10/04/2014 01:42, Ludovic Marcotte a écrit : On 2014-04-07, 9:28 AM, Philippe Brangier wrote: 2014-04-07 12:06:52.203 sogod[5432] xml2wbxmlFromContent: failed: Parsing of XML Document Failed 2014-04-07 12:06:52.360 sogod[5432] Original data written to: /tmp/sogotest_ilex-si_com_1538_18f2b03c_0.data Take one of these files and run xmllint --format on it. You'll see the culprit part in the XML. Send it over. -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] Problem with activesync, outlook 2013 and middle size or big size mailbox
On 2014-04-10, 4:26 AM, Philippe Brangier wrote: find below the result of xmllint --format on one of my .data file : --- /tmp/sogotest_ilex-si_com_6d4_18f2db70_0.data:404510: parser error : error parsing attribute name ndee_EmailAttendee_Name xmlns=Calendar:Olivier Gouranton Olivier.Gouranton This has been fixed. It seem that I have reach another memory limit ! libxml2 since 2.7.0 have a XML_PARSE_HUGE option that may be useful ? Try setting SOGoMaximumSyncWindowSize to a lower value. Maybe your AS client tries to sync a huge amount of emails, containing huge attachments. This preference will limit the number of items the server will return, no matter what the client asks. Try setting it to 25 in your /etc/sogo/sogo.conf file. New nightly builds are being generated with the above fix. They should be available in about 2 hours. Check frequently and retest. Thanks, -- Ludovic Marcotte lmarco...@inverse.ca :: +1.514.755.3630 :: http://inverse.ca Inverse inc. :: Leaders behind SOGo (http://sogo.nu) and PacketFence (http://packetfence.org) -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] Problem with activesync, outlook 2013 and middle size or big size mailbox
On 2014-04-10, 10:39 AM, Philippe Brangier wrote: I find a new one at 10:10 (16:10 in france) but only the sogo package was updated, is it normal ? New packages were pushed 40 mins ago. All packages were updated, including sogo-activesync one. The updated packages will fix the problem you still have. -- Ludovic Marcotte lmarco...@inverse.ca :: +1.514.755.3630 :: http://inverse.ca Inverse inc. :: Leaders behind SOGo (http://sogo.nu) and PacketFence (http://packetfence.org) -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] Problem with activesync, outlook 2013 and middle size or big size mailbox
On 2014-04-10, 11:28 AM, Philippe Brangier wrote: two problems remains : - some characters in mails are not correctly displayed (see outlook.png) ~30% of my mails aren't correctly displayed. Somes of them are charset=iso-8859-1 others are charset=UTF-8 - 'other user' folders lack the last character of their titles. (se previous mails) Create 2 bug reports for this. For the first one, attach a sample message (rfc822 format) to the ticket. -- Ludovic Marcotte lmarco...@inverse.ca :: +1.514.755.3630 :: http://inverse.ca Inverse inc. :: Leaders behind SOGo (http://sogo.nu) and PacketFence (http://packetfence.org) -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] Problem with activesync, outlook 2013 and middle size or big size mailbox
ok, thanks a lot for your help. bugs added as 0002709 http://www.sogo.nu/bugs/view.php?id=2709 and 0002710 http://www.sogo.nu/bugs/view.php?id=2710 Regards *Philippe Brangier * Administrateur systèmes et réseaux Ilex 51, boulevard Voltaire 92600 Asnières-sur-Seine *philippe.brang...@ilex.fr mailto:philippe.brang...@ilex.fr* Tél // +33 (0)1 46 88 03 40 Fax // +33 (0)1 46 88 03 41 http://www.ilex.fr/ -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] Problem with activesync, outlook 2013 and middle size or big size mailbox
On 2014-04-07, 9:28 AM, Philippe Brangier wrote: 2014-04-07 12:06:52.203 sogod[5432] xml2wbxmlFromContent: failed: Parsing of XML Document Failed 2014-04-07 12:06:52.360 sogod[5432] Original data written to: /tmp/sogotest_ilex-si_com_1538_18f2b03c_0.data Take one of these files and run xmllint --format on it. You'll see the culprit part in the XML. Send it over. -- Ludovic Marcotte lmarco...@inverse.ca :: +1.514.755.3630 :: http://inverse.ca Inverse inc. :: Leaders behind SOGo (http://sogo.nu) and PacketFence (http://packetfence.org) -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] Problem with activesync, outlook 2013 and middle size or big size mailbox
On 2014-04-04, 12:36 PM, Philippe Brangier wrote:
It work well with an almost empty, new mailbox (~10 messages and a few
events ), but when I try it on a real Mailbox (thousand messages, some
folders and hundreds events), the folder names sync pretty well
('other user' folders lacks the last character name ex: Autres
utilisateurs/postmaster appear as Autres utilisateurs/postmaste)
but no message or event sync at all.
From the error below, my guess is that Outlook asks for a huge chuck of
mails and you run out of file descriptor for the sogod process.
Are you in a position to test a patch? (ie., can compile SOGo/SOPE
yourself).
You could also increase the limit sogod has and retest.
--
Ludovic Marcotte
lmarco...@inverse.ca :: +1.514.755.3630 :: http://inverse.ca
Inverse inc. :: Leaders behind SOGo (http://sogo.nu) and PacketFence
(http://packetfence.org)
--
users@sogo.nu
https://inverse.ca/sogo/lists
Re: [SOGo] Problem with activesync, outlook 2013 and middle size or big size mailbox
I can compile SOGo if needed, but I don't do that since a long time and
I need some time to be able to do that again (not before monday, it's
20:09 in france).
How can I increase the sogod limit ? I use a modified ZEG sogo.
did I have to modify /etc/security/limits.conf with something like that :
---
sogo hardnproc 65535
sogo softnproc 65535
---
FYI :
# cat /proc/sys/fs/file-max
398874
# ulimit -a
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 31549
max locked memory (kbytes, -l) 64
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size(512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 8192
cpu time (seconds, -t) unlimited
max user processes (-u) 31549
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
Regards
*Philippe Brangier *
Administrateur systèmes et réseaux
Ilex
51, boulevard Voltaire
92600 Asnières-sur-Seine
*philippe.brang...@ilex.fr mailto:philippe.brang...@ilex.fr*
Tél // +33 (0)1 46 88 03 40
Fax // +33 (0)1 46 88 03 41
http://www.ilex.fr/
Le 04/04/2014 19:55, Ludovic Marcotte a écrit :
On 2014-04-04, 12:36 PM, Philippe Brangier wrote:
It work well with an almost empty, new mailbox (~10 messages and a
few events ), but when I try it on a real Mailbox (thousand messages,
some folders and hundreds events), the folder names sync pretty
well ('other user' folders lacks the last character name ex: Autres
utilisateurs/postmaster appear as Autres utilisateurs/postmaste)
but no message or event sync at all.
From the error below, my guess is that Outlook asks for a huge chuck
of mails and you run out of file descriptor for the sogod process.
Are you in a position to test a patch? (ie., can compile SOGo/SOPE
yourself).
You could also increase the limit sogod has and retest.
--
users@sogo.nu
https://inverse.ca/sogo/lists
Re: [SOGo] Problem with activesync, outlook 2013 and middle size or big size mailbox
ok, I find a way to do it :
I have modified /etc/init.d/sogo by adding a line at the begining:
---
ulimit -n 65536
---
before :
#cat /proc/sogodPID/limits| grep 'Max open files'
Max open files1024 4096 files
and now :
#cat /proc/sogodPID/limits| grep 'Max open files'
Max open files65536 65536files
I don't get the same problem but now I reach the VMem limit :
sogo.log :
---
Apr 04 22:19:03 sogod [4867]: |SOGo| terminating app, vMem size limit
(384 MB) has been reached (currently 2420 MB)
Apr 04 22:19:03 sogod [4808]: 0x0x7f6a42d78da0[WOWatchDogChild] child
4867 exited
Apr 04 22:19:03 sogod [4808]: 0x0x7f6a42da2e10[WOWatchDog] child
spawned with pid 5208
---
I will try to raise the memory limit monday !
Regards
*Philippe Brangier *
Administrateur systèmes et réseaux
Ilex
51, boulevard Voltaire
92600 Asnières-sur-Seine
*philippe.brang...@ilex.fr mailto:philippe.brang...@ilex.fr*
Tél // +33 (0)1 46 88 03 40
Fax // +33 (0)1 46 88 03 41
http://www.ilex.fr/
Le 04/04/2014 20:30, Philippe Brangier a écrit :
I can compile SOGo if needed, but I don't do that since a long time
and I need some time to be able to do that again (not before monday,
it's 20:09 in france).
How can I increase the sogod limit ? I use a modified ZEG sogo.
did I have to modify /etc/security/limits.conf with something like that :
---
sogo hardnproc 65535
sogo softnproc 65535
---
FYI :
# cat /proc/sys/fs/file-max
398874
# ulimit -a
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 31549
max locked memory (kbytes, -l) 64
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size(512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 8192
cpu time (seconds, -t) unlimited
max user processes (-u) 31549
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
Regards
*Philippe Brangier *
Administrateur systèmes et réseaux
Ilex
51, boulevard Voltaire
92600 Asnières-sur-Seine
*philippe.brang...@ilex.fr mailto:philippe.brang...@ilex.fr*
Tél // +33 (0)1 46 88 03 40
Fax // +33 (0)1 46 88 03 41
http://www.ilex.fr/
Le 04/04/2014 19:55, Ludovic Marcotte a écrit :
On 2014-04-04, 12:36 PM, Philippe Brangier wrote:
It work well with an almost empty, new mailbox (~10 messages and a
few events ), but when I try it on a real Mailbox (thousand
messages, some folders and hundreds events), the folder names sync
pretty well ('other user' folders lacks the last character name ex:
Autres utilisateurs/postmaster appear as Autres
utilisateurs/postmaste)
but no message or event sync at all.
From the error below, my guess is that Outlook asks for a huge chuck
of mails and you run out of file descriptor for the sogod process.
Are you in a position to test a patch? (ie., can compile SOGo/SOPE
yourself).
You could also increase the limit sogod has and retest.
--
users@sogo.nu
https://inverse.ca/sogo/lists
Re: [SOGo] Problem with activesync, outlook 2013 and middle size or big size mailbox
On 2014-04-04, 4:49 PM, Philippe Brangier wrote: I will try to raise the memory limit monday ! I've just pushed a fix - please try the upcoming nightly builds. It should fix both the file descriptor and memory usage. Thanks, -- Ludovic Marcotte lmarco...@inverse.ca :: +1.514.755.3630 :: http://inverse.ca Inverse inc. :: Leaders behind SOGo (http://sogo.nu) and PacketFence (http://packetfence.org) -- users@sogo.nu https://inverse.ca/sogo/lists
