Re: [SOGo] SOGo keeps falling over when previously fine
We have the same problem. I was putting it down to the switch to 64bit architecture. I increased SxVMemLimit to 1024 to no avail. The problem occurred less with 1024 but was not gone. We have an application that fetches a ical (large file 2000 entries) file from sogo an this caused this issue every time. After I stopped fetching this ical we don't have any more crashes with SxVMemLimit=1024 with less this still happens. Also when I try to export this calendar in the web interface the same thing happens. I posted this some time ago: http://comments.gmane.org/gmane.comp.groupware.sogo.user/7774 Anybody else? -- Dr. Christian Naumer Senior Scientist Analytics Engineering B.R.A.I.N Aktiengesellschaft Darmstaedter Str. 34-36, D-64673 Zwingenberg e-mail c...@brain-biotech.de, homepage www.brain-biotech.de fon +49-6251-9331-30 / fax +49-6251-9331-11 Sitz der Gesellschaft: Zwingenberg/Bergstrasse Registergericht AG Darmstadt, HRB 24758 Vorstand: Dr. Holger Zinke (Vorsitz), Dr. Jürgen Eck Vorsitzender des Aufsichtsrats: Ulrich Putsch -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] SOGo keeps falling over when previously fine
On 27/01/12 12:52, Christian Naumer wrote: We have the same problem. I was putting it down to the switch to 64bit architecture. I increased SxVMemLimit to 1024 to no avail. The problem occurred less with 1024 but was not gone. Yes that makes sense. But I don't want to keep raising the mem unless there's a good reason for it. We never had these issues a while back. I'd rather try to find what is making SOGo collapse so easily when previously with less memory it was so robust We have an application that fetches a ical (large file2000 entries) file from sogo an this caused this issue every time. After I stopped fetching this ical we don't have any more crashes with SxVMemLimit=1024 with less this still happens. We AFAIK don't have anyone loading ical files. I'm still not totally sure what is causing the excessive ram usage. Recently I did see one worker getting killed, (first example in earlier email), when we had to clear a Lightening cache and mem / cpu increased when Lightning was loading all the events from the server anew : about a 1800kB cache file (in Lightning). But this isnt that much really is it ? We only have 30 users, 5 calendars per user .. Also when I try to export this calendar in the web interface the same thing happens. I posted this some time ago: http://comments.gmane.org/gmane.comp.groupware.sogo.user/7774 Yes I think I remember that one, but didnt have any useful suggestions Julian -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] SOGo keeps falling over when previously fine
Am 27.01.2012 14:01, schrieb Julian Robbins: Yes that makes sense. But I don't want to keep raising the mem unless there's a good reason for it. We never had these issues a while back. I'd rather try to find what is making SOGo collapse so easily when previously with less memory it was so robust You are are absolutely right. I just needed a workaround because our sogo got completely unusable. With our installation everything worked smooth with 1.3.8. After this version we had this problem. We AFAIK don't have anyone loading ical files. I'm still not totally sure what is causing the excessive ram usage. Recently I did see one worker getting killed, (first example in earlier email), when we had to clear a Lightening cache and mem / cpu increased when Lightning was loading all the events from the server anew : about a 1800kB cache file (in Lightning). But this isnt that much really is it ? We only have 30 users, 5 calendars per user .. We have around 100 users and one public Calendar were everyone puts some events the lightning-cache is about 3000kb on this one. Yes I think I remember that one, but didnt have any useful suggestions I think we have the same problem here which is memory consumption. just different things that trigger it. hope somebody else has an idea. Christian -- Dr. Christian Naumer Senior Scientist Analytics Engineering B.R.A.I.N Aktiengesellschaft Darmstaedter Str. 34-36, D-64673 Zwingenberg e-mail c...@brain-biotech.de, homepage www.brain-biotech.de fon +49-6251-9331-30 / fax +49-6251-9331-11 Sitz der Gesellschaft: Zwingenberg/Bergstrasse Registergericht AG Darmstadt, HRB 24758 Vorstand: Dr. Holger Zinke (Vorsitz), Dr. Jürgen Eck Vorsitzender des Aufsichtsrats: Ulrich Putsch -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] SOGo keeps falling over when previously fine
On 27/01/12 07:52, Christian Naumer wrote: We have an application that fetches a ical (large file2000 entries) file from sogo an this caused this issue every time. After I stopped fetching this ical we don't have any more crashes with SxVMemLimit=1024 with less this still happens. We will investigate. -- Ludovic Marcotte lmarco...@inverse.ca :: +1.514.755.3630 :: www.inverse.ca Inverse inc. :: Leaders behind SOGo (www.sogo.nu) and PacketFence (www.packetfence.org) -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] SOGo keeps falling over when previously fine
Is there any possibility to delete old events? It's very unfrequently to need old events ( es. 1 year) Less events less cache -- Alessio Fattorini (alessio.fattor...@nethesis.it) nethesis srl - Via degli Olmi 16/4 - 61100 Pesaro (PU) tel. +39 0721 405516 - fax +39 0721 268147 www.nethesis.it - i...@nethesis.it -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] SOGo keeps falling over when previously fine
Hi, Am 27.01.12 15:02, schrieb Ludovic Marcotte: On 27/01/12 07:52, Christian Naumer wrote: We have an application that fetches a ical (large file2000 entries) file from sogo an this caused this issue every time. After I stopped fetching this ical we don't have any more crashes with SxVMemLimit=1024 with less this still happens. We will investigate. Seems to be a similar issue like I posted on 10th Jan, Subject Very high Load by request of personal.ics, isn't it? Maybe there is something on generating the ics ... Greetings, Martin -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] SOGo keeps falling over when previously fine
On 27/01/12 14:12, Alessio Fattorini wrote: Is there any possibility to delete old events? It's very unfrequently to need old events ( es. 1 year) Less events less cache +1 Yes, I think this would be a very useful feature ... -- Kind Regards, Julian Robbins -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] SOGo keeps falling over when previously fine
On 27/01/12 14:13, Martin Rabl wrote: Hi, Am 27.01.12 15:02, schrieb Ludovic Marcotte: On 27/01/12 07:52, Christian Naumer wrote: We have an application that fetches a ical (large file2000 entries) file from sogo an this caused this issue every time. After I stopped fetching this ical we don't have any more crashes with SxVMemLimit=1024 with less this still happens. We will investigate. Seems to be a similar issue like I posted on 10th Jan, Subject Very high Load by request of personal.ics, isn't it? Maybe there is something on generating the ics ... Possibly, but my problem with memory/CPU isnt occuring on ics generation, its happening generally Julian -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] SOGo keeps falling over when previously fine
Maybe you get it easier: limiting the sent ics-events. SOGo gives you all stored events in one file, but this is IMHO generated from the database. Maybe it is possible to insert an optional Option ;-) SOGoLimitIcsEventsToLastXWeeks, configured with the count of Weeks with events, you will get max. in a ICS, 26 could be the half year back, 0 (or unset) the current behaviour, the future events are exported like now. A bit like SOGoFreeBusyDefaultInterval ... Idea for 1.3.12 ;-) Greetings, Martin Am 27.01.12 15:52, schrieb Julian Robbins: On 27/01/12 14:12, Alessio Fattorini wrote: Is there any possibility to delete old events? It's very unfrequently to need old events ( es. 1 year) Less events less cache +1 Yes, I think this would be a very useful feature ... -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] SOGo keeps falling over when previously fine
Am 27.01.2012 15:53, schrieb Julian Robbins: We have an application that fetches a ical (large file2000 entries) file from sogo an this caused this issue every time. After I stopped Possibly, but my problem with memory/CPU isnt occuring on ics generation, its happening generally ical-file == ics-file So I did understand the issue. -- Greetings, Martin Rabl -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] SOGo keeps falling over when previously fine
On 27/01/12 15:02, Martin Rabl wrote: Am 27.01.2012 15:53, schrieb Julian Robbins: We have an application that fetches a ical (large file2000 entries) file from sogo an this caused this issue every time. After I stopped Possibly, but my problem with memory/CPU isnt occuring on ics generation, its happening generally ical-file == ics-file So I did understand the issue. I thought you specifically meant when exporting events in the web view of the calendar, but I guess its the same issue really ... -- Kind Regards, Julian Robbins -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] SOGo keeps falling over when previously fine
Il 27/01/2012 16:00, Martin Rabl ha scritto: Maybe you get it easier: limiting the sent ics-events. SOGo gives you all stored events in one file, but this is IMHO generated from the database. Maybe it is possible to insert an optional Option ;-) SOGoLimitIcsEventsToLastXWeeks, configured with the count of Weeks Ludovic says: If you want to limit the number of events returned by SOGo, you might want to set SOGoDAVCalendarStartTimeLimit at the server level. SOGoDAVCalendarStartTimeLimit = X; in my .GNUstepDefault X is in days Undocumented feature -- Alessio Fattorini (alessio.fattor...@nethesis.it) nethesis srl - Via degli Olmi 16/4 - 61100 Pesaro (PU) tel. +39 0721 405516 - fax +39 0721 268147 www.nethesis.it - i...@nethesis.it -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] SOGo keeps falling over when previously fine
Am 27.01.2012 16:10, schrieb Julian Robbins: On 27/01/12 15:02, Martin Rabl wrote: ical-file == ics-file So I did understand the issue. I thought you specifically meant when exporting events in the web view of the calendar, but I guess its the same issue really ... No, I meant retrieving a calendar with http://sogo.example.com/SOGo/dav/username/Calendar/personal.ics By the way: calling xcal shows me the same problem ... http://sogo.example.com/SOGo/dav/username/Calendar/personal.xml -- Greetings, Martin Rabl -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] SOGo keeps falling over when previously fine
Am 27.01.2012 16:11, schrieb Alessio Fattorini: Il 27/01/2012 16:00, Martin Rabl ha scritto: Maybe you get it easier: limiting the sent ics-events. SOGo gives you all stored events in one file, but this is IMHO generated from the database. Ludovic says: If you want to limit the number of events returned by SOGo, you might want to set SOGoDAVCalendarStartTimeLimit at the server level. SOGoDAVCalendarStartTimeLimit = X; in my .GNUstepDefault Very nice ... thank you! Are the events counted backwards from younger to older? Undocumented feature grep -r SOGoDAVCalendarStartTimeLimit SOGo/ = hit! I should read the changelogs more often ... -- Greetings, Martin Rabl -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] SOGo keeps falling over when previously fine
On 27/01/12 09:02, Ludovic Marcotte wrote: On 27/01/12 07:52, Christian Naumer wrote: We have an application that fetches a ical (large file2000 entries) file from sogo an this caused this issue every time. After I stopped fetching this ical we don't have any more crashes with SxVMemLimit=1024 with less this still happens. We will investigate. Fixed. http://mtn.inverse.ca/revision/diff/ee188ecf014aadf3749779aa50df66d72a126c71/with/15c306f9d11152fee321b11e184bc75e9e2be6f8 -- Ludovic Marcotte lmarco...@inverse.ca :: +1.514.755.3630 :: www.inverse.ca Inverse inc. :: Leaders behind SOGo (www.sogo.nu) and PacketFence (www.packetfence.org) -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] SOGo keeps falling over when previously fine
On 27/01/12 15:34, Ludovic Marcotte wrote: On 27/01/12 09:02, Ludovic Marcotte wrote: On 27/01/12 07:52, Christian Naumer wrote: We have an application that fetches a ical (large file2000 entries) file from sogo an this caused this issue every time. After I stopped fetching this ical we don't have any more crashes with SxVMemLimit=1024 with less this still happens. We will investigate. Fixed. http://mtn.inverse.ca/revision/diff/ee188ecf014aadf3749779aa50df66d72a126c71/with/15c306f9d11152fee321b11e184bc75e9e2be6f8 This is great many thanks Have you fixed something that had broke in an earlier vers 1.3.9 ? or is this new functionality that should help anyway ? -- Kind Regards, Julian Robbins -- users@sogo.nu https://inverse.ca/sogo/lists
Re: [SOGo] SOGo keeps falling over when previously fine
On 27/01/12 13:11, Julian Robbins wrote: This is great many thanks Have you fixed something that had broke in an earlier vers 1.3.9 ? or is this new functionality that should help anyway ? I haven't dig to see if it is a regression that was added... but for sure, that will help for ICS export and perhaps other stuff too. The fix will be part of 1.3.12 and also the upcoming nightly builds. -- Ludovic Marcotte lmarco...@inverse.ca :: +1.514.755.3630 :: www.inverse.ca Inverse inc. :: Leaders behind SOGo (www.sogo.nu) and PacketFence (www.packetfence.org) -- users@sogo.nu https://inverse.ca/sogo/lists
