Re: SIEVE Scripts on a shared folder
Quoting "Jeroen van Meeuwen (Kolab Systems)" : > Adam Tauno Williams wrote: >> cyrus-imapd-2.3.14-8 >> I've done this before, but now I'm stumped [possibly Friday induced >> brain fade]. I'm trying to set a SIEVE script on a shared folder. > Now that you mention it, I find that indeed the sieve script I was trying to > use does not work... ;-) > 2.3.16 for me. Have you tried this on a 2.4.x version? Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
Re: shared folder seen db
Quoting Francesc Guasch :
> Hi. I migrated a old cyrus-2.1 to a new server with cyrus-2.2.
You do realize you've migrated from a fossilized version of Cyrus to
an antique version of Cyrus?
You can get very good packages of near-current Cyrus versions for
either RHEL/CentOS or openSUSE.
> The seen flags from the INBOX and user subfolders seem fine but
> all the messages from the shared folders are unseen.
In 2.3.x these are in {metadatadir}/user/{user} either that or the
equivalent hashed value. But I think these same seen files are used
for any the seen state of any folder provided shared-seen-state isn't
enabled on the folder [does 2.2.x even support shared seen state?].
> I searched the archives but I am only able to find about "sharing
> the seen flags in shared folders".
> Where are the old server 2.1 seen databases for shared folders ?
> How can I dump it to cyrus-2.2 ?
> It looks like they are not in /var/lib/cyrus/user/username.seen.
Yes, that seems correct.
> Any hints ? thank you very much.
Did you change how namespaces are handled when you upgraded? Just a
guess. Cyrus 2.1.x is *SO OLD* I have only the vaguest memories how
to admin that - it is quite a different [and in every way inferior]
beast than the very nice 2.3 and 2.4 editions.
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
Cyrus 2.4.12 Released
We are pleased to announce the release of Cyrus IMAPd 2.4.12. This is a security update to the 2.4.x series, containing a fix to Secunia SA46093. Stefan Cornelius from Secunia Research discovered that anonymous users can appear to be authenticated as any useri to nttpd - by just failing to send any PASS command. Despite the security issue forcing this release, it's wonderful to see how many different authors are represented. Not only the regular contributions from Bron, Greg and Ken, but lots of bugs reported through bugzilla along with patches. We strongly recommend that all users of the stable series upgrade to 2.4.12, or at least apply the patch here: http://git.cyrusimap.org/cyrus-imapd/patch/?id=77903669e04c9788460561dd0560b9c916519594 You can download via HTTP or FTP: http://cyrusimap.org/releases/cyrus-imapd-2.4.12.tar.gz ftp://ftp.cyrusimap.org/cyrus-imapd/cyrus-imapd-2.4.12.tar.gz The list of reported bugs fixed can be found here: http://cyrusimap.org/mediawiki/index.php/Bugs_Resolved_in_2.4.12 (or check the changelog for the ones that were actually FIXED in this release rather than closed as no-longer-present) If you want extreme detail of all changes made, check git: http://git.cyrusimap.org/cyrus-imapd/log/?id=cyrus-imapd-2.4.12 Regards, Bron. Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
Cyrus 2.3.18 Released
We are pleased to announce the release of Cyrus IMAPd 2.3.18. This is a security update to the old stable series, containing just a single fix to Secunia SA46093. Stefan Cornelius from Secunia Research discovered that anonymous users can appear to be authenticated as any useri to nttpd - by just failing to send any PASS command. You can download via HTTP or FTP: http://cyrusimap.org/releases/cyrus-imapd-2.3.18.tar.gz ftp://ftp.cyrusimap.org/cyrus-imapd/cyrus-imapd-2.3.18.tar.gz Regards, Bron. Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
Re: What is this ? ERROR: message has more than 1000 header lines
On Tue, Oct 04, 2011 at 06:28:51PM +0530, Ram wrote: > I can see errors like this in my maillog ( cyrus 2.4.6 on Centos 5.5 ) > > Oct 4 18:18:11 node1 lmtpunix[10901]: ERROR: message has more than 1000 > header lines, not caching any more > > > What do these errors indicate ? An email with over 1000 lines of header. Which is insane. We added this check because some broken giant messages were causing giant cyrus.cache files, which made everything else slow. The message isn't a problem - but I do recommend checking where those messages are coming from, because they're probably broken in other ways. Bron. Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
Re: Cyrus imap server and filesystem type.
On Mon, 2011-10-03 at 21:58 +0200, Josef Karliak wrote: > Hi there, >what filesystem type do you use for Cyrus imapd ? I use SLES11x64 > (or opensuse 11.4). >I use Reiserfs3.6, so far so good. But couldn't be better ? :) >Thanks for share your expericiencies. >J.K. > > > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ We have tried reiserfs , ext3 ZFS and xfs on linux. Reiserfs is stable but I think ZFS is the best. The compression is something we really appreciate xfs is horribly slow compared to resierfs or ZFS Thanks Ram Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
What is this ? ERROR: message has more than 1000 header lines
I can see errors like this in my maillog ( cyrus 2.4.6 on Centos 5.5 ) Oct 4 18:18:11 node1 lmtpunix[10901]: ERROR: message has more than 1000 header lines, not caching any more What do these errors indicate ? Thanks Ram Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
Re: Cyrus imap server and filesystem type.
On Tuesday, October 04, 2011 11:38 AM, "Bernd Petrovitsch" wrote: > On Mon, 2011-10-03 at 22:54 +0200, Riccardo Veraldi wrote: > > On 10/3/11 10:44 PM, Adam Tauno Williams wrote: > > > On Mon, 2011-10-03 at 22:08 +0200, Bron Gondwana wrote: > > >> On Mon, Oct 03, 2011 at 09:58:28PM +0200, Josef Karliak wrote: > > >>>Hi there, > > >>>what filesystem type do you use for Cyrus imapd ? I use SLES11x64 > > >>> (or opensuse 11.4). > > >>>I use Reiserfs3.6, so far so good. But couldn't be better ? :) > > >>>Thanks for share your expericiencies. > > >> We used to use reiserfs 3.6, but we changed to ext4 a while back. > > >> ext3 was awfully bad, but ext4 is working fine. > > > +1 ext4 > > - ext3 on DRBD on two servers with awfully slow RAID-systems > (zero-channel SCI controller - don't ask) and the filesystem was not > the problem. > - ext3 on iSCSI (to a NetApp thing AFAIK) also works without a problem - > but I suspect that things are far from any hardware limits. > Of course, "nodiratime" on the mounts. Never tried "noatime" though. Yeah, it sounds to me like you're not pushing the capabilities of these systems at all. We tried ext3 for a bit, but we push the IO really hard on our systems, and we discovered that deletes just killed IO much harder than reiserfs. So we switched back. Bron. -- Bron Gondwana br...@fastmail.fm Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
Re: Cyrus imap server and filesystem type.
On Mon, 2011-10-03 at 22:54 +0200, Riccardo Veraldi wrote: > On 10/3/11 10:44 PM, Adam Tauno Williams wrote: > > On Mon, 2011-10-03 at 22:08 +0200, Bron Gondwana wrote: > >> On Mon, Oct 03, 2011 at 09:58:28PM +0200, Josef Karliak wrote: > >>>Hi there, > >>>what filesystem type do you use for Cyrus imapd ? I use SLES11x64 > >>> (or opensuse 11.4). > >>>I use Reiserfs3.6, so far so good. But couldn't be better ? :) > >>>Thanks for share your expericiencies. > >> We used to use reiserfs 3.6, but we changed to ext4 a while back. > >> ext3 was awfully bad, but ext4 is working fine. > > +1 ext4 - ext3 on DRBD on two servers with awfully slow RAID-systems (zero-channel SCI controller - don't ask) and the filesystem was not the problem. - ext3 on iSCSI (to a NetApp thing AFAIK) also works without a problem - but I suspect that things are far from any hardware limits. Of course, "nodiratime" on the mounts. Never tried "noatime" though. Bernd -- Bernd Petrovitsch Email : be...@petrovitsch.priv.at LUGA : http://www.luga.at Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
shared folder seen db
Hi. I migrated a old cyrus-2.1 to a new server with cyrus-2.2. The seen flags from the INBOX and user subfolders seem fine but all the messages from the shared folders are unseen. I searched the archives but I am only able to find about "sharing the seen flags in shared folders". Where are the old server 2.1 seen databases for shared folders ? How can I dump it to cyrus-2.2 ? It looks like they are not in /var/lib/cyrus/user/username.seen. Any hints ? thank you very much. Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
Re: Database truncation on ENOSPC (was: Re: Cyrus imap server and filesystem type.)
On Tue, Oct 04, 2011 at 10:05:17AM +0100, Andy Bennett wrote: > Hi, > > > Yeah, XFS has had its fair share of interesting failure modes along > > the way too - but it's not too bad with Cyrus, because Cyrus is very > > careful about fsyncs. > > I use Cyrus on XFS and I've noticed that, for example, the SEEN database > can get truncated if you accidentally run out of space. I assume that > this happens on other file systems as well, but I've never tried it. In > fact, I hope to never try it on XFS again either. ;-) > > I was using a Cyrus 2.2 on Debian Lenny at the time so I'm perfectly > happy to concede that this may well have been fixed a long time ago. > My databases will have been in skiplist format and I managed to recover > them by dumping and reloading with the information I found here: No, it's not. I have a bug in our internal bugtracking system for making sure we're robust against disk filling problems. We had multiple skiplist corruptions due to a disk filling problem a while back. Bron. Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
Database truncation on ENOSPC (was: Re: Cyrus imap server and filesystem type.)
Hi, > Yeah, XFS has had its fair share of interesting failure modes along > the way too - but it's not too bad with Cyrus, because Cyrus is very > careful about fsyncs. I use Cyrus on XFS and I've noticed that, for example, the SEEN database can get truncated if you accidentally run out of space. I assume that this happens on other file systems as well, but I've never tried it. In fact, I hope to never try it on XFS again either. ;-) I was using a Cyrus 2.2 on Debian Lenny at the time so I'm perfectly happy to concede that this may well have been fixed a long time ago. My databases will have been in skiplist format and I managed to recover them by dumping and reloading with the information I found here: http://wiki.linuxwall.info/doku.php/en:ressources:dossiers:cyrus:repair_skiplist http://www.mail-archive.com/info-cyrus@lists.andrew.cmu.edu/msg35868.html http://oss.netfarm.it/python-cyrus.php - Regards, @ndy -- andy...@ashurst.eu.org http://www.ashurst.eu.org/ 0x7EBA75FF Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
Re: Cyrus imap server and filesystem type.
Hi, I'm only asking, I'll migrate from old server to a new one. If are there a better filesystems (with a dissaster recovery -emails are VERY important for users), it is a time and place to migrate. Now, on HP DL380G, we've sometimes high waits of processes, 3500 mail users on 300GB SCSI mirrored disk. Also we use SAN storage, synchronized by rsync. SAN storage is now only for copy, on the new server we plan to use it actively. That's why I asking too - is Reiser on SAN good ? Or ZFS ? Or EXT4 ? And it's disaster recovery (repairing filesystem)... Thanks J.K. Cituji Eero Hänninen : Hi.. On 10/03/2011 12:58 PM, Josef Karliak wrote: Hi there, what filesystem type do you use for Cyrus imapd ? I use SLES11x64 (or opensuse 11.4). I use Reiserfs3.6, so far so good. But couldn't be better ? :) I have time to time bad experiences with ReiserFS 3.6. Soon or latter some data corruption happens, and if reiser becomes broken then its broken after repair too. May be its kernel related or my personal problem. Currently our old mail infra is using xfs and ext4, and it seems work fine with our load. XFS needs careful tuning before it gets perform like on creation log size, block size etc, and on mounting increase logbufs to 8 (default 1). And of course don't forget increase number of inodes. Future plan is change hardware and mail system architecture, so we move to ZFS (on FreeBSD) , as current stress tests shows good results on test servers. But lets see how it will be work with about 1.2m users real work load. About Your thread, why you are asking, just for sure that you have made good choice or you have some kind performance problems? :) Best Regards, Eero Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ -- Ma domena pouziva zabezpeceni a kontrolu SPF (www.openspf.org) a DomainKeys/DKIM (with ADSP) . Pokud mate problemy s dorucenim emailu, zacnete pouzivat metody overeni puvody emailu zminene vyse. Dekuji. My domain use SPF (www.openspf.org) and DomainKeys/DKIM (with ADSP) policy and check. If you've problem with sending emails to me, start using email origin methods mentioned above. Thank you. This message was sent using IMP, the Internet Messaging Program. binPERZLYCJ9H.bin Description: Veřejný PGP klíč Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
Re: Cyrus imap server and filesystem type.
On 4 Oct 2011, at 09:13, Bron Gondwana wrote: > On Monday, October 03, 2011 2:09 PM, "Vincent Fox" wrote: > >> I have btrfs on my desktop and hope it will mature. > > It did a lot early, but seems to have stagnated getting the last bit > finished. Now... btrfs is sponsored by Oracle. And the owner of ZFS is... > > ... which raises the real question of just how committed they are to actually > shipping a stable GPL competitor to ZFS now. So I'm not holding my breath. Well, you've got ZFS v28 on FreeBSD if you want to steer clear of Oracle's influence. http://lists.freebsd.org/pipermail/freebsd-stable/2011-June/062900.html - Mark Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
Re: Cyrus imap server and filesystem type.
On Monday, October 03, 2011 2:09 PM, "Vincent Fox" wrote: > On 10/03/2011 12:58 PM, Josef Karliak wrote: > > Hi there, > > what filesystem type do you use for Cyrus imapd ? I use SLES11x64 > > (or opensuse 11.4). > > I use Reiserfs3.6, so far so good. But couldn't be better ? :) > > ZFS, which unfortunately is not much of an option for > you Linux folks I think. ZFS works great with thousands > of users, no worries about getting "inodes" or partitions > right and snapshots make keeping weeks of recovery points > online in the pool trivial and cheap. Yeah, ZFS is nice. I have one Solaris box. > I am sad every day I work with filesystems that are less robust. It would be lovely to have a similar filesystem for Linux. > I have btrfs on my desktop and hope it will mature. It did a lot early, but seems to have stagnated getting the last bit finished. Now... btrfs is sponsored by Oracle. And the owner of ZFS is... ... which raises the real question of just how committed they are to actually shipping a stable GPL competitor to ZFS now. So I'm not holding my breath. Bron. -- Bron Gondwana br...@fastmail.fm Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
Re: Cyrus imap server and filesystem type.
On Mon, October 3, 2011 11:13 pm, Pascal Gienger wrote: > Le 03/10/2011 23:09, Vincent Fox a écrit : > >> On 10/03/2011 12:58 PM, Josef Karliak wrote: >> >>> Hi there, >>> what filesystem type do you use for Cyrus imapd ? I use SLES11x64 (or >>> opensuse 11.4). I use Reiserfs3.6, so far so good. But couldn't be better >>> ? :) >>> >> >> ZFS, which unfortunately is not much of an option for >> you Linux folks I think. ZFS works great with thousands of users, no worries >> about getting "inodes" or partitions right and snapshots make keeping weeks >> of recovery points online in the pool trivial and cheap > > I second this. > Roughly 51,000,000 files on one (mirrored) multipathed FiberChannel SAN > volume with no performance bottlenecks. 64 GB RAM per node, approx 40 GB ARC > (ZFS Cache). Solaris 10u9 Kernel 147441-03 64bit x64 I third this. 45 million messages (down from 49M+ after summer cleanup) in nine filesystems spread over four ZFS pools, attached to a single Solaris 10 server (dual quad core Intel 2.8 GHz, although psrinfo reports 16 virtual processors, 72 GB RAM). We keep in-spool daily snapshots for 120 days (adds roughly 50% used space). One small remark : on occasions we have run in what apparently looks like a ZFS bug and have been discussing this in private communication with a Oracle/ Sun performance specialist. Details for Pascal and Vincent : at times (moderate to heavy I/O load) our filesystem perfomance drops down to a very low level. Immediate relief can be had by deleting a few ZFS snapshots and/or breaking one of more of the mirrors. Sounds, smells and feels like an allocation map issue, which is hinted at in posts on a couple of OpenSolaris discussion forums. Eric Luyten, Computing Centre VUB/ULB. Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
Re: Cyrus imap server and filesystem type.
Hi.. > On 10/03/2011 12:58 PM, Josef Karliak wrote: >> Hi there, >> what filesystem type do you use for Cyrus imapd ? I use SLES11x64 >> (or opensuse 11.4). >> I use Reiserfs3.6, so far so good. But couldn't be better ? :) I have time to time bad experiences with ReiserFS 3.6. Soon or latter some data corruption happens, and if reiser becomes broken then its broken after repair too. May be its kernel related or my personal problem. Currently our old mail infra is using xfs and ext4, and it seems work fine with our load. XFS needs careful tuning before it gets perform like on creation log size, block size etc, and on mounting increase logbufs to 8 (default 1). And of course don't forget increase number of inodes. Future plan is change hardware and mail system architecture, so we move to ZFS (on FreeBSD) , as current stress tests shows good results on test servers. But lets see how it will be work with about 1.2m users real work load. About Your thread, why you are asking, just for sure that you have made good choice or you have some kind performance problems? :) Best Regards, Eero Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
