Re: Cyrus with a NFS storage. random DBERROR
Hi, after the problem with the wiki was solved, i added a summery about CyrusCluster http://cyrusimap.web.cmu.edu/twiki/bin/view/Cyrus/CyrusCluster . Please feel free to add infos about your experience with NFS Quoting Paul Dekkers <[EMAIL PROTECTED]>: Hi, Took me a while before I found the time to try the meta-partitions and NFS backed (data-)partitions, but: Dmitriy Kirhlarov wrote: On Thu, May 03, 2007 at 05:08:52PM +0200, Paul Dekkers wrote: I recently tried to use NFS (on a RedHat client, both to a NetApp filer as well as a RedHat NFS server) and I'll share my experiences: Michael Menge wrote: Cyrus has 2 problems with NFS. 1. Cyrus depends on filesystem locking. NFS-4 should have solved this problem but i have not tested it. 2. BerkleyDB uses shared Memory which does not work accros multiple servers. I used skiplist in the tests (default with Simon's RPM), and initially just used NFSv3 (and I also tested NFSv4): as long as I mounted with the -o nolock option it actually worked quite well (also on NFSv3). The performance was even better with the NetApp as target than with a local filesystem (and NFSv3 was faster than v4). The nolock options does not disable locking (as I understand it) for the filesystem, it just disables locking over NFS, so other nodes won't have the same file locked. (Correct me if I'm wrong.) My intention was not to have an active-active setup, so in that regard this might not be that bad. Not sure what other catches there are though. Are you try metapartition* options? If you don't need active-active setup it can be useful. I didn't try metapartitions with my "-o nolock" experiment (which of course doesn't work with active-active either), but now I did another experiment with regular NFS locking (no special mount-options) and a metapartition for every type of metadata (metapartition_files: header index cache expunge squat). I'm glad to say that this seems to work quite well! Similar to the "-o nolock", actually, but it sounds more solid without the "tweaking". We use NetApp as NFS filer, and it actually seems to perform a bit better than our (this) internal RAID5, load is similar, ... and fortunally no errors from the imaptest. It sounds like this could work. But I'm not sure about the Cyrus internals if there are any catches; Ken (or someone else), could this be considered safe? If it is safe, I'd prefer to use NFS because performance is similar (or better) and the filers are more reliable than our RAID5 setup. (I won't go into details, but it's basically a physically separated RAID-1 set of drives in RAID-6-ish.) (Performance-wise I only tried small folders, but as soon as the metadata is cached, I think there a not a lot of directory reads when a folder is opened, so that doesn't really matter... right?) I stressed the setup with the imaptest tool from Dovecot, I saw problems with that in the past (also with NFSv3 and v4, but in combination with Cyrus 2.2 and I'm not sure if I tried nolock), now it seemed to do just fine. Only NFSv4 does not seem to be the answer, it seems that -o nolock is (on Linux as client). I'm very hesitant to put this into production, I just wanted to do some more tests and ask others after that if they think this is wise or not... I couldn't find the time to do more tests... (like see how RedHat 5 behaves instead of RedHat 4, if the tric also works on FreeBSD, if I can make it fail one way or another... suggestions always welcome...) I still have to try how RedHat 5 and FreeBSD behave, Paul Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html M.Menge Tel.: (49) 7071/29-70316 Universitaet Tuebingen Fax.: (49) 7071/29-5912 Zentrum fuer Datenverarbeitung mail: [EMAIL PROTECTED] Waechterstrasse 76 72074 Tuebingen smime.p7s Description: S/MIME krytographische Unterschrift Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Ghost emails
Your logs say: May 31 20:37:37 server lmtpunix[31094]: duplicate_mark: <[EMAIL PROTECTED],it> [EMAIL PROTECTED] this means, that cyrus thinks this message is a duplicate of a existing mail in the users mailbox. Some broken email clients may generate non-unique Message-Ids (groupwise has this bug in one version, some outlook versions, ...). Search your mail logs (/var/log/mail) whether you see the Id [EMAIL PROTECTED],it for different incoming mails. If you see this the only way to get the mails is to unset "duplicatesuppression" in cyrus - or to fix broken mail clients. Flo Giuseppe Ravasio schrieb: Hi, I'm running a Postfix+Cyrus+Ldap Auth mail (IMAP) server on a Suse 9.1 with about 200 users. The software versions are: cyrus-imapd-2.2.3-83.22 postfix-2.1.1-1.20 It's working fine since 2005, but now i'm facing a strange problem on a user mailbox. An email is received by the MTA, then postfix delivers this email to CyrusImap with /usr/lib/cyrus/bin/deliver. From the /var/log/messages i see: May 31 20:37:37 server lmtpunix[31094]: accepted connection May 31 20:37:37 server lmtpunix[31094]: lmtp connection preauth'd as postman May 31 20:37:37 server lmtpunix[31094]: duplicate_check: <[EMAIL PROTECTED]> user.beppe 0 May 31 20:37:37 server lmtpunix[31094]: mystore: starting txn 2147483677 May 31 20:37:37 server lmtpunix[31094]: mystore: committing txn 2147483677 May 31 20:37:37 server lmtpunix[31094]: duplicate_mark: <[EMAIL PROTECTED]> user.beppe 1180636657 43699 May 31 20:37:37 server lmtpunix[31094]: mystore: starting txn 2147483678 May 31 20:37:37 server lmtpunix[31094]: mystore: committing txn 2147483678 May 31 20:37:37 server lmtpunix[31094]: duplicate_mark: <[EMAIL PROTECTED],it> [EMAIL PROTECTED] 1180636657 0 So it seems that the message was correctly delivered, and in fact in the user FS folder there is a file containing the email! But this email doesn't appear via IMAP, and the only way to make it visible was: reconstruct -f user/beppe It isn't the first time that i've this strange behaviour, and since today i saw this issue only on a single user folder. Any ideas? Thanks G.Ravasio Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: problem with virtualdomain
Michael Menge wrote: > Hi, > > you have set "unixhierarchysep: yes" so you have to create the mailbox > with > "cm user/[EMAIL PROTECTED]" THANKS A LOT Michael. Your suggestion workded like magic. Now Felamimail can access the mailbox :-) but the problem is it can't create the mail box automatically. I have providewd the cyrus admin called"cyrus" and password to the email admin so that during creation of a new user it also creates an imap account for that user too. but that auto-imap creation is not working here. I have to manually do "cm user/[EMAIL PROTECTED] every time. Please note the authentication is based on LDAP and log says that emailadmin can log into cyrus admin successfully. can you suggest any fix. I am using egroupware with LDAP backend and mail client is felamimail. thanks and have a nice day. > > > Quoting JOYDEEP <[EMAIL PROTECTED]>: > >> I am using " cyradm -u cyrus opendingo.com" >> >> and then I create user like " cm [EMAIL PROTECTED]" >> >> I can see the inbox at /vmail/domains/domain/k/kolkata.in/user^test >> but felamimail reports no mail box found :-( > > > > > M.Menge Tel.: (49) 7071/29-70316 > Universitaet Tuebingen Fax.: (49) 7071/29-5912 > Zentrum fuer Datenverarbeitung mail: > [EMAIL PROTECTED] > Waechterstrasse 76 > 72074 Tuebingen > > > > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: setrlimit: Unable to set file descriptors limit to -1: Operation not permitted
Benjamin Donnachie wrote: > JOYDEEP wrote: > >> setrlimit: Unable to set file descriptors limit to -1: Operation not >> permitted >> > > I seem to recall this either being covered in here before or in the > docs. Basically, some operating systems let you set the file descriptor > limit to -1, which means unlimited. Some don't and generate that error. > > You can safely ignore it. > > Tanks Ben for the useful hint. > Ben > > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html > > > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus with a NFS storage. random DBERROR
Hi, Took me a while before I found the time to try the meta-partitions and NFS backed (data-)partitions, but: Dmitriy Kirhlarov wrote: > On Thu, May 03, 2007 at 05:08:52PM +0200, Paul Dekkers wrote: > >> I recently tried to use NFS (on a RedHat client, both to a NetApp filer >> as well as a RedHat NFS server) and I'll share my experiences: >> >> Michael Menge wrote: >> >>> Cyrus has 2 problems with NFS. >>> >>> 1. Cyrus depends on filesystem locking. NFS-4 should have solved this >>> problem >>> but i have not tested it. >>> >>> 2. BerkleyDB uses shared Memory which does not work accros multiple >>> servers. >>> >> I used skiplist in the tests (default with Simon's RPM), and initially >> just used NFSv3 (and I also tested NFSv4): as long as I mounted with the >> -o nolock option it actually worked quite well (also on NFSv3). The >> performance was even better with the NetApp as target than with a local >> filesystem (and NFSv3 was faster than v4). >> >> The nolock options does not disable locking (as I understand it) for the >> filesystem, it just disables locking over NFS, so other nodes won't have >> the same file locked. (Correct me if I'm wrong.) My intention was not to >> have an active-active setup, so in that regard this might not be that >> bad. Not sure what other catches there are though. >> > > Are you try metapartition* options? If you don't need active-active > setup it can be useful. > I didn't try metapartitions with my "-o nolock" experiment (which of course doesn't work with active-active either), but now I did another experiment with regular NFS locking (no special mount-options) and a metapartition for every type of metadata (metapartition_files: header index cache expunge squat). I'm glad to say that this seems to work quite well! Similar to the "-o nolock", actually, but it sounds more solid without the "tweaking". We use NetApp as NFS filer, and it actually seems to perform a bit better than our (this) internal RAID5, load is similar, ... and fortunally no errors from the imaptest. It sounds like this could work. But I'm not sure about the Cyrus internals if there are any catches; Ken (or someone else), could this be considered safe? If it is safe, I'd prefer to use NFS because performance is similar (or better) and the filers are more reliable than our RAID5 setup. (I won't go into details, but it's basically a physically separated RAID-1 set of drives in RAID-6-ish.) (Performance-wise I only tried small folders, but as soon as the metadata is cached, I think there a not a lot of directory reads when a folder is opened, so that doesn't really matter... right?) >> I stressed the setup with the imaptest tool from Dovecot, I saw problems >> with that in the past (also with NFSv3 and v4, but in combination with >> Cyrus 2.2 and I'm not sure if I tried nolock), now it seemed to do just >> fine. Only NFSv4 does not seem to be the answer, it seems that -o nolock >> is (on Linux as client). >> >> I'm very hesitant to put this into production, I just wanted to do some >> more tests and ask others after that if they think this is wise or >> not... I couldn't find the time to do more tests... (like see how RedHat >> 5 behaves instead of RedHat 4, if the tric also works on FreeBSD, if I >> can make it fail one way or another... suggestions always welcome...) >> I still have to try how RedHat 5 and FreeBSD behave, Paul Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: problem with virtualdomain
Michael Menge wrote: > you have set "unixhierarchysep: yes" so you have to create the mailbox with > "cm user/[EMAIL PROTECTED]" D'oh! Can't believe I missed that... :-/ Ben Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: problem with virtualdomain
Hi, you have set "unixhierarchysep: yes" so you have to create the mailbox with "cm user/[EMAIL PROTECTED]" Quoting JOYDEEP <[EMAIL PROTECTED]>: I am using " cyradm -u cyrus opendingo.com" and then I create user like " cm [EMAIL PROTECTED]" I can see the inbox at /vmail/domains/domain/k/kolkata.in/user^test but felamimail reports no mail box found :-( M.Menge Tel.: (49) 7071/29-70316 Universitaet Tuebingen Fax.: (49) 7071/29-5912 Zentrum fuer Datenverarbeitung mail: [EMAIL PROTECTED] Waechterstrasse 76 72074 Tuebingen smime.p7s Description: S/MIME krytographische Unterschrift Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: problem with virtualdomain
JOYDEEP wrote: > I can see the inbox at /vmail/domains/domain/k/kolkata.in/user^test > but felamimail reports no mail box found :-( What authentication backend are you using? Have you remembered to add this new user to that? Please post your logs showing the problem, usually under /var/log/maillog. Alternatively, I offer consultancy at a very reasonable rate through Pythagoras Software (UK). Ben Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: problem with virtualdomain
Benjamin Donnachie wrote: > Benjamin Donnachie wrote: > >> Are you logged in as cyrus? What is the content of the file /etc/hosts? >> > > ... and what command line are you using with cyradm? > I am using " cyradm -u cyrus opendingo.com" and then I create user like " cm [EMAIL PROTECTED]" I can see the inbox at /vmail/domains/domain/k/kolkata.in/user^test but felamimail reports no mail box found :-( > Ben > > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html > > > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: setrlimit: Unable to set file descriptors limit to -1: Operation not permitted
JOYDEEP wrote: > setrlimit: Unable to set file descriptors limit to -1: Operation not > permitted I seem to recall this either being covered in here before or in the docs. Basically, some operating systems let you set the file descriptor limit to -1, which means unlimited. Some don't and generate that error. You can safely ignore it. Ben Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: problem with virtualdomain
JOYDEEP wrote: > Thanks for your kind response. yes I am logged in as cyrus. > here is /etc/hosts > -- > 127.0.0.1 opendingo.com > > 127.0.0.2 lvps87-230-8-228.dedicated.hosteurope.de lvps87-230-8-228 > > 127.0.0.1 lvps87-230-8-228.opendingo.com > 127.0.0.1 localhost > -- Cyrus-imapd does a reverse lookup of the IP address you are connecting from, discards the first part and then uses the rest as your domain. If your are connecting over localhost, I can only guess that it is getting opendingo.com in response, discarding opendingo and logging you in as [EMAIL PROTECTED] Hence only allowing you to administer the com domain. Temporarily replace your /etc/hosts file with: 127.0.0.1 localhost and try again with cyradm --user cyrus localhost Or is it possible to stick with virtdomains: userid ? >From http://www.lnxsys.ca/docs/postfix-cyrus-FC2/ virtdomains: [userid|yes] With virtdomains: userid, the userid with @domain determines who the person is and what mailbox they should get. With yes, either the @domain or the IP address is used to determine this Ben Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: problem with virtualdomain
Benjamin Donnachie wrote: > Are you logged in as cyrus? What is the content of the file /etc/hosts? ... and what command line are you using with cyradm? Ben Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Ghost emails
Hi, I'm running a Postfix+Cyrus+Ldap Auth mail (IMAP) server on a Suse 9.1 with about 200 users. The software versions are: cyrus-imapd-2.2.3-83.22 postfix-2.1.1-1.20 It's working fine since 2005, but now i'm facing a strange problem on a user mailbox. An email is received by the MTA, then postfix delivers this email to CyrusImap with /usr/lib/cyrus/bin/deliver. From the /var/log/messages i see: May 31 20:37:37 server lmtpunix[31094]: accepted connection May 31 20:37:37 server lmtpunix[31094]: lmtp connection preauth'd as postman May 31 20:37:37 server lmtpunix[31094]: duplicate_check: <[EMAIL PROTECTED]> user.beppe 0 May 31 20:37:37 server lmtpunix[31094]: mystore: starting txn 2147483677 May 31 20:37:37 server lmtpunix[31094]: mystore: committing txn 2147483677 May 31 20:37:37 server lmtpunix[31094]: duplicate_mark: <[EMAIL PROTECTED]> user.beppe 1180636657 43699 May 31 20:37:37 server lmtpunix[31094]: mystore: starting txn 2147483678 May 31 20:37:37 server lmtpunix[31094]: mystore: committing txn 2147483678 May 31 20:37:37 server lmtpunix[31094]: duplicate_mark: <[EMAIL PROTECTED],it> [EMAIL PROTECTED] 1180636657 0 So it seems that the message was correctly delivered, and in fact in the user FS folder there is a file containing the email! But this email doesn't appear via IMAP, and the only way to make it visible was: reconstruct -f user/beppe It isn't the first time that i've this strange behaviour, and since today i saw this issue only on a single user folder. Any ideas? Thanks G.Ravasio Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: problem with virtualdomain
JOYDEEP wrote: > 1> now if I change "virtdomains: userid" to "virtdomains: yes" I can't > create any mailbox with cm command. > it reports "permissions denied". I have flipped through the log but no > log reports about this . Are you logged in as cyrus? What is the content of the file /etc/hosts? Ben Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
problem with virtualdomain
dear list, I am really fade up and need your kind guidance to solve this cyrus-imap problem. here is my imapd.conf --- configdirectory: /var/lib/imap partition-default: /vmail/domains sievedir: /var/lib/sieve sendmail: /usr/sbin/sendmail admins: cyrus allowanonymouslogin: no allowplaintext: yes sasl_pwcheck_method: saslauthd sasl_mech_list: PLAIN LOGIN sasl_minimum_layer: 0 autocreatequota: 1 reject8bit: no quotawarn: 90 timeout: 30 poptimeout: 10 dracinterval: 0 drachost: localhost lmtp_overquota_perm_failure: no lmtp_downcase_rcpt: yes lmtpsocket: /var/lib/imap/socket/lmtp unixhierarchysep: yes virtdomains: userid defaultdomain: opendingo.com hashimapspool: true servername: lvps872308228.opendingo.com --- 1> now if I change "virtdomains: userid" to "virtdomains: yes" I can't create any mailbox with cm command. it reports "permissions denied". I have flipped through the log but no log reports about this . 2> with "virtdomains: userid" I can create user like " cm [EMAIL PROTECTED]" but felamimail reports users mailbox does not exist. please help. thanks Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
setrlimit: Unable to set file descriptors limit to -1: Operation not permitted
Dear list, When I start cyrus-imap I get the error - setrlimit: Unable to set file descriptors limit to -1: Operation not permitted --- what does it mean and how to fix it ? thanks Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
