RE: reconstruct doing nothing
Hi Bart, I think su cyrus -c /usr/lib/cyrus/bin/reconstruct -rfx user/[EMAIL PROTECTED] Should be su cyrus -c /usr/lib/cyrus/bin/reconstruct -rfx user/[EMAIL PROTECTED] Or su cyrus -c /usr/lib/cyrus/bin/reconstruct -rfx user/[EMAIL PROTECTED] Regards, Tom -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Bart Coninckx Sent: vrijdag 21 maart 2008 15:28 To: 'Rudy Gevaert' Cc: info-cyrus@lists.andrew.cmu.edu Subject: RE: reconstruct doing nothing If you are using the unix hierarchy seperator, you need to use reconstruct -r user/testuser. Or user/[EMAIL PROTECTED] if you are using virtual domains. Also make sure that the files are chown cyrus:mail (or whatever uid/guid you are using). You can run strace reconstruct ... that will maybe you give an better idea what it is trying to do. Rudy Spoke too soon I believe: I see reconstruct do some stuff, but the cyrus.* files are unaffected. Also, a folder I restored is not processed by reconstruct. I used this command: su cyrus -c /usr/lib/cyrus/bin/reconstruct -rfx user/[EMAIL PROTECTED] All files have ownership cyrus:mail Any idea on why he doesn't touch the restored folders? Thx! B. Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
RE: Open files issues
It maybe has not directly anything to see with open files. I also see this in my logs: 990618:Jan 16 13:39:14 zeus master[32503]: about to exec /usr/cyrus/bin/imapd 990636:Jan 16 13:39:14 zeus imaps[32503]: executed 990650:Jan 16 13:39:15 zeus imaps[32503]: accepted connection 990671:Jan 16 13:39:15 zeus imaps[32503]: imapd:Loading hard-coded DH parameters 990697:Jan 16 13:39:15 zeus imaps[32503]: SSL_accept() incomplete - wait 990708:Jan 16 13:39:15 zeus imaps[32503]: SSL_accept() succeeded - done 990716:Jan 16 13:39:15 zeus imaps[32503]: starttls: TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits reused) no authentication 990746:Jan 16 13:39:15 zeus imaps[32503]: login: www.someip.net [192.168.1.1] user1 plain+TLS User logged in 990747:Jan 16 13:39:15 zeus imaps[32503]: seen_db: user user1 opened /var/imap/user/a/user1.seen 990748:Jan 16 13:39:15 zeus imaps[32503]: open: user user1 opened INBOX 990796:Jan 16 13:39:16 zeus master[24939]: process 32503 exited, signaled to death by 11 990804:Jan 16 13:39:16 zeus kernel: imapd[32503]: segfault at d6f556fc eip 0806fd0a esp bfa06d90 error 5 990805:Jan 16 13:39:16 zeus master[24939]: service imaps pid 32503 in BUSY state: terminated abnormally Regards, Tom -Original Message- From: Scott Likens [mailto:[EMAIL PROTECTED] Sent: dinsdag 15 januari 2008 18:49 To: Alain Spineux Cc: Tom Myny; info-cyrus@lists.andrew.cmu.edu Subject: Re: Open files issues Step 1, su - Step 2, su cyrus - Step 3, ulimit -a More then likely the cyrus user does not have the same ability as 'root' does for maxfiles, so then you would need to modify them. Depending on how your Linux configuration is setup that can be just a simple addition to /etc/profile, or you may need to modify login.conf or some security file in order to up the maxfiles for that user. Since cyrus is not in the 'wheel' group it is not considered a superuser, so it does not inherit the 'superuser' permissions for maxopenfiles. This is a known thing for like NetBSD, and they fix it appropriately by telling the script to change the ulimit while it runs... hth Scott On Jan 15, 2008, at 7:54 AM, Alain Spineux wrote: On Jan 15, 2008 3:31 PM, Tom Myny [EMAIL PROTECTED] wrote: Hi Guys, I'm having this each day: Jan 15 09:06:03 zeus lmtpunix[1029]: IOERROR: creating quota file /var/imap/quota/l/user.user1.NEW: Too many open files Jan 15 09:51:29 zeus lmtpunix[24100]: IOERROR: creating quota file /var/imap/quota/i/user.user2.NEW: Too many open files Jan 15 09:51:50 zeus lmtpunix[24100]: IOERROR: opening quota file /var/imap/quota/f/user.user3: Too many open files Jan 15 09:52:01 zeus lmtpunix[24100]: IOERROR: opening quota file /var/imap/quota/i/user.user4: Too many open files Jan 15 10:34:04 zeus lmtpunix[16510]: IOERROR: creating quota file /var/imap/quota/w/user.user5.NEW: Too many open files .. Are you sure cyrus is guilty and no simply suffering of another process ? You can use lsof command to see who open what. I've tried the following: --- Check file-max: cat /proc/sys/fs/file-max 359801 --- Checking ulimit: ulimit -a core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited max nice(-e) 0 file size (blocks, -f) unlimited pending signals (-i) unlimited max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 1024 pipe size(512 bytes, -p) 8 POSIX message queues (bytes, -q) unlimited max rt priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited Set ulimit -n 1 on start-up script - No effect :( --- Changed NR_OPEN and NR_FILE in kernel, recompile - No effect :( --- Anybody an idea ? Regards, Tom Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- Alain Spineux aspineux gmail com May the sources be with you Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html !DSPAM:478cf03271951804284693! Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
RE: Open files issues
Maybe not: Jan 16 17:20:07 zeus lmtpunix[32293]: Delivered: [EMAIL PROTECTED] to mailbox: user.user1 Jan 16 17:20:07 zeus lmtpunix[32293]: mystore: starting txn 2147488086 Jan 16 17:20:07 zeus lmtpunix[29365]: IOERROR: opening /var/spool/imap/user/user1/cyrus.cache: Too many open files Jan 16 17:20:07 zeus lmtpunix[32293]: mystore: committing txn 2147488086 Jan 16 17:20:07 zeus lmtpunix[29365]: sieve runtime error for user1 id [EMAIL PROTECTED]: Keep: System I/O error Jan 16 17:20:07 zeus lmtpunix[32293]: duplicate_mark: [EMAIL PROTECTED] user.user1 1200500407 12626 Jan 16 17:20:07 zeus lmtpunix[29365]: IOERROR: opening quota file /var/imap/quota/a/user1: Too many open files Jan 16 17:20:07 zeus lmtpunix[32293]: unable to sendto() notify socket: No such file or directory Jan 16 17:20:07 zeus lmtpunix[29365]: DBERROR: error fetching user.user1: cyrusdb error Will try some more tests... -Original Message- From: Tom Myny [mailto:[EMAIL PROTECTED] Sent: woensdag 16 januari 2008 17:57 To: 'Scott Likens'; 'Alain Spineux' Cc: 'info-cyrus@lists.andrew.cmu.edu' Subject: RE: Open files issues It maybe has not directly anything to see with open files. I also see this in my logs: 990618:Jan 16 13:39:14 zeus master[32503]: about to exec /usr/cyrus/bin/imapd 990636:Jan 16 13:39:14 zeus imaps[32503]: executed 990650:Jan 16 13:39:15 zeus imaps[32503]: accepted connection 990671:Jan 16 13:39:15 zeus imaps[32503]: imapd:Loading hard-coded DH parameters 990697:Jan 16 13:39:15 zeus imaps[32503]: SSL_accept() incomplete - wait 990708:Jan 16 13:39:15 zeus imaps[32503]: SSL_accept() succeeded - done 990716:Jan 16 13:39:15 zeus imaps[32503]: starttls: TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits reused) no authentication 990746:Jan 16 13:39:15 zeus imaps[32503]: login: www.someip.net [192.168.1.1] user1 plain+TLS User logged in 990747:Jan 16 13:39:15 zeus imaps[32503]: seen_db: user user1 opened /var/imap/user/a/user1.seen 990748:Jan 16 13:39:15 zeus imaps[32503]: open: user user1 opened INBOX 990796:Jan 16 13:39:16 zeus master[24939]: process 32503 exited, signaled to death by 11 990804:Jan 16 13:39:16 zeus kernel: imapd[32503]: segfault at d6f556fc eip 0806fd0a esp bfa06d90 error 5 990805:Jan 16 13:39:16 zeus master[24939]: service imaps pid 32503 in BUSY state: terminated abnormally Regards, Tom -Original Message- From: Scott Likens [mailto:[EMAIL PROTECTED] Sent: dinsdag 15 januari 2008 18:49 To: Alain Spineux Cc: Tom Myny; info-cyrus@lists.andrew.cmu.edu Subject: Re: Open files issues Step 1, su - Step 2, su cyrus - Step 3, ulimit -a More then likely the cyrus user does not have the same ability as 'root' does for maxfiles, so then you would need to modify them. Depending on how your Linux configuration is setup that can be just a simple addition to /etc/profile, or you may need to modify login.conf or some security file in order to up the maxfiles for that user. Since cyrus is not in the 'wheel' group it is not considered a superuser, so it does not inherit the 'superuser' permissions for maxopenfiles. This is a known thing for like NetBSD, and they fix it appropriately by telling the script to change the ulimit while it runs... hth Scott On Jan 15, 2008, at 7:54 AM, Alain Spineux wrote: On Jan 15, 2008 3:31 PM, Tom Myny [EMAIL PROTECTED] wrote: Hi Guys, I'm having this each day: Jan 15 09:06:03 zeus lmtpunix[1029]: IOERROR: creating quota file /var/imap/quota/l/user.user1.NEW: Too many open files Jan 15 09:51:29 zeus lmtpunix[24100]: IOERROR: creating quota file /var/imap/quota/i/user.user2.NEW: Too many open files Jan 15 09:51:50 zeus lmtpunix[24100]: IOERROR: opening quota file /var/imap/quota/f/user.user3: Too many open files Jan 15 09:52:01 zeus lmtpunix[24100]: IOERROR: opening quota file /var/imap/quota/i/user.user4: Too many open files Jan 15 10:34:04 zeus lmtpunix[16510]: IOERROR: creating quota file /var/imap/quota/w/user.user5.NEW: Too many open files .. Are you sure cyrus is guilty and no simply suffering of another process ? You can use lsof command to see who open what. I've tried the following: --- Check file-max: cat /proc/sys/fs/file-max 359801 --- Checking ulimit: ulimit -a core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited max nice(-e) 0 file size (blocks, -f) unlimited pending signals (-i) unlimited max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 1024 pipe size(512 bytes, -p) 8 POSIX message queues (bytes, -q) unlimited max rt priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited Set ulimit -n 1
Open files issues
Hi Guys, I'm having this each day: Jan 15 09:06:03 zeus lmtpunix[1029]: IOERROR: creating quota file /var/imap/quota/l/user.user1.NEW: Too many open files Jan 15 09:51:29 zeus lmtpunix[24100]: IOERROR: creating quota file /var/imap/quota/i/user.user2.NEW: Too many open files Jan 15 09:51:50 zeus lmtpunix[24100]: IOERROR: opening quota file /var/imap/quota/f/user.user3: Too many open files Jan 15 09:52:01 zeus lmtpunix[24100]: IOERROR: opening quota file /var/imap/quota/i/user.user4: Too many open files Jan 15 10:34:04 zeus lmtpunix[16510]: IOERROR: creating quota file /var/imap/quota/w/user.user5.NEW: Too many open files .. I've tried the following: --- Check file-max: cat /proc/sys/fs/file-max 359801 --- Checking ulimit: ulimit -a core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited max nice(-e) 0 file size (blocks, -f) unlimited pending signals (-i) unlimited max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 1024 pipe size(512 bytes, -p) 8 POSIX message queues (bytes, -q) unlimited max rt priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited Set ulimit -n 1 on start-up script - No effect :( --- Changed NR_OPEN and NR_FILE in kernel, recompile - No effect :( --- Anybody an idea ? Regards, Tom Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
RE: Open files issues
I'm afraid no other process is causing this. lsof | grep 'cyrus' | wc -l 2589 lsof | wc -l 12741 Greetings, Tom -Original Message- On Jan 15, 2008 3:31 PM, Tom Myny [EMAIL PROTECTED] wrote: Hi Guys, I'm having this each day: Jan 15 09:06:03 zeus lmtpunix[1029]: IOERROR: creating quota file /var/imap/quota/l/user.user1.NEW: Too many open files Jan 15 09:51:29 zeus lmtpunix[24100]: IOERROR: creating quota file /var/imap/quota/i/user.user2.NEW: Too many open files Jan 15 09:51:50 zeus lmtpunix[24100]: IOERROR: opening quota file /var/imap/quota/f/user.user3: Too many open files Jan 15 09:52:01 zeus lmtpunix[24100]: IOERROR: opening quota file /var/imap/quota/i/user.user4: Too many open files Jan 15 10:34:04 zeus lmtpunix[16510]: IOERROR: creating quota file /var/imap/quota/w/user.user5.NEW: Too many open files .. Are you sure cyrus is guilty and no simply suffering of another process ? You can use lsof command to see who open what. I've tried the following: --- Check file-max: cat /proc/sys/fs/file-max 359801 --- Checking ulimit: ulimit -a core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited max nice(-e) 0 file size (blocks, -f) unlimited pending signals (-i) unlimited max locked memory (kbytes, -l) unlimited max memory size (kbytes, -m) unlimited open files (-n) 1024 pipe size(512 bytes, -p) 8 POSIX message queues (bytes, -q) unlimited max rt priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) unlimited virtual memory (kbytes, -v) unlimited file locks (-x) unlimited Set ulimit -n 1 on start-up script - No effect :( --- Changed NR_OPEN and NR_FILE in kernel, recompile - No effect :( --- Anybody an idea ? Regards, Tom Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Mailbox problems
Dear all,
We are using Cyrus 2.3.10 and are expiring the problem that mailboxes
sometimes goes 'corrupt'.
This means that messages are still being delivered but cannot be read by
imap or pop3.
I ran a debug on one of the mailboxes that was crashed and monitored the
imap process:
times({tms_utime=6, tms_stime=3, tms_cutime=0, tms_cstime=0}) = -1262862595
write(1, * 197 FETCH (UID 8200)\r\n002d..., 59) = 59
open(/var/imap/msg/shutdown, O_RDONLY) = -1 ENOENT (No such file or
directory)
time(NULL) = 1197548327
select(1, [0], NULL, NULL, {1800, 0}) = 1 (in [0], left {1800, 0})
time(NULL) = 1197548327
time(NULL) = 1197548327
select(1, [0], NULL, NULL, {1800, 0}) = 1 (in [0], left {1800, 0})
time(NULL) = 1197548327
time(NULL) = 1197548327
read(0, 002e UID FETCH 8199 UID\r\n, 4096) = 29
times({tms_utime=6, tms_stime=3, tms_cutime=0, tms_cstime=0}) = -1262862595
stat64(/var/spool/imap/user/gino^marckx^xodiac^be/cyrus.index,
{st_mode=S_IFRE
G|0600, st_size=20600, ...}) = 0
fstat64(12, {st_mode=S_IFREG|0600, st_size=385016, ...}) = 0
times({tms_utime=6, tms_stime=3, tms_cutime=0, tms_cstime=0}) = -1262862595
write(1, * 196 FETCH (UID 8199)\r\n002e..., 59) = 59
open(/var/imap/msg/shutdown, O_RDONLY) = -1 ENOENT (No such file or
directory)
time(NULL) = 1197548327
select(1, [0], NULL, NULL, {1800, 0}) = 1 (in [0], left {1800, 0})
time(NULL) = 1197548327
time(NULL) = 1197548327
select(1, [0], NULL, NULL, {1800, 0}) = 1 (in [0], left {1800, 0})
time(NULL) = 1197548327
time(NULL) = 1197548327
read(0, 002f UID FETCH 8198 UID\r\n, 4096) = 29
times({tms_utime=6, tms_stime=3, tms_cutime=0, tms_cstime=0}) = -1262862595
stat64(/var/spool/imap/user/gino^marckx^xodiac^be/cyrus.index,
{st_mode=S_IFRE
G|0600, st_size=20600, ...}) = 0
fstat64(12, {st_mode=S_IFREG|0600, st_size=385016, ...}) = 0
times({tms_utime=6, tms_stime=3, tms_cutime=0, tms_cstime=0}) = -1262862595
write(1, * 195 FETCH (UID 8198)\r\n002f..., 59) = 59
open(/var/imap/msg/shutdown, O_RDONLY) = -1 ENOENT (No such file or
directory)
time(NULL) = 1197548327
select(1, [0], NULL, NULL, {1800, 0}) = 1 (in [0], left {1800, 0})
time(NULL) = 1197548327
time(NULL) = 1197548327
select(1, [0], NULL, NULL, {1800, 0}) = 1 (in [0], left {1800, 0})
time(NULL) = 1197548327
time(NULL) = 1197548327
read(0, 0030 UID FETCH 8197 UID\r\n, 4096) = 29
times({tms_utime=6, tms_stime=3, tms_cutime=0, tms_cstime=0}) = -1262862594
stat64(/var/spool/imap/user/gino^marckx^xodiac^be/cyrus.index,
{st_mode=S_IFRE
G|0600, st_size=20600, ...}) = 0
fstat64(12, {st_mode=S_IFREG|0600, st_size=385016, ...}) = 0
times({tms_utime=6, tms_stime=3, tms_cutime=0, tms_cstime=0}) = -1262862594
write(1, * 194 FETCH (UID 8197)\r\n0030..., 59) = 59
open(/var/imap/msg/shutdown, O_RDONLY) = -1 ENOENT (No such file or
directory)
time(NULL) = 1197548327
select(1, [0], NULL, NULL, {1800, 0}) = 1 (in [0], left {1800, 0})
time(NULL) = 1197548327
time(NULL) = 1197548327
select(1, [0], NULL, NULL, {1800, 0}) = 1 (in [0], left {1800, 0})
time(NULL) = 1197548327
time(NULL) = 1197548327
read(0, 0031 UID FETCH 8196 UID\r\n, 4096) = 29
times({tms_utime=6, tms_stime=3, tms_cutime=0, tms_cstime=0}) = -1262862593
stat64(/var/spool/imap/user/gino^marckx^xodiac^be/cyrus.index,
{st_mode=S_IFRE
G|0600, st_size=20600, ...}) = 0
fstat64(12, {st_mode=S_IFREG|0600, st_size=385016, ...}) = 0
times({tms_utime=6, tms_stime=3, tms_cutime=0, tms_cstime=0}) = -1262862593
write(1, * 193 FETCH (UID 8196)\r\n0031..., 59) = 59
open(/var/imap/msg/shutdown, O_RDONLY) = -1 ENOENT (No such file or
directory)
time(NULL) = 1197548327
select(1, [0], NULL, NULL, {1800, 0}) = 1 (in [0], left {1800, 0})
time(NULL) = 1197548327
time(NULL) = 1197548327
select(1, [0], NULL, NULL, {1800, 0}) = 1 (in [0], left {1800, 0})
time(NULL) = 1197548327
time(NULL) = 1197548327
read(0, 0032 UID FETCH 8195 UID\r\n, 4096) = 29
times({tms_utime=6, tms_stime=3, tms_cutime=0, tms_cstime=0}) = -1262862593
stat64(/var/spool/imap/user/gino^marckx^xodiac^be/cyrus.index,
{st_mode=S_IFRE
G|0600, st_size=20600, ...}) = 0
fstat64(12, {st_mode=S_IFREG|0600, st_size=385016, ...}) = 0
times({tms_utime=6, tms_stime=3, tms_cutime=0, tms_cstime=0}) = -1262862593
write(1, * 192 FETCH (UID 8195)\r\n0032..., 59) = 59
