Re: sos on cyrusimapd
On 06/27/2018 11:44 AM, Albert Shih wrote: Le 27/06/2018 à 11:27:48-0400, Eric W. Bates a écrit Yah. You need to crank up some buffer sizes. This is an excellent document (written for FreeBSD 10): https://calomel.org/freebsd_network_tuning.html Yes I already find that page I think the one you're bumping your head on is: kern.ipc.maxsockbuf but the problem is It's already high according to what netstat -m say I got [root@zenobe /usr/home]# sysctl -a kern.ipc.maxsockbuf kern.ipc.maxsockbuf: 2097152 Ours is: kern.ipc.maxsockbuf: 4194304 [root@zenobe /usr/home]# netstat -m 35091/25314/60405 mbufs in use (current/cache/total) 33072/11170/44242/12180860 mbuf clusters in use (current/cache/total/max) 33072/7914 mbuf+clusters out of packet secondary zone in use (current/cache) 1254/4242/5496/6090429 4k (page size) jumbo clusters in use (current/cache/total/max) 0/0/0/1804571 9k jumbo clusters in use (current/cache/total/max) 0/0/0/1015071 16k jumbo clusters in use (current/cache/total/max) 79932K/45636K/125569K bytes allocated to network (current/cache/total) 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) 0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters) 0/0/0 requests for jumbo clusters delayed (4k/9k/16k) 0/0/0 requests for jumbo clusters denied (4k/9k/16k) 0 sendfile syscalls and both mbufs denied/delayed are at 0. Yup. That looks pretty healthy. but you shouldn't crank it up by itself. Do you think I should still increase that maxsockbuf ? Do you have anything special tweaking you kernel ? Well. Everything I did I got from the calomel documents; but this is what I set: kern.ipc.maxsockbuf=4194304 # (default 2097152) net.inet.tcp.sendbuf_max=4194304 # (default 2097152) net.inet.tcp.recvbuf_max=4194304 # (default 2097152) net.inet.tcp.mssdflt=1460 # (default 536) net.inet.tcp.minmss=1300 # (default 216) net.inet.tcp.cc.algorithm=htcp # (default newreno) net.inet.tcp.cc.htcp.adaptive_backoff=1 # (default 0 ; disabled) net.inet.tcp.cc.htcp.rtt_scaling=1 # (default 0 ; disabled) net.inet.tcp.syncache.rexmtlimit=0 # (default 3) net.inet.ip.rtexpire=10 # (default 3600) net.inet.tcp.syncookies=0 # (default 1) net.inet.tcp.tso=0 # (default 1) kern.ipc.soacceptqueue=32768 # (default 128 ; same as kern.ipc.somaxconn) net.inet.tcp.delayed_ack=0 Been quite a while since we set all that up and it's been performing well. Regards. So today I switch all my user from my old server to the new one running cyrus-imapd 3.0.7 with FreeBSD 11.1-p11. The server get 192Go of Ram. Currently I got lot of disconnection from MUA (mutt), the client going to keep the connection during let's say few minutes and then I lost the connection (nothing to do with the network). If I relaunch just after de disconnection, I can get back maibox pretty quickly, back maibox very slowly connection error (strange SSL I/O error on the client) On the server I didn't see lot of message, only this strange onewconn: pcb 0xf8276c40e570: Listen queue overflow: 49 already in queue awaiting acceptance (209 occurrences) knowing I'm not able to find the pcb f8276c40e570 with netstat or lsof, event it not change in time. I guessing I mis configure something...but what ? I know the server are under heavy load because all my user's client are re-synchronize their mailbox. But well It's not very good... Is anybody running cyrusimapd on FreeBSD have tuning some special variable in the kernel through sysctl ? Regards -- Albert SHIH Observatoire de Paris xmpp: j...@obspm.fr Heure local/Local time: Wed Jun 27 16:03:10 CEST 2018 Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus -- Albert SHIH DIO bâtiment 15 Observatoire de Paris 5 Place Jules Janssen 92195 Meudon Cedex France ☏ +33 1 45 07 76 26/+33 6 86 69 95 71 xmpp: j...@obspm.fr Heure local/Local time: Wed Jun 27 17:41:04 CEST 2018 smime.p7s Description: S/MIME Cryptographic Signature Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: sos on cyrusimapd
Le 27/06/2018 à 11:27:48-0400, Eric W. Bates a écrit > Yah. You need to crank up some buffer sizes. > > This is an excellent document (written for FreeBSD 10): > https://calomel.org/freebsd_network_tuning.html Yes I already find that page > > I think the one you're bumping your head on is: > kern.ipc.maxsockbuf but the problem is It's already high according to what netstat -m say I got [root@zenobe /usr/home]# sysctl -a kern.ipc.maxsockbuf kern.ipc.maxsockbuf: 2097152 [root@zenobe /usr/home]# netstat -m 35091/25314/60405 mbufs in use (current/cache/total) 33072/11170/44242/12180860 mbuf clusters in use (current/cache/total/max) 33072/7914 mbuf+clusters out of packet secondary zone in use (current/cache) 1254/4242/5496/6090429 4k (page size) jumbo clusters in use (current/cache/total/max) 0/0/0/1804571 9k jumbo clusters in use (current/cache/total/max) 0/0/0/1015071 16k jumbo clusters in use (current/cache/total/max) 79932K/45636K/125569K bytes allocated to network (current/cache/total) 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) 0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters) 0/0/0 requests for jumbo clusters delayed (4k/9k/16k) 0/0/0 requests for jumbo clusters denied (4k/9k/16k) 0 sendfile syscalls and both mbufs denied/delayed are at 0. > > but you shouldn't crank it up by itself. Do you think I should still increase that maxsockbuf ? Do you have anything special tweaking you kernel ? Regards. > > > > So today I switch all my user from my old server to the new one running > > cyrus-imapd 3.0.7 with FreeBSD 11.1-p11. > > > > The server get 192Go of Ram. > > > > Currently I got lot of disconnection from MUA (mutt), the client going to > > keep the connection during let's say few minutes and then I lost the > > connection (nothing to do with the network). > > > > If I relaunch just after de disconnection, I can get > > > >back maibox pretty quickly, > >back maibox very slowly > >connection error (strange SSL I/O error on the client) > > > > On the server I didn't see lot of message, only this strange > > > >onewconn: pcb 0xf8276c40e570: Listen queue overflow: 49 already in > > queue awaiting acceptance (209 occurrences) > > > > knowing I'm not able to find the pcb f8276c40e570 with netstat or lsof, > > event it not change in time. > > > > I guessing I mis configure something...but what ? > > > > I know the server are under heavy load because all my user's client are > > re-synchronize their mailbox. But well It's not very good... > > > > Is anybody running cyrusimapd on FreeBSD have tuning some special variable > > in the kernel through sysctl ? > > > > Regards > > > > -- > > Albert SHIH > > Observatoire de Paris > > xmpp: j...@obspm.fr > > Heure local/Local time: > > Wed Jun 27 16:03:10 CEST 2018 > > > > Cyrus Home Page: http://www.cyrusimap.org/ > > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > > To Unsubscribe: > > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus > > > > > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ > To Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus -- Albert SHIH DIO bâtiment 15 Observatoire de Paris 5 Place Jules Janssen 92195 Meudon Cedex France ☏ +33 1 45 07 76 26/+33 6 86 69 95 71 xmpp: j...@obspm.fr Heure local/Local time: Wed Jun 27 17:41:04 CEST 2018 Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: sos on cyrusimapd
Yah. You need to crank up some buffer sizes. This is an excellent document (written for FreeBSD 10): https://calomel.org/freebsd_network_tuning.html I think the one you're bumping your head on is: kern.ipc.maxsockbuf but you shouldn't crank it up by itself. On 06/27/2018 10:09 AM, Albert Shih wrote: Hi everyone, So today I switch all my user from my old server to the new one running cyrus-imapd 3.0.7 with FreeBSD 11.1-p11. The server get 192Go of Ram. Currently I got lot of disconnection from MUA (mutt), the client going to keep the connection during let's say few minutes and then I lost the connection (nothing to do with the network). If I relaunch just after de disconnection, I can get back maibox pretty quickly, back maibox very slowly connection error (strange SSL I/O error on the client) On the server I didn't see lot of message, only this strange onewconn: pcb 0xf8276c40e570: Listen queue overflow: 49 already in queue awaiting acceptance (209 occurrences) knowing I'm not able to find the pcb f8276c40e570 with netstat or lsof, event it not change in time. I guessing I mis configure something...but what ? I know the server are under heavy load because all my user's client are re-synchronize their mailbox. But well It's not very good... Is anybody running cyrusimapd on FreeBSD have tuning some special variable in the kernel through sysctl ? Regards -- Albert SHIH Observatoire de Paris xmpp: j...@obspm.fr Heure local/Local time: Wed Jun 27 16:03:10 CEST 2018 Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus smime.p7s Description: S/MIME Cryptographic Signature Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
sos on cyrusimapd
Hi everyone, So today I switch all my user from my old server to the new one running cyrus-imapd 3.0.7 with FreeBSD 11.1-p11. The server get 192Go of Ram. Currently I got lot of disconnection from MUA (mutt), the client going to keep the connection during let's say few minutes and then I lost the connection (nothing to do with the network). If I relaunch just after de disconnection, I can get back maibox pretty quickly, back maibox very slowly connection error (strange SSL I/O error on the client) On the server I didn't see lot of message, only this strange onewconn: pcb 0xf8276c40e570: Listen queue overflow: 49 already in queue awaiting acceptance (209 occurrences) knowing I'm not able to find the pcb f8276c40e570 with netstat or lsof, event it not change in time. I guessing I mis configure something...but what ? I know the server are under heavy load because all my user's client are re-synchronize their mailbox. But well It's not very good... Is anybody running cyrusimapd on FreeBSD have tuning some special variable in the kernel through sysctl ? Regards -- Albert SHIH Observatoire de Paris xmpp: j...@obspm.fr Heure local/Local time: Wed Jun 27 16:03:10 CEST 2018 Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: switch master/slve replication
* 27/06/2018, Bron Gondwana wrote : >Yep, that will be enough. The only thing it might not catch is if >there are users on the replica which aren't present on the master (for >whatever reason)... in that case, they will remain on the replica >still. ok I check, but I don't think I have other user on replica. thanks a lot for reply Antonio -- Never try to teach a pig to sing. It wastes your time and annoys the pig. Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: switch master/slve replication
Yep, that will be enough. The only thing it might not catch is if there are users on the replica which aren't present on the master (for whatever reason)... in that case, they will remain on the replica still. Bron. On Wed, Jun 27, 2018, at 13:26, Antonio Conte wrote: > hi all, > > I have to switch a master/replica in rolling replication. > > How I can be sure the replication is totally done ? it's > enough to run > > /usr/lib/cyrus/sync_client -v -A > > from master ? and then, which operation I have to do ? > > thanks in advance > > -- > Never try to teach a pig to sing. > It wastes your time and annoys the pig. > > Cyrus Home Page: http://www.cyrusimap.org/ > List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/> To > Unsubscribe: > https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus -- Bron Gondwana, CEO, FastMail Pty Ltd br...@fastmailteam.com Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
