-------- Original-Nachricht -------- > Datum: Tue, 25 Aug 2009 19:16:37 +0200 > Von: Josephus <[email protected]> > An: Karl Pielorz <[email protected]> > CC: [email protected] > Betreff: Re: [Dspam-user] trouble connecting to mysql on heavy load
> Karl Pielorz wrote: > > > > > > --On 25 August 2009 01:52 +0200 Josephus <[email protected]> wrote: > > > >> > >> I have compiled the most recent git snapshot on FreeBSD 7.2. > > > >> Aug 25 00:46:38 mail dspam[31755]: Can't connect to MySQL server on > >> '10.1.0.1' (1) > > > > We had a similar issue here (FreeBSD 7.2, DSpam 3.8.0) - setting 'max > > connections' under mysql to 1,000 seemed to fix it. > > > > The system doesn't need anywhere near that many connections - but I > > think something with mysql gets lagged behind on high connection churn > > rates. > > > > Another system we have (using different software) had a similar issue > > on highly churned connections - we had to go to 4,000 connections on > > that one. > > > > Worked for us, but YMMV :) > > > > -Kp > No luck, I set it as high as 3000, but still the same. I'm new to dspam > and I'm not familiar with its design that well, but would it be possible > to use persistent mysql connections? > > Threads: 2 Questions: 75091 Slow queries: 0 Opens: 20 Flush tables: > 1 Open tables: 13 Queries per second avg: 197.607 > (We are talking about 5.1.35) > > "show full processlist" only shows one connection at a time for dspam, > I can not confirm that with DSPAM 3.9.0 GIT and with MySQL 5.1.37. I checked on two nodes so far. Node 1: *************************** 5. row *************************** Id: 24949 User: sysusr_dspam Host: localhost db: sysdb_dspam Command: Sleep Time: 414008 State: Info: NULL *************************** 6. row *************************** Id: 24950 User: sysusr_dspam Host: localhost db: sysdb_dspam Command: Sleep Time: 414008 State: Info: NULL *************************** 7. row *************************** Id: 24951 User: sysusr_dspam Host: localhost db: sysdb_dspam Command: Sleep Time: 414008 State: Info: NULL *************************** 8. row *************************** Id: 24952 User: sysusr_dspam Host: localhost db: sysdb_dspam Command: Sleep Time: 414008 State: Info: NULL *************************** 9. row *************************** Id: 24953 User: sysusr_dspam Host: localhost db: sysdb_dspam Command: Sleep Time: 543 State: Info: NULL *************************** 10. row *************************** Id: 24954 User: sysusr_dspam Host: localhost db: sysdb_dspam Command: Sleep Time: 36848 State: Info: NULL *************************** 11. row *************************** Id: 24955 User: sysusr_dspam Host: localhost db: sysdb_dspam Command: Sleep Time: 30322 State: Info: NULL *************************** 12. row *************************** Id: 24956 User: sysusr_dspam Host: localhost db: sysdb_dspam Command: Sleep Time: 414008 State: Info: NULL *************************** 13. row *************************** Id: 24957 User: sysusr_dspam Host: localhost db: sysdb_dspam Command: Sleep Time: 414008 State: Info: NULL *************************** 14. row *************************** Id: 24958 User: sysusr_dspam Host: localhost db: sysdb_dspam Command: Sleep Time: 414008 State: Info: NULL *************************** 15. row *************************** Id: 24959 User: sysusr_dspam Host: localhost db: sysdb_dspam Command: Sleep Time: 414008 State: Info: NULL *************************** 16. row *************************** Id: 24960 User: sysusr_dspam Host: localhost db: sysdb_dspam Command: Sleep Time: 414008 State: Info: NULL *************************** 17. row *************************** Id: 24961 User: sysusr_dspam Host: localhost db: sysdb_dspam Command: Sleep Time: 414008 State: Info: NULL *************************** 18. row *************************** Id: 24962 User: sysusr_dspam Host: localhost db: sysdb_dspam Command: Sleep Time: 414008 State: Info: NULL *************************** 19. row *************************** Id: 24963 User: sysusr_dspam Host: localhost db: sysdb_dspam Command: Sleep Time: 414008 State: Info: NULL *************************** 20. row *************************** Id: 24964 User: sysusr_dspam Host: localhost db: sysdb_dspam Command: Sleep Time: 414008 State: Info: NULL *************************** 21. row *************************** Id: 24965 User: sysusr_dspam Host: localhost db: sysdb_dspam Command: Sleep Time: 414008 State: Info: NULL *************************** 22. row *************************** Id: 24966 User: sysusr_dspam Host: localhost db: sysdb_dspam Command: Sleep Time: 414008 State: Info: NULL *************************** 23. row *************************** Id: 24967 User: sysusr_dspam Host: localhost db: sysdb_dspam Command: Sleep Time: 414008 State: Info: NULL *************************** 24. row *************************** Id: 24968 User: sysusr_dspam Host: localhost db: sysdb_dspam Command: Sleep Time: 414008 State: Info: NULL Node 2: *************************** 5. row *************************** Id: 26025 User: sysusr_dspam Host: theia.vunet.local:31674 db: sysdb_dspam Command: Sleep Time: 414383 State: Info: NULL *************************** 6. row *************************** Id: 26026 User: sysusr_dspam Host: theia.vunet.local:31675 db: sysdb_dspam Command: Sleep Time: 414383 State: Info: NULL *************************** 7. row *************************** Id: 26027 User: sysusr_dspam Host: theia.vunet.local:31676 db: sysdb_dspam Command: Sleep Time: 414383 State: Info: NULL *************************** 8. row *************************** Id: 26028 User: sysusr_dspam Host: theia.vunet.local:31677 db: sysdb_dspam Command: Sleep Time: 414383 State: Info: NULL *************************** 9. row *************************** Id: 26029 User: sysusr_dspam Host: theia.vunet.local:31678 db: sysdb_dspam Command: Sleep Time: 10 State: Info: NULL *************************** 10. row *************************** Id: 26030 User: sysusr_dspam Host: theia.vunet.local:31679 db: sysdb_dspam Command: Sleep Time: 35824 State: Info: NULL *************************** 11. row *************************** Id: 26031 User: sysusr_dspam Host: theia.vunet.local:31680 db: sysdb_dspam Command: Sleep Time: 11139 State: Info: NULL *************************** 12. row *************************** Id: 26032 User: sysusr_dspam Host: theia.vunet.local:31681 db: sysdb_dspam Command: Sleep Time: 414383 State: Info: NULL *************************** 13. row *************************** Id: 26033 User: sysusr_dspam Host: theia.vunet.local:31682 db: sysdb_dspam Command: Sleep Time: 383425 State: Info: NULL *************************** 14. row *************************** Id: 26034 User: sysusr_dspam Host: theia.vunet.local:31683 db: sysdb_dspam Command: Sleep Time: 414383 State: Info: NULL *************************** 15. row *************************** Id: 26035 User: sysusr_dspam Host: theia.vunet.local:31684 db: sysdb_dspam Command: Sleep Time: 414383 State: Info: NULL *************************** 16. row *************************** Id: 26036 User: sysusr_dspam Host: theia.vunet.local:31685 db: sysdb_dspam Command: Sleep Time: 414383 State: Info: NULL *************************** 17. row *************************** Id: 26037 User: sysusr_dspam Host: theia.vunet.local:31686 db: sysdb_dspam Command: Sleep Time: 414383 State: Info: NULL *************************** 18. row *************************** Id: 26038 User: sysusr_dspam Host: theia.vunet.local:31687 db: sysdb_dspam Command: Sleep Time: 414383 State: Info: NULL *************************** 19. row *************************** Id: 26039 User: sysusr_dspam Host: theia.vunet.local:31688 db: sysdb_dspam Command: Sleep Time: 414383 State: Info: NULL *************************** 20. row *************************** Id: 26040 User: sysusr_dspam Host: theia.vunet.local:31689 db: sysdb_dspam Command: Sleep Time: 414383 State: Info: NULL *************************** 21. row *************************** Id: 26041 User: sysusr_dspam Host: theia.vunet.local:31690 db: sysdb_dspam Command: Sleep Time: 414383 State: Info: NULL *************************** 22. row *************************** Id: 26042 User: sysusr_dspam Host: theia.vunet.local:31691 db: sysdb_dspam Command: Sleep Time: 414383 State: Info: NULL *************************** 23. row *************************** Id: 26043 User: sysusr_dspam Host: theia.vunet.local:31692 db: sysdb_dspam Command: Sleep Time: 414383 State: Info: NULL *************************** 24. row *************************** Id: 26044 User: sysusr_dspam Host: theia.vunet.local:31693 db: sysdb_dspam Command: Sleep Time: 414383 State: Info: NULL > however connection id goes up to 20000 in a few minutes due to > reconnects, maybe mysql is not freeing something after a disconnect or > it might be related to the networking stack? > There seems to be plenty of fds left though. > > # netstat -an | grep TIME_WAIT | grep 10.1.0.1 | wc -l > 3456 > Strange. What DSPAM version is that? Is it already 3.9.0? > kern.maxfiles: 8072 > kern.maxfilesperproc: 7264 > kern.openfiles: 506 > > # netstat -m > 258/1482/1740 mbufs in use (current/cache/total) > 256/1342/1598/17088 mbuf clusters in use (current/cache/total/max) > 256/755 mbuf+clusters out of packet secondary zone in use (current/cache) > > > BR, > Jos > > ------------------------------------------------------------------------------ > Let Crystal Reports handle the reporting - Free Crystal Reports 2008 > 30-Day > trial. Simplify your report design, integration and deployment - and focus > on > what you do best, core application coding. Discover what's new with > Crystal Reports now. http://p.sf.net/sfu/bobj-july > _______________________________________________ > Dspam-user mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/dspam-user -- Jetzt kostenlos herunterladen: Internet Explorer 8 und Mozilla Firefox 3 - sicherer, schneller und einfacher! http://portal.gmx.net/de/go/atbrowser ------------------------------------------------------------------------------ Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july _______________________________________________ Dspam-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/dspam-user
