> -----Original Message----- > From: [email protected] [mailto:rsyslog- > [email protected]] On Behalf Of David Lang > Sent: Tuesday, October 6, 2015 12:49 PM > To: rsyslog-users <[email protected]> > Subject: Re: [rsyslog] RHEL7.1 / rsyslog 8.x random message loss > > > Thank you both David and Rainer - I really appreciate the detailed > responses > > and it's already helping put my box in a better state. > > good to hear > > > I used the impstats analyzer and started increasing dynaFileCacheSize for > > the actions that were problematic. CPU usage increased by about 2.5x and > > context switches went up to 800k for about 15 minutes after I restarted > > rsyslogd but seems to have settled back in around 60-70% and around 100k > > context switches now. Top showed three in:imtcp threads as the busiest > > during that time. > > a backlog of inbound messages via tcp after a restart isn't unusual. > > with heavy inbound tcp use you may want to look at using imptcp instead of > imtcp. > > > Cacti stats show about half the number of disk operations as before. So it > > seems to be a general performance gain, but it did not affect message loss, > > however, as I can already see that some messages have disappeared. > > I'm surprised it didn't help more than that. what do the impstats look like.
Impstats looks good - only two dynafiles that still have evictions, which I'll tune a little more now. See bottom of message for a full recent output. > > > Regarding queues, some of my rules in each ruleset do forward messages > to > > another host (a SIEM) over TCP. Should I keep the queue to support that, > or > > is TCP good enough? > > it's a good idea to have a queue on outbound delivery methods that can > block > because if the remote system goes down it will block all message processing. > Consider using a disk queue for this as well (to hand an extended outage of > the > remote system) > > also note for the record that TCP is not as reliable as you may be thinking. > https://urldefense.proofpoint.com/v2/url?u=http- > 3A__blog.gerhards.net_2008_04_on-2Dunreliability-2Dof-2Dplain-2Dtcp- > 2Dsyslog.html&d=BQICAg&c=kbmfwr1Yojg42sGEpaQh5ofMHBeTl9EI2eaqQZ > hHbOU&r=0S5vJ8-FmQy6Qk5D6_T4U9EYbkCcMc4ijDuyUem89Lk&m=N- > 1ExMOcN75_9w1gY8ODemHdzRwHC_SeAxYSaAEb4P0&s=XiOr6GhA1NvhGT > keIJGzrwxy7vjn6FYRasLdeBoLCvo&e= Thanks. That is definitely important to me so I will look into creating a disk queue for outbound messages once I get this missing message issue worked out. > > > RH support suggests turning of DNS lookups. Would that have any affect? > > We've come to rely on hostname for creating directories for each server. > > the %hostname% variable is what the sending system puts in the message, > DNS > lookups aren't needed for that. Turning off DNS will avoid delays on UDP > messages. With DNS lookups, a slow DNS server can cause delays (without > rsyslog > using CPU) that can end up causing some messages to be lost if the OS > queues end > up running out of space. We have several %fromhost% templates for servers. I noticed that there is a rush of DNS requests when rsyslog first starts up but then it quiets down due to the internal caching. I also have a local DNS cache running to point to - not currently set - but when I did have the system pointed there, I still had missing messages. > > Now that you have addressed some of the worst problems in your config, > let's > talk about the log loss problem. > > are you loosing messages that arrive via UDP or TCP (or both)? Losing messages in both. Currently I'm testing with a port dedicated to just one log source that I am continuously having problems with, and I'm sending UDP right now. The port is 10517 and the config is: template(name="EduroamACSFile" type="string" string="/var/log/collection/eduroam_acs.log") template(name="EduroamACSFormat" type="string" string="%timestamp% %hostname% %syslogtag%%msg:::escape-cc%\n") ruleset(name="TestingRuleSet") { *.* { /tmp/debug.log;RSYSLOG_DebugFormat action(type="omfile" dynaFile="EduroamACSFile" template="EduroamACSFormat" name="writeEduroamACSFile") stop } } # end ruleset # bind the listening ports to the ruleset input(type="imudp" port="10517" ruleset="TestingRuleSet") input(type="imtcp" port="10517" ruleset="TestingRuleSet") I haven't had a message appear in /tmp/debug or in eduroam_acs since 11:01 this morning, even with several rsyslogd restarts since then. Last message in my log file (sanitized by me): Oct 6 11:01:06 <hostname> CSCOacs_Passed_Authentications 0000129983 2 1 Step=11001 , Step=11017 , Step=15008 , Step=15004 , Step=15012 , Step=11358 , Step=11361 , Step=11355 , Step=11100 , Step=11101 , Step=11357 , Step=11002 , NetworkDeviceName=... msg continues But tcpdump shows data coming into the box to port 10517 UDP: 16:26:36.751119 IP x.x.2.85.55422 > x.x.101.70.10517: UDP, length 1015 E.....@.<......U..eF.~)....4<181>Oct 6 16:26:36 <hostname> CSCOacs_Passed_Authentications 0000131246 2 0 2015-10-06 16:26:36.749 -04:00 0006519073 5200 NOTICE Passed-Authentication: Authentication succeeded, ACS... msg continues Iptables is on with a rule to allow the traffic, but I also tested with iptables disabled - still the same thing, tcpdump sees them, rsyslog does not. I just noticed this in impstats: Oct 6 16:27:45 its-syslog-up1 rsyslogd-pstats: imudp(*:10517): origin=imudp submitted=1221 Oct 6 16:27:45 its-syslog-up1 rsyslogd-pstats: imudp(*:10517): origin=imudp submitted=0 There's a count! So is rsyslog getting the messages and somewhere losing them? > > what are you doing to roll logs? are you doing a restart of rsyslog or a HUP? > Do > you have HUPisRestart turned on? logs will be lost when you do a restart > (messages in the memory queues will be lost when you shutdown for a > restart) We roll using logrotate, doing a HUP. We do not have HUPisRestart turned on, so I'm assuming the default is off? Thank you, Dan > > David Lang > Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: imuxsock: origin=imuxsock submitted=6439 ratelimit.discarded=0 ratelimit.numratelimiters=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache StatsFile: origin=omfile requests=7336 level0=7310 missed=26 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 1: origin=core.action processed=7336 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 2: origin=core.action processed=108425803 failed=0 suspended=1 suspended.duration=30 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache LDAPFile: origin=omfile requests=26674874 level0=26674848 missed=26 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 3: origin=core.action processed=26674874 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache LinuxIPTablesFile: origin=omfile requests=2882819 level0=381006 missed=2117 evicted=0 maxused=87 closetimeouts=11 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 4: origin=core.action processed=2882819 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache LinuxUFWFile: origin=omfile requests=0 level0=0 missed=0 evicted=0 maxused=0 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 5: origin=core.action processed=0 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache DHCPFile: origin=omfile requests=122175 level0=122149 missed=26 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 6: origin=core.action processed=122175 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache LinuxBlankProgramFile: origin=omfile requests=1088 level0=697 missed=59 evicted=0 maxused=6 closetimeouts=10 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 7: origin=core.action processed=1088 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache LinuxProgramFile: origin=omfile requests=8458431 level0=5881408 missed=9199 evicted=0 maxused=737 closetimeouts=1546 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 8: origin=core.action processed=8458431 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache 10514Catchall: origin=omfile requests=0 level0=0 missed=0 evicted=0 maxused=0 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 9: origin=core.action processed=0 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache WindowsSecFile: origin=omfile requests=6311546 level0=5112528 missed=6221 evicted=0 maxused=394 closetimeouts=453 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 10: origin=core.action processed=6311546 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache WindowsSecFile: origin=omfile requests=273 level0=263 missed=10 evicted=0 maxused=1 closetimeouts=5 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 11: origin=core.action processed=273 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache WindowsAppFile: origin=omfile requests=341539 level0=212797 missed=3224 evicted=0 maxused=200 closetimeouts=357 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 12: origin=core.action processed=341539 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache WindowsSysFile: origin=omfile requests=140671 level0=63326 missed=3840 evicted=0 maxused=308 closetimeouts=682 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 13: origin=core.action processed=140671 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache ParkingPayStationFile: origin=omfile requests=0 level0=0 missed=0 evicted=0 maxused=0 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 14: origin=core.action processed=0 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache WindowsProgramFileNoDotLog: origin=omfile requests=30472247 level0=28731416 missed=89412 evicted=73024 maxused=1500 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 15: origin=core.action processed=30472247 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache WindowsProgramFile: origin=omfile requests=104619 level0=82912 missed=327 evicted=0 maxused=28 closetimeouts=36 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 16: origin=core.action processed=104619 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 17: origin=core.action processed=637 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache EduroamACSFile: origin=omfile requests=637 level0=626 missed=11 evicted=0 maxused=1 closetimeouts=1 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: writeEduroamACSFile: origin=core.action processed=637 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache ProofpointMailFile: origin=omfile requests=89183 level0=89157 missed=26 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 19: origin=core.action processed=89183 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache ProofpointMailFile: origin=omfile requests=328117 level0=328091 missed=26 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 20: origin=core.action processed=328117 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache ProofpointMailFile: origin=omfile requests=12404912 level0=12404886 missed=26 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 21: origin=core.action processed=12404912 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 22: origin=core.action processed=1130 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache EduroamACSFile: origin=omfile requests=1130 level0=1120 missed=10 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: writeEduroamACSFile: origin=core.action processed=1130 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 24: origin=core.action processed=0 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache EduroamACSFile: origin=omfile requests=0 level0=0 missed=0 evicted=0 maxused=0 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: writeEduroamACSFile: origin=core.action processed=0 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache InternetFirewallFile: origin=omfile requests=242 level0=233 missed=9 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 26: origin=core.action processed=242 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache DatacenterFirewallsFile: origin=omfile requests=682 level0=669 missed=13 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 27: origin=core.action processed=682 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache GuestFirewallFile: origin=omfile requests=59149407 level0=59149381 missed=26 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 28: origin=core.action processed=59149407 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 29: origin=core.action processed=542 failed=0 suspended=1 suspended.duration=10620 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 30: origin=core.action processed=57514984 failed=0 suspended=1 suspended.duration=30 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache PAUPNSFile: origin=omfile requests=57514984 level0=57514958 missed=26 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 31: origin=core.action processed=57514984 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache InternetFirewallFile: origin=omfile requests=173882046 level0=173882020 missed=26 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 32: origin=core.action processed=173882046 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache DatacenterFirewallsFile: origin=omfile requests=64076211 level0=64076185 missed=26 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 33: origin=core.action processed=64076211 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache VPNFile: origin=omfile requests=1708364 level0=1708338 missed=26 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 34: origin=core.action processed=1708364 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache OtherFirewallsFile: origin=omfile requests=28994244 level0=28994218 missed=26 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 35: origin=core.action processed=28994244 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache F5TrafficFile: origin=omfile requests=0 level0=0 missed=0 evicted=0 maxused=0 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 36: origin=core.action processed=0 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache F5SystemFile: origin=omfile requests=16466 level0=16440 missed=26 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 37: origin=core.action processed=16466 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache UCSFile: origin=omfile requests=19088 level0=19071 missed=17 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 38: origin=core.action processed=19088 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache WirelessMSEFile: origin=omfile requests=237753 level0=237727 missed=26 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 39: origin=core.action processed=237753 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache RouterSwitchFile: origin=omfile requests=89509 level0=89483 missed=26 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 40: origin=core.action processed=89509 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache WirelessFile: origin=omfile requests=42445 level0=42419 missed=26 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 41: origin=core.action processed=42445 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache WirelessSNMPTrapFile: origin=omfile requests=891596 level0=891570 missed=26 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 42: origin=core.action processed=891596 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 43: origin=core.action processed=15 failed=0 suspended=1 suspended.duration=150 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache InfoBloxDNSFile: origin=omfile requests=836375 level0=836349 missed=26 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 44: origin=core.action processed=836375 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache GuestDHCPFile: origin=omfile requests=132730 level0=132704 missed=26 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 45: origin=core.action processed=132730 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache DHCPFile: origin=omfile requests=1069885 level0=1069859 missed=26 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 46: origin=core.action processed=1069885 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache InfoBloxTFTPFile: origin=omfile requests=1048 level0=1028 missed=20 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 47: origin=core.action processed=1048 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache InfoBloxFTPFile: origin=omfile requests=9213 level0=9188 missed=25 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 48: origin=core.action processed=9213 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache InfoBloxSystemFile: origin=omfile requests=232 level0=228 missed=4 evicted=0 maxused=1 closetimeouts=1 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 49: origin=core.action processed=232 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache WirelessFile: origin=omfile requests=0 level0=0 missed=0 evicted=0 maxused=0 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 50: origin=core.action processed=0 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache IPSNSCFile: origin=omfile requests=13 level0=0 missed=13 evicted=0 maxused=1 closetimeouts=8 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 51: origin=core.action processed=13 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache PAPanoramaFile: origin=omfile requests=36 level0=30 missed=6 evicted=0 maxused=1 closetimeouts=4 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 52: origin=core.action processed=36 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache VMwareFile: origin=omfile requests=581083 level0=516876 missed=233 evicted=0 maxused=9 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 53: origin=core.action processed=581083 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache NimbleStorageFile: origin=omfile requests=39 level0=32 missed=7 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 54: origin=core.action processed=39 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache TandbergFile: origin=omfile requests=72580 level0=72554 missed=26 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 55: origin=core.action processed=72580 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache WirelessACSFile: origin=omfile requests=618687 level0=618661 missed=26 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 56: origin=core.action processed=618687 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache CiscoTACACSFile: origin=omfile requests=44331 level0=44305 missed=26 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 57: origin=core.action processed=44331 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache WifiVoiceFile: origin=omfile requests=736921 level0=736895 missed=26 evicted=0 maxused=1 closetimeouts=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 58: origin=core.action processed=736921 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: dynafile cache 514Catchall: origin=omfile requests=50299 level0=36136 missed=735 evicted=47 maxused=100 closetimeouts=244 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 59: origin=core.action processed=50299 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 60: origin=core.action processed=0 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 61: origin=core.action processed=0 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 62: origin=core.action processed=0 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 63: origin=core.action processed=0 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 64: origin=core.action processed=0 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 65: origin=core.action processed=0 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 66: origin=core.action processed=36 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 67: origin=core.action processed=41016 failed=0 suspended=1 suspended.duration=60 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 68: origin=core.action processed=8298 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 69: origin=core.action processed=3901 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 70: origin=core.action processed=2481 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 71: origin=core.action processed=5 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 72: origin=core.action processed=52 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 73: origin=core.action processed=0 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 74: origin=core.action processed=0 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: action 75: origin=core.action processed=0 failed=0 suspended=0 suspended.duration=0 resumed=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: imudp(*:10514): origin=imudp submitted=10900869 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: imudp(*:10514): origin=imudp submitted=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: imudp(*:10515): origin=imudp submitted=676365 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: imudp(*:10515): origin=imudp submitted=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: imudp(*:10516): origin=imudp submitted=12822849 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: imudp(*:10516): origin=imudp submitted=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: imudp(*:10517): origin=imudp submitted=1130 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: imudp(*:10517): origin=imudp submitted=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: imudp(*:514): origin=imudp submitted=390437143 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: imudp(*:514): origin=imudp submitted=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: imtcp(10514): origin=imtcp submitted=27238551 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: imtcp(10515): origin=imtcp submitted=50065552 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: imtcp(10516): origin=imtcp submitted=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: imtcp(10517): origin=imtcp submitted=0 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: imtcp(514): origin=imtcp submitted=339386 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: resource-usage: origin=impstats utime=6625944724 stime=3284847869 maxrss=210904 minflt=2992266 majflt=0 inblock=30816 oublock=211128048 nvcsw=594151352 nivcsw=131912 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: main Q: origin=core.queue size=149 enqueued=492522977 full=51 discarded.full=0 discarded.nf=0 maxqsize=100000 Oct 6 16:07:44 its-syslog-up1 rsyslogd-pstats: imudp(w0): origin=imudp called.recvmmsg=504549565 called.recvmsg=0 msgs.received=414838368
smime.p7s
Description: S/MIME cryptographic signature
_______________________________________________ rsyslog mailing list http://lists.adiscon.net/mailman/listinfo/rsyslog http://www.rsyslog.com/professional-services/ What's up with rsyslog? Follow https://twitter.com/rgerhards NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.
