Hi,
On 8 July 2014 14:50, Rainer Gerhards <[email protected]> wrote: > Two things: > > a) let us know what the actual problem is ;) > Ops! Forgot the most important part.... I couldn't see the logs on the remote server but actually I realized I did a misconfiguration.Fixed that but I see not all logs are arriving to the remote server. Here is an example. Local file: INFO *AbstractCassandraDaemon:322* - Cassandra shutting down... INFO CassandraDaemon:219 - Stop listening to thrift clients INFO Gossiper:1134 - Announcing shutdown INFO MessagingService:549 - Waiting for messaging service to quiesce *ERROR AbstractCassandraDaemon:135* - Exception in thread Thread[ACCEPT-/ 10.151.61.202,5,main] *java.lang.RuntimeException: java.net.SocketException: Socket closed at org.apache.cassandra.net.MessagingService$SocketThread.run(MessagingService.java:710)* Caused by: java.net.SocketException: Socket closed ..... Remote server: Jul 8 14:28:21 localring93-1 cassandra: shard93/localring:*INFO* *AbstractCassandraDaemon:322* - Cassandra shutting down... Jul 8 14:28:23 localring93-1 cassandra: shard93/localring:*ERROR AbstractCassandraDaemon:135* - Exception in thread Thread[ACCEPT-/ 10.151.61.202,5,main] Jul 8 14:28:23 localring93-1 cassandra: shard93/localring:*java.lang.RuntimeException: java.net.SocketException: Socket closed#012#011at org.apache.cassandra.net.MessagingService$SocketThread.run(MessagingService.java:710)* Local files are not logging the timestamp to avoid repeting it on remote server. But as you can see there are some missing lines on the remote server. That's not good. > b) 8.1.6 is an outdated past *development* version. No idea what was broken > at that time, don't even know if epoll mode worked correctly. Suggest to > update to 8.3.3. > Oh thanks. Using add-apt-repository -y ppa:adiscon/v8-stable. Got rsyslogd 8.2.0. That was the easier way for me to try deb packages on my Ubuntu server. The errors I wrote above are using this 8.2.0. Thanks, Xavi > > Rainer > > > On Tue, Jul 8, 2014 at 1:43 PM, Xavier Fustero <[email protected]> wrote: > > > Hi, > > > > I modified a Cassandra application to write to a file and use imfile in > > rsyslog to avoid the multiline logs headache. > > > > I am running rsyslogd 8.1.6 on both client and server. The rsyslog client > > is configured with this imfile: > > > > # Cassandra log > > input(type="imfile" > > File="/var/log/cassandra/system.log" > > Tag="cassandra" > > StateFile="stat-localring93-1" > > readMode="2" > > Severity="info" > > Facility="local2") > > > > Using a template for a dynamic file > > # Templates for logging remotely > > template(name="GroupApp" type="string" > > string="<%PRI%>%TIMESTAMP:::date-rfc3339% %HOSTNAME% > > %syslogtag%testingdirectory:%msg%\n" > > ) > > > > if $syslogfacility-text == 'local0' or $syslogfacility-text == 'local1' > or > > $syslogfacility-text == 'local2' then { > > action(type="omrelp" target="my_rsyslog_server" port="XXX" > > template="GroupApp" > > > > This template is used for many applications and it works. > > > > I am tunning cassandra permissions but I am testing it with the following > > persmissions: > > -rw-r--r-- 1 cassandra cassandra 68819 Jul 8 11:25 system.log > > > > I have launched the rsyslog in debug mode and found lines like the ones > > below. Don't understand what is wrong here.... > > > > Thanks a lot, > > Xavi > > > > > > > > 8724.960462242:7f8465f45700: DDDD: imfile event notification: rd 16[0], > wd > > (2, mask 00000002, cookie 0000, len 0) > > 8724.960497617:7f8465f45700: watch was MODIFID > > 8724.960508553:7f8465f45700: DDDD: imfile: wd 2 got file 0, dir -1 > > 8724.960524766:7f8465f45700: strm 0x7f8458000970: file 2 read 143 bytes > > 8724.960540272:7f8465f45700: strm 0x7f8458000970: file 2 read 0 bytes > > 8724.960568041:7f8465f45700: stream checking for file change on > > '/var/log/cassandra/system.log', inode 147/147 > > 8724.961306511:7f8465f45700: DDDD: imfile event notification: rd 16[0], > wd > > (2, mask 00000002, cookie 0000, len 0) > > 8724.961323707:7f8465f45700: watch was MODIFID > > 8724.961333731:7f8465f45700: DDDD: imfile: wd 2 got file 0, dir -1 > > 8724.961346822:7f8465f45700: strm 0x7f8458000970: file 2 read 123 bytes > > 8724.961360541:7f8465f45700: strm 0x7f8458000970: file 2 read 0 bytes > > 8724.961379270:7f8465f45700: stream checking for file change on > > '/var/log/cassandra/system.log', inode 147/147 > > 8724.975517956:7f8465f45700: DDDD: imfile event notification: rd 16[0], > wd > > (2, mask 00000002, cookie 0000, len 0) > > 8724.975537713:7f8465f45700: watch was MODIFID > > 8724.975555400:7f8465f45700: DDDD: imfile: wd 2 got file 0, dir -1 > > 8724.975570538:7f8465f45700: strm 0x7f8458000970: file 2 read 227 bytes > > 8724.975586518:7f8465f45700: strm 0x7f8458000970: file 2 read 0 bytes > > 8724.975607192:7f8465f45700: stream checking for file change on > > '/var/log/cassandra/system.log', inode 147/147 > > 8726.223181801:7f8465f45700: DDDD: imfile event notification: rd 16[0], > wd > > (2, mask 00000002, cookie 0000, len 0) > > 8726.223222283:7f8465f45700: watch was MODIFID > > 8726.223233392:7f8465f45700: DDDD: imfile: wd 2 got file 0, dir -1 > > 8726.223252494:7f8465f45700: strm 0x7f8458000970: file 2 read 108 bytes > > 8726.223267511:7f8465f45700: strm 0x7f8458000970: file 2 read 0 bytes > > 8726.223300058:7f8465f45700: stream checking for file change on > > '/var/log/cassandra/system.log', inode 147/147 > > 8726.250839063:7f8465f45700: DDDD: imfile event notification: rd 16[0], > wd > > (2, mask 00000002, cookie 0000, len 0) > > 8726.250860390:7f8465f45700: watch was MODIFID > > 8726.250870414:7f8465f45700: DDDD: imfile: wd 2 got file 0, dir -1 > > 8726.250884511:7f8465f45700: strm 0x7f8458000970: file 2 read 94 bytes > > 8726.250898340:7f8465f45700: strm 0x7f8458000970: file 2 read 0 bytes > > 8726.250919260:7f8465f45700: stream checking for file change on > > '/var/log/cassandra/system.log', inode 147/147 > > 8726.362849538:7f8465f45700: DDDD: imfile event notification: rd 16[0], > wd > > (2, mask 00000002, cookie 0000, len 0) > > 8726.362886487:7f8465f45700: watch was MODIFID > > 8726.362897480:7f8465f45700: DDDD: imfile: wd 2 got file 0, dir -1 > > 8726.362916266:7f8465f45700: strm 0x7f8458000970: file 2 read 73 bytes > > 8726.362930826:7f8465f45700: strm 0x7f8458000970: file 2 read 0 bytes > > 8726.362961331:7f8465f45700: stream checking for file change on > > '/var/log/cassandra/system.log', inode 147/147 > > 8726.365043313:7f8465f45700: DDDD: imfile event notification: rd 16[0], > wd > > (2, mask 00000002, cookie 0000, len 0) > > 8726.365059195:7f8465f45700: watch was MODIFID > > 8726.365068844:7f8465f45700: DDDD: imfile: wd 2 got file 0, dir -1 > > 8726.365082313:7f8465f45700: strm 0x7f8458000970: file 2 read 143 bytes > > 8726.365097233:7f8465f45700: strm 0x7f8458000970: file 2 read 0 bytes > > 8726.365116020:7f8465f45700: stream checking for file change on > > '/var/log/cassandra/system.log', inode 147/147 > > 8726.370472579:7f8465f45700: DDDD: imfile event notification: rd 16[0], > wd > > (2, mask 00000002, cookie 0000, len 0) > > 8726.370489599:7f8465f45700: watch was MODIFID > > 8726.370499573:7f8465f45700: DDDD: imfile: wd 2 got file 0, dir -1 > > 8726.370513159:7f8465f45700: strm 0x7f8458000970: file 2 read 123 bytes > > 8726.370526933:7f8465f45700: strm 0x7f8458000970: file 2 read 0 bytes > > 8726.370546615:7f8465f45700: stream checking for file change on > > '/var/log/cassandra/system.log', inode 147/147 > > 8726.395377647:7f8465f45700: DDDD: imfile event notification: rd 16[0], > wd > > (2, mask 00000002, cookie 0000, len 0) > > 8726.395404487:7f8465f45700: watch was MODIFID > > 8726.395415234:7f8465f45700: DDDD: imfile: wd 2 got file 0, dir -1 > > 8726.395431543:7f8465f45700: strm 0x7f8458000970: file 2 read 228 bytes > > 8726.395447460:7f8465f45700: strm 0x7f8458000970: file 2 read 0 bytes > > 8726.395491800:7f8465f45700: stream checking for file change on > > '/var/log/cassandra/system.log', inode 147/147 > > 8726.415947524:7f8465f45700: DDDD: imfile event notification: rd 16[0], > wd > > (2, mask 00000002, cookie 0000, len 0) > > 8726.415976445:7f8465f45700: watch was MODIFID > > 8726.415987581:7f8465f45700: DDDD: imfile: wd 2 got file 0, dir -1 > > 8726.416004499:7f8465f45700: strm 0x7f8458000970: file 2 read 93 bytes > > 8726.416018990:7f8465f45700: strm 0x7f8458000970: file 2 read 0 bytes > > 8726.416041850:7f8465f45700: stream checking for file change on > > '/var/log/cassandra/system.log', inode 147/147 > > 8726.445146859:7f8465f45700: DDDD: imfile event notification: rd 16[0], > wd > > (2, mask 00000002, cookie 0000, len 0) > > 8726.445169265:7f8465f45700: watch was MODIFID > > 8726.445179750:7f8465f45700: DDDD: imfile: wd 2 got file 0, dir -1 > > 8726.445194270:7f8465f45700: strm 0x7f8458000970: file 2 read 105 bytes > > 8726.445208414:7f8465f45700: strm 0x7f8458000970: file 2 read 0 bytes > > 8726.445229364:7f8465f45700: stream checking for file change on > > '/var/log/cassandra/system.log', inode 147/147 > > 8726.847758210:7f8465f45700: DDDD: imfile event notification: rd 16[0], > wd > > (2, mask 00000002, cookie 0000, len 0) > > 8726.847795247:7f8465f45700: watch was MODIFID > > _______________________________________________ > > rsyslog mailing list > > http://lists.adiscon.net/mailman/listinfo/rsyslog > > http://www.rsyslog.com/professional-services/ > > What's up with rsyslog? Follow https://twitter.com/rgerhards > > NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad > > of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you > > DON'T LIKE THAT. > > > _______________________________________________ > rsyslog mailing list > http://lists.adiscon.net/mailman/listinfo/rsyslog > http://www.rsyslog.com/professional-services/ > What's up with rsyslog? Follow https://twitter.com/rgerhards > NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad > of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you > DON'T LIKE THAT. > _______________________________________________ rsyslog mailing list http://lists.adiscon.net/mailman/listinfo/rsyslog http://www.rsyslog.com/professional-services/ What's up with rsyslog? Follow https://twitter.com/rgerhards NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.
