Re: [Php-syslog-ng-support] LogRotate (V2.9.2 tested)
Vadim I'm sorry you weren't able to get my version working, the minimum amount of work you need to fix the defaul version is to copy the lines that re-load the table list into memory and paste them in a second time to run after the old tables are cleaned and before the merge table is re-created.- Original Message From: Vadim Pushkin <[EMAIL PROTECTED]>To: [EMAIL PROTECTED]; [email protected]: [EMAIL PROTECTED]Sent: Wednesday, July 19, 2006 6:15:37 PMSubject: Re: [Php-syslog-ng-support] LogRotate (V2.9.2 tested)>From: "Freeman, Michael" <[EMAIL PROTECTED]>>What is the "modified" version? I am only familiar with the one that>comes in current.tgz from cdukes (2.9.2), it is about 110 lines, and>seems to have support for merge tables..The "modified" version is the one that Joel <[EMAIL PROTECTED]> had been running, albeit for 2.8. He's stated that his was working under 2.8, but with so many changes under current, it does not for me.>Where does this LOGROTATE value come from? I didn't see it in config.phpSorry, it is LOGROTATERETENTION, not LOGROTATE.>I'm also confused as to why/how we're actually using merge tables. So if>you're rotating your logs every 2 days, and at the end of the year you'd>have 180 tables, the all_logs merge table refers to all 180 tables? How>does this speed up queries? Shouldn't merge tables be created>dynamically? For instance, if a user is only searching through data of>CURRENT_MONTH - CURRENT_MONTH(-2) (two months), why would you need to>search through 180 tables?No, the idea should be to rotate whenever logrotate.php is run. In my case, I would run logrotate daily at slighltly past midnight. What I feel should happen is the following:1. Rename the table logs to logsYESTERSDATE.2. Drop table(s) older than what LOGROTATERETENTION has stated.3a. Drop table all_logs, then re-create this table and MERGE all logs into that one.OR3b. PURGE from all_logs all data from this table where datetime is older than what LOGROTATERETENTION has stated.With regards to the all_logs.MRG having names of tables no longer contained within the syslog DB, I suspect that this is because the MySql server may have to be issued a restart command at the end of the logrotate. Does anyone know if this is true?>Or does it not matter due to the nature of MERGE tables? Can someone>please clue me in? 8)What version of MySql are you running?.vp>-Original Message->From: Vadim Pushkin [mailto:[EMAIL PROTECTED]>Sent: Wednesday, July 19, 2006 3:23 PM>To: Freeman, Michael; [email protected]>Subject: RE: [Php-syslog-ng-support] LogRotate (V2.9.2 tested)>>Hello Mikael;>>Here are my current issues.>>1. Logrotate (the one that comes stock because I was unable to work out>several bugs with the "modified" version) does not rotate to the correct>number of days. My LOGROTATE entry has a 2. Here is what my syslog DB>has in terms of tables as of right now:>>mysql> show tables;>+-->| Tables_in_syslog>+->| actions>| all_logs>| cemdb>| logs>| logs20060717>| logs20060718>| logs20060719>| search_cache>| user_access>| users>+->10 rows in set (0.00 sec)>>2. This AM, I had to edit all_logs.MRG, had to remove logs20060716,>which was no longer available, presumably dropped as it should have>been, but why not logs20060717 as well?>>PS I am running logrotate at 00:15 HRS and without the removal of>logs20060716, the front-end would not work.>>The below is as of right now (mid-day).>>[root /]# cat /var/lib/mysql/syslog/all_logs.MRG>>logs>logs20060717>logs20060718>logs20060719>>3. Within mysql, tablename "search_cache" shows hostnames in "logs" for>srv-www-001, this was one of the "canned" hostnames that Clayton>provided as a test. They *do not* live in the logs table, though they>*may* live under all_logs, so why are they still there? And how do I>remove them?>>With regads to MERGE tables, what version of MySql are you running? I>*believe* that this feature will not work on earlier version of MySql.>>I hope someone, hopefully someone with far more ability to do something>about this than I, will find this info useful :)>>.vp>>> >From: "Freeman, Michael" <[EMAIL PROTECTED]>>> >Did you get anywhere with logrotate.php?>> >Can someone please explain to me what is going on with MERGE tables in> >2.9.2?>> >-Original Message-> >From: [EMAIL PROTECTED]> >[mailto:[EMAIL PROTECTED] On Behalf> >Of Vadim Pushkin> >Sent: Saturday, July 15, 2006 2:00 PM&g
Re: [Php-syslog-ng-support] LogRotate (V2.9.2 tested)
>From: "Freeman, Michael" <[EMAIL PROTECTED]> >What is the "modified" version? I am only familiar with the one that >comes in current.tgz from cdukes (2.9.2), it is about 110 lines, and >seems to have support for merge tables.. The "modified" version is the one that Joel <[EMAIL PROTECTED]> had been running, albeit for 2.8. He's stated that his was working under 2.8, but with so many changes under current, it does not for me. >Where does this LOGROTATE value come from? I didn't see it in config.php Sorry, it is LOGROTATERETENTION, not LOGROTATE. >I'm also confused as to why/how we're actually using merge tables. So if >you're rotating your logs every 2 days, and at the end of the year you'd >have 180 tables, the all_logs merge table refers to all 180 tables? How >does this speed up queries? Shouldn't merge tables be created >dynamically? For instance, if a user is only searching through data of >CURRENT_MONTH - CURRENT_MONTH(-2) (two months), why would you need to >search through 180 tables? No, the idea should be to rotate whenever logrotate.php is run. In my case, I would run logrotate daily at slighltly past midnight. What I feel should happen is the following: 1. Rename the table logs to logsYESTERSDATE. 2. Drop table(s) older than what LOGROTATERETENTION has stated. 3a. Drop table all_logs, then re-create this table and MERGE all logs into that one. OR 3b. PURGE from all_logs all data from this table where datetime is older than what LOGROTATERETENTION has stated. With regards to the all_logs.MRG having names of tables no longer contained within the syslog DB, I suspect that this is because the MySql server may have to be issued a restart command at the end of the logrotate. Does anyone know if this is true? >Or does it not matter due to the nature of MERGE tables? Can someone >please clue me in? 8) What version of MySql are you running? .vp >-Original Message- >From: Vadim Pushkin [mailto:[EMAIL PROTECTED] >Sent: Wednesday, July 19, 2006 3:23 PM >To: Freeman, Michael; [email protected] >Subject: RE: [Php-syslog-ng-support] LogRotate (V2.9.2 tested) > >Hello Mikael; > >Here are my current issues. > >1. Logrotate (the one that comes stock because I was unable to work out >several bugs with the "modified" version) does not rotate to the correct >number of days. My LOGROTATE entry has a 2. Here is what my syslog DB >has in terms of tables as of right now: > >mysql> show tables; >+-- >| Tables_in_syslog >+- >| actions >| all_logs >| cemdb >| logs >| logs20060717 >| logs20060718 >| logs20060719 >| search_cache >| user_access >| users >+- >10 rows in set (0.00 sec) > >2. This AM, I had to edit all_logs.MRG, had to remove logs20060716, >which was no longer available, presumably dropped as it should have >been, but why not logs20060717 as well? > >PS I am running logrotate at 00:15 HRS and without the removal of >logs20060716, the front-end would not work. > >The below is as of right now (mid-day). > >[root /]# cat /var/lib/mysql/syslog/all_logs.MRG > >logs >logs20060717 >logs20060718 >logs20060719 > >3. Within mysql, tablename "search_cache" shows hostnames in "logs" for >srv-www-001, this was one of the "canned" hostnames that Clayton >provided as a test. They *do not* live in the logs table, though they >*may* live under all_logs, so why are they still there? And how do I >remove them? > >With regads to MERGE tables, what version of MySql are you running? I >*believe* that this feature will not work on earlier version of MySql. > >I hope someone, hopefully someone with far more ability to do something >about this than I, will find this info useful :) > >.vp > > > >From: "Freeman, Michael" <[EMAIL PROTECTED]> > > >Did you get anywhere with logrotate.php? > > >Can someone please explain to me what is going on with MERGE tables in > >2.9.2? > > >-Original Message- > >From: [EMAIL PROTECTED] > >[mailto:[EMAIL PROTECTED] On Behalf > >Of Vadim Pushkin > >Sent: Saturday, July 15, 2006 2:00 PM > >To: [email protected] > >Subject: [Php-syslog-ng-support] LogRotate (V2.9.2 tested) > > > >Hello All; > > > >I've downloaded and am testing the latest (2.9.2) and have set > >LOGROTATE to > >2 within my config.php file. So far, I now have 3 days worth of data, > >when I should have just 2. > > > >I have *not* re-created my SQL db, and assuming this does not matter, >
Re: [Php-syslog-ng-support] LogRotate (V2.9.2 tested)
What is the "modified" version? I am only familiar with the one that comes in current.tgz from cdukes (2.9.2), it is about 110 lines, and seems to have support for merge tables.. Where does this LOGROTATE value come from? I didn't see it in config.php -- I'm also confused as to why/how we're actually using merge tables. So if you're rotating your logs every 2 days, and at the end of the year you'd have 180 tables, the all_logs merge table refers to all 180 tables? How does this speed up queries? Shouldn't merge tables be created dynamically? For instance, if a user is only searching through data of CURRENT_MONTH - CURRENT_MONTH(-2) (two months), why would you need to search through 180 tables? Or does it not matter due to the nature of MERGE tables? Can someone please clue me in? 8) -Original Message- From: Vadim Pushkin [mailto:[EMAIL PROTECTED] Sent: Wednesday, July 19, 2006 3:23 PM To: Freeman, Michael; [email protected] Subject: RE: [Php-syslog-ng-support] LogRotate (V2.9.2 tested) Hello Mikael; Here are my current issues. 1. Logrotate (the one that comes stock because I was unable to work out several bugs with the "modified" version) does not rotate to the correct number of days. My LOGROTATE entry has a 2. Here is what my syslog DB has in terms of tables as of right now: mysql> show tables; +-- | Tables_in_syslog +- | actions | all_logs | cemdb | logs | logs20060717 | logs20060718 | logs20060719 | search_cache | user_access | users +- 10 rows in set (0.00 sec) 2. This AM, I had to edit all_logs.MRG, had to remove logs20060716, which was no longer available, presumably dropped as it should have been, but why not logs20060717 as well? PS I am running logrotate at 00:15 HRS and without the removal of logs20060716, the front-end would not work. The below is as of right now (mid-day). [root /]# cat /var/lib/mysql/syslog/all_logs.MRG logs logs20060717 logs20060718 logs20060719 3. Within mysql, tablename "search_cache" shows hostnames in "logs" for srv-www-001, this was one of the "canned" hostnames that Clayton provided as a test. They *do not* live in the logs table, though they *may* live under all_logs, so why are they still there? And how do I remove them? With regads to MERGE tables, what version of MySql are you running? I *believe* that this feature will not work on earlier version of MySql. I hope someone, hopefully someone with far more ability to do something about this than I, will find this info useful :) .vp >From: "Freeman, Michael" <[EMAIL PROTECTED]> >Did you get anywhere with logrotate.php? >Can someone please explain to me what is going on with MERGE tables in >2.9.2? >-Original Message- >From: [EMAIL PROTECTED] >[mailto:[EMAIL PROTECTED] On Behalf >Of Vadim Pushkin >Sent: Saturday, July 15, 2006 2:00 PM >To: [email protected] >Subject: [Php-syslog-ng-support] LogRotate (V2.9.2 tested) > >Hello All; > >I've downloaded and am testing the latest (2.9.2) and have set >LOGROTATE to >2 within my config.php file. So far, I now have 3 days worth of data, >when I should have just 2. > >I have *not* re-created my SQL db, and assuming this does not matter, >am I the only one with this problem? > >Thanks, > >.vp - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV ___ Php-syslog-ng-support mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/php-syslog-ng-support
Re: [Php-syslog-ng-support] LogRotate (V2.9.2 tested)
Hello Mikael; Here are my current issues. 1. Logrotate (the one that comes stock because I was unable to work out several bugs with the "modified" version) does not rotate to the correct number of days. My LOGROTATE entry has a 2. Here is what my syslog DB has in terms of tables as of right now: mysql> show tables; +-- | Tables_in_syslog +- | actions | all_logs | cemdb | logs | logs20060717 | logs20060718 | logs20060719 | search_cache | user_access | users +- 10 rows in set (0.00 sec) 2. This AM, I had to edit all_logs.MRG, had to remove logs20060716, which was no longer available, presumably dropped as it should have been, but why not logs20060717 as well? PS I am running logrotate at 00:15 HRS and without the removal of logs20060716, the front-end would not work. The below is as of right now (mid-day). [root /]# cat /var/lib/mysql/syslog/all_logs.MRG logs logs20060717 logs20060718 logs20060719 3. Within mysql, tablename "search_cache" shows hostnames in "logs" for srv-www-001, this was one of the "canned" hostnames that Clayton provided as a test. They *do not* live in the logs table, though they *may* live under all_logs, so why are they still there? And how do I remove them? With regads to MERGE tables, what version of MySql are you running? I *believe* that this feature will not work on earlier version of MySql. I hope someone, hopefully someone with far more ability to do something about this than I, will find this info useful :) .vp >From: "Freeman, Michael" <[EMAIL PROTECTED]> >Did you get anywhere with logrotate.php? >Can someone please explain to me what is going on with MERGE tables in >2.9.2? >-Original Message- >From: [EMAIL PROTECTED] >[mailto:[EMAIL PROTECTED] On Behalf >Of Vadim Pushkin >Sent: Saturday, July 15, 2006 2:00 PM >To: [email protected] >Subject: [Php-syslog-ng-support] LogRotate (V2.9.2 tested) > >Hello All; > >I've downloaded and am testing the latest (2.9.2) and have set LOGROTATE >to >2 within my config.php file. So far, I now have 3 days worth of data, >when I should have just 2. > >I have *not* re-created my SQL db, and assuming this does not matter, am >I the only one with this problem? > >Thanks, > >.vp - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV ___ Php-syslog-ng-support mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/php-syslog-ng-support
Re: [Php-syslog-ng-support] LogRotate (V2.9.2 tested)
Did you get anywhere with logrotate.php? Can someone please explain to me what is going on with MERGE tables in 2.9.2? -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Vadim Pushkin Sent: Saturday, July 15, 2006 2:00 PM To: [email protected] Subject: [Php-syslog-ng-support] LogRotate (V2.9.2 tested) Hello All; I've downloaded and am testing the latest (2.9.2) and have set LOGROTATE to 2 within my config.php file. So far, I now have 3 days worth of data, when I should have just 2. I have *not* re-created my SQL db, and assuming this does not matter, am I the only one with this problem? Thanks, .vp - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ Php-syslog-ng-support mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/php-syslog-ng-support - Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys -- and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV ___ Php-syslog-ng-support mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/php-syslog-ng-support
[Php-syslog-ng-support] LogRotate (V2.9.2 tested)
Hello All; I've downloaded and am testing the latest (2.9.2) and have set LOGROTATE to 2 within my config.php file. So far, I now have 3 days worth of data, when I should have just 2. I have *not* re-created my SQL db, and assuming this does not matter, am I the only one with this problem? Thanks, .vp - Using Tomcat but need to do more? Need to support web services, security? Get stuff done quickly with pre-integrated technology to make your job easier Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642 ___ Php-syslog-ng-support mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/php-syslog-ng-support
