[sniffer] midnight ftp upload
Hi, When I started using sniffer, April 2004, uploading the log took about 20 seconds. Then on June 19th 2004 it suddenly took over 13 minutes. After that it has consistently taken arround 13 minutes to upload the small logfile. I've never found a reason, the suggestion overhere was it might be because of the load arround midnight Central European time. About a week ago, Jan 18th, I did some experimenting with the time. At first I rotated the logs a minute later to get them rotated closer to midnight, the upload started and finished one minute later. Then a few days later, Jan 21th,I delayed the ftp upload by 10 minutes to get a better timeslot. To my surprise it STILL took 13 minutes to upload the small logfile. Anybody ANY idea where I, or Pete, can start to look for a clue about what is going on? Groetjes, Bonno Bloksma Back up my hard drive? How do I put it in reverse? Log snippets: 2004/04/16 23:59:02 : Running logrotate 2004/04/16 23:59:21 : Ready rotating logs 2004/04/17 23:59:00 : Running logrotate 2004/04/17 23:59:21 : Ready rotating logs 2004/04/18 23:59:00 : Running logrotate 2004/04/18 23:59:23 : Ready rotating logs 2004/04/19 23:59:01 : Running logrotate 2004/04/19 23:59:20 : Ready rotating logs 2004/04/20 23:59:00 : Running logrotate 2004/04/20 23:59:20 : Ready rotating logs 2004/04/21 23:59:01 : Running logrotate 2004/04/21 23:59:20 : Ready rotating logs []2004/06/16 23:59:02 : Running logrotate 2004/06/16 23:59:21 : Ready rotating logs 2004/06/17 23:59:00 : Running logrotate 2004/06/17 23:59:20 : Ready rotating logs 2004/06/18 23:59:01 : Running logrotate 2004/06/19 00:12:27 : Ready rotating logs 2004/06/19 23:59:01 : Running logrotate 2004/06/20 00:12:27 : Ready rotating logs 2004/06/20 23:59:00 : Running logrotate 2004/06/21 00:12:26 : Ready rotating logs 2004/06/21 23:59:01 : Running logrotate 2004/06/22 00:12:26 : Ready rotating logs 2004/06/22 23:59:01 : Running logrotate 2004/06/23 00:12:26 : Ready rotating logs [] 2004/06/28 23:59:01 : Running logrotate 2004/06/28 23:59:01 : Starting ftp upload 2004/06/29 00:12:27 : Finished ftp upload 2004/06/29 00:12:27 : Ready rotating logs 2004/06/29 23:59:00 : Running logrotate 2004/06/29 23:59:00 : Starting ftp upload 2004/06/30 00:12:26 : Finished ftp upload 2004/06/30 00:12:26 : Ready rotating logs [.]2005/01/16 23:59:00 : Running logrotate 2005/01/16 23:59:00 : Starting ftp upload 2005/01/17 00:12:14 : Finished ftp upload 2005/01/17 00:12:14 : Ready rotating logs 2005/01/17 23:59:01 : Running logrotate 2005/01/18 00:00:01 : Starting ftp upload 2005/01/18 00:13:12 : Finished ftp upload 2005/01/18 00:13:12 : Ready rotating logs 2005/01/18 23:59:00 : Running logrotate 2005/01/19 00:00:01 : Starting ftp upload 2005/01/19 00:13:11 : Finished ftp upload 2005/01/19 00:13:11 : Ready rotating logs 2005/01/19 23:59:01 : Running logrotate 2005/01/20 00:00:01 : Starting ftp upload 2005/01/20 00:13:12 : Finished ftp upload 2005/01/20 00:13:12 : Ready rotating logs 2005/01/20 23:59:00 : Running logrotate 2005/01/21 00:00:01 : Renaming logfile 2005/01/21 00:10:04 : Starting ftp upload 2005/01/21 00:23:15 : Finished ftp upload 2005/01/21 00:23:15 : Ready rotating logs 2005/01/21 23:59:03 : Running logrotate 2005/01/22 00:00:04 : Renaming logfile 2005/01/22 00:10:07 : Starting ftp upload 2005/01/22 00:23:18 : Finished ftp upload 2005/01/22 00:23:18 : Ready rotating logs 2005/01/22 23:59:00 : Running logrotate 2005/01/23 00:00:01 : Renaming logfile 2005/01/23 00:10:04 : Starting ftp upload 2005/01/23 00:23:15 : Finished ftp upload 2005/01/23 00:23:15 : Ready rotating logs 2005/01/23 23:59:01 : Running logrotate 2005/01/24 00:00:01 : Renaming logfile 2005/01/24 00:10:05 : Starting ftp upload 2005/01/24 00:23:15 : Finished ftp upload 2005/01/24 00:23:15 : Ready rotating logs
Re: [sniffer] midnight ftp upload
On Monday, January 24, 2005, 4:35:29 AM, Bonno wrote: BB Hi, BB BB When I started using sniffer, April 2004, uploading the log BB took about 20 seconds. Then on June 19th 2004 it suddenly took BB over 13 minutes. After that it has consistently taken arround 13 BB minutes to upload the small logfile. I've never found a reason, BB the suggestion overhere was it might be because of the load BB arround midnight Central European time. BB BB About a week ago, Jan 18th, I did some experimenting with BB the time. At first I rotated the logs a minute later to get them BB rotated closer to midnight, the upload started and finished one BB minute later. Then a few days later, Jan 21th, I delayed the ftp BB upload by 10 minutes to get a better timeslot. To my surprise it BB STILL took 13 minutes to upload the small logfile. BB BB Anybody ANY idea where I, or Pete, can start to look for a clue about what is going on? I'm guessing that you've run into a few of the very large systems we're supporting. These folks process billions of messages per month so their log files tend to be prolific and as I recall they are sending those in near the top of the hour, all at once. If you try working from the bottom of the hour then you should get past this. We are actively working on the move to a new hosting solution so you can expect this to change in a relatively short time frame (2-6 wks). Hope this helps, _M This E-Mail came from the Message Sniffer mailing list. For information and (un)subscription instructions go to http://www.sortmonster.com/MessageSniffer/Help/Help.html
