Re: Url checker

2005-10-03 Thread J. Lievisse Adriaanse
Maybe you mean something like:
http://www.openbsd.org/cgi-bin/cvsweb/ports/www/linkchecker/ ?

Cheers,
Jasper

Op 3/10/2005 schreef [EMAIL PROTECTED]
[EMAIL PROTECTED]:

Hi list,

Anyone knows a good URL checker that runs on OpenBSD? My boss wants me
to monitor web site traffic and present a report with all visits to all
websites per user (pc). I've searched the internet but did not find an
appropriate (free) solution. I have been playing with the idea to use
snort, but that seems a lot of work to me.

Any suggestions are more then welcome.

Nils

=
A disclaimer applies to this email and any attachments.
Refer to http://www.sparkholland.com/emaildisclaimer for the full text of this 
disclaimer.



Re: Url checker

2005-10-03 Thread Nils.Reuvers
Thanks Jasper,

I just thought of another solution. Stupid me not thinking of it
earlier. I can log all http traffic with PF and write some perl to
process the logfile. Can't believe I was staring blind on a 3rd party
solution.

Nils
 

-Original Message-
From: J. Lievisse Adriaanse [mailto:[EMAIL PROTECTED] 
Sent: maandag 3 oktober 2005 12:41
To: Reuvers, Nils; misc@openbsd.org
Subject: Re: Url checker


Maybe you mean something like:
http://www.openbsd.org/cgi-bin/cvsweb/ports/www/linkchecker/ ?

Cheers,
Jasper

Op 3/10/2005 schreef [EMAIL PROTECTED]
[EMAIL PROTECTED]:

Hi list,

Anyone knows a good URL checker that runs on OpenBSD? My boss wants me 
to monitor web site traffic and present a report with all visits to all

websites per user (pc). I've searched the internet but did not find an 
appropriate (free) solution. I have been playing with the idea to use 
snort, but that seems a lot of work to me.

Any suggestions are more then welcome.

Nils

===
== A disclaimer applies to this email and any 
attachments.
Refer to http://www.sparkholland.com/emaildisclaimer for the full text
of this disclaimer.



=
A disclaimer applies to this email and any attachments. 
Refer to http://www.sparkholland.com/emaildisclaimer for the full text of this 
disclaimer.



Re: Url checker

2005-10-03 Thread Teemu Schaabl
[EMAIL PROTECTED]([EMAIL PROTECTED])@2005.10.03
11:08:31 +:
 Hi list,

 Anyone knows a good URL checker that runs on OpenBSD? My boss wants me
 to monitor web site traffic and present a report with all visits to all
 websites per user (pc). I've searched the internet but did not find an
 appropriate (free) solution. I have been playing with the idea to use
 snort, but that seems a lot of work to me.

 Any suggestions are more then welcome.


use squid transparent on your openbsd gateway:
daniel has a working howto:
http://www.benzedrine.cx/transquid.html

after you got it up and running, analyse the resulting log-files
with one of these: http://www.squid-cache.org/Scripts/

maybe you should try out this, sounded good to me, but I never had to
implemented it (thank god):

http://squidalyser.sourceforge.net

hope this helps,
teemu

--
personal crap: http://teemu.lynix.net

[demime 1.01d removed an attachment of type application/pgp-signature]



Re: Url checker

2005-10-03 Thread Gaby vanhegan
On 3 Oct 2005, at 12:11, [EMAIL PROTECTED] wrote:

 I just thought of another solution. Stupid me not thinking of it
 earlier. I can log all http traffic with PF and write some perl to
 process the logfile. Can't believe I was staring blind on a 3rd party
 solution.

Perhaps transparent proxying with Squid and PF might give you the  
information you need?

--
Junkets for bunterish lickspittles since 1998!
[EMAIL PROTECTED]
http://weblog.vanhegan.net



Re: Url checker

2005-10-03 Thread Teemu Schaabl
Teemu Schaabl([EMAIL PROTECTED])@2005.10.03 13:15:20 +:
 [EMAIL PROTECTED]([EMAIL PROTECTED])@2005.10.03
 11:08:31 +:
  Hi list,
 
  Anyone knows a good URL checker that runs on OpenBSD? My boss wants me
  to monitor web site traffic and present a report with all visits to all
  websites per user (pc). I've searched the internet but did not find an
  appropriate (free) solution. I have been playing with the idea to use
  snort, but that seems a lot of work to me.
 
  Any suggestions are more then welcome.
 

 use squid transparent on your openbsd gateway:
 daniel has a working howto:
 http://www.benzedrine.cx/transquid.html

 [ ... ]


gezz - got this question wrong, sorry for the noise.

--
Every man takes the limits of his own field of vision
 for the limits of the world. - Schopenhauer

[demime 1.01d removed an attachment of type application/pgp-signature]



Re: Url checker

2005-10-03 Thread Nils.Reuvers
Good point. 

-Original Message-
From: michael hamerski [mailto:[EMAIL PROTECTED] 
Sent: maandag 3 oktober 2005 15:46
To: Reuvers, Nils
Subject: Re: Url checker

be warned: depending on the number of clients on your network, logging
all http traffic is a pretty good way of testing the reliability of your
disk.

when I was reluctantly asked to implement this a few years ago on a 100
client network, the aging disk failed within a week. if you want to do
this on a long-term basis for more than a few clients, I would consider
a dedicated disk.

mike


=
A disclaimer applies to this email and any attachments. 
Refer to http://www.sparkholland.com/emaildisclaimer for the full text of this 
disclaimer.



Re: Url checker

2005-10-03 Thread Gaby vanhegan
On 3 Oct 2005, at 14:48, [EMAIL PROTECTED] wrote:

 be warned: depending on the number of clients on your network, logging
 all http traffic is a pretty good way of testing the reliability of  
 your
 disk.

If you do eventually get your HTTP traffic running through one host,  
running EtherPeg on it always tickles me.

--
Junkets for bunterish lickspittles since 1998!
[EMAIL PROTECTED]
http://weblog.vanhegan.net



Re: Url checker

2005-10-03 Thread Dave Anderson
** Reply to message from [EMAIL PROTECTED] on Mon, 3 Oct
2005 11:08:31 +0200

Anyone knows a good URL checker that runs on OpenBSD? My boss wants me
to monitor web site traffic and present a report with all visits to all
websites per user (pc). I've searched the internet but did not find an
appropriate (free) solution. I have been playing with the idea to use
snort, but that seems a lot of work to me.

Your boss _is_ aware that what he seems to be asking for is
fundamentally impossible, due to caching proxies, dynamic IP addresses,
multiuser systems, etc?

Dave

-- 
Dave Anderson
[EMAIL PROTECTED]



Re: Url checker

2005-10-03 Thread Hannah Schroeter
Hello!

On Mon, Oct 03, 2005 at 12:24:41PM -0400, Dave Anderson wrote:
** Reply to message from [EMAIL PROTECTED] on Mon, 3 Oct
2005 11:08:31 +0200

Anyone knows a good URL checker that runs on OpenBSD? My boss wants me
to monitor web site traffic and present a report with all visits to all
websites per user (pc). I've searched the internet but did not find an
appropriate (free) solution. I have been playing with the idea to use
snort, but that seems a lot of work to me.

Your boss _is_ aware that what he seems to be asking for is
fundamentally impossible, due to caching proxies, dynamic IP addresses,
multiuser systems, etc?

An exact solution is impossible for the reasons you state. But
you *can* do heuristic approximations. I don't know of any free
solutions though.

But I know that the OP isn't alone. There's a company doing that for
the web sites they host, based on the httpd (Apache) logs.

   Dave

Kind regards,

Hannah.