HTTP background tool
Hi, I was wondering if anyone knew of a tool, that will basically connect to a site through port 80, using HTTP and download a document in the background? Some sites are very slow, and they only provide HTTP access to the information they provide... while it would be nice to be able to download some links with a command line tool. Any links or hints are appreciated. -- TO UNSUBSCRIBE FROM THIS MAILING LIST: e-mail the word unsubscribe to [EMAIL PROTECTED] . Trouble? e-mail to [EMAIL PROTECTED] .
Re: HTTP background tool
Orn E. Hansen wrote: I was wondering if anyone knew of a tool, that will basically connect to a site through port 80, using HTTP and download a document in the background? Some sites are very slow, and they only provide HTTP access to the information they provide... while it would be nice to be able to download some links with a command line tool. Any links or hints are appreciated. Use wget and background it. -- see shy jo -- TO UNSUBSCRIBE FROM THIS MAILING LIST: e-mail the word unsubscribe to [EMAIL PROTECTED] . Trouble? e-mail to [EMAIL PROTECTED] .
RE: HTTP background tool
On 05-Dec-97 Orn E. Hansen wrote: Hi, I was wondering if anyone knew of a tool, that will basically connect to a site through port 80, using HTTP and download a document in the background? perl certainly provides all you need. You could easily specify a URL and have a perl program download its file and everything it links to and everything its links link to. If you start with yahoo, and have infinite disk resources... Some sites are very slow, and they only provide HTTP access to the information they provide... while it would be nice to be able to download some links with a command line tool. Any links or hints are appreciated. -- TO UNSUBSCRIBE FROM THIS MAILING LIST: e-mail the word unsubscribe to [EMAIL PROTECTED] . Trouble? e-mail to [EMAIL PROTECTED] . - Ralph Winslow [EMAIL PROTECTED] The IQ of the group is that of the member whose IQ is lowest divided by the number of members. -- TO UNSUBSCRIBE FROM THIS MAILING LIST: e-mail the word unsubscribe to [EMAIL PROTECTED] . Trouble? e-mail to [EMAIL PROTECTED] .
Re: HTTP background tool
Ralph Winslow [EMAIL PROTECTED] wrote: : I was wondering if anyone knew of a tool, that will basically : connect to a site through port 80, using HTTP and download a document : in the background? : perl certainly provides all you need. You could easily specify a URL : and have a perl program download its file and everything it links to and : everything its links link to. If you start with yahoo, and have infinite : disk resources... Do not reinvent the wheel. The Wget package will do what you want, and more. E.- -- Eloy A. Paris Information Technology Department Rockwell Automation de Venezuela Telephone: +58-2-9432311 Fax: +58-2-9431645 -- TO UNSUBSCRIBE FROM THIS MAILING LIST: e-mail the word unsubscribe to [EMAIL PROTECTED] . Trouble? e-mail to [EMAIL PROTECTED] .
Re: HTTP background tool
Ralph Winslow [EMAIL PROTECTED] wrote: : I was wondering if anyone knew of a tool, that will basically : connect to a site through port 80, using HTTP and download a document : in the background? : perl certainly provides all you need. You could easily specify a URL : and have a perl program download its file and everything it links to and : everything its links link to. If you start with yahoo, and have infinite : disk resources... Do not reinvent the wheel. The Wget package will do what you want, and more. E.- -- Eloy A. Paris Information Technology Department Rockwell Automation de Venezuela Telephone: +58-2-9432311 Fax: +58-2-9431645 -- TO UNSUBSCRIBE FROM THIS MAILING LIST: e-mail the word unsubscribe to [EMAIL PROTECTED] . Trouble? e-mail to [EMAIL PROTECTED] . -- TO UNSUBSCRIBE FROM THIS MAILING LIST: e-mail the word unsubscribe to [EMAIL PROTECTED] . Trouble? e-mail to [EMAIL PROTECTED] .
Re: HTTP background tool
Orn E. Hansen [EMAIL PROTECTED] writes: Hi, I was wondering if anyone knew of a tool, that will basically connect to a site through port 80, using HTTP and download a document in the background? Some sites are very slow, and they only provide HTTP access to the information they provide... while it would be nice to be able to download some links with a command line tool. Any links or hints are appreciated. I use snarf. It can do command line grabs from http, finger, ftp, and gopher. Seems to work reasonably well, and it's super simple to use. I'm not sure if it's still available or not - I don't see it in my mirror. Let me know if it's not - I'll package it. Later, Dale -- + finger for pgp public key -+ | Dale E. Martin | University of Cincinnati Savant Research Laboratory | | [EMAIL PROTECTED]| http://www.ececs.uc.edu/~dmartin | +--+ -- TO UNSUBSCRIBE FROM THIS MAILING LIST: e-mail the word unsubscribe to [EMAIL PROTECTED] . Trouble? e-mail to [EMAIL PROTECTED] .
Re: HTTP background tool
Dale Martin writes: I use snarf. It can do command line grabs from http, finger, ftp, and gopher. Seems to work reasonably well, and it's super simple to use. I'm not sure if it's still available or not - I don't see it in my mirror. Let me know if it's not - I'll package it. I looked and it isn't there... Such tools can come in handy, as an example I just downloaded some excel tables from a http site, where I took the actual index for some company shares. Then transfer it into the accounting server I am writing, and used the accounting client to display a line chart of the index of the company I was interested in. No need to keep your fingers on a Dynosaur like web browser to hop from one site to the next over slow links to get that info. Just have it automatically transferred to your machine, then have a script pin out the information you're interested in and put it into your books... That's Unix :-) -- TO UNSUBSCRIBE FROM THIS MAILING LIST: e-mail the word unsubscribe to [EMAIL PROTECTED] . Trouble? e-mail to [EMAIL PROTECTED] .
Re: HTTP background tool
Eloy A. Paris writes: Do not reinvent the wheel. The Wget package will do what you want, and more. Tried it, it works great. -- TO UNSUBSCRIBE FROM THIS MAILING LIST: e-mail the word unsubscribe to [EMAIL PROTECTED] . Trouble? e-mail to [EMAIL PROTECTED] .
