Hi everyone!

Leila, it's not a tutorial, but a simple sample of a web crawler, to test
in your machine:
https://github.com/ajlopez/NodeSamples/tree/master/WebCrawler

The key code:
https://github.com/ajlopez/NodeSamples/blob/master/WebCrawler/app.js#L51-L67
prepare and call http.get, and reading the data

If you want to have a web crawler running in many machine, there are many
approaches. Some experiments at English post:
http://ajlopez.wordpress.com/2013/05/30/aplicaciones-distribuidas-y-node-js/

Angel "Java" Lopez
@ajlopez



On Thu, Jul 25, 2013 at 9:35 PM, Leila Hamon <[email protected]> wrote:

> I want to use node to asynchronously _request_ as many pages my machine
> can handle. Node is known for handling many connections, so I'm guessing
> there has to be a decent tutorial on this. Does anyone have a
> recommendation?
>
> --
> --
> Job Board: http://jobs.nodejs.org/
> Posting guidelines:
> https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
> You received this message because you are subscribed to the Google
> Groups "nodejs" group.
> To post to this group, send email to [email protected]
> To unsubscribe from this group, send email to
> [email protected]
> For more options, visit this group at
> http://groups.google.com/group/nodejs?hl=en?hl=en
>
> ---
> You received this message because you are subscribed to the Google Groups
> "nodejs" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [email protected].
> For more options, visit https://groups.google.com/groups/opt_out.
>
>
>

-- 
-- 
Job Board: http://jobs.nodejs.org/
Posting guidelines: 
https://github.com/joyent/node/wiki/Mailing-List-Posting-Guidelines
You received this message because you are subscribed to the Google
Groups "nodejs" group.
To post to this group, send email to [email protected]
To unsubscribe from this group, send email to
[email protected]
For more options, visit this group at
http://groups.google.com/group/nodejs?hl=en?hl=en

--- 
You received this message because you are subscribed to the Google Groups 
"nodejs" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
For more options, visit https://groups.google.com/groups/opt_out.


Reply via email to