Re: Crawling the entire web

2024-01-10 Thread Ridwan Naibi 
Hi Gora,

Thank you very much for your advice. That is exactly what I need.

Best wishes
Ridwan

From: Gora Mohanty 
Sent: Wednesday, January 10, 2024 5:21:49 PM
To: user@nutch.apache.org 
Subject: Re: Crawling the entire web

Hi,

Would suggest starting out by looking at Common Crawl:
https://commoncrawl.org/

Regards,
Gora

Re: Crawling the entire web

2024-01-10 Thread Gora Mohanty 
Hi,

Would suggest starting out by looking at Common Crawl:
https://commoncrawl.org/

Regards,
Gora