Hi Gora, Thank you very much for your advice. That is exactly what I need.
Best wishes Ridwan ________________________________ From: Gora Mohanty <g...@mimirtech.com> Sent: Wednesday, January 10, 2024 5:21:49 PM To: user@nutch.apache.org <user@nutch.apache.org> Subject: Re: Crawling the entire web Hi, Would suggest starting out by looking at Common Crawl: https://commoncrawl.org/ Regards, Gora