Greetings!

Update:
I managed to prevent overwriting and redownload of 'robots.txt' and
'index.html'.

TODOs:
- Crawling the local index.html for checking related files.

Best regards,
Kumar Mallikarjuna

Reply via email to