Kumar Mallikarjuna Sat, 16 Mar 2019 05:39:54 -0700
Greetings! Update: I managed to prevent overwriting and redownload of 'robots.txt' and 'index.html'.
TODOs: - Crawling the local index.html for checking related files. Best regards, Kumar Mallikarjuna