Hi All, I use wget often. On some sites I cannot download files. On one such site I found this file "robots.txt". Is this file the cause for wget not downloading the files.
Any way I could circumvent this and download this website. best regards Mettavihari ---------- robots.txt ---------- User-agent: Googlebot Disallow: User-agent: Atomz Disallow: User-agent: WebCrawler Disallow: User-agent: Lycos Disallow: User-agent: AltaVista Disallow: User-agent: HotBot Disallow: User-agent: Infoseek Disallow: User-agent: Pathfinder Disallow: User-agent: Yahoo Disallow: User-agent: * Disallow: / -------------------------------------------- A saying of the Buddha from http://metta.lk/ -------------------------------------------- Delightful are the forests where worldlings delight not; the passionless will rejoice (therein), (for) they seek no sensual pleasures. Random Dhammapada Verse 99
