Oops...my mistake. The main URLs do not really contain links but load another URL
that contains the links instead. I used "View Source" from the browser to check the
contents but did not notice that the URL has changed, should have used lwp-request
without the -o links option instead to check the content.
I have another question though. For the http://www.cpf.gov.sg URL,
http://www.cpf.gov.sg/cpf_info/home.asp is loaded instead. This contains a number of
frames:
http://www.cpf.gov.sg/cpf_info/home.asp/home_main.asp
http://www.cpf.gov.sg/cpf_info/home.asp/home_menu.asp
http://www.cpf.gov.sg/cpf_info/home.asp/home_topLeft.asp
http://www.cpf.gov.sg/cpf_info/home.asp/home_topRight.asp
I am not able to use lwp-request to download these frames, error "404 Object Not
Found" occurs. I hope somebody can enlighten me as to why this happens.
Thank you for the attention.
- Joo Geok
----- Original Message -----
From: Tan Joo Geok
To: [EMAIL PROTECTED]
Sent: Wednesday, November 22, 2000 4:29 PM
Subject: Links not extracted!
Hello,
I am using the lwp-request sample program that comes with the libwww distribution to
parse the content of various web sites. I noticed that for certain web sites, the
links fail to be extracted by lwp-request, e.g:
lwp-request -o links http://www.cpf.gov.sg
lwp-request -o links http://www.moe.edu.sg
Would appreciate if somebody can let me know why this is happening. I have verified
that both the above URLs contain a number of images and hyperlinks.
Thanks for the attention.
- Joo Geok
