Granted I am new to Watir and ruby in general but I do have a
background of programming. My brief experience has been that watir and
ruby are awesome but VERY poorly documented, which is odd concidering
the massive amount of web pages dedicated to it.

anyway, here is the issue I am having.

I am trying to screen scrape book information from a college
bookstores website. My first attempt was php (and I had a full script
done for it) then realized that the site uses javascript to get info
from their database and all I was scraping was the static HTML and
missed the generated stuff I need.

The script in theory:
opens an excel document,
looks at (A1) and goes to "www.website.com/(A1)" where (A1) is a
course number,
stores Title, ISBN and other info into B1, C1, D1 etc (I also have to
take into account more than 1 book per class) though once I get the
first I should be able to do this.
goes to (A2) and repeats.

>From what I have seen there are 2 ways to do this each with its own
problem.

1) use hpricot or some other parser to find the proper tag. This has 2
issues.

<span
id="rptCourses_ctl00_rptItems_ctl00_lblItemTxtISBN">9780324574289</
span>
The second ctl00 itterates to ctl01 for the second book (I am hoping I
can just use regexp in line)

The second issue is that I have not been able to figure out how to
pick out a span tag. There are all sorts of commands for finding links
and tables and such but I cant figure out how to pick out that
particular tag (specificly with hpricot)

2) Load the entire page into a variable, strip out all new lines and
tabs, scan entire page for specific regexp
<span id="rptCourses_ctl00_rptItems_ctl\d\d_lblItemTxtTitle"
style="font-weight:bold;">[^<]+<\/span>
I know this works, I used rubulator to test it. It returns all titles
of books on the page, I do forsee an issue of which title belongs to
which other info if I do it that way though.

If an exact example is required I can give out all the info you
require though I figured it would be more clutter than helpful. An
actual syntax example would be most helpful rather than just refering
me to a class definition though I will take whatever is offered.

Many thanks,
Michael




--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups 
"Watir General" group.
To post to this group, send email to [email protected]
Before posting, please read the following guidelines: 
http://wiki.openqa.org/display/WTR/Support
To unsubscribe from this group, send email to 
[email protected]
For more options, visit this group at 
http://groups.google.com/group/watir-general
-~----------~----~----~----~------~----~------~--~---

Reply via email to