Serkan Serttop wrote: > Hi Ryan, > Thanks for your response. I checked those insert codes > and all the JS repository from the piggy bank. > Unfortunately I was not successful despite numerous > attempts. David's question was very similar to mine so > I'm guessing I should not be the only one to benefit > from a simple example. I wonder if a very simple > plain-vanilla example is possible? eg: to show a > single page version vs multi page to clearly see what > the differences are. > > It is sometimes hard to figure out what the building > blocks are without having a basic working sample (for > multi page). I would very much appreciate this. I am > talking about like one line example, something looping > over http://www.blabla.com/'$somenumber'.php for > example.
Start with the 'Code to scrape several pages' code insertion. Generate an array of URLs in the gatherPagesToScrape function, I suppose through a for-loop. Scraping a page is done in the scrapePage function. The rest of that code insertion will run. The only minor quibble is which URL pattern match you'd use for Piggy Bank to recognize and run your scraper. I suppose I'd match the first page and write the for-loop that generates URL to ignore the first. If you have more questions, please be specific about what precisely you'd like cleared up. You may want to post your code in a public place - not only so we can look at and help debug it, but so when you've finished others can benefit from your work. -- Ryan Lee [EMAIL PROTECTED] MIT CSAIL Research Staff http://simile.mit.edu/ http://people.csail.mit.edu/ryanlee/ _______________________________________________ General mailing list [email protected] http://simile.mit.edu/mailman/listinfo/general
