Re: [R] web scraping tables generated in multiple server pages

I upgraded ffox to the 46-series and intermittently received the same error. But by adding a `Sys.sleep(1)` to the final `if`: if ((i %% 10) == 0) { ref <- remDr$findElements("xpath", ".//a[.='...']") ref[[length(ref)]]$clickElement() Sys.sleep(1) } I was able to reproduce my

Re: [R] web scraping tables generated in multiple server pages

Hey David, I'm on a Mac as well but have never had to tweak anything to get [R]Selenium to work (but this is one reason I try to avoid solutions involving RSelenium as they are pretty fragile IMO). The site itself has "Página 1 de 69" at the top which is where i got the "69" from and I just

Re: [R] web scraping tables generated in multiple server pages

> On May 10, 2016, at 1:11 PM, boB Rudis wrote: > > Unfortunately, it's a wretched, vile, SharePoint-based site. That > means it doesn't use traditional encoding methods to do the pagination > and one of the only ways to do this effectively is going to be to use > RSelenium: >

Re: [R] web scraping tables generated in multiple server pages / Best of R-help

On 5/10/2016 4:11 PM, boB Rudis wrote: > Unfortunately, it's a wretched, vile, SharePoint-based site. That > means it doesn't use traditional encoding methods to do the pagination > and one of the only ways to do this effectively is going to be to use > RSelenium: > R-help is not stack exchange,

Re: [R] web scraping tables generated in multiple server pages

Unfortunately, it's a wretched, vile, SharePoint-based site. That means it doesn't use traditional encoding methods to do the pagination and one of the only ways to do this effectively is going to be to use RSelenium: library(RSelenium) library(rvest) library(dplyr)

Re: [R] web scraping tables generated in multiple server pages

Excerpts from Michael Friendly's message of 2016-05-10 14:45:28 -0400: > This is my first attempt to try R web scraping tools, for a project my > daughter is working on. It concerns a data base of projects in Sao > Paulo, Brazil, listed at >

[R] web scraping tables generated in multiple server pages

This is my first attempt to try R web scraping tools, for a project my daughter is working on. It concerns a data base of projects in Sao Paulo, Brazil, listed at http://outorgaonerosa.prefeitura.sp.gov.br/relatorios/RelSituacaoGeralProcessos.aspx, but spread out over 69 pages accessed