Re: Javascript website scraping using WebKit and Selenium tools

2015-07-02 Thread Veek M
dieter wrote: Once the problems to get the final HTML code solved, I would use lxml and its xpath support to locate any relevant HTML information. Hello Dieter, yes - you are correct. (though I don't think there's any auth to browse - nice that you actually tried) He's using jsonP and

Re: Javascript website scraping using WebKit and Selenium tools

2015-07-01 Thread dieter
Veek M vek.m1...@gmail.com writes: I tried scraping a javascript website using two tools, both didn't work. The website link is: http://xdguo.taobao.com/category-499399872.htm The relevant text I'm trying to extract is 'GY-68...': div class=item3line1 dl class=item

Javascript website scraping using WebKit and Selenium tools

2015-07-01 Thread Veek M
I tried scraping a javascript website using two tools, both didn't work. The website link is: http://xdguo.taobao.com/category-499399872.htm The relevant text I'm trying to extract is 'GY-68...': div class=item3line1 dl class=item data-id=38952795780 dt class=photo a