I am trying to clicking the next pages link using scrapy with python for
iterate next 5 pages link.But it's fails to click the next pages link.
***Expected results:***
When we click the Next pages link..It should be show the next five pages
jobs..
***HTML Tags Next pages:***
<table align="left" id="pages"><tbody><tr> <td>Results:</td> <td> <p
class="next">;<a href="/candidate/job_search/quick/results/59">Previous
pages</a></p> </td> <td> <nobr> **<b>601 - 610</b>;</nobr> </td> <td>
<nobr> <a href="/candidate/job_search/quick/results/61">611 - 620</a>;
</nobr> </td> <td> <nobr> <a
href="/candidate/job_search/quick/results/62">621 - 630</a></nobr> </td>
<td> <nobr> <a href="/candidate/job_search/quick/results/63">631 -
640</a></nobr> </td> <td> <nobr> <a
href="/candidate/job_search/quick/results/64">641 - 650</a> </nobr>
</td> <td> <p class="next"> **<a
href="/candidate/job_search/quick/results/65">Next pages</a>**** </p>
</td> </tr></tbody></table>
***Next page link:***
Previous pages 601 - 610 | 611 - 620 | 621 - 630 |
631 - 640 | 641 - 650 Next pages
Its should be show Next five iterate pages link while clicking the Next
Pages link...
I try to click the Next pages link, but its clicking the
"job_search/quick/results/5" only not clicking the Next pages link..
***Spider code:***
next_page = response.xpath(".//*[@id='pages']").extract()
for next_page in next_page:
next_page =
response.xpath(".//*[@id='pages']/tbody/tr/td[4]/nobr/a").extract()
yield Request(urlparse.urljoin(response.url, next_page),
dont_filter=True)
nextpages =
response.xpath(".//*[@id='pages']/tbody/tr/td[8]/p/a").extract()
for nextlink in nextpages:
nextlink =
response.xpath(".//*[@id='pages']/tbody/tr/td[8]/p/a").extract()
yield Request(urlparse.urljoin(response.url, nextlink),
self.parse, dont_filter=True)
--
You received this message because you are subscribed to the Google Groups
"scrapy-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at http://groups.google.com/group/scrapy-users.
For more options, visit https://groups.google.com/d/optout.
