Hi Raf, Not sure that I understand your question well, you can always use a regex in the LinkExtractor to retrieve all the pagination links that you need. Something like
"telephone-horaires-metier\/Restaurant\?p=[0-9]+$" can match the links, if your last number is always a positive integer. Regards, On Sunday, August 14, 2016 at 11:11:40 PM UTC+8, Raf Roger wrote: > > Hi, > > i'm new to scrapy and i'm looking for a way to retrieve all links (with > class: ul li a). > on each page, there is pagination and first page url is like: > telephone-horaires-metier/Restaurant > > page 2 url is: > telephone-horaires-metier/Restaurant?p=2 > > page 3 url is: > telephone-horaires-metier/Restaurant?p=3 > > etc... > > the "next" url is always the current page +1 so if i'm page 2 "next" url > is telephone-horaires-metier/Restaurant?p=3 > > How can i do to collect all links on each page ? > > thx > -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to scrapy-users+unsubscr...@googlegroups.com. To post to this group, send email to scrapy-users@googlegroups.com. Visit this group at https://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
