We detect the crawler (via it's user agent) and output 'real' HREF links
to the pages.
Tom
On 12/01/17 06:32, Manav Bagai wrote:
While crawling, all the links on page 1 are crawled but on page 2
(pagination) as there is some javascript applied, the crawler ignore the
page.
Can you please help me with an approach by which crawler can crawl that
data on page 2.
Regards,
Manav
______________________________________________________________________
This email has been scanned by the Symantec Email Security.cloud service.
For more information please visit http://www.symanteccloud.com
______________________________________________________________________
