Thank you very much. It solved the problem. could you please, help in this, too ? https://groups.google.com/forum/?fromgroups#!topic/scrapy-users/Vb7B4sITIJM
On Thursday, February 9, 2017 at 2:51:35 PM UTC+2, Paul Tremberth wrote: > > Hi, > You're experiencing the infamous 'added tbody' effect, > you've probably tested your XPath in your browser's developer tools panel. > The things is modern browser transform the document tree a bit internally, > and especially, they insert a tbody element between table and tr > > If you try with the following (i.e. without the tbody in the XPath), > you'll get to the elements you want: > > >>> response.xpath('//*[@id="gf-result-table"]/tr[2]/td[2]/div') > [<Selector xpath='//*[@id="gf-result-table"]/tr[2]/td[2]/div' data=u'<div > class="sr-number">\r\n 091'>] > > > > On Thu, Feb 9, 2017 at 12:53 PM, I. Hathout <becksh...@gmail.com > <javascript:>> wrote: > >> first of all i tried to extract data from this url: >> https://partsouq.com/en/search/search?q=0910112012&qty=1&_=1486640633959 >> >> >> $ scrapy shell " >> https://partsouq.com/en/search/search?q=0910112012&qty=1&_=1486640633959 >> >> but each time i tried to get any element using xpath i got an empty set >> !!! >> >> Could anyone please explain why this happens to me ? >> >> >> <https://lh3.googleusercontent.com/-SI5TJuMvwBY/WJxYJU82TaI/AAAAAAAAB6U/9y8PkKhjQa0ySrczWtrMYrwwHuVWOifugCLcB/s1600/ttt.png> >> >> -- >> You received this message because you are subscribed to the Google Groups >> "scrapy-users" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to scrapy-users...@googlegroups.com <javascript:>. >> To post to this group, send email to scrapy...@googlegroups.com >> <javascript:>. >> Visit this group at https://groups.google.com/group/scrapy-users. >> For more options, visit https://groups.google.com/d/optout. >> > > -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to scrapy-users+unsubscr...@googlegroups.com. To post to this group, send email to scrapy-users@googlegroups.com. Visit this group at https://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.