I am using scrapy 0.24 . I am using image pipeline but the problem is it
doesn't like to functions i am calling in pipeline.py .
I just downloads every image_urls in item into single folder .
I am using this code to differentiate it .
def process_item(self, item, spider):
image_guid = item
print "me before"
# yield [scrapy.Request (urlparse.urljoin(url,'%s/full/%s.jpg'%
(item['Property_name'],self.process_item(url)) ) for url in
item['image_urls'])]
for image_url in item['image_urls']:
yield scrapy.Request(image_url,meta={'id':item['Property_name']})
return "/full/%s%s.jpg"% (id,image_guid)
#this should work , exactly as per documentation
def get_media_requests(self, item, info):
print "me before"
# yield [scrapy.Request (urlparse.urljoin(url,'%s/full/%s.jpg'%
(item['Property_name'],self.process_item(url)) ) for url in
item['image_urls'])]
for image_url in item['image_urls']:
yield scrapy.Request(image_url,meta={'id':item['Property_name']})
But it is not even executing .
What is happening in scrapy 0.24 ?
Any ideas !
--
You received this message because you are subscribed to the Google Groups
"scrapy-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to scrapy-users+unsubscr...@googlegroups.com.
To post to this group, send email to scrapy-users@googlegroups.com.
Visit this group at http://groups.google.com/group/scrapy-users.
For more options, visit https://groups.google.com/d/optout.
