Hi everyone,
i'm working with scrapy, i really need your help...
i need to save image to mongoDB dataset using gridfs , what's the best way
to do this?( i mean full image not the path to the folder in the OS)
what i have is :
**items**
file_urls = scrapy.Field()
files = scrapy.Field()
***the image field in the spider**
item['file_urls']=response.xpath('//div[@id="imgTagWrapperId"]/img[@id="landingImage"]/@src').extract()
***settings***
.....
ITEM_PIPELINES = {
'scrapy.pipelines.images.FilesPipeline': 1,
'full.pipelines.MongoDBPipeline': 300,
}
FILES_STORE = '/home/Desktop/output'
thanks in advance,
--
You received this message because you are subscribed to the Google Groups
"scrapy-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to scrapy-users+unsubscr...@googlegroups.com.
To post to this group, send email to scrapy-users@googlegroups.com.
Visit this group at https://groups.google.com/group/scrapy-users.
For more options, visit https://groups.google.com/d/optout.
