How to override project wide settings in specific spider?

2014-05-29 Thread scrapydev
Hello, There are some middlewares which provides variables to set in settings.py. For example, "RedirectMiddleware" provides "REDIRECT_ENABLED" and "REDIRECT_MAX_TIMES" settings. If we set this in settings.py, this settings will be applied to whole project so all spiders in that project. Now

Re: How to change output xml default tags?

2014-05-27 Thread scrapydev
Hello Paul, Thanks for providing solution for changing xml elements. This seems working for me. Now searching to add option to split output xml files based on number of records. Also, current output is single line file (all xml tags are in same line), could you suggest if there is some way to

Re: How to change output xml default tags?

2014-05-26 Thread scrapydev
Hello! Could someone get time to look into this and providing some solution? Thanks, On Wednesday, May 21, 2014 4:15:26 PM UTC+5:30, scra...@gmail.com wrote: > > Hi, > > I am beginners with scrapy and also with the python. So far I could manage > to create some basic spiders based on given exam

Re: Service_Identity Error

2014-05-25 Thread scrapydev
Hello! Just install service_identity with pip. pip install service_identity This should fix this warning. Regards, On Sunday, May 25, 2014 11:42:29 AM UTC+5:30, Bhoomin Pandya wrote: > > Hi, > > I have installed Scrapy with Python 2.7.6 32 bit on Windows 7 64 bit. > > At the python command p

How to change output xml default tags?

2014-05-21 Thread scrapydev
Hi, I am beginners with scrapy and also with the python. So far I could manage to create some basic spiders based on given examples in scrapy doc. Now I would like to extend the default features according to custom requirement. Atm I am trying to change the default tag names in output xml. For