Actually this brings up the problem that my command-line args get
clobbered, unless I perform a check: if 'foo' in kwargs, do nothing. It
seems like I'm doing something wrong. Any tips?
On Wednesday, April 5, 2017 at 4:00:27 PM UTC-7, Andre King wrote:
>
> Just answered my own questions:
>
> (1) Do NOT call get_project_settings() in spider's __init__ method
> because: this will retrieve only the settings in settings.py, not any
> custom spider or command line settings.
> (2) In order to pass arguments into the spider's __init__ method from the
> from_crawler method, make sure both methods accept *args and **kwargs as
> input. Then you can do something like this in from_crawler:
>
> my_setting = crawler.settings.get('MY_SETTING')
>
> kwargs['foo'] = my_setting
>
> obj = super(MySpider, self).from_crawler(crawler, *args, **kwargs)
>
> return obj
>
> On Wednesday, April 5, 2017 at 3:33:55 PM UTC-7, Andre King wrote:
>>
>> So far, I've read that settings should be gotten in the from_crawler
>> method and passed in as args or kwargs to the spider __init__ method.
>>
>> I wasn't able to figure out how to do this, so my solution has been to
>> simply call get_project_settings() in the spider's __init__ method instead
>> and go from there.
>>
>> Is there anything wrong with this approach? If so, can someone provide an
>> example as to how to pass settings to __init__ from from_crawler?
>>
>> Thanks,
>> Andre
>>
>
--
You received this message because you are subscribed to the Google Groups
"scrapy-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to scrapy-users+unsubscr...@googlegroups.com.
To post to this group, send email to scrapy-users@googlegroups.com.
Visit this group at https://groups.google.com/group/scrapy-users.
For more options, visit https://groups.google.com/d/optout.
