Hello guys, Please check the comments at https://github.com/scrapy/scrapyd-client/issues/43
regards, Mani On Thursday, 9 March 2017 12:36:40 UTC+1, Paul Tremberth wrote: > > Hello Arnaud, > > what version of Scrapy are you using? > 1.3.0 has this change: https://github.com/scrapy/scrapy/pull/2433 that > swallows exceptions on spider modules import, > and which is very unfortunately not mentioned in the release notes > (totally my bad, I missed it) > > It looks like this change was a bad move since users do rely on import > errors for `scrapy list` for example. > And this seems the case here for scrapyd especially. > Could you check with scrapy 1.2.2? > > There is this proposal change to have the warning only optional, > and by default for some scrapy commands which do not need to load spiders > (e.g. scrapy version) > https://github.com/scrapy/scrapy/pull/2632 > > If it gets approved, I think I'll backport it to 1.3 branch. > > Best, > Paul. > > > > > On Wed, Mar 8, 2017 at 5:20 PM, Nikolaos-Digenis Karagiannis < > digen...@gmail.com <javascript:>> wrote: > >> Hi, >> >> This is definitely a bug >> and if it works as you just described >> there should be many users stumbling on it. >> >> Thank you for the update >> and for discovering it. >> >> Do you mind reporting it in the issue tracker? >> https://github.com/scrapy/scrapyd >> >> On 8 March 2017 at 14:29, Arnaud Knobloch <arnaud....@gmail.com >> <javascript:>> wrote: >> >>> If finally found what was the issue. If this can help someone else. >>> >>> I have "import pytesseract" in my spider file. I forgot to install this >>> on my server. In this case, when there is an import error from the spider >>> file (pytesseract or pil or whatever), you'll deploy 0 spider and you don't >>> have any logs. If it's an error import somewhere else (pipelines for >>> example) you'll have some logs to help you. >>> >>> On Wednesday, March 8, 2017 at 11:51:03 AM UTC+1, Nikolaos-Digenis >>> Karagiannis wrote: >>>> >>>> Hi, >>>> >>>> Sorry for the late reply. >>>> It looks like the spider is indeed packaged in the egg. >>>> There's a bug when definining LOG_STDOUT=True >>>> but this is not the case for you. >>>> Does it work if you remove the line `LOG_FILE =...`? >>>> >>>> On 19 February 2017 at 20:03, Arnaud Knobloch <arnaud....@gmail.com> >>>> wrote: >>>> >>>>> I tried severals things but I didn't find a way to deploy my spider. >>>>> Using curl http://IP:6800/addversion.json give me 0 spider too. >>>>> >>>>> Here some more info if someone can help me. >>>>> >>>>> *Stderr* >>>>> >>>>> 'build/scripts-2.7' does not exist -- can't clean it >>>>> zip_safe flag not set; analyzing archive contents... >>>>> >>>>> *Stout* >>>>> copying build/lib/m_scrapy/pipelines.py -> >>>>> build/bdist.macosx-10.11-x86_64/egg/m_scrapy >>>>> copying build/lib/m_scrapy/settings.py -> >>>>> build/bdist.macosx-10.11-x86_64/egg/m_scrapy >>>>> creating build/bdist.macosx-10.11-x86_64/egg/m_scrapy/spiders >>>>> copying build/lib/m_scrapy/spiders/__init__.py -> >>>>> build/bdist.macosx-10.11-x86_64/egg/m_scrapy/spiders >>>>> copying build/lib/m_scrapy/spiders/m_spider.py -> >>>>> build/bdist.macosx-10.11-x86_64/egg/m_scrapy/spiders >>>>> byte-compiling >>>>> build/bdist.macosx-10.11-x86_64/egg/m_scrapy/__init__.py to __init__.pyc >>>>> byte-compiling build/bdist.macosx-10.11-x86_64/egg/m_scrapy/items.py >>>>> to items.pyc >>>>> byte-compiling >>>>> build/bdist.macosx-10.11-x86_64/egg/m_scrapy/pipelines.py to pipelines.pyc >>>>> byte-compiling >>>>> build/bdist.macosx-10.11-x86_64/egg/m_scrapy/settings.py to settings.pyc >>>>> byte-compiling >>>>> build/bdist.macosx-10.11-x86_64/egg/m_scrapy/spiders/__init__.py to >>>>> __init__.pyc >>>>> byte-compiling >>>>> build/bdist.macosx-10.11-x86_64/egg/m_scrapy/spiders/m_spider.py to >>>>> m_spider.pyc >>>>> creating build/bdist.macosx-10.11-x86_64/egg/EGG-INFO >>>>> copying project.egg-info/PKG-INFO -> >>>>> build/bdist.macosx-10.11-x86_64/egg/EGG-INFO >>>>> copying project.egg-info/SOURCES.txt -> >>>>> build/bdist.macosx-10.11-x86_64/egg/EGG-INFO >>>>> copying project.egg-info/dependency_links.txt -> >>>>> build/bdist.macosx-10.11-x86_64/egg/EGG-INFO >>>>> copying project.egg-info/entry_points.txt -> >>>>> build/bdist.macosx-10.11-x86_64/egg/EGG-INFO >>>>> copying project.egg-info/top_level.txt -> >>>>> build/bdist.macosx-10.11-x86_64/egg/EGG-INFO >>>>> creating >>>>> '/var/folders/p3/tbhnqdq9019dbfwjtkrbb50r0000gn/T/scrapydeploy-4p418b/project-1.0-py2.7.egg' >>>>> >>>>> and adding 'build/bdist.macosx-10.11-x8$ >>>>> removing 'build/bdist.macosx-10.11-x86_64/egg' (and everything under >>>>> it) >>>>> >>>>> -- >>>>> You received this message because you are subscribed to a topic in the >>>>> Google Groups "scrapy-users" group. >>>>> To unsubscribe from this topic, visit >>>>> https://groups.google.com/d/topic/scrapy-users/JlfoQ5LlAl4/unsubscribe >>>>> . >>>>> To unsubscribe from this group and all its topics, send an email to >>>>> scrapy-users...@googlegroups.com. >>>>> To post to this group, send email to scrapy...@googlegroups.com. >>>>> Visit this group at https://groups.google.com/group/scrapy-users. >>>>> For more options, visit https://groups.google.com/d/optout. >>>>> >>>> >>>> -- >>> You received this message because you are subscribed to a topic in the >>> Google Groups "scrapy-users" group. >>> To unsubscribe from this topic, visit >>> https://groups.google.com/d/topic/scrapy-users/JlfoQ5LlAl4/unsubscribe. >>> To unsubscribe from this group and all its topics, send an email to >>> scrapy-users...@googlegroups.com <javascript:>. >>> To post to this group, send email to scrapy...@googlegroups.com >>> <javascript:>. >>> Visit this group at https://groups.google.com/group/scrapy-users. >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> -- >> You received this message because you are subscribed to the Google Groups >> "scrapy-users" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to scrapy-users...@googlegroups.com <javascript:>. >> To post to this group, send email to scrapy...@googlegroups.com >> <javascript:>. >> Visit this group at https://groups.google.com/group/scrapy-users. >> For more options, visit https://groups.google.com/d/optout. >> > > -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to scrapy-users+unsubscr...@googlegroups.com. To post to this group, send email to scrapy-users@googlegroups.com. Visit this group at https://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
