Hey all, I'm trying to throw Django model saving into a thread, so I can download requests faster. Only problem is, callbacks aren't synchronous, after it hits a yield, it keeps going, and then I get foreign key errors. It doesn't work like @defer.inlineCallbacks, which is what I expect!
Anyone have any solution to this? I also tried an intricate spider middleware solution, which didn't work... :( Anyone have any idea how to do this? Here's an example of my problem https://gist.github.com/anonymous/0383f0b980fa7c1084a6 Thanks, Ryan -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
