I forgot about the rollbacks. They are needed in sqlite, yes. In postgresql however, you can do "DELETE...RETURNING.." so you shouldn't need to commit/rollback manually.
Also, I forgot about the remove method. It's used by the cancel.json ws so you should implement it too. On 28 December 2016 at 09:48, <scrapy-users@googlegroups.com> wrote: > scrapy-users@googlegroups.com > <https://groups.google.com/forum/?utm_source=digest&utm_medium=email#!forum/scrapy-users/topics> > Google > Groups > <https://groups.google.com/forum/?utm_source=digest&utm_medium=email/#!overview> > <https://groups.google.com/forum/?utm_source=digest&utm_medium=email/#!overview> > Today's topic summary > View all topics > <https://groups.google.com/forum/?utm_source=digest&utm_medium=email#!forum/scrapy-users/topics> > > - Shared Job Queue with Postgresql > <#m_8205804781841609126_group_thread_0> - 3 Updates > > Shared Job Queue with Postgresql > <http://groups.google.com/group/scrapy-users/t/57cbec8578a30b97?utm_source=digest&utm_medium=email> > k bez <priceview...@gmail.com>: Dec 27 07:59AM -0800 > > Ok I patched *sqlite.py* module and SqlitePriorityQueue class and it seems > to work fine with Postgre. > But i have some questions if smone can answer. > 1. SQLite use parameter ...more > <http://groups.google.com/group/scrapy-users/msg/1b624b99cf842?utm_source=digest&utm_medium=email> > Nikolaos-Digenis Karagiannis <digenish...@gmail.com>: Dec 27 11:00PM > +0200 > > 1. Yes, just keep the connection in auto commit. > Also, know that you will have to ensure your pg server's availability. > 2. Leftovers. Shouldn't matter. > > ...more > <http://groups.google.com/group/scrapy-users/msg/1c69a9876fd3b?utm_source=digest&utm_medium=email> > k bez <priceview...@gmail.com>: Dec 27 03:14PM -0800 > > I didnt use auto commit but seems to work fine without it in development > server. > There are some rollbacks in scrapyd code too so i dont know if auto commit > is good..... > Why auto commit is ...more > <http://groups.google.com/group/scrapy-users/msg/1cde8d01ca829?utm_source=digest&utm_medium=email> > Back to top <#m_8205804781841609126_digest_top> > You received this digest because you're subscribed to updates for this > group. You can change your settings on the group membership page > <https://groups.google.com/forum/?utm_source=digest&utm_medium=email#!forum/scrapy-users/join> > . > To unsubscribe from this group and stop receiving emails from it send an > email to scrapy-users+unsubscr...@googlegroups.com. > -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to scrapy-users+unsubscr...@googlegroups.com. To post to this group, send email to scrapy-users@googlegroups.com. Visit this group at https://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
