+1 This is awesome. Nice find! Seems to provide key areas that pulp relies on and if we can get rid of maintaining and developing another package ourselves(gofer/tasking library) I think its a win for us. If this can do everything it claims to do and do it well, I think we should seriously consider investigating this in a sprint.
~ Prad ----- Original Message ----- From: "Jason L Connor" <[email protected]> To: "pulp-list" <[email protected]> Sent: Tuesday, January 18, 2011 4:56:12 PM Subject: [Pulp-list] Celery and the death of pulp tasking and gofer Hi All, I've been watching this project grow for the last 6 months or so, and I think it's time to seriously consider it. Celery is a distributed task queue framework for python. It can use an number of back ends, including mongodb and rabbitmq. It allows tasks to be run synchronously and asynchronously, locally and remotely. It has task persistence already implemented, as well as scheduling, including retries. It now runs on python 2.4+ (which it didn't used to), making it meet our need to be rhel 5 compatible. It's home page is here: http://celeryproject.org/ I propose we take a very serious look at celery to replace both the pulp tasking libraries and gofer project for our asynchronous and remote execution needs. It's feature set is well beyond what we've achieved, and I believe in a single sprint we could replace the existing libraries and lend our creative talents to a project already implementing the hard bits instead of rolling our own here. -- Jason L Connor Software Engineer Red Hat, Inc. RHCE: 805010912355231 Freenode: linear GPG Fingerprint: 2048R/CC4ED7C1 _______________________________________________ Pulp-list mailing list [email protected] https://www.redhat.com/mailman/listinfo/pulp-list -- -- Pradeep Kilambi Red Hat Systems Management [email protected] Phone: +1 919 754 4285 RHCE/RHCDS # 805008680430554 _______________________________________________ Pulp-list mailing list [email protected] https://www.redhat.com/mailman/listinfo/pulp-list
