The approach I think most people take is to store as little information as needed in the job body, and then store the rest of the job meta information in a persistent store like a DB.
Thus, your job body might just store a Offer ID - which when pulled from Beanstalk via a worker the worker in turn retrieves the full Offer details from your store and then acts accordingly. /Cody On Sun, Nov 7, 2010 at 9:04 AM, Adnan <[email protected]> wrote: > Hi All > > Thanks for a lot for pushing me to have a kick start Message Queue > implementation. I am implementing it on a form posting application. I > created a tube with name "Offer" and encoded the entire POST var in > form of JSON in it. Now since I have to retrieve data from it hence i > need guidelines to do that. > > 1- I made a single tube where all data will be dumped on each > successful form post. The tube will be continuously busy to store the > data. Now I am willing to fetch data via Cron Job after every hour or > half an hour. Now can you tell me whether same tube could be used to > fetch and store data at same time? When I use reserve command, does it > lock the entire tube since the time data is being fetched and delete? > if yes then where will the data go which is currently being dumped? > > 2- Since the machine could go down anytime, how to initiate the > process of storing data in log files in case it could be retrieved > later? Do logs store data at same time while they write in memory? if > yes then does not it cost performance ? > > Thanks for your time > > -- > You received this message because you are subscribed to the Google Groups > "beanstalk-talk" group. > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]. > For more options, visit this group at > http://groups.google.com/group/beanstalk-talk?hl=en. > > -- You received this message because you are subscribed to the Google Groups "beanstalk-talk" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/beanstalk-talk?hl=en.
