issue is not amount of data but controlling of storing and fetching data so if any given time x amount y is being stored in tube, at time x amount should be fetched. I am not sure whether queue gets locked while data is being fetched? if not then how to make sure data is not duplicated while retrieving?
Thanks /A On Nov 7, 10:38 pm, Cody Caughlan <[email protected]> wrote: > The approach I think most people take is to store as little > information as needed in the job body, and then store the rest of the > job meta information in a persistent store like a DB. > > Thus, your job body might just store a Offer ID - which when pulled > from Beanstalk via a worker the worker in turn retrieves the full > Offer details from your store and then acts accordingly. > > /Cody > > > > On Sun, Nov 7, 2010 at 9:04 AM, Adnan <[email protected]> wrote: > > Hi All > > > Thanks for a lot for pushing me to have a kick start Message Queue > > implementation. I am implementing it on a form posting application. I > > created a tube with name "Offer" and encoded the entire POST var in > > form of JSON in it. Now since I have to retrieve data from it hence i > > need guidelines to do that. > > > 1- I made a single tube where all data will be dumped on each > > successful form post. The tube will be continuously busy to store the > > data. Now I am willing to fetch data via Cron Job after every hour or > > half an hour. Now can you tell me whether same tube could be used to > > fetch and store data at same time? When I use reserve command, does it > > lock the entire tube since the time data is being fetched and delete? > > if yes then where will the data go which is currently being dumped? > > > 2- Since the machine could go down anytime, how to initiate the > > process of storing data in log files in case it could be retrieved > > later? Do logs store data at same time while they write in memory? if > > yes then does not it cost performance ? > > > Thanks for your time > > > -- > > You received this message because you are subscribed to the Google Groups > > "beanstalk-talk" group. > > To post to this group, send email to [email protected]. > > To unsubscribe from this group, send email to > > [email protected]. > > For more options, visit this group > > athttp://groups.google.com/group/beanstalk-talk?hl=en. -- You received this message because you are subscribed to the Google Groups "beanstalk-talk" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/beanstalk-talk?hl=en.
