Julian, Okay, thanks for confirming. By your thread suggestion, we achieved big milestone in our project. So I would like to thank you once again from bottom of my heart! Would you like to be part of the private beta of the project - we are working on?
Regards, Ashvin On Thu, Apr 2, 2009 at 10:10 PM, Julian (Google) <[email protected]> wrote: > > Thank you for sharing, yes, there should be a limit around there. > > -Julian. > > On Apr 2, 5:37 pm, Ashvin Savani <[email protected]> wrote: > > Julian, > > Previously it was taking 45 minutes to insert 5000 contacts. Now its > taking > > under 10 mins, so thats good sign for us. The final benchmark was 12 mins > > for 10007 contacts with 9 threads. We got message after 10007 message > about > > contacts quota is over. So thats the limit, right? > > > > Regards, > > > > Ashvin > > > > > > > > On Thu, Apr 2, 2009 at 10:04 PM, Julian (Google) <[email protected]> > wrote: > > > > > Hi Ashvin, > > > > > If you are already doing multiple threads per multiple users that > > > should be almost the maximum output. Please let me know if you manage > > > to get a better result, I will also let you know if I find more > > > information. > > > > > Thanks, > > > Julian > > > > > On Mar 31, 3:14 pm, Ashvin Savani <[email protected]> wrote: > > > > Julian, > > > > Thanks for your time to answer this issue. I like your idea of doing > > > > multiple threads. We are already doing multiple threads per multiple > > > users > > > > but will it work for multiple threads for different batches of same > user? > > > > > > Here is the exact situation: > > > > > > We sync Google account with our application server at every X amount > of > > > > minutes. It includes contacts and calendars both. Our application > server > > > > manages add / update / deletes and we are not doing unwanted > transactions > > > > with Google. So if user have 1000 contacts, we divide into 10 batches > of > > > 100 > > > > each. We also did some benchmarking of doing batch of 50 and we found > 100 > > > is > > > > better. But I will try it again. Each batch executes as single thread > for > > > > now. and this time goes beyond 1 minute in some cases. Average its 55 > > > > seconds and its random for each batch, might be depending on content > > > length > > > > of all contacts. > > > > > > We even came across situation for testing account we use. Say for > example > > > > 10000 contacts are there in google account and after our test case > > > > completes, we do delete all of them. So they will come back in next > sync > > > as > > > > deleted entries. Even that bunch is not taking much time to retrieve > and > > > > process. Only Google server update time is more. I will try with max > 10 > > > > threads per user and will update you. > > > > > > We came across many issues so far about special character handling, > wrong > > > > JSON feed if content is more etc., I was not much confident that bugs > > > were > > > > from Google or from ourside or some libraries we are using. > > > > > > Once again, Thanks for the hint of multi-threading. It should save > lots > > > of > > > > time. > > > > > > Regards, > > > > > > Ashvin > > > > > > On Tue, Mar 31, 2009 at 7:25 PM, Julian (Google) <[email protected]> > > > wrote: > > > > > > > Hi Ashvin, > > > > > > > This is a good question, the average is bellow 1 minute. Are you > > > > > having problems with a specific user's contacts? How frequent is > the > > > > > delay? > > > > > > > As for tips, if the response time increases, try smaller batches. > If > > > > > you handle multiple user's contacts, you could try to use a thread > per > > > > > user up to 10 threads in parallel. > > > > > > > Thanks, > > > > > Julian > > > > > > > On Mar 31, 11:08 am, Ashvin Savani <[email protected]> wrote: > > > > > > Julian, > > > > > > > > I am waiting for your answer :) > > > > > > > > Regards, > > > > > > > > Ashvin > > > > > > > > On Mar 31, 1:30 am, Ashvin Savani <[email protected]> wrote: > > > > > > > > > Hello All, > > > > > > > > > What is average time for insert of 100 contacts batch? It is > taking > > > up > > > > > > > to 1 minute sometimes. Is that normal? Any tips on reduce this > > > time? > > > > > > > > > Thanks in advance, > > > > > > > > > Ashvin > > > > -- > > Regards, > > > > Ashvin Savani > > CEO & Chief Architect, > > FlashBrain - A Division of Avinashi > > > -- Regards, Ashvin Savani CEO & Chief Architect, FlashBrain - A Division of Avinashi --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Google Contacts API" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/google-contacts-api?hl=en -~----------~----~----~----~------~----~------~--~---
