I am glad to hear that the thread suggestion helped you reduce the times. I will be happy to test it if you need testers.
Cheers, Julian. On Apr 2, 5:45 pm, Ashvin Savani <[email protected]> wrote: > Julian, > Okay, thanks for confirming. By your thread suggestion, we achieved big > milestone in our project. So I would like to thank you once again from > bottom of my heart! > Would you like to be part of the private beta of the project - we are > working on? > > Regards, > > Ashvin > > > > On Thu, Apr 2, 2009 at 10:10 PM, Julian (Google) <[email protected]> wrote: > > > Thank you for sharing, yes, there should be a limit around there. > > > -Julian. > > > On Apr 2, 5:37 pm, Ashvin Savani <[email protected]> wrote: > > > Julian, > > > Previously it was taking 45 minutes to insert 5000 contacts. Now its > > taking > > > under 10 mins, so thats good sign for us. The final benchmark was 12 mins > > > for 10007 contacts with 9 threads. We got message after 10007 message > > about > > > contacts quota is over. So thats the limit, right? > > > > Regards, > > > > Ashvin > > > > On Thu, Apr 2, 2009 at 10:04 PM, Julian (Google) <[email protected]> > > wrote: > > > > > Hi Ashvin, > > > > > If you are already doing multiple threads per multiple users that > > > > should be almost the maximum output. Please let me know if you manage > > > > to get a better result, I will also let you know if I find more > > > > information. > > > > > Thanks, > > > > Julian > > > > > On Mar 31, 3:14 pm, Ashvin Savani <[email protected]> wrote: > > > > > Julian, > > > > > Thanks for your time to answer this issue. I like your idea of doing > > > > > multiple threads. We are already doing multiple threads per multiple > > > > users > > > > > but will it work for multiple threads for different batches of same > > user? > > > > > > Here is the exact situation: > > > > > > We sync Google account with our application server at every X amount > > of > > > > > minutes. It includes contacts and calendars both. Our application > > server > > > > > manages add / update / deletes and we are not doing unwanted > > transactions > > > > > with Google. So if user have 1000 contacts, we divide into 10 batches > > of > > > > 100 > > > > > each. We also did some benchmarking of doing batch of 50 and we found > > 100 > > > > is > > > > > better. But I will try it again. Each batch executes as single thread > > for > > > > > now. and this time goes beyond 1 minute in some cases. Average its 55 > > > > > seconds and its random for each batch, might be depending on content > > > > length > > > > > of all contacts. > > > > > > We even came across situation for testing account we use. Say for > > example > > > > > 10000 contacts are there in google account and after our test case > > > > > completes, we do delete all of them. So they will come back in next > > sync > > > > as > > > > > deleted entries. Even that bunch is not taking much time to retrieve > > and > > > > > process. Only Google server update time is more. I will try with max > > 10 > > > > > threads per user and will update you. > > > > > > We came across many issues so far about special character handling, > > wrong > > > > > JSON feed if content is more etc., I was not much confident that bugs > > > > were > > > > > from Google or from ourside or some libraries we are using. > > > > > > Once again, Thanks for the hint of multi-threading. It should save > > lots > > > > of > > > > > time. > > > > > > Regards, > > > > > > Ashvin > > > > > > On Tue, Mar 31, 2009 at 7:25 PM, Julian (Google) <[email protected]> > > > > wrote: > > > > > > > Hi Ashvin, > > > > > > > This is a good question, the average is bellow 1 minute. Are you > > > > > > having problems with a specific user's contacts? How frequent is > > the > > > > > > delay? > > > > > > > As for tips, if the response time increases, try smaller batches. > > If > > > > > > you handle multiple user's contacts, you could try to use a thread > > per > > > > > > user up to 10 threads in parallel. > > > > > > > Thanks, > > > > > > Julian > > > > > > > On Mar 31, 11:08 am, Ashvin Savani <[email protected]> wrote: > > > > > > > Julian, > > > > > > > > I am waiting for your answer :) > > > > > > > > Regards, > > > > > > > > Ashvin > > > > > > > > On Mar 31, 1:30 am, Ashvin Savani <[email protected]> wrote: > > > > > > > > > Hello All, > > > > > > > > > What is average time for insert of 100 contacts batch? It is > > taking > > > > up > > > > > > > > to 1 minute sometimes. Is that normal? Any tips on reduce this > > > > time? > > > > > > > > > Thanks in advance, > > > > > > > > > Ashvin > > > > -- > > > Regards, > > > > Ashvin Savani > > > CEO & Chief Architect, > > > FlashBrain - A Division of Avinashi > > -- > Regards, > > Ashvin Savani > CEO & Chief Architect, > FlashBrain - A Division of Avinashi --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Google Contacts API" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/google-contacts-api?hl=en -~----------~----~----~----~------~----~------~--~---
