Julian, Previously it was taking 45 minutes to insert 5000 contacts. Now its taking under 10 mins, so thats good sign for us. The final benchmark was 12 mins for 10007 contacts with 9 threads. We got message after 10007 message about contacts quota is over. So thats the limit, right?
Regards, Ashvin On Thu, Apr 2, 2009 at 10:04 PM, Julian (Google) <[email protected]> wrote: > > Hi Ashvin, > > If you are already doing multiple threads per multiple users that > should be almost the maximum output. Please let me know if you manage > to get a better result, I will also let you know if I find more > information. > > Thanks, > Julian > > > On Mar 31, 3:14 pm, Ashvin Savani <[email protected]> wrote: > > Julian, > > Thanks for your time to answer this issue. I like your idea of doing > > multiple threads. We are already doing multiple threads per multiple > users > > but will it work for multiple threads for different batches of same user? > > > > Here is the exact situation: > > > > We sync Google account with our application server at every X amount of > > minutes. It includes contacts and calendars both. Our application server > > manages add / update / deletes and we are not doing unwanted transactions > > with Google. So if user have 1000 contacts, we divide into 10 batches of > 100 > > each. We also did some benchmarking of doing batch of 50 and we found 100 > is > > better. But I will try it again. Each batch executes as single thread for > > now. and this time goes beyond 1 minute in some cases. Average its 55 > > seconds and its random for each batch, might be depending on content > length > > of all contacts. > > > > We even came across situation for testing account we use. Say for example > > 10000 contacts are there in google account and after our test case > > completes, we do delete all of them. So they will come back in next sync > as > > deleted entries. Even that bunch is not taking much time to retrieve and > > process. Only Google server update time is more. I will try with max 10 > > threads per user and will update you. > > > > We came across many issues so far about special character handling, wrong > > JSON feed if content is more etc., I was not much confident that bugs > were > > from Google or from ourside or some libraries we are using. > > > > Once again, Thanks for the hint of multi-threading. It should save lots > of > > time. > > > > Regards, > > > > Ashvin > > > > On Tue, Mar 31, 2009 at 7:25 PM, Julian (Google) <[email protected]> > wrote: > > > > > Hi Ashvin, > > > > > This is a good question, the average is bellow 1 minute. Are you > > > having problems with a specific user's contacts? How frequent is the > > > delay? > > > > > As for tips, if the response time increases, try smaller batches. If > > > you handle multiple user's contacts, you could try to use a thread per > > > user up to 10 threads in parallel. > > > > > Thanks, > > > Julian > > > > > On Mar 31, 11:08 am, Ashvin Savani <[email protected]> wrote: > > > > Julian, > > > > > > I am waiting for your answer :) > > > > > > Regards, > > > > > > Ashvin > > > > > > On Mar 31, 1:30 am, Ashvin Savani <[email protected]> wrote: > > > > > > > Hello All, > > > > > > > What is average time for insert of 100 contacts batch? It is taking > up > > > > > to 1 minute sometimes. Is that normal? Any tips on reduce this > time? > > > > > > > Thanks in advance, > > > > > > > Ashvin > > > -- Regards, Ashvin Savani CEO & Chief Architect, FlashBrain - A Division of Avinashi --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Google Contacts API" group. To post to this group, send email to [email protected] To unsubscribe from this group, send email to [email protected] For more options, visit this group at http://groups.google.com/group/google-contacts-api?hl=en -~----------~----~----~----~------~----~------~--~---
