My app needs to gather info from web pages. I use cron job to trigger tasks in task queue. Each queue entry does some URL fetch for the job. I've tried two methods: one use 4 queue entries, each of which covers 10 URL fetches; another one use 40 entries each of which covers only 1 URL fetches. I found that the second method consume 5 times more bandwidth than the first. Why?
Other than trial and error, how do I know what is the optimum grouping of tasks with regards to bandwidth reduction? 2X20, 4X5, 8X5, 10X4? -- You received this message because you are subscribed to the Google Groups "Google App Engine for Java" group. To post to this group, send email to google-appengine-java@googlegroups.com. To unsubscribe from this group, send email to google-appengine-java+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine-java?hl=en.
