2 things: 1. i've not observed this limit when running queries on GAE. i've gotten as many as 14,000 records back when running in the production environment. though it runs way too slow, and i end up eating up my 30 seconds. 2. somewhere (i can't remember where) a paging technique was suggested that if you want pages of 100 records, ask for 101, if you get 101 records then you know there is at least 1 item to show on the next page. perhaps this sort of technique can be adapted for your purposes?
good luck! christian On Apr 10, 9:14 pm, mdipierro <mdipie...@cs.depaul.edu> wrote: > it requires using cursor. DAL select requires fetching all records. > The issue it, can we retrieve more than 1000 records looping over them > using cursor instead of using fetch? I have not tried but my > impression is that there is a tradeoff. we overcome a limitation (1000 > records) by requiring more computing time for the app (even when below > the limit). Moreover: > 1) there is no way to know in advance how many records to fetch > because count() is limited to 1000 > 2) the documentation says this only works with some queries. > > I think we just just wait Google figures out this is crazy and they > should remove the limitation in fetch and count. > > Massimo > > On Apr 10, 10:19 pm, Richard <richar...@gmail.com> wrote: > > > I've used it via webapp. Can this somehow be used via the DAL? > > > On Apr 10, 2:32 pm, mdipierro <mdipie...@cs.depaul.edu> wrote: > > > > Here is says more about it > > > >http://code.google.com/appengine/docs/python/datastore/queriesandinde... > > > > It looks like you can return more than 1000 but in different requests > > > (in the example they are retrieving 1000, then cache the cursor > > > location and, then fecth another 1000). > > > > Massimo > > > > On Apr 10, 5:14 am, Richard <richar...@gmail.com> wrote: > > > > > GAE supports accessing beyond 1000 records with the > > > > cursor:http://code.google.com/appengine/docs/python/datastore/gqlqueryclass.... > > > > > Can this somehow be used via the DAL? > > -- To unsubscribe, reply using "remove me" as the subject.
