Hi Alexandru, I suspect some of those key_words are common across many entities. You do not have an explicit index defined, so queries are done using merge-join. That means a lot of records need returned and processed to fullfil your query. You're storing a lot of keywords on each entity, so adding an explicit index is going to result in an 'explosion' of index rows, and would likely noticeably impact your write performance.
I have no idea if you could make it work, but perhaps you could keep track of the frequency of your tags, select the most restrictive ones in a particular query, use those to execute the query, then filter the returned rows in memory with the 'common' search terms. Since you know your data and use-cases, perhaps you could optimize this process further with some clever 'index' entities of your own. Robert On Tue, Apr 12, 2011 at 20:54, Alexandru Farcas <[email protected]> wrote: > Hello, i have a problem with default indexes when executing a query > with equality filters on a list of properties. > > When querying a table with about 30000 entities I get the response > without errors, but after the table reaches 90000 entities the query > returns the error "The built-in indices are not efficient enough for > this query and your data. ...". > The entities have a list of about 30-40 keywords, and the queries have > about 3-4 eq filters. > > For example: SELECT __key__ FROM MyKeywords WHERE keyWordsList = 'leg' > AND keyWordsList = '53' AND keyWordsList = 'cod' AND entityName = Law > > I migrated from Master/Slave to HR. The error still appeared on the > SAME queries. > I created another table for the keywords (where i introduced the > "entityName" field inside the list of properties): exactly the same > behaviour... > Can someone tell me what i'm doing wrong ? > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to [email protected]. > To unsubscribe from this group, send email to > [email protected]. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to [email protected]. To unsubscribe from this group, send email to [email protected]. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
