Re: [web2py] Re: DAL speed - an idea

2012-03-09 Thread nick name
On Friday, March 9, 2012 2:18:58 PM UTC-5, viniciusban wrote: > > Anthony, I'm not supposed to retrieve tens os thousands records from a > single query in a web app It's all a question of what each layer is doing. Let's say you have a database with 100,000 records. You need a summary: select su

[web2py] Re: DAL speed - an idea

2012-03-09 Thread nick name
On Friday, March 9, 2012 1:48:06 PM UTC-5, spiffytech wrote: > > Before we add special features to the DAL, has anyone profiled the DAL > with queries and data similar to nick name's to see if there's any > low-hanging fruit we can tackle to speed up the normal select()? The suggested change i

Re: [web2py] Re: DAL speed - an idea

2012-03-09 Thread Anthony
> > Anthony, I'm not supposed to retrieve tens os thousands records from a > single query in a web app. Mostly true, but not always: https://groups.google.com/d/msg/web2py/A11z4UdMaIc/882_shAVk4UJ Of course, if you've got a busy site with lots of queries, it can add up even for relatively sma

Re: [web2py] Re: DAL speed - an idea

2012-03-09 Thread Vinicius Assef
Anthony, I'm not supposed to retrieve tens os thousands records from a single query in a web app. I would address this problem to app structure, instead of to DAL. Anyway, we can execute raw SQL statements via DAL, right? -- Vinicius Assef On Fri, Mar 9, 2012 at 4:12 PM, Anthony wrote: > mcm

[web2py] Re: DAL speed - an idea

2012-03-09 Thread Anthony
mcm made some initial attempts and indicated about a 25% improvement, with the expectation that some further improvement could be made with more effort: https://groups.google.com/forum/#!topic/web2py-developers/Tp6HXsSf7lk/discussion. However, it sounded like we wouldn't be likely to get enoug

[web2py] Re: DAL speed - an idea

2012-03-09 Thread spiffytech
Before we add special features to the DAL, has anyone profiled the DAL with queries and data similar to nick name's to see if there's any low-hanging fruit we can tackle to speed up the normal select()? nick name, can you please provide your table schema so we can test performance on data sets

[web2py] Re: DAL speed - an idea

2012-03-08 Thread Anthony
Nice. I added a comment. On Friday, March 9, 2012 12:41:26 AM UTC-5, nick name wrote: > > > > On Friday, February 10, 2012 12:04:59 AM UTC-5, Massimo Di Pierro wrote: >> >> open a ticket, this can be done. I like the idea of passing a >> processor. >> > > Opened in http://code.google.com/p/web2p

[web2py] Re: DAL speed - an idea

2012-03-08 Thread nick name
On Friday, February 10, 2012 12:04:59 AM UTC-5, Massimo Di Pierro wrote: > > open a ticket, this can be done. I like the idea of passing a > processor. > Opened in http://code.google.com/p/web2py/issues/detail?id=701 with discussion and a much improved suggestion of how to handle this.

[web2py] Re: DAL speed - an idea

2012-02-10 Thread Simon Lukell
+1 Having this option would make it really simple to change between the full-blown DAL result set and a faster stripped down one (which could then be adapted with the processor to keep the rest of the code working.) > I've been thinking about something like this as well. Instead of a separate > se

[web2py] Re: DAL speed - an idea

2012-02-09 Thread Massimo Di Pierro
open a ticket, this can be done. I like the idea of passing a processor. On Feb 9, 3:14 pm, Anthony wrote: > I've been thinking about something like this as well. Instead of a separate > select_raw() method, maybe we can just add a raw=True|False argument to the > existing select() method. I like