Oleg Broytmann wrote:
> On Tue, Jul 28, 2009 at 04:04:28PM -0400, Stef Telford wrote:
>
>> Oleg Broytmann wrote:
>>
>>> Can I ask you do an experiment with a different program? What if you use
>>> sqlbuilder.Select() - a lower-level interface? How long it'd take to draw
>>> all these rows?
>>>
>> Sorry, I have almost -0- experience with that low a level .. do you
>> have any nice canned example I could tailor to suit ?
>>
>
> Very easy: sqlbuilder.Select(list_of_columns), convert the expression to
> a string (SQL query), execute the query and get back the results:
>
> connection = connectionForURI('...')
>
> class Test(SQLObject):
> _connection = connection
> a = IntCol()
> b = IntCol()
>
> Test.createTable()
>
> Test(a=1, b=2)
> Test(a=2, b=1)
>
> for row in connection.queryAll(connection.sqlrepr(
> sqlbuilder.Select([Test.q.a, Test.q.b]))):
> print row
>
> In case you want to pass the list of columns as a list of strings - pass
> the list of tables for the FROM clause:
>
> Select(['a', 'b'], staticTables=['test'])
>
> Oleg.
>
Hello Oleg,
Here is the output from the lowlevel connection select as you
suggested above (mostly) ordered by internal time. Note that it selects
all 220k bookings, as opposed to last time when it 'only' selected 40k.
It seems that decimal.__new__ is killer .. I could be reading this wrong
(of course) but.. the tottime would seem to back that up I think.
133167599 function calls (133165268 primitive calls) in 392.615
CPU seconds
Ordered by: internal time
ncalls tottime percall cumtime percall filename:lineno(function)
9883936 93.137 0.000 93.137 0.000 {built-in method __new__
of type object at 0x814fa00}
9883851 90.187 0.000 242.693 0.000 decimal.py:515(__new__)
1 53.209 53.209 295.902 295.902 {method 'fetchall' of
'psycopg2._psycopg.cursor' objects}
9883845 35.014 0.000 42.012 0.000 decimal.py:830(__str__)
9884218 25.102 0.000 25.102 0.000 {built-in method match}
9883845 21.096 0.000 63.108 0.000 decimal.py:825(__repr__)
39536056 20.103 0.000 20.103 0.000 {built-in method group}
1 16.715 16.715 392.589 392.589 t.lowlevel:3(<module>)
1 16.522 16.522 16.522 16.522 {method 'execute' of
'psycopg2._psycopg.cursor' objects}
24350308/24349893 9.742 0.000 9.742 0.000 {len}
9883846 6.461 0.000 6.461 0.000 {method 'lstrip' of 'str'
objects}
9885976 4.971 0.000 4.971 0.000 {isinstance}
1 0.031 0.031 0.031 0.031
pgconnection.py:108(makeConnection)
1 0.026 0.026 392.615 392.615 {execfile}
371/62 0.015 0.000 0.048 0.001 sre_parse.py:385(_parse)
1 0.014 0.014 312.470 312.470
dbconnection.py:257(_runWithConnection)
4824 0.012 0.000 0.015 0.000 sre_parse.py:188(__next)
740/61 0.011 0.000 0.033 0.001 sre_compile.py:38(_compile)
261 0.010 0.000 0.011 0.000 {eval}
339 0.010 0.000 0.015 0.000
sre_compile.py:213(_optimize_charset)
1054/380 0.008 0.000 0.009 0.000 sre_parse.py:146(getwidth)
664 0.006 0.000 0.009 0.000 {built-in method sub}
12091 0.005 0.000 0.005 0.000 {method 'append' of 'list'
objects}
4074 0.005 0.000 0.018 0.000 sre_parse.py:207(get)
43 0.004 0.000 0.004 0.000 sre_compile.py:264(_mk_bitmap)
128 0.004 0.000 0.017 0.000
pkg_resources.py:1645(find_on_path)
1 0.004 0.004 0.005 0.005 socket.py:43(<module>)
1 0.004 0.004 0.031 0.031 converters.py:1(<module>)
1 0.004 0.004 0.007 0.007 mimetypes.py:199(readfp)
6273 0.003 0.000 0.003 0.000 {method 'startswith' of
'str' objects}
Regards
Stef
------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
trial. Simplify your report design, integration and deployment - and focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now. http://p.sf.net/sfu/bobj-july
_______________________________________________
sqlobject-discuss mailing list
sqlobject-discuss@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/sqlobject-discuss
