Oleg Broytmann wrote: > On Tue, Jul 28, 2009 at 04:04:28PM -0400, Stef Telford wrote: > >> Oleg Broytmann wrote: >> >>> Can I ask you do an experiment with a different program? What if you use >>> sqlbuilder.Select() - a lower-level interface? How long it'd take to draw >>> all these rows? >>> >> Sorry, I have almost -0- experience with that low a level .. do you >> have any nice canned example I could tailor to suit ? >> > > Very easy: sqlbuilder.Select(list_of_columns), convert the expression to > a string (SQL query), execute the query and get back the results: > > connection = connectionForURI('...') > > class Test(SQLObject): > _connection = connection > a = IntCol() > b = IntCol() > > Test.createTable() > > Test(a=1, b=2) > Test(a=2, b=1) > > for row in connection.queryAll(connection.sqlrepr( > sqlbuilder.Select([Test.q.a, Test.q.b]))): > print row > > In case you want to pass the list of columns as a list of strings - pass > the list of tables for the FROM clause: > > Select(['a', 'b'], staticTables=['test']) > > Oleg. > Hello Oleg, Here is the output from the lowlevel connection select as you suggested above (mostly) ordered by internal time. Note that it selects all 220k bookings, as opposed to last time when it 'only' selected 40k. It seems that decimal.__new__ is killer .. I could be reading this wrong (of course) but.. the tottime would seem to back that up I think.
133167599 function calls (133165268 primitive calls) in 392.615 CPU seconds Ordered by: internal time ncalls tottime percall cumtime percall filename:lineno(function) 9883936 93.137 0.000 93.137 0.000 {built-in method __new__ of type object at 0x814fa00} 9883851 90.187 0.000 242.693 0.000 decimal.py:515(__new__) 1 53.209 53.209 295.902 295.902 {method 'fetchall' of 'psycopg2._psycopg.cursor' objects} 9883845 35.014 0.000 42.012 0.000 decimal.py:830(__str__) 9884218 25.102 0.000 25.102 0.000 {built-in method match} 9883845 21.096 0.000 63.108 0.000 decimal.py:825(__repr__) 39536056 20.103 0.000 20.103 0.000 {built-in method group} 1 16.715 16.715 392.589 392.589 t.lowlevel:3(<module>) 1 16.522 16.522 16.522 16.522 {method 'execute' of 'psycopg2._psycopg.cursor' objects} 24350308/24349893 9.742 0.000 9.742 0.000 {len} 9883846 6.461 0.000 6.461 0.000 {method 'lstrip' of 'str' objects} 9885976 4.971 0.000 4.971 0.000 {isinstance} 1 0.031 0.031 0.031 0.031 pgconnection.py:108(makeConnection) 1 0.026 0.026 392.615 392.615 {execfile} 371/62 0.015 0.000 0.048 0.001 sre_parse.py:385(_parse) 1 0.014 0.014 312.470 312.470 dbconnection.py:257(_runWithConnection) 4824 0.012 0.000 0.015 0.000 sre_parse.py:188(__next) 740/61 0.011 0.000 0.033 0.001 sre_compile.py:38(_compile) 261 0.010 0.000 0.011 0.000 {eval} 339 0.010 0.000 0.015 0.000 sre_compile.py:213(_optimize_charset) 1054/380 0.008 0.000 0.009 0.000 sre_parse.py:146(getwidth) 664 0.006 0.000 0.009 0.000 {built-in method sub} 12091 0.005 0.000 0.005 0.000 {method 'append' of 'list' objects} 4074 0.005 0.000 0.018 0.000 sre_parse.py:207(get) 43 0.004 0.000 0.004 0.000 sre_compile.py:264(_mk_bitmap) 128 0.004 0.000 0.017 0.000 pkg_resources.py:1645(find_on_path) 1 0.004 0.004 0.005 0.005 socket.py:43(<module>) 1 0.004 0.004 0.031 0.031 converters.py:1(<module>) 1 0.004 0.004 0.007 0.007 mimetypes.py:199(readfp) 6273 0.003 0.000 0.003 0.000 {method 'startswith' of 'str' objects} Regards Stef ------------------------------------------------------------------------------ Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day trial. Simplify your report design, integration and deployment - and focus on what you do best, core application coding. Discover what's new with Crystal Reports now. http://p.sf.net/sfu/bobj-july _______________________________________________ sqlobject-discuss mailing list sqlobject-discuss@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/sqlobject-discuss