Re: Benchmarking and timing DB transactions in Django

2013-03-04 Thread Mike Dewhirst
There are a few interesting pages if you google 'scaling django' and 
here is one those ...


https://speakerdeck.com/jacobian/django-doesnt-scale

Mike

On 5/03/2013 12:29am, Venkatraman S wrote:



On Fri, Feb 22, 2013 at 4:48 PM, R R > wrote:


I was wondering if there are any tools to benchmark DB transactions
using the Django ORM. I'm using PostGreSQL with Django 1.4. I'm
required to compare and come up with the best possible database
design for a project which will have millions of records when it's
deployed.

I'd love to hear your workflow or suggestions. Also I haven't seen
many articles that focus on developing high-performance webapps in
Django. May be it's the problem with me. so if you know of any good
articles which would help me, kindly share it too.


Well, data modelling is independent of all this - right? :)

I mean, benchmarking should not drive database design; and if it does,
then there is a VERY HIGH probability that you are not doing things
right. IF your models are right, then the problems would be in the way
you are constructing the query and django-debug-toolbar is a life-saver
here.

Regards,
Venkat

--
You received this message because you are subscribed to the Google
Groups "Django users" group.
To unsubscribe from this group and stop receiving emails from it, send
an email to django-users+unsubscr...@googlegroups.com.
To post to this group, send email to django-users@googlegroups.com.
Visit this group at http://groups.google.com/group/django-users?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




--
You received this message because you are subscribed to the Google Groups "Django 
users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-users+unsubscr...@googlegroups.com.
To post to this group, send email to django-users@googlegroups.com.
Visit this group at http://groups.google.com/group/django-users?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




Re: Benchmarking and timing DB transactions in Django

2013-03-04 Thread Venkatraman S
On Fri, Feb 22, 2013 at 4:48 PM, R R  wrote:

>
> I was wondering if there are any tools to benchmark DB transactions using
> the Django ORM. I'm using PostGreSQL with Django 1.4. I'm required to
> compare and come up with the best possible database design for a project
> which will have millions of records when it's deployed.
>
> I'd love to hear your workflow or suggestions. Also I haven't seen many
> articles that focus on developing high-performance webapps in Django. May
> be it's the problem with me. so if you know of any good articles which
> would help me, kindly share it too.
>
>
Well, data modelling is independent of all this - right? :)

I mean, benchmarking should not drive database design; and if it does, then
there is a VERY HIGH probability that you are not doing things right. IF
your models are right, then the problems would be in the way you are
constructing the query and django-debug-toolbar is a life-saver here.

Regards,
Venkat

-- 
You received this message because you are subscribed to the Google Groups 
"Django users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-users+unsubscr...@googlegroups.com.
To post to this group, send email to django-users@googlegroups.com.
Visit this group at http://groups.google.com/group/django-users?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




Re: Benchmarking and timing DB transactions in Django

2013-03-03 Thread Andy McKay

On Feb 22, 2013, at 3:18 AM, R R  wrote:
> I was wondering if there are any tools to benchmark DB transactions using the 
> Django ORM. I'm using PostGreSQL with Django 1.4. I'm required to compare and 
> come up with the best possible database design for a project which will have 
> millions of records when it's deployed.

If nothing else use Django debug toolbar to time your pages and get debug 
information:

https://github.com/django-debug-toolbar/django-debug-toolbar

> I'd love to hear your workflow or suggestions. Also I haven't seen many 
> articles that focus on developing high-performance webapps in Django. May be 
> it's the problem with me. so if you know of any good articles which would 
> help me, kindly share it too.

I've given some talks on Mozilla sites here (e.g. OSCON 2012):

http://andymckay.github.com/presentations/

I find django statsd extremely useful for performance tuning:

https://django-statsd.readthedocs.org/en/latest/#usage

And don't forget to use all your standard database tools (e.g. slow query log).

-- 
You received this message because you are subscribed to the Google Groups 
"Django users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-users+unsubscr...@googlegroups.com.
To post to this group, send email to django-users@googlegroups.com.
Visit this group at http://groups.google.com/group/django-users?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.