Re: HBase backend support

2011-03-30 Thread Rohit Upadhyaya 
On Wed, Mar 30, 2011 at 6:40 PM, Russell Keith-Magee <
russ...@keith-magee.com> wrote:

> On Wed, Mar 30, 2011 at 7:58 PM, Rohit  wrote:
> > Hi,
> > I plan to implement HBase backend support for Django as part of
> > GSoC 2011. Before I flesh out the idea in detail, I would like to know
> > if this is useful enough to Django, whether there are alternatives to
> > using HBase in the first place.
>
> I'm not sure this is a good project for GSoC.
>
> Firstly, Alex Gaynor worked on providing support for non-relational
> backends in last year's GSoC; that code hasn't landed in trunk yet,
> and may undergo some more modification before it does. If you were to
> build a HBase backend for Django under the auspices of the GSoC, it
> would need to use this interface. So, you're proposing a project that
> will be working against an interface that is still a work in progress.
>
> Secondly, HBase support itself (or support for any non-relational
> store) is unlikely to end up in core any time soon. Therefore, you're
> proposing to work on a project that won't become part of core. I'm not
> saying that contributing to Django's broader community isn't without
> merit, but Django has a limited number of GSoC slots, so we're looking
> to get the most bang for our buck. Working on Django's core is an easy
> win; if it's going to be an external project, it would need to be
> something that a large part of Django's community would gain benefit
> from (c.f., Armin Ronacher's template compilation proposal).
>
> Lastly, I'm not convinced that a backend for a single data store is a
> project that would be big enough for a Summer of Code. Alex built a
> MongoDB backend as part of his GSoC work, and he also had to do a
> bunch of refactoring of Django's query engine in order to make it
> work. You're proposing a massive subset of the work that he proposed
> (and delivered), which leads me to suspect that you won't actually
> fill an entire summer with this proposal.
>
> If you're still interested in the GSoC, we're still interested in
> having you as an applicant. If you're looking for other GSoC project
> ideas, the list on the wiki [1] has a bunch of other suggestions.
>
> [1] http://code.djangoproject.com/wiki/SummerOfCode2011
>
> Yours,
> Russ Magee %-)
>
> --
> You received this message because you are subscribed to the Google Groups
> "Django developers" group.
> To post to this group, send email to django-developers@googlegroups.com.
> To unsubscribe from this group, send email to
> django-developers+unsubscr...@googlegroups.com.
> For more options, visit this group at
> http://groups.google.com/group/django-developers?hl=en.
>
>

Right. So NoSQL backends are not really high on the Django GSoC priority
list currently. That's exactly what I wanted to know. I shall definitely go
through the other ideas.

-- 
You received this message because you are subscribed to the Google Groups 
"Django developers" group.
To post to this group, send email to django-developers@googlegroups.com.
To unsubscribe from this group, send email to 
django-developers+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/django-developers?hl=en.

Re: HBase backend support

2011-03-30 Thread Russell Keith-Magee 
On Wed, Mar 30, 2011 at 7:58 PM, Rohit  wrote:
> Hi,
>     I plan to implement HBase backend support for Django as part of
> GSoC 2011. Before I flesh out the idea in detail, I would like to know
> if this is useful enough to Django, whether there are alternatives to
> using HBase in the first place.

I'm not sure this is a good project for GSoC.

Firstly, Alex Gaynor worked on providing support for non-relational
backends in last year's GSoC; that code hasn't landed in trunk yet,
and may undergo some more modification before it does. If you were to
build a HBase backend for Django under the auspices of the GSoC, it
would need to use this interface. So, you're proposing a project that
will be working against an interface that is still a work in progress.

Secondly, HBase support itself (or support for any non-relational
store) is unlikely to end up in core any time soon. Therefore, you're
proposing to work on a project that won't become part of core. I'm not
saying that contributing to Django's broader community isn't without
merit, but Django has a limited number of GSoC slots, so we're looking
to get the most bang for our buck. Working on Django's core is an easy
win; if it's going to be an external project, it would need to be
something that a large part of Django's community would gain benefit
from (c.f., Armin Ronacher's template compilation proposal).

Lastly, I'm not convinced that a backend for a single data store is a
project that would be big enough for a Summer of Code. Alex built a
MongoDB backend as part of his GSoC work, and he also had to do a
bunch of refactoring of Django's query engine in order to make it
work. You're proposing a massive subset of the work that he proposed
(and delivered), which leads me to suspect that you won't actually
fill an entire summer with this proposal.

If you're still interested in the GSoC, we're still interested in
having you as an applicant. If you're looking for other GSoC project
ideas, the list on the wiki [1] has a bunch of other suggestions.

[1] http://code.djangoproject.com/wiki/SummerOfCode2011

Yours,
Russ Magee %-)

-- 
You received this message because you are subscribed to the Google Groups 
"Django developers" group.
To post to this group, send email to django-developers@googlegroups.com.
To unsubscribe from this group, send email to 
django-developers+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/django-developers?hl=en.

Re: HBase backend support

2011-03-30 Thread Andrew Godwin 
On 30/03/11 12:58, Rohit wrote:
> Hi,
>  I plan to implement HBase backend support for Django as part of
> GSoC 2011. Before I flesh out the idea in detail, I would like to know
> if this is useful enough to Django, whether there are alternatives to
> using HBase in the first place.

Hi Rohit,

The main issue with implementing support for HBase will be the fact that
it's non-relational, and doesn't use SQL, and thus none of the existing
database backends make a good starting point.

You'd probably be depending on Alex Gaynor's query-refactor branch [1],
which contains the relevant changes to help support non-SQL backends;
that's not merged in yet, though there's a possibility it will be at
some point before or during the Summer Of Code.

Our main concerns would be:

 - That this is a feature that people want (our top criterion for
eligibility). You'll be able to need to point us to some previous
discussion on the topic on either django-users, django-developers, or
otherwise show that other people do really want the Django model layer
to support HBase.

 - That you're able to complete the project in the time given. The
Django model layer is a complex beast, and Alex was only accepted last
year to work on it as he had a proven track record of commits there.
We'd want to see some of the work you've done on Django or similar
projects relating to the area of model layers/ORMs.

If you think you can address these issues, I look forward to seeing a
GSoC proposal. Don't expect it to get through without some serious
debate, however.

Andrew


[1]:
http://code.djangoproject.com/browser/django/branches/soc2010/query-refactor

-- 
You received this message because you are subscribed to the Google Groups 
"Django developers" group.
To post to this group, send email to django-developers@googlegroups.com.
To unsubscribe from this group, send email to 
django-developers+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/django-developers?hl=en.

Re: HBase backend support

2011-03-30 Thread Rohit 
Hi,
 I plan to implement HBase backend support for Django as part of
GSoC 2011. Before I flesh out the idea in detail, I would like to know
if this is useful enough to Django, whether there are alternatives to
using HBase in the first place.

-- 
You received this message because you are subscribed to the Google Groups 
"Django developers" group.
To post to this group, send email to django-developers@googlegroups.com.
To unsubscribe from this group, send email to 
django-developers+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/django-developers?hl=en.