Re: [GSoC 2013] contribute to django-deployer for deploying django to PaaS easily

2013-05-03 Thread Andrew Godwin
Hi Nate,

I guess I'm personally just burnt by the PaaS model in general - it's a
very limited-scope way of modelling applications, I've never had it work
for anything serious, and in particular every attempt I've seen at
something that targets multiple PaaS hosts ultimately ends up only having
the core feature set of the lowest common denominator. A lot of small
projects are transitioning from PaaS to more "traditional" hosting, and I'm
not sure if this would help there.

Though it's too late for this GSOC, I'd rather like to see work on the
parts of Django that actually do affect deploy-ability for everyone, like
database configuration through a standard set of environment variables and
sorting out settings and how Django expects to find production vs.
development settings. I know that's a terrible argument, akin to the "why
are all the physicists colliding particles when they should be curing
cancer?!", but I do generally feel a little that tailoring to just a
certain specific set of PaaS providers is kind of papering over the problem.

Anyway, if the proposal is good and you're willing to mentor, I don't see
why we shouldn't accept it - you have commit access to the target project,
after all, and it'll set a good precedent - and it's worth seeing what
issues come up, because just knowing what some of them are is useful data.

Sorry about the slightly haphazard way I've handled this so far this year,
I'm still trying to work out where to draw the boundaries with the new
rules.

Andrew



On Fri, May 3, 2013 at 8:57 AM, Nate Aune  wrote:

>
> On Thursday, May 2, 2013 4:11:35 AM UTC-4, Andrew Godwin wrote:
>>
>> I feel like the deployment problem is one that cannot be solved in a mere
>> 12 weeks and I'm not sure django-deployer is the right approach to
>> encourage for this - it sits at the wrong level of abstraction and looks
>> pretty fragile, and I'd be hesitant to put any sort of official emphasis on
>> it without a lot of my qualms being answered.
>>
>
> Could you elaborate on what your qualms are? I won't claim that it's a
> work of art and I know there is lots of room for improvement, but please
> remember that django-deployer is the result of two days of work, and it
> already deploys Django projects to Dotcloud and Google App Engine with
> almost minimal effort on the part of the user. Imagine what we can do in 12
> weeks!
>
>
>> In particular, it appears to be sitting at the lowest-common-denominator
>> level of the various feature sets and looks pretty immature.
>>
>
> The initial goal of django-deployer was to reduce the barrier to entry for
> someone new to Django who wants to quickly and easily get their Django
> project running up on one of the PaaS providers.
> So we started out with a minimum feature set which seems to cover the
> non-production deployment needs for 80-90% of Django projects.
>
> We purposely omitted support for services such as Memcached, Celery,
> email, cron jobs, etc. because we were trying to limit the scope at the
> sprint and get a basic version working first. Now that the basic version is
> working, we can look into adding support for these other services that
> you'd most likely find in a production environment.
>
> I'm not sure I could accept this without a much clearer idea of what's
>> going to happen and a very clear focus on what section of our user base it
>> will help. Deployment isn't something there can be a single solution (or
>> even pattern) for, and I think encouraging that could be a bad idea.
>>
>
> Agreed. We're not attempting to make a one-size-fits-all solution, and
> django-deployer will never claim to serve that purpose. But for
> bootstrapping your Django project so that you can minimize the amount of
> time it takes to try deploying your project to various PaaS providers, and
> for demonstrating best practices when readying your project to be deployed,
> I think it has a place in the Django ecosystem.
>
> I've looked at all the getting started docs from the various PaaS
> providers, and many of them leave a lot to be desired. Many developers that
> I've spoken with who've tried PaaS have thrown up their hands in
> frustration when things don't work as advertised. This is largely the
> impetus for starting the django-deployer project, to try to streamline this
> process for those new to PaaS and Django deployment.
>
> Nate
>
>
>> On Wed, May 1, 2013 at 8:20 PM, Nate Aune  wrote:
>>
>>> Hi Russell and Florian,
>>>
>>> A bit late to the party, but hopefully there's still time for this GSoC
>>> proposal to be considered. I'm the maintainer of 
>>> django-deployer.
>>> It was initiated at the DjangoCon 2012 sprint and recently revisited at the
>>> PyCon 2013 sprint. The overarching goal of django-deployer is to make it
>>> easier to get Django deployed. So far the focus has been on deploying to
>>> PaaS providers, because they require little to no sysadmin skills, 

Re: [GSoC 2013] contribute to django-deployer for deploying django to PaaS easily

2013-05-03 Thread Nate Aune

On Thursday, May 2, 2013 4:11:35 AM UTC-4, Andrew Godwin wrote:
>
> I feel like the deployment problem is one that cannot be solved in a mere 
> 12 weeks and I'm not sure django-deployer is the right approach to 
> encourage for this - it sits at the wrong level of abstraction and looks 
> pretty fragile, and I'd be hesitant to put any sort of official emphasis on 
> it without a lot of my qualms being answered. 
>

Could you elaborate on what your qualms are? I won't claim that it's a work 
of art and I know there is lots of room for improvement, but please 
remember that django-deployer is the result of two days of work, and it 
already deploys Django projects to Dotcloud and Google App Engine with 
almost minimal effort on the part of the user. Imagine what we can do in 12 
weeks!
 

> In particular, it appears to be sitting at the lowest-common-denominator 
> level of the various feature sets and looks pretty immature.
>

The initial goal of django-deployer was to reduce the barrier to entry for 
someone new to Django who wants to quickly and easily get their Django 
project running up on one of the PaaS providers.
So we started out with a minimum feature set which seems to cover the 
non-production deployment needs for 80-90% of Django projects. 

We purposely omitted support for services such as Memcached, Celery, email, 
cron jobs, etc. because we were trying to limit the scope at the sprint and 
get a basic version working first. Now that the basic version is working, 
we can look into adding support for these other services that you'd most 
likely find in a production environment. 

I'm not sure I could accept this without a much clearer idea of what's 
> going to happen and a very clear focus on what section of our user base it 
> will help. Deployment isn't something there can be a single solution (or 
> even pattern) for, and I think encouraging that could be a bad idea.
>

Agreed. We're not attempting to make a one-size-fits-all solution, and 
django-deployer will never claim to serve that purpose. But for 
bootstrapping your Django project so that you can minimize the amount of 
time it takes to try deploying your project to various PaaS providers, and 
for demonstrating best practices when readying your project to be deployed, 
I think it has a place in the Django ecosystem. 

I've looked at all the getting started docs from the various PaaS 
providers, and many of them leave a lot to be desired. Many developers that 
I've spoken with who've tried PaaS have thrown up their hands in 
frustration when things don't work as advertised. This is largely the 
impetus for starting the django-deployer project, to try to streamline this 
process for those new to PaaS and Django deployment.

Nate


> On Wed, May 1, 2013 at 8:20 PM, Nate Aune  > wrote:
>
>> Hi Russell and Florian,
>>
>> A bit late to the party, but hopefully there's still time for this GSoC 
>> proposal to be considered. I'm the maintainer of 
>> django-deployer. 
>> It was initiated at the DjangoCon 2012 sprint and recently revisited at the 
>> PyCon 2013 sprint. The overarching goal of django-deployer is to make it 
>> easier to get Django deployed. So far the focus has been on deploying to 
>> PaaS providers, because they require little to no sysadmin skills, and have 
>> the added benefit of being free for small projects.
>>
>> django-deployer is the sister project PaaS Cheatsheet, a larger 
>> documentation project that I've started recently. PaaS 
>> Cheatsheetis a guide for how to get a 
>> Django/Python deployed on various PaaS 
>> providers. 
>>
>> The way django-deployer works is by asking a series of questions about 
>> your Django project, and then generates a generic deploy.yml file that 
>> captures all of your project's requirements. When you choose a particular 
>> PaaS provider, django-deployer then translates the requirements defined in 
>> the deploy.yml file and generates configuration files for that specific 
>> PaaS provider.
>>
>> I met Colin (a student in Taiwan) at the PyCon sprint, and he was 
>> responsible for single-handedly adding Google App Engine support to 
>> django-deployer. He brought considerable expertise to our sprint team, and 
>> shipped working code within a matter of hours. Since returning from PyCon, 
>> we've been working remotely together, and he has continued to be a 
>> dedicated contributor to the project. I have utmost confidence in his 
>> abilities to add even more cool features and improve code quality of the 
>> django-deployer tool if this project is accepted into GSoC. 
>>
>> English is a second language for Colin, so he may have had some 
>> difficulties in defending his proposal, so please allow me to step in and 
>> clarify a few things.
>>  
>>
>>> Firstly, I'm not familiar with Django-deploy; but from a quick 
>>> inspection of the project page it doesn't appear that anyone in the 

Re: [GSoC 2013] contribute to django-deployer for deploying django to PaaS easily

2013-05-03 Thread Nate Aune
On Thursday, May 2, 2013 9:46:52 PM UTC-4, Jacob Kaplan-Moss wrote:

> While I share some of Andrew's concerns, I do think this is still a fairly 
> good topic for GSoC. 
>

Thanks for your vote of confidence! :) We'd love to get your input on how 
to address Andrew's concerns. We've already started looking into replacing 
the manage.sh script with Django management commands, so you can deploy 
using the familiar manage.py (which is something that I think you suggested 
awhile ago). 

I made a couple screencasts where you can see the tool in action, in it's 
current state of infancy:
http://appsembler.com/blog/deploy-django-apps-to-google-app-engine-with-django-deployer-in-5-minutes/
http://appsembler.com/blog/deploy-django-apps-to-dotcloud-with-django-deployer-in-5-minutes/
 

> However, I think the only way it could happen would be if Nate wants 
> to mentor the project; Nate, can you mentor? 


Yes! As I mentioned in my last post, I'm happy to serve as a GSoC mentor. I 
will do my best to provide guidance to Colin as we continue to shape 
django-deployer to be a useful tool for the Django community.
 

> If so, you should hook up  with Andrew and make sure you apply to be a 
> mentor so we can have you 
> added before the review process. 
>

I added my name to the wiki, and also signed up on the GSoC site 
here: http://www.google-melange.com/gsoc/connection/google/gsoc2013/nateaune/1

Nate

On Thu, May 2, 2013 at 4:11 AM, Andrew Godwin 
 
> wrote: 
> > I feel like the deployment problem is one that cannot be solved in a 
> mere 12 
> > weeks and I'm not sure django-deployer is the right approach to 
> encourage 
> > for this - it sits at the wrong level of abstraction and looks pretty 
> > fragile, and I'd be hesitant to put any sort of official emphasis on it 
> > without a lot of my qualms being answered. In particular, it appears to 
> be 
> > sitting at the lowest-common-denominator level of the various feature 
> sets 
> > and looks pretty immature. 
> > 
> > I'm not sure I could accept this without a much clearer idea of what's 
> going 
> > to happen and a very clear focus on what section of our user base it 
> will 
> > help. Deployment isn't something there can be a single solution (or even 
> > pattern) for, and I think encouraging that could be a bad idea. 
> > 
> > Andrew 
> > 
> > 
> > On Wed, May 1, 2013 at 8:20 PM, Nate Aune  
> wrote: 
> >> 
> >> Hi Russell and Florian, 
> >> 
> >> A bit late to the party, but hopefully there's still time for this GSoC 
> >> proposal to be considered. I'm the maintainer of django-deployer. It 
> was 
> >> initiated at the DjangoCon 2012 sprint and recently revisited at the 
> PyCon 
> >> 2013 sprint. The overarching goal of django-deployer is to make it 
> easier to 
> >> get Django deployed. So far the focus has been on deploying to PaaS 
> >> providers, because they require little to no sysadmin skills, and have 
> the 
> >> added benefit of being free for small projects. 
> >> 
> >> django-deployer is the sister project PaaS Cheatsheet, a larger 
> >> documentation project that I've started recently. PaaS Cheatsheet is a 
> guide 
> >> for how to get a Django/Python deployed on various PaaS providers. 
> >> 
> >> The way django-deployer works is by asking a series of questions about 
> >> your Django project, and then generates a generic deploy.yml file that 
> >> captures all of your project's requirements. When you choose a 
> particular 
> >> PaaS provider, django-deployer then translates the requirements defined 
> in 
> >> the deploy.yml file and generates configuration files for that specific 
> PaaS 
> >> provider. 
> >> 
> >> I met Colin (a student in Taiwan) at the PyCon sprint, and he was 
> >> responsible for single-handedly adding Google App Engine support to 
> >> django-deployer. He brought considerable expertise to our sprint team, 
> and 
> >> shipped working code within a matter of hours. Since returning from 
> PyCon, 
> >> we've been working remotely together, and he has continued to be a 
> dedicated 
> >> contributor to the project. I have utmost confidence in his abilities 
> to add 
> >> even more cool features and improve code quality of the django-deployer 
> tool 
> >> if this project is accepted into GSoC. 
> >> 
> >> English is a second language for Colin, so he may have had some 
> >> difficulties in defending his proposal, so please allow me to step in 
> and 
> >> clarify a few things. 
> >> 
> >>> 
> >>> Firstly, I'm not familiar with Django-deploy; but from a quick 
> inspection 
> >>> of the project page it doesn't appear that anyone in the Django core 
> team is 
> >>> on the committee list. In order for you to have this proposal accepted 
> as 
> >>> part of the GSoC, you'll need to secure agreement from the project 
> >>> maintainers of Django-deploy that they want the help your offering, 
> that 
> >>> your project proposal is sound, and that they're willing to commit to 
> 

Re: [GSoC 2013] contribute to django-deployer for deploying django to PaaS easily

2013-05-02 Thread Jacob Kaplan-Moss
While I share some of Andrew's concerns, I do think this is still a
fairly good topic for GSoC.

However, I think the only way it could happen would be if Nate wants
to mentor the project; Nate, can you mentor? If so, you should hook up
with Andrew and make sure you apply to be a mentor so we can have you
added before the review process.

Jacob

On Thu, May 2, 2013 at 4:11 AM, Andrew Godwin  wrote:
> I feel like the deployment problem is one that cannot be solved in a mere 12
> weeks and I'm not sure django-deployer is the right approach to encourage
> for this - it sits at the wrong level of abstraction and looks pretty
> fragile, and I'd be hesitant to put any sort of official emphasis on it
> without a lot of my qualms being answered. In particular, it appears to be
> sitting at the lowest-common-denominator level of the various feature sets
> and looks pretty immature.
>
> I'm not sure I could accept this without a much clearer idea of what's going
> to happen and a very clear focus on what section of our user base it will
> help. Deployment isn't something there can be a single solution (or even
> pattern) for, and I think encouraging that could be a bad idea.
>
> Andrew
>
>
> On Wed, May 1, 2013 at 8:20 PM, Nate Aune  wrote:
>>
>> Hi Russell and Florian,
>>
>> A bit late to the party, but hopefully there's still time for this GSoC
>> proposal to be considered. I'm the maintainer of django-deployer. It was
>> initiated at the DjangoCon 2012 sprint and recently revisited at the PyCon
>> 2013 sprint. The overarching goal of django-deployer is to make it easier to
>> get Django deployed. So far the focus has been on deploying to PaaS
>> providers, because they require little to no sysadmin skills, and have the
>> added benefit of being free for small projects.
>>
>> django-deployer is the sister project PaaS Cheatsheet, a larger
>> documentation project that I've started recently. PaaS Cheatsheet is a guide
>> for how to get a Django/Python deployed on various PaaS providers.
>>
>> The way django-deployer works is by asking a series of questions about
>> your Django project, and then generates a generic deploy.yml file that
>> captures all of your project's requirements. When you choose a particular
>> PaaS provider, django-deployer then translates the requirements defined in
>> the deploy.yml file and generates configuration files for that specific PaaS
>> provider.
>>
>> I met Colin (a student in Taiwan) at the PyCon sprint, and he was
>> responsible for single-handedly adding Google App Engine support to
>> django-deployer. He brought considerable expertise to our sprint team, and
>> shipped working code within a matter of hours. Since returning from PyCon,
>> we've been working remotely together, and he has continued to be a dedicated
>> contributor to the project. I have utmost confidence in his abilities to add
>> even more cool features and improve code quality of the django-deployer tool
>> if this project is accepted into GSoC.
>>
>> English is a second language for Colin, so he may have had some
>> difficulties in defending his proposal, so please allow me to step in and
>> clarify a few things.
>>
>>>
>>> Firstly, I'm not familiar with Django-deploy; but from a quick inspection
>>> of the project page it doesn't appear that anyone in the Django core team is
>>> on the committee list. In order for you to have this proposal accepted as
>>> part of the GSoC, you'll need to secure agreement from the project
>>> maintainers of Django-deploy that they want the help your offering, that
>>> your project proposal is sound, and that they're willing to commit to
>>> applying any patches you produce.
>>
>>
>> As stated above, I'm willing to work closely with Colin to meet the
>> objectives described in the proposal.
>>
>>> Secondly, you haven't provided any timelines for your proposal. My
>>> immediate reaction is that you're proposing a lot of work for a student to
>>> complete in 12 weeks. For example, writing a fully tested and documented
>>> database backend strikes me as a 12 week project in itself - yet this is
>>> apparently just one line item in one part of your project proposal.
>>
>>
>> I think you may have misread that part of proposal. He's not proposing to
>> write a database backend.  There is already one provided by the Google App
>> Engine SDK, so we're simply incorporating that into the configuration
>> scripts (i.e. adding a settings_appengine.py that substitutes the DATABASE
>> setting value).
>>>
>>>
>>> Lastly, your project proposal is very light on details. You're proposing
>>> a lot of ideas, but you haven't really specified anything beyond "I'm going
>>> to do it". Are there APIs that need to be specified? If, in the case of
>>> something like a database backend, the APi is already specified, are there
>>> going to be any complications in satisfying the API? We need a lot more
>>> detail before we will be able to judge if you understand 

Re: [GSoC 2013] contribute to django-deployer for deploying django to PaaS easily

2013-05-02 Thread LittleQ@NCCU, Taiwan
Hello, Andrew

On Thursday, May 2, 2013 4:11:35 PM UTC+8, Andrew Godwin wrote:
>
> I feel like the deployment problem is one that cannot be solved in a mere 
> 12 weeks and I'm not sure django-deployer is the right approach to 
> encourage for this - it sits at the wrong level of abstraction and looks 
> pretty fragile, and I'd be hesitant to put any sort of official emphasis on 
> it without a lot of my qualms being answered. In particular, it appears to 
> be sitting at the lowest-common-denominator level of the various feature 
> sets and looks pretty immature.
>

I'm not going to build the whole django-deployer as description in my 
proposal, django-deployer is a running project already and I started 
contributing recently, the tasks I wanna do is just made django-deployer 
support GAE and provide a better connection to django. For improving my 
proposal, I already reduced the tasks listed in my proposal and listed out 
more detail.

could you please list out all your qualms? then maybe I can know what can I 
do in the next.
 

>
> I'm not sure I could accept this without a much clearer idea of what's 
> going to happen and a very clear focus on what section of our user base it 
> will help. Deployment isn't something there can be a single solution (or 
> even pattern) for, and I think encouraging that could be a bad idea.
>

The user base which django-deployer want to help is "people who are trying 
deploy their django app onto any PaaS", and for minimizing the effort from 
who already know how to deploy django onto some PaaS to provide the 
solution to others.

I agree with you that deployment isn't something could be a single 
solution, the ease of deployment should be provided by PaaS provider but 
not django or any django third-party library, but I think it's impossible 
to ask each PaaS provider to make "perfect django deployment flow" to each 
django user.

actually this project helps me a lot when I went back from PyCon, I have a 
running django project on GAE and it works well.

please feel free to ask me question about the proposal or give out more 
feedback, I will appreciate for that, thank you.


- Colin : )

I really hope I can get involved GSoC with Django community, Django is 
always one of my favorite project, for now maybe I'm not qualified to do 
some task for django-core, but I think I could improve this project to get 
more people use Django easily.
 

>
> Andrew
>
>
> On Wed, May 1, 2013 at 8:20 PM, Nate Aune  > wrote:
>
>> Hi Russell and Florian,
>>
>> A bit late to the party, but hopefully there's still time for this GSoC 
>> proposal to be considered. I'm the maintainer of 
>> django-deployer. 
>> It was initiated at the DjangoCon 2012 sprint and recently revisited at the 
>> PyCon 2013 sprint. The overarching goal of django-deployer is to make it 
>> easier to get Django deployed. So far the focus has been on deploying to 
>> PaaS providers, because they require little to no sysadmin skills, and have 
>> the added benefit of being free for small projects.
>>
>> django-deployer is the sister project PaaS Cheatsheet, a larger 
>> documentation project that I've started recently. PaaS 
>> Cheatsheetis a guide for how to get a 
>> Django/Python deployed on various PaaS 
>> providers. 
>>
>> The way django-deployer works is by asking a series of questions about 
>> your Django project, and then generates a generic deploy.yml file that 
>> captures all of your project's requirements. When you choose a particular 
>> PaaS provider, django-deployer then translates the requirements defined in 
>> the deploy.yml file and generates configuration files for that specific 
>> PaaS provider.
>>
>> I met Colin (a student in Taiwan) at the PyCon sprint, and he was 
>> responsible for single-handedly adding Google App Engine support to 
>> django-deployer. He brought considerable expertise to our sprint team, and 
>> shipped working code within a matter of hours. Since returning from PyCon, 
>> we've been working remotely together, and he has continued to be a 
>> dedicated contributor to the project. I have utmost confidence in his 
>> abilities to add even more cool features and improve code quality of the 
>> django-deployer tool if this project is accepted into GSoC. 
>>
>> English is a second language for Colin, so he may have had some 
>> difficulties in defending his proposal, so please allow me to step in and 
>> clarify a few things.
>>  
>>
>>> Firstly, I'm not familiar with Django-deploy; but from a quick 
>>> inspection of the project page it doesn't appear that anyone in the Django 
>>> core team is on the committee list. In order for you to have this proposal 
>>> accepted as part of the GSoC, you'll need to secure agreement from the 
>>> project maintainers of Django-deploy that they want the help your offering, 
>>> that your project proposal is sound, and that they're willing to commit 

Re: [GSoC 2013] contribute to django-deployer for deploying django to PaaS easily

2013-05-02 Thread Andrew Godwin
I feel like the deployment problem is one that cannot be solved in a mere
12 weeks and I'm not sure django-deployer is the right approach to
encourage for this - it sits at the wrong level of abstraction and looks
pretty fragile, and I'd be hesitant to put any sort of official emphasis on
it without a lot of my qualms being answered. In particular, it appears to
be sitting at the lowest-common-denominator level of the various feature
sets and looks pretty immature.

I'm not sure I could accept this without a much clearer idea of what's
going to happen and a very clear focus on what section of our user base it
will help. Deployment isn't something there can be a single solution (or
even pattern) for, and I think encouraging that could be a bad idea.

Andrew


On Wed, May 1, 2013 at 8:20 PM, Nate Aune  wrote:

> Hi Russell and Florian,
>
> A bit late to the party, but hopefully there's still time for this GSoC
> proposal to be considered. I'm the maintainer of 
> django-deployer.
> It was initiated at the DjangoCon 2012 sprint and recently revisited at the
> PyCon 2013 sprint. The overarching goal of django-deployer is to make it
> easier to get Django deployed. So far the focus has been on deploying to
> PaaS providers, because they require little to no sysadmin skills, and have
> the added benefit of being free for small projects.
>
> django-deployer is the sister project PaaS Cheatsheet, a larger
> documentation project that I've started recently. PaaS 
> Cheatsheetis a guide for how to get a 
> Django/Python deployed on various PaaS
> providers.
>
> The way django-deployer works is by asking a series of questions about
> your Django project, and then generates a generic deploy.yml file that
> captures all of your project's requirements. When you choose a particular
> PaaS provider, django-deployer then translates the requirements defined in
> the deploy.yml file and generates configuration files for that specific
> PaaS provider.
>
> I met Colin (a student in Taiwan) at the PyCon sprint, and he was
> responsible for single-handedly adding Google App Engine support to
> django-deployer. He brought considerable expertise to our sprint team, and
> shipped working code within a matter of hours. Since returning from PyCon,
> we've been working remotely together, and he has continued to be a
> dedicated contributor to the project. I have utmost confidence in his
> abilities to add even more cool features and improve code quality of the
> django-deployer tool if this project is accepted into GSoC.
>
> English is a second language for Colin, so he may have had some
> difficulties in defending his proposal, so please allow me to step in and
> clarify a few things.
>
>
>> Firstly, I'm not familiar with Django-deploy; but from a quick inspection
>> of the project page it doesn't appear that anyone in the Django core team
>> is on the committee list. In order for you to have this proposal accepted
>> as part of the GSoC, you'll need to secure agreement from the project
>> maintainers of Django-deploy that they want the help your offering, that
>> your project proposal is sound, and that they're willing to commit to
>> applying any patches you produce.
>
>
> As stated above, I'm willing to work closely with Colin to meet the
> objectives described in the proposal.
>
> Secondly, you haven't provided any timelines for your proposal. My
>> immediate reaction is that you're proposing a lot of work for a student to
>> complete in 12 weeks. For example, writing a fully tested and documented
>> database backend strikes me as a 12 week project in itself - yet this is
>> apparently just one line item in one part of your project proposal.
>>
>
> I think you may have misread that part of proposal. He's not proposing to
> write a database backend.  There is already one provided by the Google
> App Engine 
> SDK,
> so we're simply incorporating that into the configuration scripts (i.e.
> adding a settings_appengine.py that substitutes the DATABASE setting
> value).
>
>>
>> Lastly, your project proposal is very light on details. You're proposing
>> a lot of ideas, but you haven't really specified anything beyond "I'm going
>> to do it". Are there APIs that need to be specified? If, in the case of
>> something like a database backend, the APi is already specified, are there
>> going to be any complications in satisfying the API? We need a lot more
>> detail before we will be able to judge if you understand the project your
>> proposing, or if you are just proposing a bunch of ideas but haven't given
>> those ideas any more thought than "this sounds interesting"
>>
>
> I think the draft proposal was intended to get initial feedback and was
> intentially light on details. Colin and I can work on specifying more
> details on the actual deliverables within the next 

Re: [GSoC 2013] contribute to django-deployer for deploying django to PaaS easily

2013-05-01 Thread Nate Aune
Hi Russell and Florian,

A bit late to the party, but hopefully there's still time for this GSoC 
proposal to be considered. I'm the maintainer of 
django-deployer. 
It was initiated at the DjangoCon 2012 sprint and recently revisited at the 
PyCon 2013 sprint. The overarching goal of django-deployer is to make it 
easier to get Django deployed. So far the focus has been on deploying to 
PaaS providers, because they require little to no sysadmin skills, and have 
the added benefit of being free for small projects.

django-deployer is the sister project PaaS Cheatsheet, a larger 
documentation project that I've started recently. PaaS 
Cheatsheetis a guide for how to get a 
Django/Python deployed on various PaaS 
providers. 

The way django-deployer works is by asking a series of questions about your 
Django project, and then generates a generic deploy.yml file that captures 
all of your project's requirements. When you choose a particular PaaS 
provider, django-deployer then translates the requirements defined in the 
deploy.yml file and generates configuration files for that specific PaaS 
provider.

I met Colin (a student in Taiwan) at the PyCon sprint, and he was 
responsible for single-handedly adding Google App Engine support to 
django-deployer. He brought considerable expertise to our sprint team, and 
shipped working code within a matter of hours. Since returning from PyCon, 
we've been working remotely together, and he has continued to be a 
dedicated contributor to the project. I have utmost confidence in his 
abilities to add even more cool features and improve code quality of the 
django-deployer tool if this project is accepted into GSoC. 

English is a second language for Colin, so he may have had some 
difficulties in defending his proposal, so please allow me to step in and 
clarify a few things.
 

> Firstly, I'm not familiar with Django-deploy; but from a quick inspection 
> of the project page it doesn't appear that anyone in the Django core team 
> is on the committee list. In order for you to have this proposal accepted 
> as part of the GSoC, you'll need to secure agreement from the project 
> maintainers of Django-deploy that they want the help your offering, that 
> your project proposal is sound, and that they're willing to commit to 
> applying any patches you produce. 


As stated above, I'm willing to work closely with Colin to meet the 
objectives described in the proposal. 

Secondly, you haven't provided any timelines for your proposal. My 
> immediate reaction is that you're proposing a lot of work for a student to 
> complete in 12 weeks. For example, writing a fully tested and documented 
> database backend strikes me as a 12 week project in itself - yet this is 
> apparently just one line item in one part of your project proposal.
>

I think you may have misread that part of proposal. He's not proposing to 
write a database backend.  There is already one provided by the Google App 
Engine 
SDK,
 
so we're simply incorporating that into the configuration scripts (i.e. 
adding a settings_appengine.py that substitutes the DATABASE setting 
value). 

>
> Lastly, your project proposal is very light on details. You're proposing a 
> lot of ideas, but you haven't really specified anything beyond "I'm going 
> to do it". Are there APIs that need to be specified? If, in the case of 
> something like a database backend, the APi is already specified, are there 
> going to be any complications in satisfying the API? We need a lot more 
> detail before we will be able to judge if you understand the project your 
> proposing, or if you are just proposing a bunch of ideas but haven't given 
> those ideas any more thought than "this sounds interesting"
>

I think the draft proposal was intended to get initial feedback and was 
intentially light on details. Colin and I can work on specifying more 
details on the actual deliverables within the next couple of days. We've 
already posted some ideas for improving it to the Github issue tracker: 
https://github.com/natea/django-deployer/issues?state=open

>You list "Refactor for Expandability" as last on your schedule. I think it 
should be at the start, eg compare different solutions like GAE, heroku, 
Gondor, find a >common subset and then write the backends accordingly. I 
fear that if you do this the other way around you will have to throw away 
most of the code for >heroku/GAE and rewrite it.

That's essentially what we've started to do on the PaaS cheatsheet site. 
One interesting side benefit of looking at all the PaaS providers, is that 
we've able to identify the commonalities among them.

>* Regarding storage stuff, you say "I chose Google Cloud Storage according 
to the networking speed and authorization flow will be easier than using 
other >storage service such as S3.". Personally I 

Re: [GSoC 2013] contribute to django-deployer for deploying django to PaaS easily

2013-04-22 Thread LittleQ@NCCU, Taiwan


On Sunday, April 21, 2013 6:54:22 PM UTC+8, Florian Apolloner wrote:
>
> Hi,
>
> aside from what Russell already pointed out, I would like to add a few 
> points:
>
> * You list "Refactor for Expandability" as last on your schedule. I think 
> it should be at the start, eg compare different solutions like GAE, heroku, 
> Gondor, find a common subset and then write the backends accordingly. I 
> fear that if you do this the other way around you will have to throw away 
> most of the code for heroku/GAE and rewrite it.
>

thanks for the advise, I will try it :D
 

>
> * Regarding storage stuff, you say "I chose Google Cloud Storage according 
> to the networking speed and authorization flow will be easier than using 
> other storage service such as S3.". Personally I don't think it's wise to 
> choose the easier storage (network speed should be no concern here 
> anyways), your API should be able to allow to hook in the more complex 
> authorization flow too, what would be a better way to test your API than 
> using S3 :)
>

okay, I think I can do that, could you provide some storage providers 
besides S3 and Google Storage? I don't know what are popular now, but if 
there's recommendations, I will try to make it.
 

>
> All in all this proposal imo tries to address way to much and focuses to 
> much on Google. It would be more useful to lay the groundwork for an API 
> instead. That said, did you get in contact with the project authors about 
> mentorship (eg are they interested and do have the time for it), I am 
> pretty sure none of the core devs uses django-deployer, so mentoring it 
> would be a bit suboptimal.


I'm so sorry about that, LOL, they are the services which I'm most familiar 
with, but I will consider other solutions or workaround, any recommendation 
please feel free to provide me, I will appreciate for that.

And about the mentoring, I contacted the owner of django-deployer and he 
said he would like to help and already sent the application for begin a 
mentor of django, is that working?

thanks for the advise, now I'm going to modify my proposal first, and try 
to make it more generic and detailed : )

have a nice day,
- Colin 
 

>
> Regards,
> Florian
>

-- 
You received this message because you are subscribed to the Google Groups 
"Django developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-developers+unsubscr...@googlegroups.com.
To post to this group, send email to django-developers@googlegroups.com.
Visit this group at http://groups.google.com/group/django-developers?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




Re: [GSoC 2013] contribute to django-deployer for deploying django to PaaS easily

2013-04-22 Thread LittleQ@NCCU, Taiwan


On Sunday, April 21, 2013 12:26:30 PM UTC+8, Russell Keith-Magee wrote:
>
> Hi Colin,
>
> I've taken a look at your proposal, and I've got some concerns.
>
> Firstly, I'm not familiar with Django-deploy; but from a quick inspection 
> of the project page it doesn't appear that anyone in the Django core team 
> is on the committee list. In order for you to have this proposal accepted 
> as part of the GSoC, you'll need to secure agreement from the project 
> maintainers of Django-deploy that they want the help your offering, that 
> your project proposal is sound, and that they're willing to commit to 
> applying any patches you produce.
>

I've contacted the owner of this project, and he said he would like to 
mentor this project, I sent him my proposal as well and haven't got the 
response. I think for this part it's no problem. and actually I finished 
some prototypes of some ideas in my proposal, it's my bad not yet writing 
it in my proposal. I'm not good at writing proposals (I'm not English 
native, so it takes me more time to write it), but I will keep improving my 
proposal, so plz feel free to give me some input. 
 

>
> Secondly, you haven't provided any timelines for your proposal. My 
> immediate reaction is that you're proposing a lot of work for a student to 
> complete in 12 weeks. For example, writing a fully tested and documented 
> database backend strikes me as a 12 week project in itself - yet this is 
> apparently just one line item in one part of your project proposal.
>

I'm still calculating how much time will I spend on each part of work, 
sorry about that, I know it's too much for doing it in 12 week, so I have 
already started it, in the project github repo you could find there's 
already some commit by me. 

>
> Lastly, your project proposal is very light on details. You're proposing a 
> lot of ideas, but you haven't really specified anything beyond "I'm going 
> to do it". Are there APIs that need to be specified? If, in the case of 
> something like a database backend, the APi is already specified, are there 
> going to be any complications in satisfying the API? We need a lot more 
> detail before we will be able to judge if you understand the project your 
> proposing, or if you are just proposing a bunch of ideas but haven't given 
> those ideas any more thought than "this sounds interesting"
>

Sorry about this part, I will filled it out ASAP, I posted this to mailing 
list beforehand because I would like to know am I correct on the idea, and 
willing to get feedback on the mailing, then refine my proposal after 
discussion of my idea. I will keep working on the proposal detail until 
it's good enough for GSoC and everybody's understanding.

I will conclude the others' comments and keep modifying the proposal.

thanks you very much : )

- Colin 
 

>
> Yours,
> Russ Magee %-)
>
> On Sunday, April 21, 2013, LittleQ@NCCU, Taiwan wrote:
>
>> to django-developers:
>>
>> Sorry, I use Google Drive for proposing, and I original tend to 
>> copy it to here but found it will get in a mess.
>>
>> so I put my proposal here: 
>> http://goo.gl/xJyJ9
>>
>> My idea is to contribute to django-deployer and make some significant 
>> improvements for it.
>> This proposal is still editing, but I pre-post it to prevent I'm thinking 
>> it in the wrong way.
>>
>> any questions or any advise are welcome, thank you, I'm really a big 
>> Django fan, and I hope I can make it better.
>>
>> cuz seems like there's no #django-dev, so feel free to add my XMPP 
>> directly: littleq0...@gmail.com
>>
>> it's open for messaging anytime :D
>>
>>
>> - Colin Su
>>
>>
>>
>>  -- 
>> You received this message because you are subscribed to the Google Groups 
>> "Django developers" group.
>> To unsubscribe from this group and stop receiving emails from it, send an 
>> email to django-developers+unsubscr...@googlegroups.com.
>> To post to this group, send email to django-developers@googlegroups.com.
>> Visit this group at 
>> http://groups.google.com/group/django-developers?hl=en.
>> For more options, visit https://groups.google.com/groups/opt_out.
>>  
>>  
>>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Django developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-developers+unsubscr...@googlegroups.com.
To post to this group, send email to django-developers@googlegroups.com.
Visit this group at http://groups.google.com/group/django-developers?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




Re: [GSoC 2013] contribute to django-deployer for deploying django to PaaS easily

2013-04-21 Thread Florian Apolloner
Hi,

aside from what Russell already pointed out, I would like to add a few 
points:

* You list "Refactor for Expandability" as last on your schedule. I think 
it should be at the start, eg compare different solutions like GAE, heroku, 
Gondor, find a common subset and then write the backends accordingly. I 
fear that if you do this the other way around you will have to throw away 
most of the code for heroku/GAE and rewrite it.

* Regarding storage stuff, you say "I chose Google Cloud Storage according 
to the networking speed and authorization flow will be easier than using 
other storage service such as S3.". Personally I don't think it's wise to 
choose the easier storage (network speed should be no concern here 
anyways), your API should be able to allow to hook in the more complex 
authorization flow too, what would be a better way to test your API than 
using S3 :)

All in all this proposal imo tries to address way to much and focuses to 
much on Google. It would be more useful to lay the groundwork for an API 
instead. That said, did you get in contact with the project authors about 
mentorship (eg are they interested and do have the time for it), I am 
pretty sure none of the core devs uses django-deployer, so mentoring it 
would be a bit suboptimal.

Regards,
Florian

-- 
You received this message because you are subscribed to the Google Groups 
"Django developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-developers+unsubscr...@googlegroups.com.
To post to this group, send email to django-developers@googlegroups.com.
Visit this group at http://groups.google.com/group/django-developers?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




Re: [GSoC 2013] contribute to django-deployer for deploying django to PaaS easily

2013-04-20 Thread Russell Keith-Magee
Hi Colin,

I've taken a look at your proposal, and I've got some concerns.

Firstly, I'm not familiar with Django-deploy; but from a quick inspection
of the project page it doesn't appear that anyone in the Django core team
is on the committee list. In order for you to have this proposal accepted
as part of the GSoC, you'll need to secure agreement from the project
maintainers of Django-deploy that they want the help your offering, that
your project proposal is sound, and that they're willing to commit to
applying any patches you produce.

Secondly, you haven't provided any timelines for your proposal. My
immediate reaction is that you're proposing a lot of work for a student to
complete in 12 weeks. For example, writing a fully tested and documented
database backend strikes me as a 12 week project in itself - yet this is
apparently just one line item in one part of your project proposal.

Lastly, your project proposal is very light on details. You're proposing a
lot of ideas, but you haven't really specified anything beyond "I'm going
to do it". Are there APIs that need to be specified? If, in the case of
something like a database backend, the APi is already specified, are there
going to be any complications in satisfying the API? We need a lot more
detail before we will be able to judge if you understand the project your
proposing, or if you are just proposing a bunch of ideas but haven't given
those ideas any more thought than "this sounds interesting"

Yours,
Russ Magee %-)

On Sunday, April 21, 2013, LittleQ@NCCU, Taiwan wrote:

> to django-developers:
>
> Sorry, I use Google Drive for proposing, and I original tend to copy
> it to here but found it will get in a mess.
>
> so I put my proposal here:
> http://goo.gl/xJyJ9
>
> My idea is to contribute to django-deployer and make some significant
> improvements for it.
> This proposal is still editing, but I pre-post it to prevent I'm thinking
> it in the wrong way.
>
> any questions or any advise are welcome, thank you, I'm really a big
> Django fan, and I hope I can make it better.
>
> cuz seems like there's no #django-dev, so feel free to add my XMPP
> directly: littleq0...@gmail.com  'littleq0...@gmail.com');>
>
> it's open for messaging anytime :D
>
>
> - Colin Su
>
>
>
>  --
> You received this message because you are subscribed to the Google Groups
> "Django developers" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to django-developers+unsubscr...@googlegroups.com 'cvml',
> 'django-developers%2bunsubscr...@googlegroups.com');>.
> To post to this group, send email to 
> django-developers@googlegroups.com 'django-developers@googlegroups.com');>
> .
> Visit this group at http://groups.google.com/group/django-developers?hl=en
> .
> For more options, visit https://groups.google.com/groups/opt_out.
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Django developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-developers+unsubscr...@googlegroups.com.
To post to this group, send email to django-developers@googlegroups.com.
Visit this group at http://groups.google.com/group/django-developers?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




Re: [GSoC 2013] contribute to django-deployer for deploying django to PaaS easily

2013-04-20 Thread LittleQ@NCCU, Taiwan
thank you, I forgot it  LOL

On Sunday, April 21, 2013 5:32:43 AM UTC+8, Florian Apolloner wrote:
>
> Hi,
>
> On Saturday, April 20, 2013 8:03:43 PM UTC+2, LittleQ@NCCU, Taiwan wrote:
>>
>> cuz seems like there's no #django-dev, so feel free to add my XMPP 
>> directly: littl...@gmail.com
>
>
> There is #django-dev (sic) on irc.freenode.net.
>
> Regards,
> Florian 
>

-- 
You received this message because you are subscribed to the Google Groups 
"Django developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-developers+unsubscr...@googlegroups.com.
To post to this group, send email to django-developers@googlegroups.com.
Visit this group at http://groups.google.com/group/django-developers?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




Re: [GSoC 2013] contribute to django-deployer for deploying django to PaaS easily

2013-04-20 Thread Florian Apolloner
Hi,

On Saturday, April 20, 2013 8:03:43 PM UTC+2, LittleQ@NCCU, Taiwan wrote:
>
> cuz seems like there's no #django-dev, so feel free to add my XMPP 
> directly: littl...@gmail.com


There is #django-dev (sic) on irc.freenode.net.

Regards,
Florian 

-- 
You received this message because you are subscribed to the Google Groups 
"Django developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-developers+unsubscr...@googlegroups.com.
To post to this group, send email to django-developers@googlegroups.com.
Visit this group at http://groups.google.com/group/django-developers?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.




[GSoC 2013] contribute to django-deployer for deploying django to PaaS easily

2013-04-20 Thread LittleQ@NCCU, Taiwan
to django-developers:

Sorry, I use Google Drive for proposing, and I original tend to copy 
it to here but found it will get in a mess.

so I put my proposal here: 
http://goo.gl/xJyJ9

My idea is to contribute to django-deployer and make some significant 
improvements for it.
This proposal is still editing, but I pre-post it to prevent I'm thinking 
it in the wrong way.

any questions or any advise are welcome, thank you, I'm really a big Django 
fan, and I hope I can make it better.

cuz seems like there's no #django-dev, so feel free to add my XMPP 
directly: littleq0...@gmail.com

it's open for messaging anytime :D


- Colin Su



-- 
You received this message because you are subscribed to the Google Groups 
"Django developers" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-developers+unsubscr...@googlegroups.com.
To post to this group, send email to django-developers@googlegroups.com.
Visit this group at http://groups.google.com/group/django-developers?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.