Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins
Magnus Hagander mag...@hagander.net writes: I think mcron already implements it all and is made to be embedded into a larger program. As long as your larger program is gpl. Not even lgpl on that one. I'd think that's a killer for that idea... Oh, are we now talking about including a scheduler in core or contrib? My understanding was that the background worker infrastructure had been made in parts so that we don't even have to talk about a scheduler specs and implementation details on -hackers, where the usual answer is that we already have a system's scheduler anyways. Regards, -- Dimitri Fontaine http://2ndQuadrant.fr PostgreSQL : Expertise, Formation et Support -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers
Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins
On 20 March 2013 16:03, Thom Brown t...@linux.com wrote: On 19 March 2013 17:42, Thom Brown t...@linux.com wrote: On 14 February 2013 18:02, Josh Berkus j...@agliodbs.com wrote: Folks, Once again, Google is holding Summer of Code. We need to assess whether we want to participate this year. Questions: - Who wants to mentor for GSOC? - Who can admin for GSOC? Thom? - Please suggest project ideas for GSOC - Students seeing this -- please speak up if you have projects you plan to submit. If anyone else has more projects ideas to suggest, please do share. Students, please feel free to review the PostgreSQL Todo list for inspiration: http://wiki.postgresql.org/wiki/Todo Of course ensure you don't choose anything too ambitious or trivial. Okay, here's a random idea (which could be infeasible and/or undesirable). How about a way to internally schedule tasks using a background worker process (introduced in 9.2) to wake on each tick and run tasks? So: CREATE EXTENSION pg_scheduler; -- schedule_task(task_command, task_priority, task_start, repeat_interval); SELECT schedule_task('REINDEX my_table', 1, '2012-03-20 00:10:00'::timestamp, '1 week'::interval); SELECT list_tasks(); -[ RECORD 1 ]---+--- task_id | 1 task_command| REINDEX my_table task_priority | 1 task_start | 2012-03-20 00:10:00-04 repeat_interval | 7 days owner | postgres SELECT delete_task(1); Tasks would be run in sequence if they share the same scheduled time ordered by priority descending, beyond which it would be non-deterministic. Or perhaps additional worker processes to fire commands in parallel if necessary. Disclaimer: I haven't really thought this through. Here's some evidence for my last statement: custom background worker processes are actually being introduced as part of 9.3, not available in 9.2. I don't think that changes things much though. -- Thom -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers
Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins
Atri Sharma atri.j...@gmail.com writes: We can use a scheduling algorithm, and can define a pool of tasks as well as a time constraint for the amount of time which can be used for running the tasks.Then, a scheduling algorithm can pick tasks from the pool based on priorities and the time duration of a task.I can see a dynamic programming solution to this problem. I think mcron already implements it all and is made to be embedded into a larger program. http://www.gnu.org/software/mcron/ I wonder if we can add the domain, something like: SELECT * FROM DOMAINS mydom; Returns {a, b, c, d} Their content. Saludos, Gilberto Castillo La Habana, Cuba --- This message was processed by Kaspersky Mail Gateway 5.6.28/RELEASE running at host imx3.etecsa.cu Visit our web-site: http://www.kaspersky.com, http://www.viruslist.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers
Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins
On 19 March 2013 17:42, Thom Brown t...@linux.com wrote: On 14 February 2013 18:02, Josh Berkus j...@agliodbs.com wrote: Folks, Once again, Google is holding Summer of Code. We need to assess whether we want to participate this year. Questions: - Who wants to mentor for GSOC? - Who can admin for GSOC? Thom? - Please suggest project ideas for GSOC - Students seeing this -- please speak up if you have projects you plan to submit. If anyone else has more projects ideas to suggest, please do share. Students, please feel free to review the PostgreSQL Todo list for inspiration: http://wiki.postgresql.org/wiki/Todo Of course ensure you don't choose anything too ambitious or trivial. Okay, here's a random idea (which could be infeasible and/or undesirable). How about a way to internally schedule tasks using a background worker process (introduced in 9.2) to wake on each tick and run tasks? So: CREATE EXTENSION pg_scheduler; -- schedule_task(task_command, task_priority, task_start, repeat_interval); SELECT schedule_task('REINDEX my_table', 1, '2012-03-20 00:10:00'::timestamp, '1 week'::interval); SELECT list_tasks(); -[ RECORD 1 ]---+--- task_id | 1 task_command| REINDEX my_table task_priority | 1 task_start | 2012-03-20 00:10:00-04 repeat_interval | 7 days owner | postgres SELECT delete_task(1); Tasks would be run in sequence if they share the same scheduled time ordered by priority descending, beyond which it would be non-deterministic. Or perhaps additional worker processes to fire commands in parallel if necessary. Disclaimer: I haven't really thought this through. -- Thom -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers
Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins
It does sound nice,something like cron? We can use a scheduling algorithm, and can define a pool of tasks as well as a time constraint for the amount of time which can be used for running the tasks.Then, a scheduling algorithm can pick tasks from the pool based on priorities and the time duration of a task.I can see a dynamic programming solution to this problem. Atri Sent from my iPad On 20-Mar-2013, at 21:33, Thom Brown t...@linux.com wrote: On 19 March 2013 17:42, Thom Brown t...@linux.com wrote: On 14 February 2013 18:02, Josh Berkus j...@agliodbs.com wrote: Folks, Once again, Google is holding Summer of Code. We need to assess whether we want to participate this year. Questions: - Who wants to mentor for GSOC? - Who can admin for GSOC? Thom? - Please suggest project ideas for GSOC - Students seeing this -- please speak up if you have projects you plan to submit. If anyone else has more projects ideas to suggest, please do share. Students, please feel free to review the PostgreSQL Todo list for inspiration: http://wiki.postgresql.org/wiki/Todo Of course ensure you don't choose anything too ambitious or trivial. Okay, here's a random idea (which could be infeasible and/or undesirable). How about a way to internally schedule tasks using a background worker process (introduced in 9.2) to wake on each tick and run tasks? So: CREATE EXTENSION pg_scheduler; -- schedule_task(task_command, task_priority, task_start, repeat_interval); SELECT schedule_task('REINDEX my_table', 1, '2012-03-20 00:10:00'::timestamp, '1 week'::interval); SELECT list_tasks(); -[ RECORD 1 ]---+--- task_id | 1 task_command| REINDEX my_table task_priority | 1 task_start | 2012-03-20 00:10:00-04 repeat_interval | 7 days owner | postgres SELECT delete_task(1); Tasks would be run in sequence if they share the same scheduled time ordered by priority descending, beyond which it would be non-deterministic. Or perhaps additional worker processes to fire commands in parallel if necessary. Disclaimer: I haven't really thought this through. -- Thom -- Sent via pgsql-advocacy mailing list (pgsql-advoc...@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-advocacy -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers
Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins
Atri Sharma atri.j...@gmail.com writes: We can use a scheduling algorithm, and can define a pool of tasks as well as a time constraint for the amount of time which can be used for running the tasks.Then, a scheduling algorithm can pick tasks from the pool based on priorities and the time duration of a task.I can see a dynamic programming solution to this problem. I think mcron already implements it all and is made to be embedded into a larger program. http://www.gnu.org/software/mcron/ Regards, -- Dimitri Fontaine http://2ndQuadrant.fr PostgreSQL : Expertise, Formation et Support -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers
Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins
On Mar 20, 2013 11:14 PM, Dimitri Fontaine dimi...@2ndquadrant.fr wrote: Atri Sharma atri.j...@gmail.com writes: We can use a scheduling algorithm, and can define a pool of tasks as well as a time constraint for the amount of time which can be used for running the tasks.Then, a scheduling algorithm can pick tasks from the pool based on priorities and the time duration of a task.I can see a dynamic programming solution to this problem. I think mcron already implements it all and is made to be embedded into a larger program. As long as your larger program is gpl. Not even lgpl on that one. I'd think that's a killer for that idea... /Magnus
Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins
On 14 February 2013 18:02, Josh Berkus j...@agliodbs.com wrote: Folks, Once again, Google is holding Summer of Code. We need to assess whether we want to participate this year. Questions: - Who wants to mentor for GSOC? - Who can admin for GSOC? Thom? - Please suggest project ideas for GSOC - Students seeing this -- please speak up if you have projects you plan to submit. If anyone else has more projects ideas to suggest, please do share. Students, please feel free to review the PostgreSQL Todo list for inspiration: http://wiki.postgresql.org/wiki/Todo Of course ensure you don't choose anything too ambitious or trivial. -- Thom -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers
Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins
On 9 March 2013 01:01, Josh Berkus j...@agliodbs.com wrote: Thom. I don't mind being an admin again. Can you gather together all of the projects suggested on this thread and use them to create updated text for the GSOC page? If you don't have web repo access, I can create a patch, but if you can do the text, that would be a big help. Okay, I've pushed some changes to the repo for 2013 GSoC, and purged the varnish cache so that it's visible immediately: http://www.postgresql.org/developer/summerofcode/ I've also created a new GSoC 2013 wiki page with mentor volunteers and project ideas submitted so far: https://wiki.postgresql.org/wiki/GSoC_2013 -- Thom -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers
Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins
Thom. I don't mind being an admin again. Can you gather together all of the projects suggested on this thread and use them to create updated text for the GSOC page? If you don't have web repo access, I can create a patch, but if you can do the text, that would be a big help. -- Josh Berkus PostgreSQL Experts Inc. http://pgexperts.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers
Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins
Take a look at MADLib. My suggestion would be extending the MADlib functions; there's plenty of unimplemented ML algrothims which could be added to it. I went through the MADLib library and came up with the following two ideas which I feel could be potential GSoC 2013 projects: 1) MADlib currently has K-means clustering implemented.I would suggest implementing the K-medoids clustering as it has better performance as compared to K-means clustering.We could use k-means clustering code base as the starting point for our implementation. 2) A more complex project would be to implement backpropogation algorithm for much better classification. This would require implementing some parts of neural network algorithms as well. Again, I am willing to mentor either of the two projects if they are taken. Regards, Atri -- Regards, Atri l'apprenant -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers
Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins
On 2013-02-14 10:02:13 -0800, Josh Berkus wrote: - Please suggest project ideas for GSOC pg_upgrade support for debian's pg_upgradecluster Greetings, Andres Freund -- Andres Freund http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers
Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins
On Thu, Feb 14, 2013 at 7:02 PM, Josh Berkus j...@agliodbs.com wrote: Folks, Once again, Google is holding Summer of Code. We need to assess whether we want to participate this year. Questions: - Who wants to mentor for GSOC? Sign me up on that list. Depending on projects, of course. -- Magnus Hagander Me: http://www.hagander.net/ Work: http://www.redpill-linpro.com/ -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers
Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins
Alvaro Herrera alvhe...@2ndquadrant.com writes: - Who wants to mentor for GSOC? I am open to being a mentor. Me too. -- Dimitri Fontaine http://2ndQuadrant.fr PostgreSQL : Expertise, Formation et Support -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers
Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins
Hello, Can you guys send me a link to a where to start page ? Thanks, Sirbu Nicolae-Cezar
Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins
On Fri, Feb 15, 2013 at 2:51 PM, Dimitri Fontaine dimi...@2ndquadrant.frwrote: Alvaro Herrera alvhe...@2ndquadrant.com writes: - Who wants to mentor for GSOC? I am open to being a mentor. Me too. I'm ready for mentoring too. And I will encourage students in my university to apply proposals to PostgreSQL. -- With best regards, Alexander Korotkov.
Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins
On 15.02.2013 14:29, Sîrbu Nicolae-Cezar wrote: Hello, Can you guys send me a link to a where to start page ? Take a look at the Project Ideas page from last year, and the project TODO list. See http://www.postgresql.org/developer/summerofcode/#ideas. One approach is to pick a research paper on some algorithm or technique that's applicable to databases, and then implement that in PostgreSQL. - Heikki -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers
Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins
Can't we have something related to machine learning? I was thinking of extending a technique where we can fill in some missing values in a data set for the user if he wants us to using some standard ml algorithms. Atri Sent from my iPad On 15-Feb-2013, at 19:26, Heikki Linnakangas hlinnakan...@vmware.com wrote: On 15.02.2013 14:29, Sîrbu Nicolae-Cezar wrote: Hello, Can you guys send me a link to a where to start page ? Take a look at the Project Ideas page from last year, and the project TODO list. See http://www.postgresql.org/developer/summerofcode/#ideas. One approach is to pick a research paper on some algorithm or technique that's applicable to databases, and then implement that in PostgreSQL. - Heikki -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers
Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins
On 02/15/2013 06:03 AM, Atri Sharma wrote: Can't we have something related to machine learning? I was thinking of extending a technique where we can fill in some missing values in a data set for the user if he wants us to using some standard ml algorithms. Take a look at MADLib. My suggestion would be extending the MADlib functions; there's plenty of unimplemented ML algrothims which could be added to it. http://madlib.net/ -- Josh Berkus PostgreSQL Experts Inc. http://pgexperts.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers
Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins
I would love to mentor if anybody would be willing to take a project in it. Atri Sent from my iPad On 15-Feb-2013, at 23:04, Josh Berkus j...@agliodbs.com wrote: On 02/15/2013 06:03 AM, Atri Sharma wrote: Can't we have something related to machine learning? I was thinking of extending a technique where we can fill in some missing values in a data set for the user if he wants us to using some standard ml algorithms. Take a look at MADLib. My suggestion would be extending the MADlib functions; there's plenty of unimplemented ML algrothims which could be added to it. http://madlib.net/ -- Josh Berkus PostgreSQL Experts Inc. http://pgexperts.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers
Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins
Josh Berkus wrote: Folks, Once again, Google is holding Summer of Code. We need to assess whether we want to participate this year. Questions: - Who wants to mentor for GSOC? I am open to being a mentor too. Saludos, Gilberto Castillo La Habana, Cuba --- This message was processed by Kaspersky Mail Gateway 5.6.28/RELEASE running at host imx3.etecsa.cu Visit our web-site: http://www.kaspersky.com, http://www.viruslist.com -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers
Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins
Hello, Well i'm interested in PostgreSQL for GSOC, i'm not sure for the project yet. But i'm looking forward in meeting the mentors and speak with them what could be implemented over the summer. Thanks, Sirbu Nicolae-Cezar
Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins
On 14 February 2013 18:02, Josh Berkus j...@agliodbs.com wrote: Folks, Once again, Google is holding Summer of Code. We need to assess whether we want to participate this year. Questions: - Who wants to mentor for GSOC? - Who can admin for GSOC? Thom? I don't mind being an admin again. -- Thom -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers
Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins
Josh Berkus wrote: Folks, Once again, Google is holding Summer of Code. We need to assess whether we want to participate this year. Questions: - Who wants to mentor for GSOC? I am open to being a mentor. -- Álvaro Herrerahttp://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training Services -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers
Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins
I forgot to mark all. I could be a co mentor, helping in overall coordination and supporting all the students in getting familiar with the project and community etc. Atri Sent from my iPad On 14-Feb-2013, at 23:32, Josh Berkus j...@agliodbs.com wrote: Folks, Once again, Google is holding Summer of Code. We need to assess whether we want to participate this year. Questions: - Who wants to mentor for GSOC? - Who can admin for GSOC? Thom? - Please suggest project ideas for GSOC - Students seeing this -- please speak up if you have projects you plan to submit. -- Josh Berkus PostgreSQL Experts Inc. http://pgexperts.com -- Sent via pgsql-advocacy mailing list (pgsql-advoc...@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-advocacy -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers