Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-03-21 Thread Dimitri Fontaine
Magnus Hagander mag...@hagander.net writes:
 I think mcron already implements it all and is made to be embedded into
 a larger program.

 As long as your larger program is gpl. Not even lgpl on that one. I'd think
 that's a killer for that idea...

Oh, are we now talking about including a scheduler in core or contrib?

My understanding was that the background worker infrastructure had been
made in parts so that we don't even have to talk about a scheduler specs
and implementation details on -hackers, where the usual answer is that
we already have a system's scheduler anyways.

Regards,
-- 
Dimitri Fontaine
http://2ndQuadrant.fr PostgreSQL : Expertise, Formation et Support


-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-03-21 Thread Thom Brown
On 20 March 2013 16:03, Thom Brown t...@linux.com wrote:
 On 19 March 2013 17:42, Thom Brown t...@linux.com wrote:
 On 14 February 2013 18:02, Josh Berkus j...@agliodbs.com wrote:
 Folks,

 Once again, Google is holding Summer of Code.  We need to assess whether
 we want to participate this year.

 Questions:

 - Who wants to mentor for GSOC?

 - Who can admin for GSOC?  Thom?

 - Please suggest project ideas for GSOC

 - Students seeing this -- please speak up if you have projects you plan
 to submit.

 If anyone else has more projects ideas to suggest, please do share.
 Students, please feel free to review the PostgreSQL Todo list for
 inspiration: http://wiki.postgresql.org/wiki/Todo  Of course ensure
 you don't choose anything too ambitious or trivial.

 Okay, here's a random idea (which could be infeasible and/or
 undesirable).  How about a way to internally schedule tasks using a
 background worker process (introduced in 9.2) to wake on each tick and
 run tasks?

 So:

 CREATE EXTENSION pg_scheduler;
 --
 schedule_task(task_command, task_priority, task_start, repeat_interval);

 SELECT schedule_task('REINDEX my_table', 1, '2012-03-20
 00:10:00'::timestamp, '1 week'::interval);

 SELECT list_tasks();

 -[ RECORD 1 ]---+---
 task_id | 1
 task_command| REINDEX my_table
 task_priority   | 1
 task_start  | 2012-03-20 00:10:00-04
 repeat_interval | 7 days
 owner   | postgres

 SELECT delete_task(1);

 Tasks would be run in sequence if they share the same scheduled time
 ordered by priority descending, beyond which it would be
 non-deterministic.  Or perhaps additional worker processes to fire
 commands in parallel if necessary.

 Disclaimer: I haven't really thought this through.

Here's some evidence for my last statement: custom background worker
processes are actually being introduced as part of 9.3, not available
in 9.2.  I don't think that changes things much though.

--
Thom


-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-03-21 Thread Gilberto Castillo



 Atri Sharma atri.j...@gmail.com writes:
 We can use a scheduling algorithm, and can define a pool of tasks as
 well as
 a time constraint for the amount of time which can be used for running
 the
 tasks.Then, a scheduling algorithm can pick tasks from the pool based on
 priorities and the time duration of a task.I can see a dynamic
 programming
 solution to this problem.

 I think mcron already implements it all and is made to be embedded into
 a larger program.

   http://www.gnu.org/software/mcron/

I wonder if we can add the domain, something like:

SELECT * FROM DOMAINS mydom;

Returns

{a, b, c, d}

Their content.

Saludos,
Gilberto Castillo
La Habana, Cuba
--- 
This message was processed by Kaspersky Mail Gateway 5.6.28/RELEASE running at 
host imx3.etecsa.cu
Visit our web-site: http://www.kaspersky.com, http://www.viruslist.com

-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-03-20 Thread Thom Brown
On 19 March 2013 17:42, Thom Brown t...@linux.com wrote:
 On 14 February 2013 18:02, Josh Berkus j...@agliodbs.com wrote:
 Folks,

 Once again, Google is holding Summer of Code.  We need to assess whether
 we want to participate this year.

 Questions:

 - Who wants to mentor for GSOC?

 - Who can admin for GSOC?  Thom?

 - Please suggest project ideas for GSOC

 - Students seeing this -- please speak up if you have projects you plan
 to submit.

 If anyone else has more projects ideas to suggest, please do share.
 Students, please feel free to review the PostgreSQL Todo list for
 inspiration: http://wiki.postgresql.org/wiki/Todo  Of course ensure
 you don't choose anything too ambitious or trivial.

Okay, here's a random idea (which could be infeasible and/or
undesirable).  How about a way to internally schedule tasks using a
background worker process (introduced in 9.2) to wake on each tick and
run tasks?

So:

CREATE EXTENSION pg_scheduler;
--
schedule_task(task_command, task_priority, task_start, repeat_interval);

SELECT schedule_task('REINDEX my_table', 1, '2012-03-20
00:10:00'::timestamp, '1 week'::interval);

SELECT list_tasks();

-[ RECORD 1 ]---+---
task_id | 1
task_command| REINDEX my_table
task_priority   | 1
task_start  | 2012-03-20 00:10:00-04
repeat_interval | 7 days
owner   | postgres

SELECT delete_task(1);

Tasks would be run in sequence if they share the same scheduled time
ordered by priority descending, beyond which it would be
non-deterministic.  Or perhaps additional worker processes to fire
commands in parallel if necessary.

Disclaimer: I haven't really thought this through.

--
Thom


-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-03-20 Thread Atri Sharma
It does sound nice,something like cron?

We can use a scheduling algorithm, and can define a pool of tasks as well as a 
time constraint for the amount of time which can be used for running the 
tasks.Then, a scheduling algorithm can pick tasks from the pool based on 
priorities and the time duration of a task.I can see a dynamic programming 
solution to this problem.

Atri

Sent from my iPad

On 20-Mar-2013, at 21:33, Thom Brown t...@linux.com wrote:

 On 19 March 2013 17:42, Thom Brown t...@linux.com wrote:
 On 14 February 2013 18:02, Josh Berkus j...@agliodbs.com wrote:
 Folks,
 
 Once again, Google is holding Summer of Code.  We need to assess whether
 we want to participate this year.
 
 Questions:
 
 - Who wants to mentor for GSOC?
 
 - Who can admin for GSOC?  Thom?
 
 - Please suggest project ideas for GSOC
 
 - Students seeing this -- please speak up if you have projects you plan
 to submit.
 
 If anyone else has more projects ideas to suggest, please do share.
 Students, please feel free to review the PostgreSQL Todo list for
 inspiration: http://wiki.postgresql.org/wiki/Todo  Of course ensure
 you don't choose anything too ambitious or trivial.
 
 Okay, here's a random idea (which could be infeasible and/or
 undesirable).  How about a way to internally schedule tasks using a
 background worker process (introduced in 9.2) to wake on each tick and
 run tasks?
 
 So:
 
 CREATE EXTENSION pg_scheduler;
 --
 schedule_task(task_command, task_priority, task_start, repeat_interval);
 
 SELECT schedule_task('REINDEX my_table', 1, '2012-03-20
 00:10:00'::timestamp, '1 week'::interval);
 
 SELECT list_tasks();
 
 -[ RECORD 1 ]---+---
 task_id | 1
 task_command| REINDEX my_table
 task_priority   | 1
 task_start  | 2012-03-20 00:10:00-04
 repeat_interval | 7 days
 owner   | postgres
 
 SELECT delete_task(1);
 
 Tasks would be run in sequence if they share the same scheduled time
 ordered by priority descending, beyond which it would be
 non-deterministic.  Or perhaps additional worker processes to fire
 commands in parallel if necessary.
 
 Disclaimer: I haven't really thought this through.
 
 --
 Thom
 
 
 -- 
 Sent via pgsql-advocacy mailing list (pgsql-advoc...@postgresql.org)
 To make changes to your subscription:
 http://www.postgresql.org/mailpref/pgsql-advocacy


-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-03-20 Thread Dimitri Fontaine
Atri Sharma atri.j...@gmail.com writes:
 We can use a scheduling algorithm, and can define a pool of tasks as well as
 a time constraint for the amount of time which can be used for running the
 tasks.Then, a scheduling algorithm can pick tasks from the pool based on
 priorities and the time duration of a task.I can see a dynamic programming
 solution to this problem.

I think mcron already implements it all and is made to be embedded into
a larger program.

  http://www.gnu.org/software/mcron/

Regards,
-- 
Dimitri Fontaine
http://2ndQuadrant.fr PostgreSQL : Expertise, Formation et Support


-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-03-20 Thread Magnus Hagander
On Mar 20, 2013 11:14 PM, Dimitri Fontaine dimi...@2ndquadrant.fr wrote:

 Atri Sharma atri.j...@gmail.com writes:
  We can use a scheduling algorithm, and can define a pool of tasks as
well as
  a time constraint for the amount of time which can be used for running
the
  tasks.Then, a scheduling algorithm can pick tasks from the pool based on
  priorities and the time duration of a task.I can see a dynamic
programming
  solution to this problem.

 I think mcron already implements it all and is made to be embedded into
 a larger program.


As long as your larger program is gpl. Not even lgpl on that one. I'd think
that's a killer for that idea...

/Magnus


Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-03-19 Thread Thom Brown
On 14 February 2013 18:02, Josh Berkus j...@agliodbs.com wrote:
 Folks,

 Once again, Google is holding Summer of Code.  We need to assess whether
 we want to participate this year.

 Questions:

 - Who wants to mentor for GSOC?

 - Who can admin for GSOC?  Thom?

 - Please suggest project ideas for GSOC

 - Students seeing this -- please speak up if you have projects you plan
 to submit.

If anyone else has more projects ideas to suggest, please do share.
Students, please feel free to review the PostgreSQL Todo list for
inspiration: http://wiki.postgresql.org/wiki/Todo  Of course ensure
you don't choose anything too ambitious or trivial.

--
Thom


-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-03-09 Thread Thom Brown
On 9 March 2013 01:01, Josh Berkus j...@agliodbs.com wrote:
 Thom.

 I don't mind being an admin again.

 Can you gather together all of the projects suggested on this thread and
 use them to create updated text for the GSOC page?  If you don't have
 web repo access, I can create a patch, but if you can do the text, that
 would be a big help.

Okay, I've pushed some changes to the repo for 2013 GSoC, and purged
the varnish cache so that it's visible immediately:
http://www.postgresql.org/developer/summerofcode/

I've also created a new GSoC 2013 wiki page with mentor volunteers and
project ideas submitted so far:
https://wiki.postgresql.org/wiki/GSoC_2013

--
Thom


-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-03-08 Thread Josh Berkus
Thom.

 I don't mind being an admin again.

Can you gather together all of the projects suggested on this thread and
use them to create updated text for the GSOC page?  If you don't have
web repo access, I can create a patch, but if you can do the text, that
would be a big help.

-- 
Josh Berkus
PostgreSQL Experts Inc.
http://pgexperts.com


-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-02-23 Thread Atri Sharma
 Take a look at MADLib.  My suggestion would be extending the MADlib
 functions; there's plenty of unimplemented ML algrothims which could be
 added to it.

I went through the MADLib library and came up with the following two
ideas which I feel could be potential GSoC 2013 projects:

1) MADlib currently has K-means clustering implemented.I would suggest
implementing the K-medoids clustering as it has better performance as
compared to K-means clustering.We could use k-means clustering code
base as the starting point for our implementation.

2) A more complex project would be to implement backpropogation
algorithm for much better classification. This would require
implementing some parts of neural network algorithms as well.

Again, I am willing to mentor either of the two projects if they are taken.

Regards,

Atri



-- 
Regards,

Atri
l'apprenant


-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-02-18 Thread Andres Freund
On 2013-02-14 10:02:13 -0800, Josh Berkus wrote:
 - Please suggest project ideas for GSOC

pg_upgrade support for debian's pg_upgradecluster

Greetings,

Andres Freund

-- 
 Andres Freund http://www.2ndQuadrant.com/
 PostgreSQL Development, 24x7 Support, Training  Services


-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-02-18 Thread Magnus Hagander
On Thu, Feb 14, 2013 at 7:02 PM, Josh Berkus j...@agliodbs.com wrote:
 Folks,

 Once again, Google is holding Summer of Code.  We need to assess whether
 we want to participate this year.

 Questions:

 - Who wants to mentor for GSOC?

Sign me up on that list. Depending on projects, of course.

-- 
 Magnus Hagander
 Me: http://www.hagander.net/
 Work: http://www.redpill-linpro.com/


-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-02-15 Thread Dimitri Fontaine
Alvaro Herrera alvhe...@2ndquadrant.com writes:
 - Who wants to mentor for GSOC?

 I am open to being a mentor.

Me too.

-- 
Dimitri Fontaine
http://2ndQuadrant.fr PostgreSQL : Expertise, Formation et Support


-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-02-15 Thread Sîrbu Nicolae-Cezar
Hello,

Can you guys send me a link to a where to start page ?

Thanks,
Sirbu Nicolae-Cezar


Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-02-15 Thread Alexander Korotkov
On Fri, Feb 15, 2013 at 2:51 PM, Dimitri Fontaine dimi...@2ndquadrant.frwrote:

 Alvaro Herrera alvhe...@2ndquadrant.com writes:
  - Who wants to mentor for GSOC?
 
  I am open to being a mentor.

 Me too.


I'm ready for mentoring too. And I will encourage students in my university
to apply proposals to PostgreSQL.

--
With best regards,
Alexander Korotkov.


Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-02-15 Thread Heikki Linnakangas

On 15.02.2013 14:29, Sîrbu Nicolae-Cezar wrote:

Hello,

Can you guys send me a link to a where to start page ?


Take a look at the Project Ideas page from last year, and the project 
TODO list. See http://www.postgresql.org/developer/summerofcode/#ideas.


One approach is to pick a research paper on some algorithm or technique 
that's applicable to databases, and then implement that in PostgreSQL.


- Heikki


--
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-02-15 Thread Atri Sharma
Can't we have something related to machine learning? I was thinking of 
extending a technique where we can fill in some missing values in a data set 
for the user if he wants us to using some standard ml algorithms.

Atri

Sent from my iPad

On 15-Feb-2013, at 19:26, Heikki Linnakangas hlinnakan...@vmware.com wrote:

 On 15.02.2013 14:29, Sîrbu Nicolae-Cezar wrote:
 Hello,
 
 Can you guys send me a link to a where to start page ?
 
 Take a look at the Project Ideas page from last year, and the project TODO 
 list. See http://www.postgresql.org/developer/summerofcode/#ideas.
 
 One approach is to pick a research paper on some algorithm or technique 
 that's applicable to databases, and then implement that in PostgreSQL.
 
 - Heikki
 
 
 -- 
 Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
 To make changes to your subscription:
 http://www.postgresql.org/mailpref/pgsql-hackers


-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-02-15 Thread Josh Berkus
On 02/15/2013 06:03 AM, Atri Sharma wrote:
 Can't we have something related to machine learning? I was thinking of 
 extending a technique where we can fill in some missing values in a data set 
 for the user if he wants us to using some standard ml algorithms.

Take a look at MADLib.  My suggestion would be extending the MADlib
functions; there's plenty of unimplemented ML algrothims which could be
added to it.

http://madlib.net/


-- 
Josh Berkus
PostgreSQL Experts Inc.
http://pgexperts.com


-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-02-15 Thread Atri Sharma
I would love to mentor if anybody would be willing to take a project in it.

Atri

Sent from my iPad

On 15-Feb-2013, at 23:04, Josh Berkus j...@agliodbs.com wrote:

 On 02/15/2013 06:03 AM, Atri Sharma wrote:
 Can't we have something related to machine learning? I was thinking of 
 extending a technique where we can fill in some missing values in a data set 
 for the user if he wants us to using some standard ml algorithms.
 
 Take a look at MADLib.  My suggestion would be extending the MADlib
 functions; there's plenty of unimplemented ML algrothims which could be
 added to it.
 
 http://madlib.net/
 
 
 -- 
 Josh Berkus
 PostgreSQL Experts Inc.
 http://pgexperts.com


-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-02-15 Thread Gilberto Castillo



 Josh Berkus wrote:
 Folks,

 Once again, Google is holding Summer of Code.  We need to assess whether
 we want to participate this year.

 Questions:

 - Who wants to mentor for GSOC?

I am open to being a mentor too.

Saludos,
Gilberto Castillo
La Habana, Cuba
--- 
This message was processed by Kaspersky Mail Gateway 5.6.28/RELEASE running at 
host imx3.etecsa.cu
Visit our web-site: http://www.kaspersky.com, http://www.viruslist.com

-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-02-14 Thread Sîrbu Nicolae-Cezar
Hello,

Well i'm interested in PostgreSQL for GSOC, i'm not sure for the project
yet. But i'm looking forward in meeting the mentors and speak with them
what could be implemented over the summer.

Thanks,
Sirbu Nicolae-Cezar


Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-02-14 Thread Thom Brown
On 14 February 2013 18:02, Josh Berkus j...@agliodbs.com wrote:
 Folks,

 Once again, Google is holding Summer of Code.  We need to assess whether
 we want to participate this year.

 Questions:

 - Who wants to mentor for GSOC?

 - Who can admin for GSOC?  Thom?

I don't mind being an admin again.

-- 
Thom


-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-02-14 Thread Alvaro Herrera
Josh Berkus wrote:
 Folks,
 
 Once again, Google is holding Summer of Code.  We need to assess whether
 we want to participate this year.
 
 Questions:
 
 - Who wants to mentor for GSOC?

I am open to being a mentor.

-- 
Álvaro Herrerahttp://www.2ndQuadrant.com/
PostgreSQL Development, 24x7 Support, Training  Services


-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers


Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-02-14 Thread Atri Sharma
I forgot to mark all.

I could be a co mentor, helping in overall coordination and supporting all the 
students in getting familiar with the project and community etc.

Atri

Sent from my iPad

On 14-Feb-2013, at 23:32, Josh Berkus j...@agliodbs.com wrote:

 Folks,
 
 Once again, Google is holding Summer of Code.  We need to assess whether
 we want to participate this year.
 
 Questions:
 
 - Who wants to mentor for GSOC?
 
 - Who can admin for GSOC?  Thom?
 
 - Please suggest project ideas for GSOC
 
 - Students seeing this -- please speak up if you have projects you plan
 to submit.
 
 -- 
 Josh Berkus
 PostgreSQL Experts Inc.
 http://pgexperts.com
 
 
 -- 
 Sent via pgsql-advocacy mailing list (pgsql-advoc...@postgresql.org)
 To make changes to your subscription:
 http://www.postgresql.org/mailpref/pgsql-advocacy


-- 
Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-hackers