[HACKERS] Regarding column reordering project for GSoc 2012

2012-03-17 Thread Atri Sharma
Hi All, I am Atri Sharma.I am a C developer with experience in database designing and database management systems.I have worked with MySql,Oracle and other database systems.I have designed databases for various projects as well. I would be interested in developing the column reordering project

Re: [HACKERS] Regarding column reordering project for GSoc 2012

2012-03-17 Thread Atri Sharma
. Atri -Original Message- From: Andrew Dunstan [mailto:and...@dunslane.net] Sent: 17 March 2012 21:30 To: Atri Sharma Cc: pgsql-hackers@postgresql.org Subject: Re: [HACKERS] Regarding column reordering project for GSoc 2012 On 03/17/2012 04:39 AM, Atri Sharma wrote: Hi All, I am Atri

Re: [HACKERS] Regarding column reordering project for GSoc 2012

2012-03-17 Thread Atri Sharma
, changes in the graph will be done and minimal spanning tree would be recomputed. Atri -Original Message- From: Atri Sharma [mailto:atri.j...@gmail.com] Sent: 17 March 2012 22:43 To: 'Andrew Dunstan' Cc: 'pgsql-hackers@postgresql.org' Subject: RE: [HACKERS] Regarding column reordering

Re: [HACKERS] Regarding column reordering project for GSoc 2012

2012-03-17 Thread Atri Sharma
:17 To: Atri Sharma Cc: Pg Hackers Subject: Re: [HACKERS] Regarding column reordering project for GSoc 2012 Excerpts from Atri Sharma's message of sáb mar 17 05:39:10 -0300 2012: Hi All, I am Atri Sharma.I am a C developer with experience in database designing and database management systems.I

Re: [HACKERS] Regarding column reordering project for GSoc 2012

2012-03-17 Thread Atri Sharma
[mailto:alvhe...@commandprompt.com] Sent: 18 March 2012 00:34 To: Atri Sharma Cc: Pg Hackers Subject: RE: [HACKERS] Regarding column reordering project for GSoc 2012 Excerpts from Atri Sharma's message of sáb mar 17 15:48:13 -0300 2012: HI Alvaro, I did send a complete description to the mailing

Re: [HACKERS] Regarding column reordering project for GSoc 2012

2012-03-17 Thread Atri Sharma
Hi Dave, I believe,with the ALTER command,we plan to give the user power to modify ordering . Don't we? Atri From: Dave Page [mailto:dp...@pgadmin.org] Sent: 18 March 2012 00:46 To: Atri Sharma Cc: Alvaro Herrera; Pg Hackers Subject: Re: [HACKERS] Regarding column reordering project

Re: [HACKERS] Regarding column reordering project for GSoc 2012

2012-03-17 Thread Atri Sharma
-Original Message- From: Daniel Farina [mailto:dan...@heroku.com] Sent: 18 March 2012 06:30 To: Andrew Dunstan Cc: Dave Page; Atri Sharma; Alvaro Herrera; Pg Hackers Subject: Re: [HACKERS] Regarding column reordering project for GSoc 2012 On Sat, Mar 17, 2012 at 1:48 PM, Andrew Dunstan

Re: [HACKERS] Regarding column reordering project for GSoc 2012

2012-03-17 Thread Atri Sharma
-Original Message- From: jcasa...@systemguards.com.ec [mailto:jcasa...@systemguards.com.ec] On Behalf Of Jaime Casanova Sent: 18 March 2012 01:04 To: Atri Sharma Cc: Dave Page; Alvaro Herrera; Pg Hackers Subject: Re: [HACKERS] Regarding column reordering project for GSoc 2012 On Sat

Re: [HACKERS] Regarding column reordering project for GSoc 2012

2012-03-19 Thread Atri Sharma
On Mon, Mar 19, 2012 at 11:51 PM, Alvaro Herrera alvhe...@commandprompt.com wrote: Excerpts from Atri Sharma's message of dom mar 18 01:05:23 -0300 2012: I am understanding the scenario now. I will take a little of your time to modify my original idea: The middle layer still exists, but NOT

Re: [HACKERS] Regarding column reordering project for GSoc 2012

2012-03-19 Thread Atri Sharma
On Tue, Mar 20, 2012 at 12:08 AM, Atri Sharma atri.j...@gmail.com wrote: On Mon, Mar 19, 2012 at 11:51 PM, Alvaro Herrera alvhe...@commandprompt.com wrote: Excerpts from Atri Sharma's message of dom mar 18 01:05:23 -0300 2012: I am understanding the scenario now. I will take a little of your

Re: [HACKERS] Regarding column reordering project for GSoc 2012

2012-03-20 Thread Atri Sharma
-Original Message- From: Claes Jakobsson [mailto:cl...@versed.se] Sent: 20 March 2012 14:40 To: Merlin Moncure Cc: Heikki Linnakangas; Alvaro Herrera; Atri Sharma; Daniel Farina; Andrew Dunstan; Dave Page; Pg Hackers Subject: Re: [HACKERS] Regarding column reordering project for GSoc

Re: [HACKERS] Regarding column reordering project for GSoc 2012

2012-03-20 Thread Atri Sharma
-Original Message- From: Merlin Moncure [mailto:mmonc...@gmail.com] Sent: 20 March 2012 03:15 To: Heikki Linnakangas Cc: Alvaro Herrera; Atri Sharma; Daniel Farina; Andrew Dunstan; Dave Page; Pg Hackers Subject: Re: [HACKERS] Regarding column reordering project for GSoc 2012 On Mon, Mar

Re: [HACKERS] Regarding column reordering project for GSoc 2012

2012-03-20 Thread Atri Sharma
-Original Message- From: Heikki Linnakangas [mailto:heikki.linnakan...@enterprisedb.com] Sent: 20 March 2012 17:39 To: Claes Jakobsson Cc: Merlin Moncure; Alvaro Herrera; Atri Sharma; Daniel Farina; Andrew Dunstan; Dave Page; Pg Hackers Subject: Re: [HACKERS] Regarding column reordering

Re: [HACKERS] WIP patch for hint bit i/o mitigation

2012-11-14 Thread Atri Sharma
On Wed, Nov 7, 2012 at 9:47 PM, Merlin Moncure mmonc...@gmail.com wrote: On Wed, Nov 7, 2012 at 6:01 AM, Amit Kapila amit.kap...@huawei.com wrote: Following the sig is a first cut at a patch (written by Atri) that attempts to mitigate hint bit i/o penalty when many pages worth of

Re: [HACKERS] WIP patch for hint bit i/o mitigation

2012-11-14 Thread Atri Sharma
On Thu, Nov 15, 2012 at 12:42 AM, Atri Sharma atri.j...@gmail.com wrote: On Wed, Nov 7, 2012 at 9:47 PM, Merlin Moncure mmonc...@gmail.com wrote: On Wed, Nov 7, 2012 at 6:01 AM, Amit Kapila amit.kap...@huawei.com wrote: Following the sig is a first cut at a patch (written by Atri

Re: [HACKERS] [v9.3] writable foreign tables

2012-11-16 Thread Atri Sharma
Awesome. I would love to implement this API in JDBC_FDW. Atri Sent from my iPad On 16-Nov-2012, at 20:20, Albe Laurenz laurenz.a...@wien.gv.at wrote: Kohei KaiGai wrote: The attached patch is just a refreshed version for clean applying to the latest tree. As previous version doing, it

Re: [HACKERS] WIP patch for hint bit i/o mitigation

2012-11-16 Thread Atri Sharma
On Fri, Nov 16, 2012 at 7:33 PM, Merlin Moncure mmonc...@gmail.com wrote: On Fri, Nov 16, 2012 at 4:32 AM, Amit Kapila amit.kap...@huawei.com wrote: On Thursday, November 15, 2012 10:19 PM Merlin Moncure wrote: On Thu, Nov 15, 2012 at 10:25 AM, Amit Kapila amit.kap...@huawei.com wrote:

Re: [HACKERS] Do we need so many hint bits?

2012-11-19 Thread Atri Sharma
On Sun, Nov 18, 2012 at 10:43 PM, Jeff Davis pg...@j-davis.com wrote: On Sun, 2012-11-18 at 15:19 +0100, Andres Freund wrote: On Sunday, November 18, 2012 03:07:01 AM Jeff Davis wrote: Process A (process that clears a VM bit for a data page): 1. Acquires exclusive lock on data buffer

Re: [HACKERS] Do we need so many hint bits?

2012-11-19 Thread Atri Sharma
It's quite common to load a lot of data, and then do some reads for a while (setting hint bits and flushing them to disk), and then do a VACUUM a while later, setting PD_ALL_VISIBLE and writing all of the pages again. Also, if I remember correctly, Robert went to significant effort when

Re: [HACKERS] Do we need so many hint bits?

2012-11-19 Thread Atri Sharma
On Tue, Nov 20, 2012 at 12:08 AM, Jeff Davis pg...@j-davis.com wrote: On Mon, 2012-11-19 at 23:50 +0530, Atri Sharma wrote: Sorry If I am being a bit naive, but shouldnt a simple mutex work in the case when a process wants to change the VM bit in cache? Mutex would be cheaper than locks

Re: [HACKERS] WIP patch for hint bit i/o mitigation

2012-12-13 Thread Atri Sharma
On Thu, Dec 13, 2012 at 6:36 PM, Hari Babu haribabu.ko...@huawei.comwrote: On Thu, Dec 7, 2012 at 7:56 PM, Hari babu haribabu(dot)kommi(at)Huawei(dot)com wrote: On Thu, Dec 6, 2012 at 8:52 PM, Merlin Moncure mmonc...@gmail.com wrote: Thanks for that -- that's fairly comprehensive

Re: [HACKERS] WIP patch for hint bit i/o mitigation

2013-01-18 Thread Atri Sharma
On 18-Jan-2013, at 17:04, Craig Ringer cr...@2ndquadrant.com wrote: On 12/14/2012 09:57 PM, Amit Kapila wrote: I need to validate the vacuum results. It's possible that this is solvable by tweaking xmin check inside vacuum. Assuming that's fixed, the question stands: do the results

[HACKERS] Regarding installation of FDW on Windows

2012-07-13 Thread Atri Sharma
Hi all, I am trying to install my FDW project on windows.I did some research and I believe I shall be requiring pre compiled binaries(dll files).I tried cross compiling using MinGW on my Ubuntu.I am using PGXS for compiling and making my project.I tried overriding CC and setting it to the MinGW C

Re: [HACKERS] Regarding installation of FDW on Windows

2012-07-13 Thread Atri Sharma
On Fri, Jul 13, 2012 at 2:11 PM, Dave Page dp...@pgadmin.org wrote: On Fri, Jul 13, 2012 at 9:31 AM, Atri Sharma atri.j...@gmail.com wrote: Hi all, I am trying to install my FDW project on windows.I did some research and I believe I shall be requiring pre compiled binaries(dll files).I tried

Re: [HACKERS] Regarding installation of FDW on Windows

2012-07-13 Thread Atri Sharma
Sent from my iPad On 13-Jul-2012, at 2:23 PM, Dave Page dp...@pgadmin.org wrote: On Fri, Jul 13, 2012 at 9:46 AM, Atri Sharma atri.j...@gmail.com wrote: Hi Dave, I am sorry,I am not too sure about EDB.Cannot I cross compile even for EnterpriseDB version? I doubt it. The EDB builds

Re: [HACKERS] Regarding installation of FDW on Windows

2012-07-13 Thread Atri Sharma
On Fri, Jul 13, 2012 at 3:21 PM, Dave Page dp...@pgadmin.org wrote: On Fri, Jul 13, 2012 at 10:04 AM, Atri Sharma atri.j...@gmail.com wrote: Thanks for the advice.i shall build PostgreSQL from sources in windows,then,try to get vc++ installed and configured? No, the other way round

Re: [HACKERS] Regarding installation of FDW on Windows

2012-07-13 Thread Atri Sharma
On Fri, Jul 13, 2012 at 3:35 PM, Dave Page dp...@pgadmin.org wrote: On Fri, Jul 13, 2012 at 11:03 AM, Atri Sharma atri.j...@gmail.com wrote: Okies,thanks. Another thing,could you please help me in installation of my FDW project in packaged installations of PostgreSQL in Debian and Red hat?I

Re: [HACKERS] Regarding installation of FDW on Windows

2012-07-13 Thread Atri Sharma
On Fri, Jul 13, 2012 at 5:37 PM, Albe Laurenz laurenz.a...@wien.gv.at wrote: Atri Sharma wrote: On Fri, Jul 13, 2012 at 2:11 PM, Dave Page dp...@pgadmin.org wrote: On Fri, Jul 13, 2012 at 9:31 AM, Atri Sharma atri.j...@gmail.com wrote: I am trying to install my FDW project on windows.I did

Re: [HACKERS] Regarding installation of FDW on Windows

2012-07-13 Thread Atri Sharma
On Fri, Jul 13, 2012 at 6:13 PM, Andrew Dunstan and...@dunslane.net wrote: On 07/13/2012 08:07 AM, Albe Laurenz wrote: I have read a report that extensions built with MinGW are compatible with EDB's binaries if you use --disable-float8-byval

Re: [HACKERS] Regarding installation of FDW on Windows

2012-07-13 Thread Atri Sharma
On Fri, Jul 13, 2012 at 6:40 PM, Andrew Dunstan and...@dunslane.net wrote: On 07/13/2012 08:57 AM, Atri Sharma wrote: On Fri, Jul 13, 2012 at 6:13 PM, Andrew Dunstan and...@dunslane.net wrote: On 07/13/2012 08:07 AM, Albe Laurenz wrote: I have read a report that extensions built

Re: [HACKERS] Regarding installation of FDW on Windows

2012-07-13 Thread Atri Sharma
On Fri, Jul 13, 2012 at 7:03 PM, Andrew Dunstan and...@dunslane.net wrote: On 07/13/2012 09:12 AM, Atri Sharma wrote: On Fri, Jul 13, 2012 at 6:40 PM, Andrew Dunstan and...@dunslane.net wrote: On 07/13/2012 08:57 AM, Atri Sharma wrote: On Fri, Jul 13, 2012 at 6:13 PM, Andrew Dunstan

Re: [HACKERS] Recent absence

2012-07-24 Thread Atri Sharma
On Tue, Jul 24, 2012 at 11:05 PM, Joshua D. Drake j...@commandprompt.com wrote: On 07/24/2012 10:26 AM, Kevin Grittner wrote: I have recently been laid up with a MRSA infection, which left me suddenly unable to deal with even reading my email. (I took a shot at catching up a week ago, and

Re: [HACKERS] Bad Data back Door

2012-10-06 Thread Atri Sharma
On Sat, Oct 6, 2012 at 1:34 PM, David E. Wheeler da...@justatheory.com wrote: On Oct 5, 2012, at 6:12 PM, Tom Lane t...@sss.pgh.pa.us wrote: Probably not so much assumed as nobody thought about it. In e.g. plperl we expend the cycles to do encoding validity checking on *every* string

[HACKERS] Regarding identifying a foreign scan

2012-10-06 Thread Atri Sharma
Hi, I am trying to identify foreign scans uniquely.I am trying to do that by struct ForeignScanState,but I am confused as to how I can identify the scan. Is there a member of ForeignScanState that can be used for this purpose? Atri -- Regards, Atri l'apprenant -- Sent via pgsql-hackers

Re: [HACKERS] Regarding identifying a foreign scan

2012-10-06 Thread Atri Sharma
On Sat, Oct 6, 2012 at 3:45 PM, Tom Lane t...@sss.pgh.pa.us wrote: Atri Sharma atri.j...@gmail.com writes: I am trying to identify foreign scans uniquely. What do you mean by identify? What are you trying to accomplish, and in what context? regards, tom lane Hi Tom

Re: [HACKERS] Regarding identifying a foreign scan

2012-10-06 Thread Atri Sharma
On Sat, Oct 6, 2012 at 4:05 PM, Tom Lane t...@sss.pgh.pa.us wrote: Atri Sharma atri.j...@gmail.com writes: On Sat, Oct 6, 2012 at 3:45 PM, Tom Lane t...@sss.pgh.pa.us wrote: Atri Sharma atri.j...@gmail.com writes: I am trying to identify foreign scans uniquely. What do you mean by identify

Re: [HACKERS] WIP patch for hint bit i/o mitigation

2012-11-07 Thread Atri Sharma
On 07-Nov-2012, at 15:46, Amit Kapila amit.kap...@huawei.com wrote: From: pgsql-hackers-ow...@postgresql.org [mailto:pgsql-hackers- ow...@postgresql.org] On Behalf Of Merlin Moncure Sent: Wednesday, November 07, 2012 5:26 AM To: PostgreSQL-development Cc: Atri Sharma Subject: [HACKERS] WIP

Re: [HACKERS] WIP patch for hint bit i/o mitigation

2012-11-07 Thread Atri Sharma
On Wed, Nov 7, 2012 at 5:31 PM, Amit Kapila amit.kap...@huawei.com wrote: -Original Message- From: Atri Sharma [mailto:atri.j...@gmail.com] Sent: Wednesday, November 07, 2012 4:02 PM To: Amit Kapila Cc: Merlin Moncure; PostgreSQL-development Subject: Re: [HACKERS] WIP patch

Re: [HACKERS] [v9.3] writable foreign tables

2012-11-08 Thread Atri Sharma
On 08-Nov-2012, at 13:35, Albe Laurenz laurenz.a...@wien.gv.at wrote: Alexander Korotkov wrote: 2) You wrote that FDW can support or don't support write depending on having corresponding functions. However it's likely some tables of same FDW could be writable while another are not. I think

Re: [HACKERS] Regarding column reordering project for GSoc 2012

2012-03-20 Thread Atri Sharma
-Original Message- From: Merlin Moncure [mailto:mmonc...@gmail.com] Sent: 20 March 2012 20:52 To: Atri Sharma Cc: Heikki Linnakangas; Alvaro Herrera; Daniel Farina; Andrew Dunstan; Dave Page; Pg Hackers Subject: Re: [HACKERS] Regarding column reordering project for GSoc 2012 On Tue

Re: [HACKERS] Regarding column reordering project for GSoc 2012

2012-03-20 Thread Atri Sharma
-Original Message- From: Merlin Moncure [mailto:mmonc...@gmail.com] Sent: 20 March 2012 22:50 To: Atri Sharma Cc: Heikki Linnakangas; Alvaro Herrera; Daniel Farina; Andrew Dunstan; Dave Page; Pg Hackers Subject: Re: [HACKERS] Regarding column reordering project for GSoc 2012 On Tue

Re: [HACKERS] Regarding column reordering project for GSoc 2012

2012-03-20 Thread Atri Sharma
On Wed, Mar 21, 2012 at 12:42 AM, Merlin Moncure mmonc...@gmail.com wrote: On Tue, Mar 20, 2012 at 12:34 PM, Atri Sharma atri.j...@gmail.com wrote: -Original Message- From: Merlin Moncure [mailto:mmonc...@gmail.com] Sent: 20 March 2012 22:50 To: Atri Sharma Cc: Heikki Linnakangas

Re: [HACKERS] Regarding column reordering project for GSoc 2012

2012-03-21 Thread Atri Sharma
-Original Message- From: Atri Sharma [mailto:atri.j...@gmail.com] Sent: 22 March 2012 09:20 To: 'Atri Sharma' Subject: RE: [HACKERS] Regarding column reordering project for GSoc 2012 -Original Message- From: Atri Sharma [mailto:atri.j...@gmail.com] Sent: 20 March 2012 23:05

[HACKERS] Regarding GSoc Application

2012-04-07 Thread Atri Sharma
Hi All, I submitted a GSoc application yesterday. Please review it and let me know if anyone needs any clarifications. Atri

[HACKERS] Regarding GSoc proposal

2012-04-09 Thread Atri Sharma
Hi all, I submitted a proposal for GSoc 2012.Please review it and let me know your comments. The link is: https://google-melange.appspot.com/gsoc/proposal/review/google/gsoc2012/atrisharma/1001 Atri -- Regards, Atri l'apprenant -- Sent via pgsql-hackers mailing list

Re: [HACKERS] [JDBC] Regarding GSoc Application

2012-04-09 Thread Atri Sharma
On Mon, Apr 9, 2012 at 10:15 PM, Andrew Dunstan and...@dunslane.net wrote: On 04/09/2012 12:14 PM, Dave Cramer wrote: So I'm confused, once they link a file to an FDW can't you just read it with an normal select ? What additional functionality will this provide ? I'm confused about

Re: [HACKERS] [JDBC] Regarding GSoc Application

2012-04-09 Thread Atri Sharma
On Mon, Apr 9, 2012 at 11:40 PM, Merlin Moncure mmonc...@gmail.com wrote: On Mon, Apr 9, 2012 at 12:25 PM, Atri Sharma atri.j...@gmail.com wrote: On Mon, Apr 9, 2012 at 10:15 PM, Andrew Dunstan and...@dunslane.net wrote: On 04/09/2012 12:14 PM, Dave Cramer wrote: So I'm confused, once

Re: [HACKERS] Regarding GSoc proposal

2012-04-10 Thread Atri Sharma
On Tue, Apr 10, 2012 at 5:38 PM, Albe Laurenz laurenz.a...@wien.gv.at wrote: Atri Sharma wrote: I submitted a proposal for GSoc 2012.Please review it and let me know your comments. The link is: https://google-melange.appspot.com/gsoc/proposal/review/google/gsoc2012/ atrisharma/1001 I

Re: [HACKERS] [JDBC] Regarding GSoc Application

2012-04-10 Thread Atri Sharma
On Tue, Apr 10, 2012 at 8:55 PM, Tom Lane t...@sss.pgh.pa.us wrote: Merlin Moncure mmonc...@gmail.com writes: ...  We have to invoke java and there are two basic ways to tie into the java runtime:  one is to jump through SPI via the SQL executor. The other is JNI into the pl/java jvm which I

Re: [HACKERS] [JDBC] Regarding GSoc Application

2012-04-10 Thread Atri Sharma
I agree that JNI isn't required -- we're going to have to study the pl/java system a bit to determine the best way to hook in. This could end up getting us into the 'biting of more than can chew' territory admittedly, but Atri is enthusiastic and wants to give it a go. Well. maybe I spoke

Re: [HACKERS] [JDBC] Regarding GSoc Application

2012-04-11 Thread Atri Sharma
I think Multicorn is a good example, which invokes Python from FDW routines though it is not using PL/Python. http://multicorn.org/ Hi Hitoshi, Thanks for the link. You mean,I should try to build something like Multicorn for Java? Atri -- Sent via pgsql-hackers mailing list

Re: [HACKERS] [JDBC] Regarding GSoc Application

2012-04-11 Thread Atri Sharma
Hi all, In continuation to the discussion regarding my JDBC wrapping FDW,I have been talking to members of the community and I have two approaches on which I would request your suggestions and opinions: I think we are back on the initial approach I proposed(hooking directly into the JVM and

Re: [HACKERS] [JDBC] Regarding GSoc Application

2012-04-11 Thread Atri Sharma
On Tue, Apr 10, 2012 at 10:41 PM, Atri Sharma atri.j...@gmail.com wrote: Well. maybe I spoke too soon...JNI is probably the best route. Since SPI is off the table, all we're really pulling in from pl/java is the (non-trivial) proper installation of a jvm into a postgres process. pl/java

Re: [HACKERS] [JDBC] Regarding GSoc Application

2012-04-17 Thread Atri Sharma
On Wed, Apr 11, 2012 at 8:17 PM, Atri Sharma atri.j...@gmail.com wrote: On Tue, Apr 10, 2012 at 10:41 PM, Atri Sharma atri.j...@gmail.com wrote: Well. maybe I spoke too soon...JNI is probably the best route.  Since SPI is off the table, all we're really pulling in from pl/java is the (non

Re: [HACKERS] [JDBC] Regarding GSoc Application

2012-04-17 Thread Atri Sharma
On Tue, Apr 17, 2012 at 7:37 PM, Andrew Dunstan and...@dunslane.net wrote: On 04/17/2012 09:12 AM, Atri Sharma wrote: I just had a small doubt I wanted to clarify.I initially said in my proposal that I would be using SPI for getting the FDW API to call Pl/Java functions,but now,after

Re: [HACKERS] Welcome 2012 GSOC students

2012-04-24 Thread Atri Sharma
On Tue, Apr 24, 2012 at 10:36 PM, Josh Berkus j...@agliodbs.com wrote: Hackers, We've chosen the 5 GSOC projects for this year: * JDBC Foreign Data Wrapper, by Atri, mentored by Merlin Moncure * Document Collection Foreign Data Wrapper, by Zheng Yang (a returning student), mentored by

Re: [HACKERS] Future In-Core Replication

2012-04-30 Thread Atri Sharma
On Mon, Apr 30, 2012 at 12:39 PM, Simon Riggs si...@2ndquadrant.com wrote: On Mon, Apr 30, 2012 at 7:35 AM, Dave Page dp...@pgadmin.org wrote: On Sun, Apr 29, 2012 at 11:20 PM, Alvaro Herrera alvhe...@commandprompt.com wrote: Excerpts from Simon Riggs's message of jue abr 26 11:10:09 -0300

[HACKERS] How do I get the name of the relation on which FDW has been called?

2012-05-30 Thread Atri Sharma
SELECT * FROM table1; If,for above command,fdw1 is invoked,how do I get the name/Oid of the table(i.e. table1) in fdw1? Atri -- Regards, Atri l'apprenant -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription:

Re: [HACKERS] How do I get the name of the relation on which FDW has been called?

2012-05-30 Thread Atri Sharma
On Wed, May 30, 2012 at 5:15 PM, Shigeru HANADA shigeru.han...@gmail.com wrote: Hi Atri, (2012/05/30 19:49), Atri Sharma wrote: SELECT * FROM table1; If,for above command,fdw1 is invoked,how do I get the name/Oid of the table(i.e. table1) in fdw1? For 9.1 and 9.0, you can get foreign

[HACKERS] heap_form_tuple crashing

2012-05-31 Thread Atri Sharma
Hi all, I am trying to call heap_form_tuple to create a tuple from a datum. My call to heap_form_tuple looks like: val1=0; tupledesc1=BlessTupleDesc(node-ss.ss_currentRelation-rd_att); tuple=heap_form_tuple(tupledesc1,p1,val1); p1 is a pointer to a Datum instance which is created from a char

Re: [HACKERS] heap_form_tuple crashing

2012-05-31 Thread Atri Sharma
On Thu, May 31, 2012 at 5:02 PM, Heikki Linnakangas heikki.linnakan...@enterprisedb.com wrote: On 31.05.2012 13:42, Atri Sharma wrote: I am trying to call heap_form_tuple to create a tuple from a datum. My call to heap_form_tuple looks like: val1=0; tupledesc1=BlessTupleDesc(node

Re: [HACKERS] heap_form_tuple crashing

2012-05-31 Thread Atri Sharma
On Thu, May 31, 2012 at 5:14 PM, Heikki Linnakangas heikki.linnakan...@enterprisedb.com wrote: On 31.05.2012 14:42, Atri Sharma wrote: Another thing I wanted to ask was that would you recommend building tuples from strings directly or converting them to Datum first and then build the tuples

Re: [HACKERS] heap_form_tuple crashing

2012-05-31 Thread Atri Sharma
On Thu, May 31, 2012 at 7:01 PM, Tom Lane t...@sss.pgh.pa.us wrote: Atri Sharma atri.j...@gmail.com writes: My call to heap_form_tuple looks like: val1=0; tupledesc1=BlessTupleDesc(node-ss.ss_currentRelation-rd_att); tuple=heap_form_tuple(tupledesc1,p1,val1); p1 is a pointer to a Datum

[HACKERS] ExecStoreTuple going into infinite loop

2012-06-06 Thread Atri Sharma
Hi all, I am trying to build and store multiple tuples.The code is: ExecClearTuple(slot); /The code for fetching the data from which tuple will be formed../ for(;xy;x++){ tuple = BuildTupleFromCStrings(TupleDescGetAttInMetadata(node-ss.ss_currentRelation-rd_att), values); ExecStoreTuple(tuple,

Re: [HACKERS] 9.2 final

2012-06-11 Thread Atri Sharma
On Mon, Jun 11, 2012 at 8:39 PM, Robert Haas robertmh...@gmail.com wrote: So, when are we thinking we might release 9.2.0? We've done a fall release the last two years, but it's not obvious to me that we have a whole lot of blockers left.  In fact, the only blocker for which we have nothing

[HACKERS] Fractal tree indexing

2013-02-13 Thread Atri Sharma
Hi all, Just a curiosity I couldnt control. I was recently reading about Fractal tree indexing (http://www.tokutek.com/2012/12/fractal-tree-indexing-overview/) and how TokuDB engine for MySQL is really working nicely with big data. I was wondering, do we have support for fractal tree indexing? I

Re: [HACKERS] Fractal tree indexing

2013-02-13 Thread Atri Sharma
On Wed, Feb 13, 2013 at 3:08 PM, Heikki Linnakangas hlinnakan...@vmware.com wrote: On 13.02.2013 11:01, Atri Sharma wrote: Hi all, Just a curiosity I couldnt control. I was recently reading about Fractal tree indexing (http://www.tokutek.com/2012/12/fractal-tree-indexing-overview/) and how

Re: [HACKERS] Fractal tree indexing

2013-02-13 Thread Atri Sharma
Wed: I remember we have already discussed fractal trees privately. Short conclusions are so: 1) Fractal tree indexes are patented. It is distributed as commercial extension to MySQL. So we can't include it into PostgreSQL core. 2) Tokutek can't provide full-fledged fractal tree indexes as

Re: [HACKERS] Fractal tree indexing

2013-02-13 Thread Atri Sharma
Sent from my iPad On 13-Feb-2013, at 18:21, Greg Stark st...@mit.edu wrote Heikki was talking about a generic WAL record type that would just store a binary delta between the version of the block when it was locked and when it was unlocked. That would handle any extension cleanly as far

Re: [HACKERS] Fractal tree indexing

2013-02-13 Thread Atri Sharma
Sent from my iPad On 13-Feb-2013, at 19:05, Heikki Linnakangas hlinnakan...@vmware.com wrote: On 13.02.2013 15:31, Alexander Korotkov wrote: On Wed, Feb 13, 2013 at 4:51 PM, Greg Starkst...@mit.edu wrote: Heikki was talking about a generic WAL record type that would just store a binary

Re: [HACKERS] Fractal tree indexing

2013-02-13 Thread Atri Sharma
Sent from my iPad On 13-Feb-2013, at 19:31, Simon Riggs si...@2ndquadrant.com wrote: . I think its a good idea, the best idea even, but we still have no idea what the requirements are without a clear case for an external index. It could easily turn out that we invent a plausible API that's

Re: [HACKERS] Fractal tree indexing

2013-02-13 Thread Atri Sharma
If they are patented as Alexander says upthread, then surely the idea is dead in the water. True, I think so too. But,the generic WAL seems an awesome idea and I would love to help. Atri -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your

Re: [HACKERS] Fractal tree indexing

2013-02-13 Thread Atri Sharma
Sent from my iPad On 13-Feb-2013, at 20:30, Tom Lane t...@sss.pgh.pa.us wrote: First explain why you couldn't build it as an opclass for gist or spgist ... That needs thinking about a bit.I was confused about the current indexes because they all build on BTrees.But,

Re: [HACKERS] Fractal tree indexing

2013-02-13 Thread Atri Sharma
Sent from my iPad . That makes no sense. I don't see any way to implement this in an opclass, and it wouldn't make sense to re-implement this for every opclass anyway. The basic idea of a fractal tree index is to attach a buffer to every non-leaf page. On insertion, instead of

Re: [HACKERS] Fractal tree indexing

2013-02-13 Thread Atri Sharma
Yeah,it is just a fancy name for something that has nothing to do with fractals.I guess everything suave these days is fractal! That said,the buffered concept itself looks really cool and should help us in large data sets.I am eager to get off the mark with it. Will we be building the index

Re: [HACKERS] Fractal tree indexing

2013-02-13 Thread Atri Sharma
Sent from my iPad On 13-Feb-2013, at 22:21, Heikki Linnakangas hlinnakan...@vmware.com wrote: On 13.02.2013 18:43, Andrew Dunstan wrote: On 02/13/2013 11:20 AM, Tom Lane wrote: Heikki Linnakangas hlinnakan...@vmware.com writes: The basic fractal indexes is what I've read on some

Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-02-14 Thread Atri Sharma
I forgot to mark all. I could be a co mentor, helping in overall coordination and supporting all the students in getting familiar with the project and community etc. Atri Sent from my iPad On 14-Feb-2013, at 23:32, Josh Berkus j...@agliodbs.com wrote: Folks, Once again, Google is holding

Re: [HACKERS] Call for Google Summer of Code mentors, admins

2013-02-14 Thread Atri Sharma
I forgot to mark all. I could be a co mentor, helping in overall coordination and supporting all the students in getting familiar with the project and community etc. Atri Sent from my iPad On 15-Feb-2013, at 8:34, Stephen Frost sfr...@snowman.net wrote: * Josh Berkus (j...@agliodbs.com)

Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-02-15 Thread Atri Sharma
Can't we have something related to machine learning? I was thinking of extending a technique where we can fill in some missing values in a data set for the user if he wants us to using some standard ml algorithms. Atri Sent from my iPad On 15-Feb-2013, at 19:26, Heikki Linnakangas

Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-02-15 Thread Atri Sharma
I would love to mentor if anybody would be willing to take a project in it. Atri Sent from my iPad On 15-Feb-2013, at 23:04, Josh Berkus j...@agliodbs.com wrote: On 02/15/2013 06:03 AM, Atri Sharma wrote: Can't we have something related to machine learning? I was thinking of extending

Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-02-23 Thread Atri Sharma
Take a look at MADLib. My suggestion would be extending the MADlib functions; there's plenty of unimplemented ML algrothims which could be added to it. I went through the MADLib library and came up with the following two ideas which I feel could be potential GSoC 2013 projects: 1) MADlib

Re: [HACKERS] [pgsql-advocacy] Call for Google Summer of Code mentors, admins

2013-03-20 Thread Atri Sharma
It does sound nice,something like cron? We can use a scheduling algorithm, and can define a pool of tasks as well as a time constraint for the amount of time which can be used for running the tasks.Then, a scheduling algorithm can pick tasks from the pool based on priorities and the time

[HACKERS] Page replacement algorithm in buffer cache

2013-03-21 Thread Atri Sharma
Hello all, Sorry if this is a naive question. I was going through Greg Smith's slides on buffer cache(http://www.westnet.com/~gsmith/content/postgresql/InsideBufferCache.pdf). When going through the page replacement algorithm that we use i.e. clocksweep algorithm, I felt a potential problem in

Re: [HACKERS] Page replacement algorithm in buffer cache

2013-03-22 Thread Atri Sharma
Sent from my iPad On 22-Mar-2013, at 11:28, Amit Kapila amit.kap...@huawei.com wrote: On Friday, March 22, 2013 10:22 AM Atri Sharma wrote: Hello all, Sorry if this is a naive question. I was going through Greg Smith's slides on buffer cache(http://www.westnet.com/~gsmith/content

Re: [HACKERS] Page replacement algorithm in buffer cache

2013-03-22 Thread Atri Sharma
I think that if the initialization of USAGE_COUNT starts at the maximum allowed value instead of one, we can have a better solution to this problem. So what is your idea, if you start at maximum, what we will do for further accesses to it? I havent chalked out a detailed plan yet, but I

Re: [HACKERS] Page replacement algorithm in buffer cache

2013-03-22 Thread Atri Sharma
What would you do if the only young page has usage count zero during second sweep. UmmThe same approach we take when there is no page with usage count zero in a sweep in the current algorithm? I don't think introducing another factor along with usage count would do any much help.

Re: [HACKERS] Page replacement algorithm in buffer cache

2013-03-22 Thread Atri Sharma
On Fri, Mar 22, 2013 at 4:53 PM, Amit Kapila amit.kap...@huawei.com wrote: On Friday, March 22, 2013 4:36 PM Atri Sharma wrote: What would you do if the only young page has usage count zero during second sweep. UmmThe same approach we take when there is no page with usage count zero

Re: [HACKERS] Page replacement algorithm in buffer cache

2013-03-22 Thread Atri Sharma
However, I think the main issue isn't finding new algorithms that are better in some specific circumstances. The hard part is figuring out whether their performance is better in general. My idea was to create a patch to capture page pinning traffic from PostgreSQL (maybe stream out into a

Re: [HACKERS] Page replacement algorithm in buffer cache

2013-03-22 Thread Atri Sharma
On Fri, Mar 22, 2013 at 11:36 PM, Greg Stark st...@mit.edu wrote: On Fri, Mar 22, 2013 at 2:02 PM, Tom Lane t...@sss.pgh.pa.us wrote: And we definitely looked at ARC We didn't just look at it. At least one release used it. Then patent issues were raised (and I think the implementation had

Re: [HACKERS] Page replacement algorithm in buffer cache

2013-03-22 Thread Atri Sharma
Moreover, if the buffer happens to miss a decrement due to a data race, there's a good chance that the buffer is heavily used and wouldn't need to be evicted soon anyway. (if you arrange it to be a read-test-inc/dec-store operation then you will never go out of bounds) However, clocksweep

Re: [HACKERS] Page replacement algorithm in buffer cache

2013-03-23 Thread Atri Sharma
Partitioned clock sweep strikes me as a bad idea... you could certainly get unlucky and end up with a lot of hot stuff in one partition. Another idea that'sbeen broughht up inthe past is to have something in the background keep a minimum number of buffers on the free list. That's how OS VM

Re: [HACKERS] Page replacement algorithm in buffer cache

2013-03-24 Thread Atri Sharma
Perhaps this isn't the help you were looking for, but I spent a long time looking into this a few years ago. Then I stopped and decided to work on other things. I would recommend you do so too. Agreed. It seems that my concerns were not valid, and since you have already done some testing

Re: [HACKERS] Page replacement algorithm in buffer cache

2013-03-24 Thread Atri Sharma
I'll have to take a look. Removing *all spinning* from from page allocation though feels like it might be worthwhile to test (got to give some bonus points for being a very local change and simple to implement). I wonder if with more shared buffers you tend to sweep more buffers per

Re: [HACKERS] Page replacement algorithm in buffer cache

2013-03-24 Thread Atri Sharma
On Sun, Mar 24, 2013 at 6:11 AM, Greg Smith g...@2ndquadrant.com wrote: On 3/22/13 8:45 AM, Ants Aasma wrote: However, I think the main issue isn't finding new algorithms that are better in some specific circumstances. The hard part is figuring out whether their performance is better in

Re: [HACKERS] Page replacement algorithm in buffer cache

2013-03-24 Thread Atri Sharma
If we use the value calculated locally to decide on eviction, the highly used buffers where this is likely will get at least one clock sweep cycle of grace time. If they are indeed highly used it's likely that someone will manage to bump the usage_count in the meanwhile. If they are not hot,

Re: [HACKERS] Limiting setting of hint bits by read-only queries; vacuum_delay

2013-03-25 Thread Atri Sharma
This is pretty similar to the proposal Atri and I just recently made. I am 100% in agreement that something must be done here...SELECT has none of the i/o mitigation features that vacuum has. Is your idea better? probably (although you have to give a small penalty for a user facing tunable)

Re: [HACKERS] GSoC project : K-medoids clustering in Madlib

2013-03-26 Thread Atri Sharma
I suggested a couple of algorithms to be implemented in MADLib(apart from K Medoids). You could pick some(or all) of them, which would require 3 months to be completed. As for more information on index, you can refer http://wiki.postgresql.org/wiki/What's_new_in_PostgreSQL_9.1 along with the

Re: [HACKERS] GSoC project : K-medoids clustering in Madlib

2013-03-27 Thread Atri Sharma
I'm a bit confused as to why this is being proposed as a Postgres-related project. I don't even know what MADlib is, but I'm pretty darn sure that no part of Postgres uses it. KNNGist certainly doesn't. It's a reasonably well established extension for Postgres for statistical and machine

Re: [HACKERS] GSoC project : K-medoids clustering in Madlib

2013-03-27 Thread Atri Sharma
But it would be even better if MADLib would apply to GSoC as an independent organization. The deadline for organization applications is on March 29th, so if the MADLIb people are interested in that, they need to hurry and send the application right now. Agreed. Is there any way we could add

Re: [HACKERS] Page replacement algorithm in buffer cache

2013-04-01 Thread Atri Sharma
I don't be believe there is any reasonable argument that sitting and spinning while holding the BufFreelistLock is a good idea. I completely agree. The idea of spinning for a lock while already inside a lock seems like a source of a hit to performance. Regards, Atri -- Regards, Atri

  1   2   3   4   >