Re: [HACKERS] Patch Review: Bugfix for XPATH() if text or attribute nodes are selected

2011-07-14 Thread Radosław Smogura
On Thu, 14 Jul 2011 15:15:33 +0300, Peter Eisentraut wrote: On sön, 2011-07-10 at 11:40 -0700, Josh Berkus wrote: Hackers, >> B. 6. Current behaviour _is intended_ (there is "if" to check node type) and _"natural"_. In this particular case user ask for text content of some node, and this con

Re: [HACKERS] Patch Review: Bugfix for XPATH() if text or attribute nodes are selected

2011-07-13 Thread Radosław Smogura
If I should I will bump this patches up. Regards, Radosław Smogura -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers

Re: [HACKERS] Patch Review: Bugfix for XPATH() if text or attribute nodes are selected

2011-07-12 Thread Radosław Smogura
On Tue, 12 Jul 2011 11:45:59 +0200, Florian Pflug wrote: On Jul12, 2011, at 11:00 , Radosław Smogura wrote: On Sun, 10 Jul 2011 17:06:22 -0500, Robert Haas wrote: Unless I am missing something, Florian is clearly correct here. For me not, because this should be fixed internally by making xml

Re: [HACKERS] Patch Review: Bugfix for XPATH() if text or attribute nodes are selected

2011-07-12 Thread Radosław Smogura
On Sun, 10 Jul 2011 17:06:22 -0500, Robert Haas wrote: On Jul 10, 2011, at 1:40 PM, Josh Berkus wrote: Hackers, B. 6. Current behaviour _is intended_ (there is "if" to check node type) and _"natural"_. In this particular case user ask for text content of some node, and this content is actu

Re: [HACKERS] Crash dumps

2011-07-06 Thread Radosław Smogura
Craig Ringer Thursday 07 of July 2011 01:05:48 > On 6/07/2011 11:00 PM, Radosław Smogura wrote: > > I think IPC for fast shout down all backends and wait for report > > processing is quite enaugh. > > How do you propose to make that reliable, though? > > -- > Cra

Re: [HACKERS] Crash dumps

2011-07-06 Thread Radosław Smogura
On Wed, 06 Jul 2011 07:59:12 +0800, Craig Ringer wrote: On 5/07/2011 9:05 PM, Magnus Hagander wrote: On Tue, Jul 5, 2011 at 15:02, Robert Haas wrote: On Mon, Jul 4, 2011 at 12:47 PM, Radosław Smogura wrote: I asked about crash reports becaus of at this time there was thread about crashing

Re: [HACKERS] Crash dumps

2011-07-04 Thread Radosław Smogura
Tom Lane Monday 04 of July 2011 16:32:32 > Craig Ringer writes: > > Why not produce a tool that watches the datadir for core files and > > processes them? ... > > By and large, our attitude has been that Postgres shouldn't be crashing > often enough to make this sort of infrastructure worthwhile

Re: [HACKERS] Crash dumps

2011-07-04 Thread Radosław Smogura
On Mon, 04 Jul 2011 12:58:46 +0800, Craig Ringer wrote: On 15/06/2011 2:37 AM, Radosław Smogura wrote: Hello, Because, I work a little bit on streaming protocol and from time to time I have crashes. I want ask if you wont crash reporting (this is one of minors products from mmap playing

[HACKERS] Re: Review of patch Bugfix for XPATH() if expression returns a scalar value

2011-06-30 Thread Radosław Smogura
On Wed, 29 Jun 2011 22:26:39 +0200, Florian Pflug wrote: On Jun29, 2011, at 19:57 , Radosław Smogura wrote: This is review of patch https://commitfest.postgresql.org/action/patch_view?id=565 "Bugfix for XPATH() if expression returns a scalar value" SELECT XMLELEMENT(name root, XML

[HACKERS] Review of patch Bugfix for XPATH() if expression returns a scalar value

2011-06-29 Thread Radosław Smogura
This is review of patch https://commitfest.postgresql.org/action/patch_view?id=565 "Bugfix for XPATH() if expression returns a scalar value" Patch applies cleanly, and compiles cleanly too, I didn't checked tests. Form discussion about patch, and referenced thread in this patch http://ar

[HACKERS] Patch Review: Bugfix for XPATH() if text or attribute nodes are selected

2011-06-29 Thread Radosław Smogura
ject as "need more work", "or as invalid". The detailed explanation why such behaviour should not be implemented I will send in review of https://commitfest.postgresql.org/action/patch_view?id=565. Regards, Radosław Smogura P. S. I would like to say sorry, for such l

Re: [HACKERS] Hugetables question

2011-06-23 Thread Radosław Smogura
Martijn van Oosterhout Thursday 23 of June 2011 09:10:20 > On Wed, Jun 22, 2011 at 02:31:01PM +0200, Rados??aw Smogura wrote: > > I strictly disagree with opinion if there is 1% it's worthless. 1% > > here, 1% there, and finally You get 10%, but of course hugepages > > will work quite well if will

Re: [HACKERS] Hugetables question

2011-06-22 Thread Radosław Smogura
On Wed, 22 Jun 2011 14:24:17 +0300, Marti Raudsepp wrote: On Sun, Jun 19, 2011 at 12:56, Radosław Smogura wrote: I want to implement hugepages for shared memory Hi, Have you read this post by Tom Lane about the performance estimation and a proof-of-concept patch with hugepages? http

Re: [HACKERS] POSIX question

2011-06-20 Thread Radosław Smogura
Florian Pflug Monday 20 of June 2011 17:07:55 > On Jun20, 2011, at 17:05 , Radosław Smogura wrote: > > I'm sure at 99%. When I ware "playing" with mmap I preallocated, > > probably, about 100GB of memory. > > You need to set vm.overcommit_memory to "2&

Re: [HACKERS] POSIX question

2011-06-20 Thread Radosław Smogura
Florian Pflug Monday 20 of June 2011 17:01:40 > On Jun20, 2011, at 16:39 , Radosław Smogura wrote: > > Florian Pflug Monday 20 of June 2011 16:16:58 > > > >> On Jun20, 2011, at 15:27 , Radosław Smogura wrote: > >>> 1. mmap some large amount of an

Re: [HACKERS] POSIX question

2011-06-20 Thread Radosław Smogura
Florian Pflug Monday 20 of June 2011 16:16:58 > On Jun20, 2011, at 15:27 , Radosław Smogura wrote: > > 1. mmap some large amount of anonymous virtual memory (this will be > > maximum size of shared memory). ... > > Point 1. will no eat memory, as memory allocation is

[HACKERS] POSIX question

2011-06-20 Thread Radosław Smogura
Hello, I had some idea with hugepagse, and I read why PostgreSQL doesn't support POSIX (need of nattach). During read about POSIX/SysV I found this (thread about dynamic chunking shared memory). http://archives.postgresql.org/pgsql-hackers/2010-08/msg00586.php When playing with mmap I done s

Re: [HACKERS] Patch - Debug builds without optimization

2011-06-20 Thread Radosław Smogura
Greg Stark Monday 20 of June 2011 03:39:12 > On Thu, Jun 16, 2011 at 9:00 PM, Tom Lane wrote: > > BTW, if you're hacking Postgres code and don't already have a > > "reinstall" script, you need one. Mine is basically > > > >pg_ctl stop > >cd $PGBLDROOT/src/backend > >make

Re: [HACKERS] Hugetables question

2011-06-19 Thread Radosław Smogura
Martijn van Oosterhout Sunday 19 of June 2011 12:35:18 > On Sun, Jun 19, 2011 at 11:56:15AM +0200, Rados??aw Smogura wrote: > > I want to implement hugepages for shared memory, to make it transparent I > > want to do in this fashion: > > 1. Reserve memory M of size s > > 2. Try to allocate hugepag

[HACKERS] Hugetables question

2011-06-19 Thread Radosław Smogura
I want to implement hugepages for shared memory, to make it transparent I want to do in this fashion: 1. Reserve memory M of size s 2. Try to allocate hugepage memory of as big size as possible (hs), attach at M. 3. Allocate normal shared memory of size hs - s, and attach it at M+hs. This souluti

Re: [HACKERS] XPATH evaluation

2011-06-18 Thread Radosław Smogura
Nicolas Barbier Friday 17 of June 2011 17:29:57 > 2011/6/17, Andrew Dunstan : > > On 06/17/2011 10:55 AM, Radosław Smogura wrote: > >> XML canonization preservs whitespaces, if I remember > >> well, I think there is example. > >> > >> In any case

Re: [HACKERS] XPATH evaluation

2011-06-17 Thread Radosław Smogura
Andrew Dunstan Friday 17 of June 2011 17:09:25 > On 06/17/2011 10:55 AM, Radosław Smogura wrote: > > Andrew Dunstan Friday 17 of June 2011 15:47:04 > > > >> On 06/17/2011 05:41 AM, Florian Pflug wrote: > >>> On Jun17, 2011, at 11:09 , Radosław Smogura w

Re: [HACKERS] XPATH evaluation

2011-06-17 Thread Radosław Smogura
Florian Pflug Friday 17 of June 2011 11:41:08 > On Jun17, 2011, at 11:09 , Radosław Smogura wrote: > > 1. > > SELECT (XPATH('/root/*', 'http://olacle.com/db"; > > xmlns:p="http://postgresql.org/db";> > db>')); Produces: > > &

Re: [HACKERS] XPATH evaluation

2011-06-17 Thread Radosław Smogura
Andrew Dunstan Friday 17 of June 2011 15:47:04 > On 06/17/2011 05:41 AM, Florian Pflug wrote: > > On Jun17, 2011, at 11:09 , Radosław Smogura wrote: > >> 1. > >> SELECT (XPATH('/root/*', 'http://olacle.com/db"; > >> x

[HACKERS] XPATH evaluation

2011-06-17 Thread Radosław Smogura
2nd I have mixed fillings. I think 2nd should transfer namespaces in some way to client. What do You think? Regards, Radosław Smogura -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers

Re: [HACKERS] Patch - Debug builds without optimization

2011-06-16 Thread Radosław Smogura
On Thu, 16 Jun 2011 16:00:21 -0400, Tom Lane wrote: Alvaro Herrera writes: I disagree with this change. Debug builds are very useful to have in production, and you don't want to be running -O0 there. I have found that you can use a src/Makefile.custom like this for those times when you wan

[HACKERS] [WIP] [Stream] Preview of pg_type changes

2011-06-16 Thread Radosław Smogura
Hello, Here I would like to expose changes to pg_type and type infrastructure about streaming. Changes are as follows: - added new column typstreamin typestremout - general contract for those is for streamin same as receive (receive use internal), for streamout it is (internal, ) - changes to

Re: [HACKERS] Patch - Debug builds without optimization

2011-06-16 Thread Radosław Smogura
On Thu, 16 Jun 2011 14:30:27 +0200, Radosław Smogura wrote: Hello, I'm sending following patch which disables optimization when --enable-debug is passed. It was nasty (for me, at least) that debug build required passing of CFLAGS with -O0 to get nice traceable code. Regards, Radek Sorr

[HACKERS] Patch - Debug builds without optimization

2011-06-16 Thread Radosław Smogura
Hello, I'm sending following patch which disables optimization when --enable-debug is passed. It was nasty (for me, at least) that debug build required passing of CFLAGS with -O0 to get nice traceable code. Regards, Radekdiff --git a/configure.in b/configure.in old mode 100644 new mode 100755

[HACKERS] [Streaming] Datum compression

2011-06-16 Thread Radosław Smogura
Hello, I think about following functionality to add to streaming. In some way earlier or later soemone will add possibility for gzip communication. As I try to make streaming, I wonder if it is possible to change TOAST compression to GZIP/zLib, currently is LZMA. I want to make this: if user

[HACKERS] Crash dumps

2011-06-14 Thread Radosław Smogura
patch for this (currently without IPC killing of others). Regards, Radosław Smogura -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers

Re: [HACKERS] .gitignore for some of cygwin files

2011-06-09 Thread Radosław Smogura
Magnus Hagander Thursday 09 of June 2011 16:25:07 > On Thu, Jun 9, 2011 at 15:40, Radosław Smogura wrote: > > On Thu, 9 Jun 2011 14:12:59 +0200, Magnus Hagander wrote: > >> On Wed, Jun 8, 2011 at 12:34, Radosław Smogura > >> > >> wrote: > >>>

Re: [HACKERS] .gitignore for some of cygwin files

2011-06-09 Thread Radosław Smogura
On Thu, 9 Jun 2011 14:12:59 +0200, Magnus Hagander wrote: On Wed, Jun 8, 2011 at 12:34, Radosław Smogura wrote: After compilation I got big list of differences about binaries and other files. You may see it in patch. Hmm. Does this really affect just cygwin, and not also mingw? I know msvc

Re: [HACKERS] .gitignore for some of cygwin files

2011-06-09 Thread Radosław Smogura
On Thu, 9 Jun 2011 14:12:59 +0200, Magnus Hagander wrote: On Wed, Jun 8, 2011 at 12:34, Radosław Smogura wrote: After compilation I got big list of differences about binaries and other files. You may see it in patch. Hmm. Does this really affect just cygwin, and not also mingw? I know msvc

[HACKERS] .gitignore for some of cygwin files

2011-06-08 Thread Radosław Smogura
After compilation I got big list of differences about binaries and other files. You may see it in patch. Regards, Radekdiff --git a/.gitignore b/.gitignore old mode 100644 new mode 100755 index 81c4d5e..75e1d9a --- a/.gitignore +++ b/.gitignore @@ -20,6 +20,14 @@ lcov.info *.vcproj win32ver.rc

Re: [HACKERS] BLOB support

2011-06-06 Thread Radosław Smogura
Tom Lane Monday 06 of June 2011 16:13:26 > =?UTF-8?Q?Rados=C5=82aw_Smogura?= writes: > > I think more about this with contrast to sent references, but I still > > have in my mind construct > > Blob myWeddingDvd = conn.createBlob(myWeddingStream, size); //A bit > > outdated we have BlueRay > >

Re: [HACKERS] BLOB support

2011-06-06 Thread Radosław Smogura
On Sun, 05 Jun 2011 22:16:41 +0200, Dimitri Fontaine wrote: Tom Lane writes: Yes. I think the appropriate problem statement is "provide streaming access to large field values, as an alternative to just fetching/storing the entire value at once". I see no good reason to import the entire mes

Re: [HACKERS] Auto adjust send buffer size to congention window

2011-06-05 Thread Radosław Smogura
Tom Lane Monday 06 of June 2011 04:07:41 > =?utf-8?q?Rados=C5=82aw_Smogura?= writes: > > I've got idea to auto adjust send buffer size to size of TCP congention > > window. Will this increase performance and in which way. I suppose > > throughput may be increased, but latency decreased. What do Y

[HACKERS] Auto adjust send buffer size to congention window

2011-06-05 Thread Radosław Smogura
Hi, I've got idea to auto adjust send buffer size to size of TCP congention window. Will this increase performance and in which way. I suppose throughput may be increased, but latency decreased. What do You think? Regards, Radek -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresq

Re: [HACKERS] BLOB support

2011-06-04 Thread Radosław Smogura
Tom Lane Friday 03 of June 2011 16:44:13 > Alvaro Herrera writes: > > Excerpts from Radosław Smogura's message of jue jun 02 15:26:29 -0400 2011: > >> So do I understand good should We think about create bettered TOAST to > >> support larger values then 30-bit length? I like this much more, > >

Re: [HACKERS] BLOB support

2011-06-03 Thread Radosław Smogura
Tom Lane Friday 03 of June 2011 18:08:56 > Robert Haas writes: > > On Thu, Jun 2, 2011 at 12:53 PM, Radosław Smogura > > > > wrote: > >> 1. No tracking of unused LO (you store just id of such object). You may > >> leak LO after row remove/update. User may write triggers for this, but > >> it i

[HACKERS] Streaming solution and v3.1 protocol

2011-06-03 Thread Radosław Smogura
Hello, Sorry for short introduction about this, and plese as far as possible, disconnet it from LOBs, as it on top of LOB. Idea of streaming is to reduce memory copy mainly during receiving and sending tuples. Currently receive works as follows 1. Read bytes of tuple (allocate x memory). 2. Eve

Re: [HACKERS] BLOB support

2011-06-03 Thread Radosław Smogura
Tom Lane Friday 03 of June 2011 16:44:13 > Alvaro Herrera writes: > > Excerpts from Radosław Smogura's message of jue jun 02 15:26:29 -0400 2011: > >> So do I understand good should We think about create bettered TOAST to > >> support larger values then 30-bit length? I like this much more, > >

Re: [HACKERS] BLOB support

2011-06-02 Thread Radosław Smogura
Tom Lane Thursday 02 of June 2011 19:43:16 > =?utf-8?q?Rados=C5=82aw_Smogura?= writes: > > Tom Lane Thursday 02 of June 2011 16:42:42 > > > >> Yes. I think the appropriate problem statement is "provide streaming > >> access to large field values, as an alternative to just fetching/storing > >>

Re: [HACKERS] BLOB support

2011-06-02 Thread Radosław Smogura
Tom Lane Thursday 02 of June 2011 16:42:42 > Robert Haas writes: > > But these problems can be fixed without inventing a completely new > > system, I think. Or at least we should try. I can see the point of a > > data type that is really a pointer to a LOB, and the LOB gets deleted > > when the

Re: [HACKERS] BLOB support

2011-06-02 Thread Radosław Smogura
On Thu, 02 Jun 2011 15:39:39 +0300, Peter Eisentraut wrote: On ons, 2011-06-01 at 22:00 +0200, Radosław Smogura wrote: I partialy implemented following missing LOBs types. Requirement for this was to give ability to create (B/C)LOB columns and add casting functionality e.g. SET my_clob = &#x

[HACKERS] BLOB support

2011-06-01 Thread Radosław Smogura
Hello, I partialy implemented following missing LOBs types. Requirement for this was to give ability to create (B/C)LOB columns and add casting functionality e.g. SET my_clob = 'My long text'. Idea is as follow: 0. Blob is two state object: 1st in memory contains just bytea, serialized contain

Re: [HACKERS] Improving the memory allocator

2011-04-26 Thread Radosław Smogura
On Tue, 26 Apr 2011 14:25:10 +0200, Andres Freund wrote: On Tuesday, April 26, 2011 01:59:45 PM Radosław Smogura wrote: I didn't followed this topic carefully, so sorry If I wrote something that was written, but I thought about following approach at least for message sending, etc.

Re: [HACKERS] Improving the memory allocator

2011-04-26 Thread Radosław Smogura
I didn't followed this topic carefully, so sorry If I wrote something that was written, but I thought about following approach at least for message sending, etc.: 1. When initializing MemoryContext (pool) give one parameter that will be stack size. Stack is addition to normal operations. 2. Op

Re: [HACKERS] MMAP Buffers

2011-04-18 Thread Radosław Smogura
On Sun, 17 Apr 2011 21:06:17 -0400, Robert Haas wrote: On Sun, Apr 17, 2011 at 5:32 PM, Radosław Smogura wrote: Each process has simple "mirror" of shared descriptors. I "believe" that modifications to buffer content may be only done when holding exclusive lock (with so

Re: [HACKERS] MMAP Buffers

2011-04-17 Thread Radosław Smogura
Robert Haas Monday 18 April 2011 03:06:17 > On Sun, Apr 17, 2011 at 5:32 PM, Radosław Smogura > > wrote: > > Each process has simple "mirror" of shared descriptors. > > > > I "believe" that modifications to buffer content may be only done wh

Re: [HACKERS] MMAP Buffers

2011-04-17 Thread Radosław Smogura
Robert Haas Sunday 17 April 2011 22:01:55 > On Sun, Apr 17, 2011 at 11:48 AM, Tom Lane wrote: > > =?utf-8?q?Rados=C5=82aw_Smogura?= writes: > >> Tom Lane Sunday 17 April 2011 01:35:45 > >> > >>> ... Huh? Are you saying that you ask the kernel to map each individual > >>> shared buffer separat

Re: [HACKERS] MMAP Buffers

2011-04-17 Thread Radosław Smogura
Andres Freund Sunday 17 April 2011 20:02:11 > On Sunday 17 April 2011 19:26:31 Radosław Smogura wrote: > > Kernel merges vm_structs. So mappings are compacted. I'm not kernel > > specialist, but skipping memory consumption, for not compacted mappings, > > kernel uses bt

Re: [HACKERS] MMAP Buffers

2011-04-17 Thread Radosław Smogura
Tom Lane Sunday 17 April 2011 17:48:56 > =?utf-8?q?Rados=C5=82aw_Smogura?= writes: > > Tom Lane Sunday 17 April 2011 01:35:45 > > > >> ... Huh? Are you saying that you ask the kernel to map each individual > >> shared buffer separately? I can't believe that's going to scale to > >> realistic

Re: [HACKERS] MMAP Buffers

2011-04-17 Thread Radosław Smogura
Tom Lane Sunday 17 April 2011 01:35:45 > =?utf-8?q?Rados=C5=82aw_Smogura?= writes: > > No, no, no :) I wanted to do this, but from above reason I skipped it. I > > swap VM pages, I do remap, in place where the shared buffer was I put > > mmaped page, and in place where mmaped page was I put share

Re: [HACKERS] MMAP Buffers

2011-04-16 Thread Radosław Smogura
Tom Lane Saturday 16 April 2011 17:02:32 > Greg Stark writes: > > What he did, I gather, is treat the mmapped buffers as a read-only > > copy of the data. To actually make any modifications he copies it into > > shared buffers and treats them like normal. When the buffers get > > flushed from mem

Re: [HACKERS] MMAP Buffers

2011-04-16 Thread Radosław Smogura
Greg Stark Saturday 16 April 2011 13:00:19 > On Sat, Apr 16, 2011 at 7:24 AM, Robert Haas wrote: > > The OP says that this patch maintains the WAL-before-data rule without > > any explanation of how it accomplishes that seemingly quite amazing > > feat. I assume I'm going to have to read this pa

Re: [HACKERS] MMAP Buffers

2011-04-15 Thread Radosław Smogura
Joshua Berkus Friday 15 April 2011 18:55:04 > Radoslaw, > > 10% improvement isn't very impressive from a switch to mmap. What workload > did you test with? What I'd really like to see is testing with databases > which are 50%, 90% and 200% the size of RAM ... that's where I'd expect > the great

Re: [HACKERS] MMAP Buffers

2011-04-15 Thread Radosław Smogura
On Fri, 15 Apr 2011 14:33:37 +0300, Heikki Linnakangas wrote: On 15.04.2011 13:32, Radosław Smogura wrote: If I may, I want to share some concept to use mmap in PG. It's far, far away from perfect, but it's keeps WAL before data. As well I crated table, with index, inserted few val

[HACKERS] MMAP Buffers

2011-04-15 Thread Radosław Smogura
Hello, If I may, I want to share some concept to use mmap in PG. It's far, far away from perfect, but it's keeps WAL before data. As well I crated table, with index, inserted few values, and I done vacuum full on this table. Db inits welcome from orginal sources. Performance of read (if back

Re: [HACKERS] 2nd Level Buffer Cache

2011-03-24 Thread Radosław Smogura
Robert Haas Thursday 24 March 2011 22:41:19 > On Thu, Mar 24, 2011 at 5:34 PM, Greg Stark wrote: > > On Thu, Mar 24, 2011 at 8:59 PM, Robert Haas wrote: > >> It seems at least plausible that buffer allocation could be > >> significantly faster if it need only pop the head of a list, rather > >>

Re: [HACKERS] 2nd Level Buffer Cache

2011-03-24 Thread Radosław Smogura
Jim Nasby Thursday 24 March 2011 20:36:48 > On Mar 23, 2011, at 5:12 PM, Tom Lane wrote: > > Robert Haas writes: > >> It looks like the only way anything can ever get put on the free list > >> right now is if a relation or database is dropped. That doesn't seem > >> too good. > > > > Why not?

Re: [HACKERS] 2nd Level Buffer Cache

2011-03-23 Thread Radosław Smogura
Greg Stark Wednesday 23 March 2011 21:30:04 > On Wed, Mar 23, 2011 at 8:00 PM, Robert Haas wrote: > > It looks like the only way anything can ever get put on the free list > > right now is if a relation or database is dropped. That doesn't seem > > too good. I wonder if the background writer sh

Re: [HACKERS] 2nd Level Buffer Cache

2011-03-23 Thread Radosław Smogura
Merlin Moncure Tuesday 22 March 2011 23:06:02 > On Tue, Mar 22, 2011 at 4:28 PM, Radosław Smogura > > wrote: > > Merlin Moncure Monday 21 March 2011 20:58:16 > > > >> On Mon, Mar 21, 2011 at 2:08 PM, Greg Stark wrote: > >> > On Mon, Mar 21, 2011

Re: [HACKERS] 2nd Level Buffer Cache

2011-03-23 Thread Radosław Smogura
Merlin Moncure Monday 21 March 2011 20:58:16 > On Mon, Mar 21, 2011 at 2:08 PM, Greg Stark wrote: > > On Mon, Mar 21, 2011 at 3:54 PM, Merlin Moncure wrote: > >> Can't you make just one large mapping and lock it in 8k regions? I > >> thought the problem with mmap was not being able to detect ot

Re: [HACKERS] 2nd Level Buffer Cache

2011-03-22 Thread Radosław Smogura
Merlin Moncure Monday 21 March 2011 20:58:16 > On Mon, Mar 21, 2011 at 2:08 PM, Greg Stark wrote: > > On Mon, Mar 21, 2011 at 3:54 PM, Merlin Moncure wrote: > >> Can't you make just one large mapping and lock it in 8k regions? I > >> thought the problem with mmap was not being able to detect ot

Re: [HACKERS] 2nd Level Buffer Cache

2011-03-21 Thread Radosław Smogura
Merlin Moncure Monday 21 March 2011 20:58:16 > On Mon, Mar 21, 2011 at 2:08 PM, Greg Stark wrote: > > On Mon, Mar 21, 2011 at 3:54 PM, Merlin Moncure wrote: > >> Can't you make just one large mapping and lock it in 8k regions? I > >> thought the problem with mmap was not being able to detect ot

Re: [HACKERS] 2nd Level Buffer Cache

2011-03-18 Thread Radosław Smogura
"Kevin Grittner" Thursday 17 March 2011 22:02:18 > Rados*aw Smogura wrote: > > I have implemented initial concept of 2nd level cache. Idea is to > > keep some segments of shared memory for special buffers (e.g. > > indices) to prevent overwrite those by other operations. I added > > those function

[HACKERS] 2nd Level Buffer Cache

2011-03-17 Thread Radosław Smogura
Hi, I have implemented initial concept of 2nd level cache. Idea is to keep some segments of shared memory for special buffers (e.g. indices) to prevent overwrite those by other operations. I added those functionality to nbtree index scan. I tested this with doing index scan, seq read, drop sys

Re: [HACKERS] Binary in/out for aclitem

2011-02-24 Thread Radosław Smogura
Tom Lane Wednesday 23 February 2011 22:30:04 > =?utf-8?q?Rados=C5=82aw_Smogura?= writes: > > Here is extended version, has version field (N_ACL_RIGHTS*2) and reserved > > mask, as well definition is more general then def of PGSQL. In any way it > > require that rights mades bit array. > > You're

Re: [HACKERS] Binary in/out for aclitem

2011-02-23 Thread Radosław Smogura
Tom Lane Wednesday 23 February 2011 16:19:27 > rsmogura writes: > > On Tue, 22 Feb 2011 20:20:39 -0500, Tom Lane wrote: > >> ... But my question isn't about that; it's about > >> why aclitem should be considered a first-class citizen. It makes me > >> uncomfortable that client apps are looking

Re: [HACKERS] Binary in/out for aclitem

2011-02-23 Thread Radosław Smogura
Tom Lane Wednesday 23 February 2011 16:19:27 > rsmogura writes: > > On Tue, 22 Feb 2011 20:20:39 -0500, Tom Lane wrote: > >> ... But my question isn't about that; it's about > >> why aclitem should be considered a first-class citizen. It makes me > >> uncomfortable that client apps are looking

Re: [HACKERS] Binary in/out for aclitem

2011-02-23 Thread Radosław Smogura
Tom Lane Wednesday 23 February 2011 16:19:27 > rsmogura writes: > > On Tue, 22 Feb 2011 20:20:39 -0500, Tom Lane wrote: > >> ... But my question isn't about that; it's about > >> why aclitem should be considered a first-class citizen. It makes me > >> uncomfortable that client apps are looking

[HACKERS] Binary in/out for aclitem

2011-02-22 Thread Radosław Smogura
Hi, Actaully one more POD left it's aclitem :). In Java for e.g. it is used to obtain column priviliges, I assume some folks may want to use it too. I tested only recv :-( Acually I don't know if idea of such format is OK, but my intention was to send roles names, so driver don't need to ask f

[HACKERS] Void binary patch

2011-02-20 Thread Radosław Smogura
Just patch for missing procedures for void send/recv Regards, Radek diff --git a/src/backend/utils/adt/pseudotypes.c b/src/backend/utils/adt/pseudotypes.c index d9329f8..614eb98 100644 --- a/src/backend/utils/adt/pseudotypes.c +++ b/src/backend/utils/adt/pseudotypes.c @@ -212,7 +212,20 @@ void_out

Re: [HACKERS] Varchar and binary protocol

2011-02-09 Thread Radosław Smogura
Actually difference is http://archives.postgresql.org/pgsql-hackers/2011-02/msg00415.php Merlin Moncure Thursday 10 February 2011 08:48:26 > On Sat, Feb 5, 2011 at 4:59 PM, Radosław Smogura > > wrote: > > Hi, > > > > I do performance tests against orignal JD

Re: [HACKERS] Varlena and binary

2011-02-07 Thread Radosław Smogura
Just from curious may I ask in which direction this will go, and how this will affect performance of text and binary format? Actually I started to make smaller improvements, and I think about one big to encode text (when client and server encoding are different) directly to StringInfo, without

[HACKERS] Varlena and binary

2011-02-06 Thread Radosław Smogura
Hi, I'm sending small patch for textsend. It reduces unnecessary copies, and memory usage for duplication of varlena data. May you look? Kind regards, Radosław Smogura diff --git a/src/backend/utils/adt/varlena.c b/src/backend/utils/adt/varlena.c index e111d26..f24bbcd 100644 --- a/src/ba

[HACKERS] Varchar and binary protocol

2011-02-05 Thread Radosław Smogura
Hi, I do performance tests against orignal JDBC driver and my version in binary and in text mode. I saw strange results when I was reading varchar values. Here is some output from simple benchmark Plain strings speed Execution: 8316582, local: 2116608, all: 10433190 Binary str

Re: [HACKERS] Binary timestamp with without timezone

2010-12-20 Thread Radosław Smogura
On Thu, 16 Dec 2010 14:24:27 -0500, Tom Lane wrote: =?utf-8?q?Rados=C5=82aw_Smogura?= writes: Tom Lane Thursday 16 December 2010 18:59:56 =?utf-8?q?Rados=C5=82aw_Smogura?= writes: ... This timestamp must be properly encoded depending if target is WITH TZ or not, but JDBC (and other clien

Re: [HACKERS] Binary timestamp with without timezone

2010-12-16 Thread Radosław Smogura
one offset, as text mode allow (lack of information). I would like to send this in same behavior as text mode does: send local time with two bytes of client tz as OID unspecified. One more instead of pq_copymsgbtes better will be tzOffset = pq_getint(buf, sizeof(int16)); Kind regards, Radosła

[HACKERS] Binary timestamp with without timezone

2010-12-16 Thread Radosław Smogura
AMPTZ(timestamp); } Will be this enaugh to allow to send TIMESTAMPS WITH(OUT) TZ as UNSPECIFIED? Simillar should go for (ugly) time with timezone. //Ofc, excelent behaviour will be if I could send values always with TZ and //leave _proper_ casting to backend. Kind regards, Radosław Smogura htt

Re: [JDBC] [HACKERS] Improved JDBC driver part 2

2010-12-01 Thread Radosław Smogura
On Wed, 1 Dec 2010 12:47:13 +0100, Magnus Hagander wrote: > On Tue, Nov 30, 2010 at 19:49, Radosław Smogura wrote: >> Hello, >> >> Maybe you are interested about this what I done with JDBC > > > > >> Driver is here >> http://www.rsmogura.net/pgsql

Re: [JDBC] [HACKERS] Improved JDBC driver part 2

2010-12-01 Thread Radosław Smogura
; http://www.rsmogura.net/pgsql/pgjdbc_exp_20101130_C.tar.gz > Resolving www.rsmogura.net... 64.120.14.83 > Connecting to www.rsmogura.net|64.120.14.83|:80... connected. > HTTP request sent, awaiting response... 404 Not Found > 2010-12-01 12:05:29 ERROR 404: Not Found. > > > On Tue, Nov 30, 2

[HACKERS] Improved JDBC driver part 2

2010-11-30 Thread Radosław Smogura
Kind regards & have a nice day -- Radosław Smogura http://www.softperience.eu -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers

Re: [HACKERS] [JDBC] JDBC and Binary protocol error, for some statements

2010-11-26 Thread Radosław Smogura
so it wouldn't necessarily be well-defined anyway. > > regards, tom lane -- -- Radosław Smogura http://www.softperience.eu -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers

Re: [HACKERS] [JDBC] JDBC and Binary protocol error, for some statements

2010-11-25 Thread Radosław Smogura
rmats when results are handled. Kind regards, Radosław Smogura On Fri, 26 Nov 2010 01:02:25 -0500, Tom Lane wrote: > Maciek Sakrejda writes: >>> 21:43:02.264 (26) FE=> Describe(statement=S_1) >> You're still doing the statement-flavor Describe. As Tom pointed out, >

Re: [HACKERS] [JDBC] JDBC and Binary protocol error, for some statements

2010-11-25 Thread Radosław Smogura
ribeStatement = describeOnly || (!oneShot && > paramsHasUnknown && queryHasUnknown && !query.isStatementDescribed()); > > > --- > Maciek Sakrejda | System Architect | Truviso > > 1065 E. Hillsdale Blvd., Suite 215 > Foster City, CA 94404 > (650) 242-3500 Main &g

Re: [HACKERS] [JDBC] JDBC and Binary protocol error, for some statements

2010-11-25 Thread Radosław Smogura
duce that with my standalone test case. When I > changed the parameter oid to 23, I still got the same behavior. Can > you alter my test case to reproduce the error? > I will do it tomorrow. In this situation I need to test portals as well. > --- > Maciek Sakrejda | System Archite

Re: [HACKERS] [JDBC] JDBC and Binary protocol error, for some statements

2010-11-25 Thread Radosław Smogura
format field wasn't set to 0, but 1. Kind regards, Radosław Smogura On Thu, 25 Nov 2010 12:23:03 -0500, Tom Lane wrote: > AFAICS this isn't a bug. What you're issuing Describe against is the > prepared statement, not the portal. The result column formats are not > specifi

Re: [HACKERS] [JDBC] JDBC and Binary protocol error, for some statements

2010-11-25 Thread Radosław Smogura
m Architect | Truviso > > 1065 E. Hillsdale Blvd., Suite 215 > Foster City, CA 94404 > (650) 242-3500 Main > www.truviso.com -- -- Radosław Smogura http://www.softperience.eu -- Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-hackers

Re: [HACKERS] [JDBC] JDBC and Binary protocol error, for some statements

2010-11-24 Thread Radosław Smogura
I didn't described log correctly, 1st attached response is normal execution; flags QUERY_SUPPRESS_BEGIN | QUERY_ONESHOT, 2nd is compiled statement QUERY_SUPPRESS_BEGIN only. Text format is marked as 0, binary format is 1. The 1st shown execution (flags=17) is good, it tells that result is send

[HACKERS] JDBC and Binary protocol error, for some statements

2010-11-23 Thread Radosław Smogura
Hi, I work on implementing binary protocol, during test "select ?::int" has been executed few times to compile it to server prepared statement, but after this backend returned field format = text, but sent field data in binary mode. The parameter is long and is sent to in text mode, with oid 0,

[HACKERS] Experimental JDBC driver

2010-11-21 Thread Radosław Smogura
Hello, I last time added some features to JDBC driver meking in some way experimental driver, it could be quite usefull, but if it's possible I would like to ask for some reviews and tests. Maybe some ideas from this will be handly. Beacause the chageset is huge, I don't give patch set, but onl

Re: [HACKERS] [JDBC] Support for JDBC setQueryTimeout, et al.

2010-10-15 Thread Radosław Smogura
rnate, with C3P0 hacks and uses some private code, unwraps objects, etc... :(, so when private implementation changes we have BUM. > -- >  Magnus Hagander >  Me: http://www.hagander.net/ >  Work: http://www.redpill-linpro.com/ -- -- Radosław Smogura http://ww

Re: [HACKERS] [JDBC] Support for JDBC setQueryTimeout, et al.

2010-10-14 Thread Radosław Smogura
close to PooledConection, nor physical connection. This due to fact, that GF and others adds functionality for statements pooling (if server will call close on pooled conn, then reusing cached statement will cause error - in fact this problem occurs with Hibernate, C3po, XA, and GFv3). To summ

Re: [HACKERS] [JDBC] Support for JDBC setQueryTimeout, et al.

2010-10-14 Thread Radosław Smogura
> Regarding JDBC in the CF process -- other interfaces are handled > there. I haven't seen one patch this size for JDBC since I've been > involved, let alone two competing patches to implement the same > feature. Small patches which can be quickly handled don't make sense > to put into the proces

Re: [HACKERS] [JDBC] Support for JDBC setQueryTimeout, et al.

2010-10-14 Thread Radosław Smogura
On Wed, 13 Oct 2010 21:01:06 -0400, Robert Haas wrote: > Is this a JDBC patch or a PG patch? Are we tracking JDBC patches > using the CF app? It is JDBC patch. I will clean it and submit on this site. I didn't know about such application and such process. -- Radosław S

Re: [HACKERS] [JDBC] Support for JDBC setQueryTimeout, et al.

2010-10-13 Thread Radosław Smogura
Timer and "cancel query" facility of > > PSQL server, > > Would you like to update it? I updated patch to latets CVS version, I didn't have time to remove some trashes from it. If something will be wrong with patch, give a feedback. Kind regards, Radosław Smogura

Re: [HACKERS] [JDBC] Support for JDBC setQueryTimeout, et al.

2010-10-12 Thread Radosław Smogura
Kevin I sent such patch fully in Java (http://archives.postgresql.org/pgsql-jdbc/2009-11/msg00010.php), implementing cancellation with Timer and "cancel query" facility of PSQL server, unfortunately none has revised it, even that setQuertyTimeout todo is for long time on dashboard, and

  1   2   >