Re: [HACKERS] Proposal for Null Bitmap Optimization(for Trailing NULLs)

2007-12-17 Thread Gokulakannan Somasundaram
We can also implement the same for index tuples. On Dec 17, 2007 1:10 PM, Gokulakannan Somasundaram [EMAIL PROTECTED] wrote: Hi, Currently we check for the existence of NULL values in the tuple and we set the has_null flag. If the has_null flag is present, the tuple will be storing

Re: [HACKERS] Requesting clarification on Vacuuming/Freezing behaviour

2007-12-17 Thread Heikki Linnakangas
Gokulakannan Somasundaram wrote: a) When i was looking at the code for freezing heap tuples, i found out the following. While freezing we log the complete block(not just the tuples we froze). b) Again after removing the dead tuples and fragmentation, we log the complete block. Umm, no we

Re: [HACKERS] standalone hot backup docs

2007-12-17 Thread Bruce Momjian
Andrew Dunstan wrote: The docs contain the following example of an archive_command for use with standalone hot backup: test -f /var/lib/pgsql/backup_in_progress cp -i %p /var/lib/pgsql/archive/%f /dev/null Unfortunately, as I found out when I tried it, this command returns a

Re: [HACKERS] WORM and Read Only Tables (v0.1)

2007-12-17 Thread Simon Riggs
On Sat, 2007-12-15 at 13:32 +0100, Albert Cervera i Areny wrote: Read-Only Tables Postgres supports the concept of freezing tuples, so they can live forever within the database without needing further writes. Currently there is no command that will guarantee that a table

Re: [HACKERS] Proposal for Null Bitmap Optimization(for Trailing NULLs)

2007-12-17 Thread Gregory Stark
Gokulakannan Somasundaram [EMAIL PROTECTED] writes: a) By modifying the functions, heap_form_tuple and heap_fill_tuple, we can check whether all the nulls are trailing nulls. If all the nulls are trailing nulls, then we will not set the has_null flag and we will not have the null bitmap with

Re: [HACKERS] Proposal for Null Bitmap Optimization(for Trailing NULLs)

2007-12-17 Thread Simon Riggs
On Mon, 2007-12-17 at 13:10 +0530, Gokulakannan Somasundaram wrote: Currently we check for the existence of NULL values in the tuple and we set the has_null flag. If the has_null flag is present, the tuple will be storing a null bitmap. What i propose is Will this work for ALTER TABLE

[HACKERS] ecxt_scantuple has wrong TupleDesc

2007-12-17 Thread peter . trautmeier
Hi all, I wonder why my ecxt_scantuple has a TupleDesc matching the subplan's tlist, not my plan's tlist. Basically, my question is what is x in econtext-ecxt_scantuple = x ? I have written a new executor node Foo, with corresponding ExecFoo and make_foo functions. I have also written a new

Re: [HACKERS] Proposal for Null Bitmap Optimization(for Trailing NULLs)

2007-12-17 Thread Gokulakannan Somasundaram
On Dec 17, 2007 3:28 PM, Simon Riggs [EMAIL PROTECTED] wrote: On Mon, 2007-12-17 at 13:10 +0530, Gokulakannan Somasundaram wrote: Currently we check for the existence of NULL values in the tuple and we set the has_null flag. If the has_null flag is present, the tuple will be storing a

Re: [HACKERS] Proposal for Null Bitmap Optimization(for Trailing NULLs)

2007-12-17 Thread Gokulakannan Somasundaram
Thanks. I agree with you. -- Thanks, Gokul. CertoSQL Project, Allied Solution Group. (www.alliedgroups.com)

Re: [HACKERS] Proposal for Null Bitmap Optimization(for Trailing NULLs)

2007-12-17 Thread Andrew Dunstan
Gregory Stark wrote: Gokulakannan Somasundaram [EMAIL PROTECTED] writes: a) By modifying the functions, heap_form_tuple and heap_fill_tuple, we can check whether all the nulls are trailing nulls. If all the nulls are trailing nulls, then we will not set the has_null flag and we will not

Re: [HACKERS] Proposal for Null Bitmap Optimization(for Trailing NULLs)

2007-12-17 Thread Simon Riggs
On Mon, 2007-12-17 at 08:47 -0500, Andrew Dunstan wrote: This strikes me as such a corner case that it's likely not to be worth it. If you really want to save space along these lines, one better place to start might be mutable with column ordering - see

Re: [HACKERS] Proposal for Null Bitmap Optimization(for TrailingNULLs)

2007-12-17 Thread Gregory Stark
Simon Riggs [EMAIL PROTECTED] writes: On Mon, 2007-12-17 at 08:47 -0500, Andrew Dunstan wrote: This strikes me as such a corner case that it's likely not to be worth it. If you really want to save space along these lines, one better place to start might be mutable with column ordering -

Re: [HACKERS] ecxt_scantuple has wrong TupleDesc

2007-12-17 Thread Tom Lane
[EMAIL PROTECTED] writes: I wonder why my ecxt_scantuple has a TupleDesc matching the subplan's tlist, not my plan's tlist. That's the way it's supposed to be --- the scantuple slot is for scanning your subplan's output. I have written a new executor node Foo, with corresponding ExecFoo and

[HACKERS] Board for developers

2007-12-17 Thread Oleg Bartunov
Hi there, just interested do we have a place where developers could post their availability for contract work ? For example, I and Teodor will be available soon for contract work and we prefer to work on postgres-related projects, mostly from our todo list. I'd like to post this list

Re: [HACKERS] pgindent issue with EXEC_BACKEND-only typedefs

2007-12-17 Thread Alvaro Herrera
Tom Lane wrote: Alvaro Herrera [EMAIL PROTECTED] writes: I don't know how to make it output the symbol names like it seems to do for you. I dislike the object-file-based approach altogether, not least because it appears to depend on unportable aspects of someBSD's objdump. Surely

Re: [HACKERS] Board for developers

2007-12-17 Thread Magnus Hagander
Hi there, just interested do we have a place where developers could post their availability for contract work ? For example, I and Teodor will be available soon for contract work and we prefer to work on postgres-related projects, mostly from our todo list. I'd like to post this list

Re: [HACKERS] Board for developers

2007-12-17 Thread Oleg Bartunov
On Mon, 17 Dec 2007, Magnus Hagander wrote: Hi there, just interested do we have a place where developers could post their availability for contract work ? For example, I and Teodor will be available soon for contract work and we prefer to work on postgres-related projects, mostly from our

Re: [HACKERS] Board for developers

2007-12-17 Thread Joshua D. Drake
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Mon, 17 Dec 2007 20:24:15 +0300 (MSK) Oleg Bartunov [EMAIL PROTECTED] wrote: On Mon, 17 Dec 2007, Magnus Hagander wrote: Hi there, just interested do we have a place where developers could post their availability for contract work ?

Re: [HACKERS] Proposal for Null Bitmap Optimization(for TrailingNULLs)

2007-12-17 Thread Gokulakannan Somasundaram
Hi, I made the fix and tested it today. It involved some 10-15 lines of code change. I will mail it tomorrow. Feel free to give suggestions on making the fix more maintainable. I have followed Gregory's advice in the fix - Instead of changing the slot_deform_tuple, i have reduced the number

Re: [HACKERS] Board for developers

2007-12-17 Thread Heikki Linnakangas
Oleg Bartunov wrote: On Mon, 17 Dec 2007, Magnus Hagander wrote: Hi there, just interested do we have a place where developers could post their availability for contract work ? For example, I and Teodor will be available soon for contract work and we prefer to work on postgres-related

Re: [HACKERS] Sorting Improvements for 8.4

2007-12-17 Thread Ron Mayer
Has anyone looked into sorting algorithms that could use more than one CPU or core at a time? Benchmarks I see[1][2] suggest that sorting is an area that improves greatly with multiple processors and even with multi-threading on a single core processor. For 1-processor and 2-threads (1p2t),

Re: [HACKERS] Board for developers

2007-12-17 Thread Merlin Moncure
On Dec 17, 2007 3:23 PM, Heikki Linnakangas [EMAIL PROTECTED] wrote: Oleg Bartunov wrote: On Mon, 17 Dec 2007, Magnus Hagander wrote: just interested do we have a place where developers could post their availability for contract work ? For example, I and Teodor will be available soon

Re: [HACKERS] EXPLAIN ANALYZE printing logical and hardware I/O per-node

2007-12-17 Thread Decibel!
On Dec 14, 2007, at 11:10 PM, Neil Conway wrote: But it occurred to me just now that the hardware instruction counter available on just about every platform would be good enough for a heuristic guess at whether the read(2) was cached. I'm skeptical that this would be reliable enough to be

Re: [HACKERS] EXPLAIN ANALYZE printing logical and hardware I/O per-node

2007-12-17 Thread Greg Smith
On Mon, 17 Dec 2007, Decibel! wrote: Someone want to throw together some code that actually measures this? Maybe something that keeps a histogram of how many instructions take place per I/O request? If it turns out that counters do vary too much between CPUs, there might be ways that we can

Re: [HACKERS] EXPLAIN ANALYZE printing logical and hardware I/O per-node

2007-12-17 Thread Trevor Talbot
On 12/17/07, Decibel! [EMAIL PROTECTED] wrote: Also, has anyone looked into adding a class of system calls that would actually tell us if the kernel issued physical IO? I find it hard to believe that other RDBMSes wouldn't like to have that info... Non-blocking style interfaces can help here.