Re: [HACKERS] Index Tuple Compression Approach?

2007-08-16 Thread Heikki Linnakangas
Gregory Stark wrote: Heikki Linnakangas [EMAIL PROTECTED] writes: That general approach of storing a common part leading part just once is called prefix compression. Yeah, it helps a lot on long text fields. Tree structures like file paths in particular. You kind of want to do avoid both

Re: [HACKERS] Index Tuple Compression Approach?

2007-08-16 Thread Gregory Stark
Heikki Linnakangas [EMAIL PROTECTED] writes: Gregory Stark wrote: Heikki Linnakangas [EMAIL PROTECTED] writes: That general approach of storing a common part leading part just once is called prefix compression. Yeah, it helps a lot on long text fields. Tree structures like file paths in

Re: [HACKERS] Index Tuple Compression Approach?

2007-08-16 Thread Chris Browne
[EMAIL PROTECTED] (Gregory Stark) writes: Heikki Linnakangas [EMAIL PROTECTED] writes: Gregory Stark wrote: Heikki Linnakangas [EMAIL PROTECTED] writes: That general approach of storing a common part leading part just once is called prefix compression. Yeah, it helps a lot on long text

Re: [HACKERS] Index Tuple Compression Approach?

2007-08-15 Thread Simon Riggs
On Wed, 2007-08-15 at 06:51 +0100, Heikki Linnakangas wrote: Jeff Davis wrote: On Tue, 2007-08-14 at 16:27 -0500, Decibel! wrote: Isn't this what Grouped Index Tuples is? http://community.enterprisedb.com/git/git-readme.txt It looks like GIT is a little different. GIT actually

[HACKERS] Index Tuple Compression Approach?

2007-08-15 Thread Dawid Kuroczko
On 8/14/07, Chris Browne [EMAIL PROTECTED] wrote: I recently had a chat with someone who was pretty intimate with Adabas for a number of years who's in the process of figuring things out about PostgreSQL. We poked at bits of the respective implementations, seeing some similarities and

Re: [HACKERS] Index Tuple Compression Approach?

2007-08-15 Thread Jeff Davis
On Wed, 2007-08-15 at 06:51 +0100, Heikki Linnakangas wrote: What Chris is suggesting is basically a special case of GIT, where all the heap tuples represented by an index tuple have the same key. I was actually thinking of adding a flag to index tuples to indicate that special case in GIT. We

Re: [HACKERS] Index Tuple Compression Approach?

2007-08-15 Thread Heikki Linnakangas
Dawid Kuroczko wrote: Some time ago I've had an idea that it might be possible to compress th index size, even if it is a unique index. Take the path example. My idea would be to to split indexed value to 8-byte chunks. For example: /var/lib/postgresql/8.2/main would be split into:

Re: [HACKERS] Index Tuple Compression Approach?

2007-08-15 Thread Chris Browne
[EMAIL PROTECTED] (Dawid Kuroczko) writes: On 8/14/07, Chris Browne [EMAIL PROTECTED] wrote: I recently had a chat with someone who was pretty intimate with Adabas for a number of years who's in the process of figuring things out about PostgreSQL. We poked at bits of the respective

Re: [HACKERS] Index Tuple Compression Approach?

2007-08-15 Thread Gregory Stark
Heikki Linnakangas [EMAIL PROTECTED] writes: That general approach of storing a common part leading part just once is called prefix compression. Yeah, it helps a lot on long text fields. Tree structures like file paths in particular. You kind of want to do avoid both the prefix and the

[HACKERS] Index Tuple Compression Approach?

2007-08-14 Thread Chris Browne
I recently had a chat with someone who was pretty intimate with Adabas for a number of years who's in the process of figuring things out about PostgreSQL. We poked at bits of the respective implementations, seeing some similarities and differences. He pointed out one aspect of index handling

Re: [HACKERS] Index Tuple Compression Approach?

2007-08-14 Thread Decibel!
Isn't this what Grouped Index Tuples is? On Tue, Aug 14, 2007 at 05:21:16PM -0400, Chris Browne wrote: I recently had a chat with someone who was pretty intimate with Adabas for a number of years who's in the process of figuring things out about PostgreSQL. We poked at bits of the respective

Re: [HACKERS] Index Tuple Compression Approach?

2007-08-14 Thread Jeff Davis
On Tue, 2007-08-14 at 16:27 -0500, Decibel! wrote: Isn't this what Grouped Index Tuples is? http://community.enterprisedb.com/git/git-readme.txt It looks like GIT is a little different. GIT actually stores a lower-bound key of a contiguous* range of keys that all point to the same page, and

Re: [HACKERS] Index Tuple Compression Approach?

2007-08-14 Thread Heikki Linnakangas
Jeff Davis wrote: On Tue, 2007-08-14 at 16:27 -0500, Decibel! wrote: Isn't this what Grouped Index Tuples is? http://community.enterprisedb.com/git/git-readme.txt It looks like GIT is a little different. GIT actually stores a lower-bound key of a contiguous* range of keys that all