Re: [PERFORM] index usage on arrays

2008-02-07 Thread Tom Lane
andrew klassen <[EMAIL PROTECTED]> writes: > Is there any alternative to what am I currently doing other than creating a > row for > each array element, Since (I think) 8.2, you could create a GIN index on the array column and then array overlap (&&) would be indexable. GIN has some performance

Re: [PERFORM] index usage on arrays

2008-02-07 Thread Oleg Bartunov
andrew, what are your queries ? Have you seen contrib/intarray, GIN index ? On Thu, 7 Feb 2008, andrew klassen wrote: I am using Postgres 8.2.5. I have a table that has rows containing a variable length array with a known maximum. I was doing selects on the array elements using an ANY match

[PERFORM] index usage on arrays

2008-02-07 Thread andrew klassen
I am using Postgres 8.2.5. I have a table that has rows containing a variable length array with a known maximum. I was doing selects on the array elements using an ANY match. The performance was not too good as my table got bigger. So I added an index on the array. That didn't help since the

Re: [PERFORM] Benchmark Data requested --- pgloader CE design ideas

2008-02-07 Thread Mark Lewis
> > I was thinking of not even reading the file content from the controller > > thread, just decide splitting points in bytes (0..ST_SIZE/4 - > > ST_SIZE/4+1..2*ST_SIZE/4 etc) and let the reading thread fine-tune by > > beginning to process input after having read first newline, etc. > > The probl

Re: [PERFORM] Benchmark Data requested --- pgloader CE design ideas

2008-02-07 Thread Kenneth Marshall
On Thu, Feb 07, 2008 at 12:06:42PM -0500, Greg Smith wrote: > On Thu, 7 Feb 2008, Dimitri Fontaine wrote: > >> I was thinking of not even reading the file content from the controller >> thread, just decide splitting points in bytes (0..ST_SIZE/4 - >> ST_SIZE/4+1..2*ST_SIZE/4 etc) and let the readin

Re: [PERFORM] Benchmark Data requested --- pgloader CE design ideas

2008-02-07 Thread Matthew
On Thu, 7 Feb 2008, Greg Smith wrote: The problem I was pointing out is that if chunk#2 moved foward a few bytes before it started reading in search of a newline, how will chunk#1 know that it's supposed to read up to that further point? You have to stop #1 from reading further when it catches

Re: [PERFORM] Benchmark Data requested --- pgloader CE design ideas

2008-02-07 Thread Greg Smith
On Thu, 7 Feb 2008, Dimitri Fontaine wrote: I was thinking of not even reading the file content from the controller thread, just decide splitting points in bytes (0..ST_SIZE/4 - ST_SIZE/4+1..2*ST_SIZE/4 etc) and let the reading thread fine-tune by beginning to process input after having read fir

[PERFORM] Index Scan Backward + check additional condition before heap access

2008-02-07 Thread Markus Bertheau
Hi, (PostgreSQL 8.3) I'm trying to optimize one of the most often used queries in our system: (Full minimized pastable schema and data below.) create table feeds_users ( user_id int references users(id) not null, feed_id int references feeds(id) not null, unique(user_id, feed_id) );

Re: [PERFORM] Benchmark Data requested --- pgloader CE design ideas

2008-02-07 Thread Dimitri Fontaine
Le jeudi 07 février 2008, Greg Smith a écrit : >Le mercredi 06 février 2008, Dimitri Fontaine a écrit : >> In other cases, a logical line is a physical line, so we start after first >> newline met from given lseek start position, and continue reading after the >> last lseek position until a newline