Re: [PERFORM] How to unique-ify HUGE table?

2008-12-24 Thread Kynn Jones
Thank you all for the very helpful advice. Upping work_mem made it possible for me to generate the table within this century without bringing the server to a near standstill. I have not yet experimented with GROUP BY, but I'll do this next. Cheers, Kynn

[PERFORM] How to unique-ify HUGE table?

2008-12-23 Thread Kynn Jones
. Even printing it out to a file takes forever, let alone creating an index for it. Any words of wisdom on how to speed this up would be appreciated. TIA! Kynn

[PERFORM] How to profile an SQL script?

2008-12-03 Thread Kynn Jones
it took to execute? Thanks! Kynn

Re: [PERFORM] How to profile an SQL script?

2008-12-03 Thread Kynn Jones
Andreas, Heikki: Thanks! Kynn

[PERFORM] Performance and IN clauses

2008-11-18 Thread Kynn Jones
! Kynn

[PERFORM] The many nulls problem

2008-03-14 Thread Kynn Jones
the number of exceptional cases is small enough to warrant a second table? Of course, one could do a systematic profiling of various possible scenarios, but as a first approximation what's your rule-of-thumb? TIA! Kynn

Re: [PERFORM] The many nulls problem

2008-03-14 Thread Kynn Jones
On Fri, Mar 14, 2008 at 3:46 PM, Heikki Linnakangas [EMAIL PROTECTED] wrote: tons of useful info snipped From performance point of view, I would go with a single table with NULL fields on PostgreSQL. Wow. I'm so glad I asked! Thank you very much! Kynn

Re: [PERFORM] The many nulls problem

2008-03-14 Thread Kynn Jones
On Fri, Mar 14, 2008 at 2:59 PM, Oleg Bartunov [EMAIL PROTECTED] wrote: have you seen contrib/hstore ? You can have one table with common attributes and hide others in hstore That's interesting. I'll check it out. Thanks! Kynn

Re: [PERFORM] Joins and DELETE FROM

2008-03-11 Thread Kynn Jones
down. That's a very helpful reminder. Thanks. Kynn

Re: [PERFORM] Q on views and performance

2008-02-26 Thread Kynn Jones
On Mon, Feb 25, 2008 at 11:56 AM, Matthew [EMAIL PROTECTED] wrote: On Mon, 25 Feb 2008, Kynn Jones wrote: This is just GREAT!!! It fits the problem to a tee. It makes the queries quick then? It is good that you ask. Clearly you know the story: a brilliant-sounding optimization

Re: [PERFORM] Q on views and performance

2008-02-25 Thread Kynn Jones
On Mon, Feb 25, 2008 at 8:45 AM, Matthew [EMAIL PROTECTED] wrote: On Fri, 22 Feb 2008, Kynn Jones wrote: Hi. I'm trying to optimize... (Q1) SELECT a1.word, a2.word FROM T a1 JOIN T a2 USING ( zipk ) WHERE a1.type = int1 AND a2.type = int2; Okay, try

Re: [PERFORM] Q on views and performance

2008-02-23 Thread Kynn Jones
On Fri, Feb 22, 2008 at 8:48 PM, Dean Gibson (DB Administrator) [EMAIL PROTECTED] wrote: On 2008-02-22 12:49, Kynn Jones wrote: Of course, I expect that using views Vint1 and Vint2... would result in a loss in performance relative to a version that used bona fide tables Tint1 and Tint2

Re: [PERFORM] Q on views and performance

2008-02-23 Thread Kynn Jones
On Fri, Feb 22, 2008 at 8:48 PM, Dean Gibson (DB Administrator) [EMAIL PROTECTED] wrote: On 2008-02-22 12:49, Kynn Jones wrote: Of course, I expect that using views Vint1 and Vint2... would result in a loss in performance relative to a version that used bona fide tables Tint1 and Tint2

Re: [PERFORM] Q on views and performance

2008-02-23 Thread Kynn Jones
before I can post the EXPLAIN results.) kynn

[PERFORM] Q on views and performance

2008-02-22 Thread Kynn Jones
, and many thanks in advance for your comments! Kynn P.S. Here are the actual form of the queries. They now include an initial join with table S, and the join with Tint2 (or Vint2) is a left outer join. Interestingly, even though the queries below that use views (i.e. Q1*** and Q2

[PERFORM] Basic Q on superfluous primary keys

2007-04-14 Thread Kynn Jones
Consider these two very similar schemas: Schema 1: CREATE TABLE foo ( id serial PRIMARY KEY, frobnitz character(varying 100) NOT NULL UNIQUE ); CREATE TABLE bar ( id serial PRIMARY KEY, foo_id int REFERENCES foo(id) ) Schema 2: CREATE TABLE foo ( frobnitz character(varying 100)

[PERFORM] Optimizing a huge_table/tiny_table join

2006-05-30 Thread kynn
I want to optimize this simple join: SELECT * FROM huge_table h, tiny_table t WHERE UPPER( h.id ) = UPPER( t.id ) huge_table has about 2.5 million records, can be assumed as fixed, and has the following index: CREATE INDEX huge_table_index ON huge_table( UPPER( id ) ); ...while tiny_table

[PERFORM] Optimizing a huge_table/tiny_table join

2006-05-30 Thread kynn
[ I had a problem with my mailer when I first sent this. My apologies for any repeats. ] I want to optimize this simple join: SELECT * FROM huge_table h, tiny_table t WHERE UPPER( h.id ) = UPPER( t.id ) huge_table has about 2.5 million records, can be assumed as fixed, and has the

Re: [PERFORM] Optimizing a huge_table/tiny_table join

2006-05-30 Thread Kynn Jones
On 5/24/06, Tom Lane [EMAIL PROTECTED] wrote: [EMAIL PROTECTED] writes:Limit(cost=19676.75..21327.99 rows=6000 width=84)-Hash Join(cost=19676.75..1062244.81 rows=3788315 width=84)Hash Cond: (upper((outer.id)::text) = upper((inner.id)::text))-Seq Scan on huge_table h(cost= 0.00..51292.43

Re: [PERFORM] Optimizing a huge_table/tiny_table join

2006-05-25 Thread kynn
On 5/24/06, Tom Lane [EMAIL PROTECTED] wrote: [EMAIL PROTECTED] writes: Limit (cost=19676.75..21327.99 rows=6000 width=84) - Hash Join (cost=19676.75..1062244.81 rows=3788315 width=84) Hash Cond: (upper((outer.id)::text) upper((inner.id)::text)) - Seq Scan on

[PERFORM] Optimizing a huge_table/tiny_table join

2006-05-24 Thread kynn
I want to optimize this simple join: SELECT * FROM huge_table h, tiny_table t WHERE UPPER( h.id ) = UPPER( t.id ) huge_table has about 2.5 million records, can be assumed as fixed, and has the following index: CREATE INDEX huge_table_index ON huge_table( UPPER( id ) ); ...while tiny_table