Re: [PERFORM] libgcc double-free, backend won't die

2007-12-11 Thread Alvaro Herrera
. The third-party library (OpenBabel) has been tested pretty thoroughly by me an others and has no memory corruption problems. All malloc's are freed properly. Does that seem like a possibility? Not really. palloc uses malloc underneath. -- Alvaro Herrera Valdivia, Chile ICBM: S 39º 49' 18.1

Re: [PERFORM] libgcc double-free, backend won't die

2007-12-11 Thread Alvaro Herrera
Craig James wrote: Alvaro Herrera wrote: Craig James wrote: Here is my guess -- and this is just a guess. My functions use a third-party library which, of necessity, uses malloc/free in the ordinary way. I suspect that there's a bug in the Postgres palloc() code that's walking over memory

Re: [PERFORM] libgcc double-free, backend won't die

2007-12-11 Thread Alvaro Herrera
Craig James wrote: Alvaro Herrera wrote: Craig James wrote: Alvaro Herrera wrote: Craig James wrote: Here is my guess -- and this is just a guess. My functions use a third-party library which, of necessity, uses malloc/free in the ordinary way. I suspect that there's a bug

Re: [PERFORM] database tuning

2007-12-11 Thread Alvaro Herrera
: http://www.postgresql.org/docs/8.3/static/storage-page-layout.html -- Alvaro Herrera http://www.amazon.com/gp/registry/DXLWNGRJD34J Siempre hay que alimentar a los dioses, aunque la tierra esté seca (Orual) ---(end of broadcast

Re: [PERFORM] Cost-Based Vacuum Delay tuning

2007-12-08 Thread Alvaro Herrera
stuff. -- Alvaro Herrera http://www.amazon.com/gp/registry/CTMLCN8V17R4 La experiencia nos dice que el hombre peló millones de veces las patatas, pero era forzoso admitir la posibilidad de que en un caso entre millones, las patatas pelarían al hombre (Ijon Tichy

Re: [PERFORM] Configuring a Large RAM PostgreSQL Server

2007-11-29 Thread Alvaro Herrera
. Perhaps you just have a maintenance_work_mem setting that's too large for your server. -- Alvaro Herrerahttp://www.advogato.org/person/alvherre Uno puede defenderse de los ataques; contra los elogios se esta indefenso ---(end of broadcast

Re: [PERFORM] TB-sized databases

2007-11-28 Thread Alvaro Herrera
but not least, it would be *excelent* that this kind of optimization would be posible without weird non standard sql sentences. Right. If you can afford to sponsor development, it could make them a reality sooner. -- Alvaro Herrera Valdivia, Chile ICBM: S 39º 49' 18.1, W 73º 13' 56.4 You're

Re: [PERFORM] Curious about dead rows.

2007-11-14 Thread Alvaro Herrera
in question. You do all three on the same tables? That seems pretty pointless. A sole CLUSTER has the same effect. Do I need to do a VACUUM FULL ANALYZE instead? No. -- Alvaro Herrera Valdivia, Chile ICBM: S 39º 49' 18.1, W 73º 13' 56.4 There was no reply (Kernel Traffic

Re: [PERFORM] Curious about dead rows.

2007-11-14 Thread Alvaro Herrera
- there are no deletes The only other source of dead rows I can think is triggers ... do you have any? (Not necessarily on this table -- perhaps triggers on other tables can cause updates on this one). Oh, rolled back COPY can cause dead rows too. -- Alvaro Herrera http

Re: [PERFORM] Curious about dead rows.

2007-11-13 Thread Alvaro Herrera
. (Actually it works even when you're not using mailing lists at all). -- Alvaro Herrera http://www.amazon.com/gp/registry/CTMLCN8V17R4 If it wasn't for my companion, I believe I'd be having the time of my life (John Dunbar) ---(end of broadcast

Re: [PERFORM] Curious about dead rows.

2007-11-13 Thread Alvaro Herrera
Trevor Talbot escribió: On 11/13/07, Alvaro Herrera [EMAIL PROTECTED] wrote: Jean-David Beyer wrote: Andrew Sullivan wrote: I'm not a private support organisation; please send your replies to the list, not me. Sorry. Most of the lists I send to have ReplyTo set, but a few do

Re: [PERFORM] difference between a unique constraint and a unique index ???

2007-11-12 Thread Alvaro Herrera
queries, whereas the other one is going to be used for = queries. So you need to keep both indexes. -- Alvaro Herrera http://www.amazon.com/gp/registry/5ZYLFMCVHXC Officer Krupke, what are we to do? Gee, officer Krupke, Krup you! (West Side Story, Gee, Officer Krupke

Re: [PERFORM] Can I Determine if AutoVacuum Does Anything?

2007-11-09 Thread Alvaro Herrera
is actually with big tables, for which it doesn't make much of a difference. -- Alvaro Herrerahttp://www.CommandPrompt.com/ PostgreSQL Replication, Consulting, Custom Development, 24x7 support ---(end of broadcast

Re: [PERFORM] Need to run CLUSTER to keep performance

2007-11-08 Thread Alvaro Herrera
the table much more often, say every few minutes. Your table is 2536 pages long, but it could probably be in the vicinity of 700 ... -- Alvaro Herrerahttp://www.CommandPrompt.com/ PostgreSQL Replication, Consulting, Custom Development, 24x7 support

Re: [Fwd: Re: [PERFORM] Outer joins and Seq scans]

2007-11-02 Thread Alvaro Herrera
our lives a bit better (at least along a certain axis). -- Alvaro Herrera http://www.PlanetPostgreSQL.org/ The problem with the future is that it keeps turning into the present (Hobbes) ---(end of broadcast)--- TIP 6

Re: [PERFORM] 12 hour table vacuums

2007-10-23 Thread Alvaro Herrera
vacuum_cost_limit = 100 Isn't this a bit high? What happens if you cut the delay to, say, 10? (considering you've lowered the limit to half the default) -- Alvaro Herrera Developer, http://www.PostgreSQL.org/ Someone said that it is at least an order of magnitude more

Re: [PERFORM] 12 hour table vacuums

2007-10-23 Thread Alvaro Herrera
. (It's also much less of a problem in 8.2). -- Alvaro Herrerahttp://www.CommandPrompt.com/ The PostgreSQL Company - Command Prompt, Inc. ---(end of broadcast)--- TIP 7: You can help support the PostgreSQL project

Re: [PERFORM] 12 hour table vacuums

2007-10-23 Thread Alvaro Herrera
Ron St-Pierre wrote: Alvaro Herrera wrote: Ron St-Pierre wrote: Okay, here's our system: postgres 8.1.4 Upgrade to 8.1.10 Any particular fixes in 8.1.10 that would help with this? I don't think so, but my guess is that you really want to avoid the autovacuum bug which

Re: [PERFORM] Vacuum goes worse

2007-10-17 Thread Alvaro Herrera
that noise from vacuum and make it appear on a view. 8.4 material all of this, of course. -- Alvaro Herrera http://www.amazon.com/gp/registry/CTMLCN8V17R4 Estoy de acuerdo contigo en que la verdad absoluta no existe... El problema es que la mentira sí existe y tu estás mintiendo

Re: [PERFORM] Vacuum goes worse

2007-10-17 Thread Alvaro Herrera
. -- Alvaro Herrerahttp://www.CommandPrompt.com/ The PostgreSQL Company - Command Prompt, Inc. ---(end of broadcast)--- TIP 5: don't forget to increase your free space map settings

Re: [PERFORM] Huge amount of memory consumed during transaction

2007-10-17 Thread Alvaro Herrera
51788 940 postgres: autovacuum launcher process 51924 1236 postgres: stats collector process 22256 896 -- Alvaro Herrerahttp://www.CommandPrompt.com/ The PostgreSQL Company - Command Prompt, Inc

Re: [PERFORM] query plan worse after analyze

2007-10-06 Thread Alvaro Herrera
is dealing with the several different ways of wrapping). If there are any takers I would be very thankful. -- Alvaro Herrerahttp://www.CommandPrompt.com/ PostgreSQL Replication, Consulting, Custom Development, 24x7 support ---(end

Re: [PERFORM] Query taking too long. Problem reading explain output.

2007-10-04 Thread Alvaro Herrera
. If this weren't misestimated, it wouldn't be using those nested loops. -- Alvaro Herrerahttp://www.CommandPrompt.com/ PostgreSQL Replication, Consulting, Custom Development, 24x7 support ---(end of broadcast

Re: [PERFORM] Query taking too long. Problem reading explain output.

2007-10-04 Thread Alvaro Herrera
. -- Alvaro Herrera http://www.amazon.com/gp/registry/CTMLCN8V17R4 Este mail se entrega garantizadamente 100% libre de sarcasmo. ---(end of broadcast)--- TIP 4: Have you searched our list archives? http

Re: [PERFORM] Possible explanations for catastrophic performace deterioration?

2007-09-23 Thread Alvaro Herrera
problem disappear... I wonder if I should then periodically run a vacuum full --- say, once a week? Once a month? Never. What you need to do is make sure your FSM settings (fsm_max_pages in particular) are high enough, and that you VACUUM (not full) frequently enough. -- Alvaro Herrera

Re: [PERFORM] Possible explanations for catastrophic performance deterioration?

2007-09-23 Thread Alvaro Herrera
not distinguish pages which have no live tuples from other pages, so it has to load them all. -- Alvaro Herrera http://www.amazon.com/gp/registry/CTMLCN8V17R4 [PostgreSQL] is a great group; in my opinion it is THE best open source development communities in existence anywhere

Re: [PERFORM] Query planner unaware of possibly best plan

2007-09-21 Thread Alvaro Herrera
be different because I've tuned the query planner's parameters. Why did you set enable_sort=off? It's not like sorting 9 rows is going to take any noticeable amount of time anyway. -- Alvaro Herrerahttp://www.advogato.org/person/alvherre No hay hombre que no aspire a la

Re: [PERFORM] Long Running Commits - Not Checkpoints

2007-09-13 Thread Alvaro Herrera
I should add, there are 6 back ends running on this disk array (different servers and different data partitions) with these bgwriter settings. Maybe it is running deferred triggers or something? -- Alvaro Herrerahttp://www.advogato.org/person/alvherre I suspect most

Re: [PERFORM] [Again] Postgres performance problem

2007-09-12 Thread Alvaro Herrera
, REINDEX does not rewrite tables. If there are dead tuples, they will still be there after REINDEX. cluster, otoh, rewrites the table into index order. ... excluding dead tuples, and then rewrites all the indexes. -- Alvaro Herrerahttp://www.CommandPrompt.com

Re: [PERFORM] Reasonable amount of indices

2007-09-06 Thread Alvaro Herrera
for actual optimization (which happens to be a more normalized model), far more effective than the partial indexes you are suggesting. -- Alvaro Herrerahttp://www.CommandPrompt.com/ The PostgreSQL Company - Command Prompt, Inc. ---(end

Re: [PERFORM] Performance on 8CPU's and 32GB of RAM

2007-09-06 Thread Alvaro Herrera
performance improvements still to be reported), but that doesn't help those poor users still on 8.2. -- Alvaro Herrera http://www.amazon.com/gp/registry/DXLWNGRJD34J Los dioses no protegen a los insensatos. Éstos reciben protección de otros insensatos mejor dotados (Luis Wu, Mundo

Re: [PERFORM] Performance on 8CPU's and 32GB of RAM

2007-09-05 Thread Alvaro Herrera
it is vacuuming a table? It causes I/O. Not sure what else you have in mind. vacuum_delay throttles the I/O usage, at the expense of longer vacuum times. -- Alvaro Herrerahttp://www.CommandPrompt.com/ PostgreSQL Replication, Consulting, Custom Development, 24x7

Re: [PERFORM] Performance on 8CPU's and 32GB of RAM

2007-09-04 Thread Alvaro Herrera
high I/O load. Maybe you should fix that. -- Alvaro Herrerahttp://www.CommandPrompt.com/ PostgreSQL Replication, Consulting, Custom Development, 24x7 support ---(end of broadcast)--- TIP 9: In versions below 8.0

Re: [PERFORM] 8.2 Autovacuum BUG ?

2007-08-31 Thread Alvaro Herrera
are transactions too. They just don't modify data. -- Alvaro Herrerahttp://www.CommandPrompt.com/ PostgreSQL Replication, Consulting, Custom Development, 24x7 support ---(end of broadcast)--- TIP 4: Have you searched

Re: [PERFORM] 8.2 Autovacuum BUG ?

2007-08-31 Thread Alvaro Herrera
Mikko Partio escribió: Off-topic question: the documentation says that XID numbers are 32 bit. Could the XID be 64 bit when running on a 64 bit platform? That would effectively prevent wrap-around issues. No, because they would take too much space in tuple headers. -- Alvaro Herrera

Re: [PERFORM] 8.2 Autovacuum BUG ?

2007-08-31 Thread Alvaro Herrera
that were just frozen, but it will generate logs for tuples that weren't frozen. How many of these there are, depends on how many tuples you inserted after the batch that was just frozen. If you want to freeze the whole table completely, you can you VACUUM FREEZE. -- Alvaro Herrera

Re: [PERFORM] Optimising in queries

2007-08-23 Thread Alvaro Herrera
of this thread. I don't think you showed us the EXPLAIN ANALYZE results that Scott requested. -- Alvaro Herrerahttp://www.CommandPrompt.com/ PostgreSQL Replication, Consulting, Custom Development, 24x7 support ---(end of broadcast

Re: [PERFORM] Autovacuum is running forever

2007-08-21 Thread Alvaro Herrera
second. #autovacuum_vacuum_scale_factor = 0.4 #autovacuum_analyze_scale_factor = 0.2 These too. Try 0.1 for both and see how it goes. In short, you need autovacuum to run _way more often_ than you are. -- Alvaro Herrerahttp://www.advogato.org/person/alvherre Un

Re: [PERFORM] Simple select hangs while CPU close to 100% - Analyze

2007-08-17 Thread Alvaro Herrera
that the table contains many different values, which makes it turn the initial hashed aggregation into a sort plus group aggregation. This allows the aggregation to use less memory. As an exercise, see an EXPLAIN of the query, both before and after the analyze, and study the difference. -- Alvaro Herrera

Re: [PERFORM] Performance Solaris vs Linux

2007-08-17 Thread Alvaro Herrera
anybody else has the same experience? You haven't specified where the slowness is. Is it that connection establishing is slower? Are queries slower? Is the hardware comparable? Are the filesystems configured similarly? -- Alvaro Herrera http://www.amazon.com/gp/registry

Re: [PERFORM] Indexscan is only used if we use limit n

2007-08-15 Thread Alvaro Herrera
be slow. -- Alvaro Herrera http://www.amazon.com/gp/registry/DXLWNGRJD34J Puedes vivir solo una vez, pero si lo haces bien, una vez es suficiente ---(end of broadcast)--- TIP 2: Don't 'kill -9' the postmaster

Re: [PERFORM] TRUNCATE TABLE

2007-08-01 Thread Alvaro Herrera
a bug report ? Were you able to show that turning off autovacuum removes the performance problem? -- Alvaro Herrerahttp://www.CommandPrompt.com/ PostgreSQL Replication, Consulting, Custom Development, 24x7 support ---(end of broadcast

Re: RES: [PERFORM] Improving select peformance

2007-08-01 Thread Alvaro Herrera
) - Hash Join (cost=1.34..3356.99 rows=28 width=145) (actual time=0.215..15.225 rows=414 loops=1) Hash Cond: ((gra.codcor)::text = ((div.codite)::text || ''::text)) -- Alvaro Herrera http://www.amazon.com/gp/registry/CTMLCN8V17R4 Uno combate

Re: [PERFORM] deadlock detected when calling function (Call function_name)

2007-07-31 Thread Alvaro Herrera
for ShareLock on transaction 5098760; blocked by process 21172. What Postgres version is this? -- Alvaro Herrerahttp://www.CommandPrompt.com/ The PostgreSQL Company - Command Prompt, Inc. ---(end of broadcast)--- TIP 6

Re: [PERFORM] select on 1milion register = 6s

2007-07-29 Thread Alvaro Herrera
not 100% sure. That's correct (of course you need start_collector on as well). Most likely, autovacuum is not even running. -- Alvaro Herrerahttp://www.CommandPrompt.com/ The PostgreSQL Company - Command Prompt, Inc. ---(end of broadcast

Re: [PERFORM] User concurrency thresholding: where do I look?

2007-07-27 Thread Alvaro Herrera
Lock Id Combined Time (ns) postgres`LWLockAcquire+0x1f0 postgres`CommitTransaction+0x104 Yeah, ProcArrayLock is pretty contended. I think it would be kinda neat if we could split it up in partitions. This lock is quite particular though. -- Alvaro

Re: [PERFORM] disable archiving

2007-07-23 Thread Alvaro Herrera
Paul van den Bogaard wrote: the manual somewhere states ... if archiving is enabled... To me this implies that archiving can be disabled. However I cannot find the parameter to use to get this result. Archiving is disabled by not setting archive_command. -- Alvaro Herrera

Re: [PERFORM] User concurrency thresholding: where do I look?

2007-07-19 Thread Alvaro Herrera
you are seeing a lower number for some users and higher for others (simpler/more complex queries). This is just a guess though. No profiling or measuring at all, really. -- Alvaro Herrera http://www.amazon.com/gp/registry/5ZYLFMCVHXC How amazing is that? I call it a night

Re: [PERFORM] User concurrency thresholding: where do I look?

2007-07-19 Thread Alvaro Herrera
of tables (say 300k). -- Alvaro Herrerahttp://www.CommandPrompt.com/ The PostgreSQL Company - Command Prompt, Inc. ---(end of broadcast)--- TIP 2: Don't 'kill -9' the postmaster

Re: [PERFORM] TRUNCATE TABLE

2007-07-13 Thread Alvaro Herrera
generate_series(1, 5000); truncate van_os; times are closer to 8-13 ms. I guess the difference is the amount of data that ext3 is logging on its journal. My ext3 journal settings are default. -- Alvaro Herrera Valdivia, Chile ICBM: S 39º 49' 18.1, W 73º 13' 56.4 ¿Que diferencia tiene para los

Re: [PERFORM] Database Statistics???

2007-07-13 Thread Alvaro Herrera
smiley2211 wrote: Thanks Tom and Scott...that worked for a NEW database but not on the original SLOW database...meaning - I backed up the SLOW database and restored it to a NEW database and the query ran EXTREMELY FAST :clap: Have you ever vacuumed the DB? -- Alvaro Herrera

Re: [PERFORM] Direct I/O

2007-07-06 Thread Alvaro Herrera
with the filesystem features, at which point I shut up or they shut me down. -- Alvaro Herrerahttp://www.CommandPrompt.com/ The PostgreSQL Company - Command Prompt, Inc. ---(end of broadcast)--- TIP 5: don't forget to increase

Re: [PERFORM] Query is taking 5 HOURS to Complete on 8.1 version

2007-07-05 Thread Alvaro Herrera
the EXPLAIN ANALYZE again. It would be extremely helpful if you saved it in a file and attached it separately so that the indentation and whitespace is not mangled by your email system. It would be a lot more readable that way. -- Alvaro Herrerahttp

Re: [PERFORM] PostgreSQL 8.0 occasionally slow down

2007-06-29 Thread Alvaro Herrera
. -- Alvaro Herrerahttp://www.CommandPrompt.com/ The PostgreSQL Company - Command Prompt, Inc. ---(end of broadcast)--- TIP 4: Have you searched our list archives? http://archives.postgresql.org

Re: [PERFORM] Database-wide VACUUM ANALYZE

2007-06-26 Thread Alvaro Herrera
wraparound. -- Alvaro Herrera http://www.flickr.com/photos/alvherre/ La soledad es compañía ---(end of broadcast)--- TIP 4: Have you searched our list archives? http://archives.postgresql.org

Re: [PERFORM] Database-wide VACUUM ANALYZE

2007-06-22 Thread Alvaro Herrera
, that is. -- Alvaro Herrera http://www.amazon.com/gp/registry/5ZYLFMCVHXC The only difference is that Saddam would kill you on private, where the Americans will kill you in public (Mohammad Saleh, 39, a building contractor) ---(end of broadcast

Re: [PERFORM] Performance query about large tables, lots of concurrent access

2007-06-20 Thread Alvaro Herrera
you should be looking at is whether you can forget vacuuming the whole database in one go, and make it more granular. -- Alvaro Herrera http://www.flickr.com/photos/alvherre/ Having your biases confirmed independently is how scientific progress is made, and hence made our

Re: [PERFORM] Performance query about large tables, lots of concurrent access

2007-06-20 Thread Alvaro Herrera
Karl Wright wrote: Alvaro Herrera wrote: Karl Wright wrote: (b) the performance of individual queries had already degraded significantly in the same manner as what I'd seen before. You didn't answer whether you had smaller, more frequently updated tables that need more vacuuming

Re: [PERFORM] Performance query about large tables, lots of concurrent access

2007-06-20 Thread Alvaro Herrera
Karl Wright wrote: Alvaro Herrera wrote: Karl Wright wrote: I am afraid that I did answer this. My largest tables are the ones continually being updated. The smaller ones are updated only infrequently. Can you afford to vacuum them in parallel? Hmm, interesting question. If VACUUM

Re: [PERFORM] Performance query about large tables, lots of concurrent access

2007-06-19 Thread Alvaro Herrera
all the time? If so, that's where the problem lies. -- Alvaro Herrera http://www.amazon.com/gp/registry/CTMLCN8V17R4 Cómo ponemos nuestros dedos en la arcilla del otro. Eso es la amistad; jugar al alfarero y ver qué formas se pueden sacar del otro (C. Halloway en La Feria de las

Re: [PERFORM] Performance query about large tables, lots of concurrent access

2007-06-19 Thread Alvaro Herrera
Karl Wright wrote: Alvaro Herrera wrote: Karl Wright wrote: This particular run lasted four days before a VACUUM became essential. The symptom that indicates that VACUUM is needed seems to be that the CPU usage of any given postgresql query skyrockets. Is this essentially correct

Re: [PERFORM] Performance query about large tables, lots of concurrent access

2007-06-19 Thread Alvaro Herrera
increasing it, with ALTER TABLE ... SET STATISTICS, rerun analyze, and try again. -- Alvaro Herrerahttp://www.CommandPrompt.com/ The PostgreSQL Company - Command Prompt, Inc. ---(end of broadcast)--- TIP 7: You can help

Re: [PERFORM] VACUUM vs auto-vacuum daemon

2007-06-12 Thread Alvaro Herrera
of table alvherre.public.foo: index scans: 0 pages: 45 removed, 0 remain tuples: 1 removed, 0 remain system usage: CPU 0.00s/0.00u sec elapsed 0.01 sec LOG: automatic analyze of table alvherre.public.foo system usage: CPU 0.00s/0.00u sec elapsed 0.00 sec -- Alvaro Herrera

Re: [PERFORM] VERY slow queries at random

2007-06-07 Thread Alvaro Herrera
if you want it to interfere less with your regular operation. -- Alvaro Herrerahttp://www.CommandPrompt.com/ The PostgreSQL Company - Command Prompt, Inc. ---(end of broadcast)--- TIP 3: Have you checked our extensive FAQ

Re: [PERFORM] Getting Slow

2007-06-07 Thread Alvaro Herrera
if autovacuum is eating all your I/O you may want to look into throttling it back a bit by setting autovacuum_vacuum_cost_delay to a non-zero value. -- Alvaro Herrerahttp://www.advogato.org/person/alvherre La tristeza es un muro entre dos jardines (Khalil Gibran

Re: [PERFORM] performance drop on 8.2.4, reverting to 8.1.4

2007-06-07 Thread Alvaro Herrera
, *within* a single large transaction :-( Yeah that's probably not very solvable for the moment. -- Alvaro Herrera Valdivia, Chile ICBM: S 39º 49' 18.1, W 73º 13' 56.4 Ninguna manada de bestias tiene una voz tan horrible como la humana (Orual) ---(end of broadcast

Re: [PERFORM] Getting Slow

2007-06-07 Thread Alvaro Herrera
Tom Lane wrote: Alvaro Herrera [EMAIL PROTECTED] writes: Also if autovacuum is eating all your I/O you may want to look into throttling it back a bit by setting autovacuum_vacuum_cost_delay to a non-zero value. BTW, why is it that autovacuum_cost_delay isn't enabled by default? I can

Re: [PERFORM] upgraded to pgsql 8.2.4, getting worse performance then 7.4.x

2007-06-04 Thread Alvaro Herrera
at the eliminatecc option in the Majordomo user web pages. -- Alvaro Herrerahttp://www.CommandPrompt.com/ The PostgreSQL Company - Command Prompt, Inc. ---(end of broadcast)--- TIP 7: You can help support the PostgreSQL project

Re: [PERFORM] Big problem with sql update operation

2007-05-29 Thread Alvaro Herrera
. -- Alvaro Herrerahttp://www.advogato.org/person/alvherre The Postgresql hackers have what I call a NASA space shot mentality. Quite refreshing in a world of weekend drag racer developers. (Scott Marlowe) ---(end of broadcast

Re: [PERFORM] general PG network slowness (possible cure) (repost)

2007-05-25 Thread Alvaro Herrera
Peter T. Breuer escribió: I really think it would be worthwhile getting some developer to tell me where the network send is done in PG. See src/backend/libpq/pqcomm.c (particularly internal_flush()). -- Alvaro Herrerahttp://www.CommandPrompt.com

Re: [PERFORM] Big problem with sql update operation

2007-05-25 Thread Alvaro Herrera
environment one with production DB copy and second genereated with minimal data set and it is odd that update presented above on copy of production is executing 170ms but on small DB it executing 6s How are you vacuuming the tables? -- Alvaro Herrerahttp

Re: [PERFORM] LIKE search and performance

2007-05-24 Thread Alvaro Herrera
. -- Alvaro Herrera http://www.flickr.com/photos/alvherre/ Puedes vivir solo una vez, pero si lo haces bien, una vez es suficiente ---(end of broadcast)--- TIP 2: Don't 'kill -9' the postmaster

Re: [PERFORM] Postgres Benchmark Results

2007-05-21 Thread Alvaro Herrera
client providing input. Or was I wrong? My impression is that you are correct in theory -- this is the commit delay feature. But it seems that the feature does not work as well as one would like; and furthermore, it is disabled by default. -- Alvaro Herrerahttp

Re: [PERFORM] 121+ million record table perf problems

2007-05-18 Thread Alvaro Herrera
Craig James wrote: Better yet, if you can stand a short down time, you can drop indexes on that column, truncate, then do 121 million inserts, and finally reindex. That will be MUCH faster. Or you can do a CLUSTER, which does all the same things automatically. -- Alvaro Herrera

Re: [PERFORM] [doc patch] a slight VACUUM / VACUUM FULL doc improvement proposal

2007-05-16 Thread Alvaro Herrera
faster workaround. -- Alvaro Herrerahttp://www.CommandPrompt.com/ The PostgreSQL Company - Command Prompt, Inc. ---(end of broadcast)--- TIP 4: Have you searched our list archives? http

Re: [PERFORM] [doc patch] a slight VACUUM / VACUUM FULL doc improvement proposal

2007-05-16 Thread Alvaro Herrera
supposedly be faster. -- Alvaro Herrerahttp://www.CommandPrompt.com/ PostgreSQL Replication, Consulting, Custom Development, 24x7 support ---(end of broadcast)--- TIP 2: Don't 'kill -9' the postmaster

Re: [PERFORM] Many to many join seems slow?

2007-05-15 Thread Alvaro Herrera
AND tp.translation_id = t.translation_id AND t.language_id = l.language_id AND l.name = 'French' ; Please provide an EXPLAIN ANALYZE of the query. -- Alvaro Herrerahttp://www.CommandPrompt.com/ The PostgreSQL Company - Command Prompt, Inc

Re: [PERFORM] How to Run a pg_stats Query

2007-05-15 Thread Alvaro Herrera
stats_reset_on_server_start = true Stats are present on all databases. As for the name of the tables, try pg_stat_user_tables and pg_stat_activity for starters. There are a lot more; check the documentation or a \d pg_stat* in psql. -- Alvaro Herrerahttp

Re: [PERFORM] estimating the need for VACUUM FULL and REINDEX

2007-05-11 Thread Alvaro Herrera
the last vacuum, which was cumbersome and not very effective (because they were lost on restart for example). Also, the new autovac has some features that the old one didn't have. Ability to set per-table configuration for example. -- Alvaro Herrerahttp

Re: ZFS and Postgresql - WASRe: [PERFORM] Best OS for Postgres 8.2

2007-05-09 Thread Alvaro Herrera
). But of course the philosophy is where should it be done (ZFS or PostgreSQL). Checksums on WAL are not optional in Postgres, because AFAIR they are used to determine when it should stop recovering. -- Alvaro Herrerahttp://www.CommandPrompt.com/ PostgreSQL

Re: [PERFORM] Performance Woes

2007-05-09 Thread Alvaro Herrera
actually expect it to cause extra system load (as opposed to user) rather than IO, but I'm not sure. -- Alvaro Herrerahttp://www.CommandPrompt.com/ The PostgreSQL Company - Command Prompt, Inc. ---(end of broadcast

Re: [PERFORM] specific query (not all) on Pg8 MUCH slower than Pg7

2007-05-08 Thread Alvaro Herrera
obtain a plan faster than this one. -- Alvaro Herrerahttp://www.CommandPrompt.com/ The PostgreSQL Company - Command Prompt, Inc. ---(end of broadcast)--- TIP 2: Don't 'kill -9' the postmaster

Re: [PERFORM] What's The Difference Between VACUUM and VACUUM ANALYZE?

2007-05-08 Thread Alvaro Herrera
VACUUM, except that it also runs an ANALYZE afterwards. -- Alvaro Herrerahttp://www.CommandPrompt.com/ The PostgreSQL Company - Command Prompt, Inc. ---(end of broadcast)--- TIP 9: In versions below 8.0, the planner

Re: [PERFORM] What's The Difference Between VACUUM and VACUUM ANALYZE?

2007-05-08 Thread Alvaro Herrera
Steinar H. Gunderson wrote: On Tue, May 08, 2007 at 05:52:13PM -0400, Alvaro Herrera wrote: I am trying to follow a message thread. One guy says we should be running vacuum analyze daily and the other says we should be running vacuum multiple times a day. I have tried looking for what

Re: [PERFORM] Foreign Key Deadlocking

2007-04-19 Thread Alvaro Herrera
the triggers insert deltas records; to get the sum, add them all. Periodically, take the deltas and apply them to the totals. -- Alvaro Herrerahttp://www.CommandPrompt.com/ PostgreSQL Replication, Consulting, Custom Development, 24x7 support ---(end

Re: [PERFORM] SCSI vs SATA

2007-04-04 Thread Alvaro Herrera
is quite different from failure of a disk array (in case there is one). -- Alvaro Herrerahttp://www.CommandPrompt.com/ The PostgreSQL Company - Command Prompt, Inc. ---(end of broadcast)--- TIP 2: Don't 'kill -9

Re: [PERFORM] SCSI vs SATA

2007-04-04 Thread Alvaro Herrera
a spare disk to let the array controller replace the broken one as soon as it breaks, but yeah, that would be more or less the procedure. There is a way to defer the walk/drive until a more convenient opportunity presents. -- Alvaro Herrerahttp://www.CommandPrompt.com

Re: [PERFORM] Parallel Vacuum

2007-03-22 Thread Alvaro Herrera
Dimitri escribió: On Thursday 22 March 2007 14:52, Alvaro Herrera wrote: Dimitri escribió: Folks, is there any constrains/problems/etc. to run several vacuum processes in parallel while each one is 'vaccuming' one different table? No, no problem. Keep in mind that if one

Re: [PERFORM] Execution plan changed after upgrade from 7.3.9 to 8.2.3

2007-03-13 Thread Alvaro Herrera
the other plan seems to be more elaborate -- I wonder if you have disabled bitmap scan, merge joins, in 8.2? Try a SHOW enable_mergejoin in psql. -- Alvaro Herrerahttp://www.CommandPrompt.com/ The PostgreSQL Company - Command Prompt, Inc

Re: [PERFORM] Execution plan changed after upgrade from 7.3.9 to 8.2.3

2007-03-13 Thread Alvaro Herrera
'enable_%'; -- Alvaro Herrerahttp://www.CommandPrompt.com/ The PostgreSQL Company - Command Prompt, Inc. ---(end of broadcast)--- TIP 4: Have you searched our list archives? http://archives.postgresql.org

Re: [PERFORM] [EMAIL PROTECTED]: Progress on scaling of FreeBSD on 8 CPU systems]

2007-03-02 Thread Alvaro Herrera
think this suggests that the MySQL deficiency was rather a performance bug in Linux, not in MySQL itself ... -- Alvaro Herrerahttp://www.CommandPrompt.com/ The PostgreSQL Company - Command Prompt, Inc. ---(end of broadcast

Re: [PERFORM] strange performance regression between 7.4 and 8.1

2007-03-02 Thread Alvaro Herrera
and related opclasses, right? That helps for LIKE queries in non-C locales (though you do have to keep almost-duplicate indexes). -- Alvaro Herrerahttp://www.CommandPrompt.com/ PostgreSQL Replication, Consulting, Custom Development, 24x7 support

Re: [PERFORM] which Xeon processors don't have the context switching problem

2007-02-23 Thread Alvaro Herrera
. -- Alvaro Herrerahttp://www.CommandPrompt.com/ The PostgreSQL Company - Command Prompt, Inc. ---(end of broadcast)--- TIP 3: Have you checked our extensive FAQ? http://www.postgresql.org/docs/faq

Re: [PERFORM] Auto-Vacuum in 8.1 was ineffective for me. 8.2 may work better?

2007-02-21 Thread Alvaro Herrera
://people.planetpostgresql.org/mha/index.php?/archives/134-8.1-on-win32-pgstat-and-autovacuum.html -- Alvaro Herrerahttp://www.CommandPrompt.com/ PostgreSQL Replication, Consulting, Custom Development, 24x7 support ---(end of broadcast

Re: [PERFORM] Auto-Vacuum in 8.1 was ineffective for me. 8.2 may work better?

2007-02-21 Thread Alvaro Herrera
Mark Stosberg wrote: Alvaro Herrera wrote: Mark Stosberg wrote: When I upgraded a busy database system to PostgreSQL 8.1, I was excited about AutoVacuum, and promptly enabled it, and turned off the daily vacuum process. ( I set the following, as well as the option to enable auto

Re: [PERFORM] Not Picking Index

2007-02-16 Thread Alvaro Herrera
Gauri Kanekar escribió: I want the planner to ignore a specific index. I am testing some query output. For that purpose i dont want the index. I that possible to ignore a index by the planner. Sure: BEGIN DROP INDEX foo SELECT ROLLBACK -- Alvaro Herrera

Re: [PERFORM] Question about Bitmap Heap Scan/BitmapAnd

2007-02-15 Thread Alvaro Herrera
cond of Bitmap Index Scan is in the filter? Is it also a consequence of the code you pointed? It is in the filter, is it not? Having a recheck would be redundant. -- Alvaro Herrerahttp://www.CommandPrompt.com/ The PostgreSQL Company - Command Prompt, Inc

Re: [PERFORM] stats collector process high CPU utilization

2007-02-09 Thread Alvaro Herrera
preventing that in 8.2? -- Alvaro Herrerahttp://www.CommandPrompt.com/ PostgreSQL Replication, Consulting, Custom Development, 24x7 support ---(end of broadcast)--- TIP 1: if posting/reading through Usenet, please send

Re: [PERFORM] Querying distinct values from a large table

2007-01-30 Thread Alvaro Herrera
is more impressive in PHB terms. -- Alvaro Herrerahttp://www.CommandPrompt.com/ PostgreSQL Replication, Consulting, Custom Development, 24x7 support ---(end of broadcast)--- TIP 9: In versions below 8.0, the planner

Re: [PERFORM] Querying distinct values from a large table

2007-01-30 Thread Alvaro Herrera
Luke Lonergan wrote: Alvaro, On 1/30/07 9:04 AM, Alvaro Herrera [EMAIL PROTECTED] wrote: (Incidentally I'm not sure where 2-5x comes from. It's entirely dependant on your data distribution. It's not hard to come up with distributions where it's 1000x as fast and others where

<    1   2   3   4   5   >