Re: [PERFORM] pg_autovacuum not having enough suction ?

2005-03-25 Thread Joshua D. Drake
acuum synchronously > > as part of the batch updating script, I feel. > > I added this to the TODO section for autovacuum: > > o Do VACUUM FULL if table is nearly empty? We should never automatically launch a vacuum full. That seems like a really bad idea. Sincerely,

Re: [PERFORM] How to improve db performance with $7K?

2005-03-25 Thread Joshua D. Drake
it to accomplish the goal. You could build a dual opteron with 4 GB of ram, 12 10k raptor SATA drives with a battery backed cache for about 7k or less. Or if they are not CPU bound just IO bound you could easily just add an external 12 drive array (even if scsi) for less than 7k. Sincerely, Joshua D.

Re: [PERFORM] Sluggish server performance

2005-03-28 Thread Joshua D. Drake
ted... What level is that at? Lastly you may be able to get away with a lower random_page_cost. Sincerely, Joshua D. Drake > > > Here are some of my settings. I can provide more as needed: > > > cat /proc/sys/kernel/shmmax > 175013888 > > max_connections = 100 >

Re: [PERFORM] which dual-CPU hardware/OS is fastest for PostgreSQL?

2005-03-28 Thread Joshua D. Drake
u about using write-cache. You have to explicitly turn it on within the controller bios. They also have optional battery backed cache. Sincerely, Joshua D. Drake > -- Command Prompt, Inc., Your PostgreSQL solutions company. 503-667-4564 Custom programming, 24x7 support, managed services

Re: [PERFORM] Sustained inserts per sec ... ?

2005-04-01 Thread Joshua D. Drake
> What seems to happen is it slams into a "wall" of some sort, the > system goes into disk write frenzy (wait=90% CPU), and eventually > recovers and starts running for a while at a more normal speed. What > I need though, is to not have that wall happen. It is easier for me > to accept a consta

Re: [PERFORM] performance hit for replication

2005-04-12 Thread Joshua D. Drake
experiences, Well with replicator you are going to take a pretty big hit initially during the full sync but then you could use batch replication and only replicate every 2-3 hours. I am pretty sure Slony has similar capabilities. Sincerely, Joshua D. Drake ---

Re: [PERFORM] performance hit for replication

2005-04-12 Thread Joshua D. Drake
Matthew Nuzum wrote: I'm eager to hear your thoughts and experiences, Well with replicator you are going to take a pretty big hit initially during the full sync but then you could use batch replication and only replicate every 2-3 hours. Sincerely, Joshua D. Drake Thanks, I'

Re: [PERFORM] Intel SRCS16 SATA raid?

2005-04-14 Thread Joshua D. Drake
battery backup option as well. Oh and 3ware has BBU for certain models as well. Sincerely, Joshua D. Drake ---(end of broadcast)--- TIP 8: explain analyze is your friend

Re: [PERFORM] How to improve db performance with $7K?

2005-04-14 Thread Joshua D. Drake
ty of companies running databases on SATA without issue. Would I put it on a database that is expecting to have 500 connections at all times? No. Then again, if you have an application with that requirement, you have the money to buy a big fat SCSI array. Sincerely, Joshua D. Drake Postgres apps,

Re: [PERFORM] How to improve db performance with $7K?

2005-04-15 Thread Joshua D. Drake
drives get bad blocks. It doesn't always mean you have to replace the drive but it does mean you need to maintain it and usually at least backup, low level (if scsi) and mark bad blocks. Then restore. Sincerely, Joshua D. Drake /me remembers trying to cram an old donated 5MB (yes M) disk in

Re: [PERFORM] plperl vs plpgsql

2005-04-17 Thread Joshua D. Drake
problem i have with the plpgsql is that the quoting is really a pain. plpgsql but I believe that will change in a short period of time. Sincerely, Joshua D. Drake -- Command Prompt, Inc., Your PostgreSQL solutions company. 503-667-4564 Custom programming, 24x7 support, managed services, and hosting Open

Re: [PERFORM] How to improve db performance with $7K?

2005-04-18 Thread Joshua D. Drake
Alex Turner wrote: Not true - the recommended RAID level is RAID 10, not RAID 0+1 (at least I would never recommend 1+0 for anything). Uhmm I was under the impression that 1+0 was RAID 10 and that 0+1 is NOT RAID 10. Ref: http://www.acnc.com/raid.html Sincerely, Joshua D. Drake

Re: [PERFORM] Foreign key slows down copy/insert

2005-04-18 Thread Joshua D. Drake
then re-enable them after your done with the import. Sincerely, Joshua D. Drake -- Command Prompt, Inc., Your PostgreSQL solutions company. 503-667-4564 Custom programming, 24x7 support, managed services, and hosting Open Source Authors: plPHP, pgManage, Co-Authors: plPerlNG Reliable replication

Re: [PERFORM] Joel's Performance Issues WAS : Opteron vs Xeon

2005-04-23 Thread Joshua D. Drake
t to work fast. Once I am up I can try to learn more about it, I am so glad there are so many folks here willing to take time to educate us newb's. Sincerely, Joshua D. Drake Command Prompt, Inc. ---(end of broadcast)--- TIP 6: Have you s

Re: [PERFORM] Final decision

2005-04-27 Thread Joshua D. Drake
rewriting a complete OSS driver. Sincerely, Joshua D. Drake Command Prompt, Inc. ---(end of broadcast)--- TIP 3: if posting/reading through Usenet, please send an appropriate subscribe-nomail command to [EMAIL PROTECTED] so that your message

Re: [PERFORM] Final decision

2005-04-27 Thread Joshua D. Drake
It is? No-one told the developers... We have mentioned it on the list. http://www.linuxdevcenter.com/pub/a/linux/2002/07/16/drake.html Ooops ;) http://archives.postgresql.org/pgsql-odbc/2005-03/msg00109.php Sincerely, Joshua D. Drake Command Prompt, Inc. -- Your PostgreSQL solutions company

Re: ODBC driver overpopulation (was Re: [PERFORM] Final decision)

2005-04-27 Thread Joshua D. Drake
and that is Command Prompt, If there are others I would like to hear about it because I would rather work with someone than against them. Sincerely, Joshua D. Drake -- Your PostgreSQL solutions provider, Command Prompt, Inc. 24x7 support - 1.800.492.2240, programming, and consulting Home of

Re: [PERFORM] Final decision

2005-04-27 Thread Joshua D. Drake
Dave Page wrote: -Original Message- From: Joshua D. Drake [mailto:[EMAIL PROTECTED] Sent: 27 April 2005 17:46 To: Dave Page Cc: Josh Berkus; Joel Fradkin; PostgreSQL Perform Subject: Re: [PERFORM] Final decision It is? No-one told the developers... We have mentioned it on the list

Re: [PERFORM] Partitioning / Clustering

2005-05-10 Thread Joshua D. Drake
ed stable). Sincerely, Joshua D. Drake ---(end of broadcast)--- TIP 6: Have you searched our list archives? http://archives.postgresql.org ---(end of broadcast)--- TIP 6: Have you searc

Re: [PERFORM] Partitioning / Clustering

2005-05-10 Thread Joshua D. Drake
Neil Conway wrote: Josh Berkus wrote: Don't hold your breath. MySQL, to judge by their first "clustering" implementation, has a *long* way to go before they have anything usable. Oh? What's wrong with MySQL's clustering implementation? Ram only tables :) -Neil ---(end of

Re: [PERFORM] Which is better, correlated subqueries or joins?

2005-05-19 Thread Joshua D. Drake
Hello, It always depends on the dataset but you should try an explain analyze on each query. It will tell you which one is more efficient for your particular data. Sincerely, Joshua D. Drake Here's the join: # explain select child_pid from ssv_product_children, nv_products

Re: [PERFORM] Need help to decide Mysql vs Postgres

2005-05-24 Thread Joshua D. Drake
real RDMS, it is like Oracle or DB2 and comes with a comparable feature set. Only you can decide if that is what you need. Sincerely, Joshua D. Drake Command Prompt, Inc. -- Your PostgreSQL solutions company - Command Prompt, Inc. 1.800.492.2240 PostgreSQL Replication, Consulting, Custom Program

Re: [PERFORM] Need help to decide Mysql vs Postgres

2005-05-24 Thread Joshua D. Drake
slower (which under normal use I don't find to be the case) wouldn't the reliability of PostgreSQL make up for say the 10% net difference in performance? Sincerely, Joshua D. Drake Thanks, Amit -Original Message----- From: Joshua D. Drake [mailto:[EMAIL PROTECTED] Sen

Re: [PERFORM] Adaptec/LSI/?? RAID

2005-06-02 Thread Joshua D. Drake
date anyway). At Command Prompt we have also had some great success with the LSI cards. The only thing we didn't like is the obscure way you have to configure RAID 10. Sincerely, Joshua D. Drake J. Andrew Rogers ---(end of broadcast)--- T

Re: [PERFORM] Postgresql and Software RAID/LVM

2005-06-03 Thread Joshua D. Drake
ction box? What have been your experience? I would not run RAID + LVM in a software scenario. Software RAID is fine however. Sincerely, Joshua D. Drake I don't forsee more 10-15 concurrent sessions running for an their OLTP application. Thanks. Steve Poe

Re: [PERFORM] Postgresql on an AMD64 machine

2005-06-07 Thread Joshua D. Drake
cally Well for Opteron you should also gain from the very high memory bandwidth and the fact that it has I believe "3" FP units per CPU. Sincerely, Joshua D. Drake -- Your PostgreSQL solutions company - Command Prompt, Inc. 1.800.492.2240 PostgreSQL Replication, Consulting, Custom Pr

Re: [PERFORM] Help specifying new web server/database machine

2005-06-08 Thread Joshua D. Drake
Three options: 9500-4LP with Raptor drives 10k rpm, raid 1 + raid 1 9500-8LP with Raptor drives 10k rpm, raid 10 + raid 1 Go for SCSI (LSI Megaraid or ICP Vortex) and take 10k drives If you are going with Raptor drives use the LSI 150-6 SATA RAID with the BBU. Sincerely, Joshua D. Drake

Re: [PERFORM] faster search

2005-06-10 Thread Joshua D. Drake
istid=3 and typeid=9); Sincerely, Joshua D. Drake test - id| integer partnumber| character varying(32) productlistid | integer typeid| integer Indexes: "test_productlistid" btree (productlistid) "test_t

Re: [PERFORM] faster search

2005-06-10 Thread Joshua D. Drake
(productlistid=3 and Hello, Also what happens if you: set enable_seqscan = false; explain analyze query Sincerely, Joshua D. Drake typeid=9); QUERY PLAN -- Seq Scan on test

Re: [PERFORM] faster search

2005-06-10 Thread Joshua D. Drake
= 3) AND (typeid = 9)) Total runtime: 36847.754 ms (3 rows) Time: 36850.719 ms On Fri, 10 Jun 2005, Joshua D. Drake wrote: Clark Slater wrote: hmm, i'm baffled. i simplified the query and it is still taking forever... What happens if you: alter table test alter column productlisti

Re: [PERFORM] faster search

2005-06-10 Thread Joshua D. Drake
Clark Slater wrote: Query should return 132,528 rows. O.k. then the planner is doing fine it looks like. The problem is you are pulling 132,528 rows. I would suggest moving to a cursor which will allow you to fetch in smaller chunks much quicker. Sincerely, Joshua D. Drake vbp=# set

Re: [PERFORM] Configurator project launched

2005-06-21 Thread Joshua D. Drake
me know, I can bump it up on my todo list. Um, can't we just get that from pg_settings? Anyway, I'll be deriving settings from the .conf file, since most of the time the Configurator will be run on a new installation. Aren't most of the settings all kept in the SHOW variables anyw

Re: [PERFORM] ported application having performance issues

2005-06-30 Thread Joshua D. Drake
ld do. Sincerely, Joshua D. Drake JohnM - table definitions - - db=> \d contacts Table "db.contacts" Column|Type | Modifiers --+

Re: [PERFORM] Mount database on RAM disk?

2005-07-07 Thread Joshua D. Drake
erely, Joshua D. Drake I'd also be interested in knowing if this is dependant on whether I am running 7.4, 8.0 or 8.1. -- Your PostgreSQL solutions provider, Command Prompt, Inc. 24x7 support - 1.800.492.2240, programming, and consulting Home of PostgreSQL Replicator, plPHP, pl

Re: [PERFORM] How to revoke a password

2005-07-08 Thread Joshua D. Drake
encrypted password ''; But as I look at pg_shadow there is still a hash... You could do: update pg_shadow set passwd = '' where usename = 'foo'; Sincerely, Joshua D. Drake Larry Bailey Sr. Oracle DBA First American Real Estate Solution (

Re: [PERFORM] How to revoke a password

2005-07-08 Thread Joshua D. Drake
Bailey, Larry wrote: Thanks but it is still prompting for a password. Does your pg_hba.conf require a password? Sincerely, Joshua D. Drake Larry Bailey Sr. Oracle DBA First American Real Estate Solution (714) 701-3347 [EMAIL PROTECTED] -Original Message- From: Joshua D. Drake

Re: [PERFORM] JFS fastest filesystem for PostgreSQL?

2005-07-15 Thread Joshua D. Drake
64 I would be curious as to what options were passed to jfs and xfs. Sincerely, Joshua D. Drake BTW, it'd be interesting to see how UFS on FreeBSD compared. -- Your PostgreSQL solutions company - Command Prompt, Inc. 1.800.492.2240 PostgreSQL Replication, Consulti

Re: [PERFORM] Really bad diskio

2005-07-15 Thread Joshua D. Drake
Ron Wills wrote: Hello all I'm running a postgres 7.4.5, on a dual 2.4Ghz Athlon, 1Gig RAM and an 3Ware SATA raid. 2 drives? 4 drives? 8 drives? RAID 1? 0? 10? 5? Currently the database is only 16G with about 2 tables with 50+ row, one table 20+ row and a few small tables. The l

Re: [PERFORM] Looking for tips

2005-07-19 Thread Joshua D. Drake
Oliver Crosby wrote: Hi, I'm running Postgres 7.4.6 on a dedicated server with about 1.5gigs of ram. Running scripts locally, it takes about 1.5x longer than mysql, and the load on the server is only about 21%. What queries? What is your structure? Have you tried explain analyze? How many rows

Re: [PERFORM] [PATCHES] COPY FROM performance improvements

2005-07-22 Thread Joshua D. Drake
MB in 2.00 seconds = 908.00 MB/sec Timing buffered disk reads: 26 MB in 3.11 seconds = 8.36 MB/sec [EMAIL PROTECTED] root]# Which is just horrible. Sincerely, Joshua D. Drake Patrick Welche wrote: On Thu, Jul 21, 2005 at 09:19:04PM -0700, Luke Lonergan wrote: Joshua, On 7/21/05

Re: [PERFORM] Mirroring PostgreSQL database

2005-07-25 Thread Joshua D. Drake
I just want to know , for immediate data mirroring , what is the best way for PostgreSQL . PostgreSQL is offering many mirror tools , but which one is the best ?. Is there any other way to accomplish the task ? You want to take a look at Slony-I or Mammoth Replicator. http://www.slony.info/

Re: [PERFORM] [PATCHES] COPY FROM performance improvements

2005-07-28 Thread Joshua D. Drake
and faster on my LSI SATA controllers. Sincerely, Joshua D. Drake -- Your PostgreSQL solutions provider, Command Prompt, Inc. 24x7 support - 1.800.492.2240, programming, and consulting Home of PostgreSQL Replicator, plPHP, plPerlNG and pgPHPToolkit http://www.commandprompt.com /

Re: [PERFORM] Table locking problems?

2005-08-09 Thread Joshua D. Drake
is updating? Is the query using indexes? Is the query modifying ALOT of rows? Of course there is also the RTFM of are you analyzing and vacuuming? Sincerely, Joshua D. Drake I'm running 8.0.1 on kernel 2.6.12-3 on 64-bit Opterons if that matters.. -Dan ---

Re: [PERFORM] Speedier count(*)

2005-08-10 Thread Joshua D. Drake
Also, I am using "select ... group by ... order by .. limit 1" to get the min/max since I have already been bit by the issue of min() max() being slower. This specific instance is fixed in 8.1 Sincerely, Joshua D. Drake -Dan ---(end of

Re: [SPAM?] Re: [PERFORM] PG8 Tuning

2005-08-16 Thread Joshua D. Drake
I've been asked this a couple of times and I don't know the answer: what happens if you give XLog a single drive (unmirrored single spindle), and that drive dies? So the question really is, should you be giving two disks to XLog? If that drive dies your restoring from backup. You would need t

Re: [PERFORM] performance drop on RAID5

2005-08-24 Thread Joshua D. Drake
ut over three times faster is disturbing. the postgresql.conf of both machines is here: max_connections = 50 shared_buffers = 1000 # min 16, at least max_connections*2, 8KB each You should look at the annotated conf: http://www.powerpostgresql.com/Downloads/annotated_c

Re: [PERFORM] RAID Configuration Sugestion

2005-08-30 Thread Joshua D. Drake
off to the OS disks without sacrificing the performance and reliability of the database itself. Sincerely, Joshua D. Drake HD's and RAM are cheap enough that you should be able to upgrade in more ways, but do at least that "upgrade"! Beyond that, the best ways to spend you

Re: [PERFORM] RAID Configuration Sugestion

2005-08-30 Thread Joshua D. Drake
is to put everything on one RAID 10. YMMV. Really? That's interesting. My experience is different, I assume SCSI? Software/Hardware Raid? Sincerely, Joshua D. Drake Ron Peacetree ---(end of broadcast)--- TIP 3: Have you checked ou

Re: [PERFORM] About method of PostgreSQL's Optimizer

2005-09-13 Thread Joshua D. Drake
hm) instead of plan constructions used by PostgreSQL. Does anyone know why this method was choosen? Are there any papers or researches about it? You may want to pass this question over to pgsql-hackers. Sincerely, Joshua D. Drake Thank's a lot, Pryscila. -- Your PostgreSQL solutions

Re: [PERFORM] Advice on RAID card

2005-09-25 Thread Joshua D. Drake
make a difference. From my experience software raid works very, very well. However I have never put software raid on anything that is very heavily loaded. I would still use hardware raid if it is very heavily loaded. Sincerely, Joshua D. Drake -- Your PostgreSQL solutions company - Command P

Re: [PERFORM] Advice on RAID card

2005-09-25 Thread Joshua D. Drake
get the performance out of software raid on the high level (think 1 gig of cache) that you would on a software raid setup. It is a bit of a tradeoff but for most installations software raid is more than adequate. Sincerely, Joshua D. Drake -- Your PostgreSQL solutions company -

Re: [PERFORM] Is There Any Way ....

2005-10-04 Thread Joshua D. Drake
reSQL. Sincerely, Joshua D. Drake -- Your PostgreSQL solutions company - Command Prompt, Inc. 1.800.492.2240 PostgreSQL Replication, Consulting, Custom Programming, 24x7 support Managed Services, Shared and Dedicated Hosting Co-Authors: plPHP, plPerlNG - http://www.commandpromp

Re: [HACKERS] [PERFORM] A Better External Sort?

2005-10-05 Thread Joshua D. Drake
to attack. Sincerely, Joshua D. Drake -- Your PostgreSQL solutions company - Command Prompt, Inc. 1.800.492.2240 PostgreSQL Replication, Consulting, Custom Programming, 24x7 support Managed Services, Shared and Dedicated Hosting Co-Authors: plPHP, plPerlNG - http://www.commandp

Re: [PERFORM] browsing table with 2 million records

2005-10-26 Thread Joshua D. Drake
a integer field that is an ID that increments? E.g; serial? > select * from table order by date limit 25 offset 0 You could use a cursor. Sincerely, Joshua D. Drake > > Tables seems properly indexed, with vacuum and analyze ran regularly. > Still this very basic SQLs takes u

Re: [PERFORM] Temporary Table

2005-11-07 Thread Joshua D. Drake
Christian Paul B. Cosinas wrote: I try to run this command in my linux server. VACUUM FULL pg_class; VACUUM FULL pg_attribute; VACUUM FULL pg_depend; But it give me the following error: -bash: VACUUM: command not found That needs to be run from psql ... I choose Polesoft Lockspa

Re: [PERFORM] Hardware/OS recommendations for large databases (

2005-11-16 Thread Joshua D. Drake
e the need for it. The reason you want the dual core cpus is that PostgreSQL can only execute 1 query per cpu at a time, so the application will see a big boost in overall transactional velocity if you push two dual-core cpus into the machine. Joshua D. Drake

Re: [PERFORM] Hardware/OS recommendations for large databases (

2005-11-16 Thread Joshua D. Drake
. I have never had an IDE drive last longer than 3 years (when used in production). That being said, so what. That is what raid is for. You loose a drive and hot swap it back in. Heck keep a hotspare in the trays. Joshua D. Drake I'd expect that a larger number of hotter drives will g

Re: [PERFORM] Hardware/OS recommendations for large databases (

2005-11-16 Thread Joshua D. Drake
a bit extra so your server can generate a ton more heat. Well if you are an Intel/Dell shop running PostgreSQL you have bigger problems ;) Sincerely, Joshua D. Drake ---(end of broadcast)--- TIP 6: explain analyze is your friend

Re: [PERFORM] Hardware/OS recommendations for large databases (

2005-11-17 Thread Joshua D. Drake
that because we are hitting it with 50-100 connections at a time. Joshua D. Drake Alex. ---(end of broadcast)--- TIP 3: Have you checked our extensive FAQ? http://www.postgresql.org/docs/faq ---(e

Re: [PERFORM] What's the best hardver for PostgreSQL 8.1?

2005-12-24 Thread Joshua D. Drake
0 for everything or even most things is not possible. Even if economically feasible. RAID levels are like any other tool. Each is useful in the proper circumstances. There is also RAID 50 which is quite nice. Joshua D. Drake Happy holidays, Ron Peacetree ---(e

Re: [PERFORM] What's the best hardver for PostgreSQL 8.1?

2005-12-24 Thread Joshua D. Drake
the controllers. Interesting, I have had zero problems with Linux and SATA with LSI controllers and hot plug. I wonder what the difference is. The LSI controller even though SATA just uses the scsi driver. Joshua D. Drake - Luke ---(end of broadcast)--

Re: [PERFORM] When to vacuum a table?

2006-11-26 Thread Joshua D. Drake
evils? ;) Joshua D. Drake regards, tom lane ---(end of broadcast)--- TIP 1: if posting/reading through Usenet, please send an appropriate subscribe-nomail command to [EMAIL PROTECTED] so that your message can

Re: [PERFORM] File Systems Compared

2006-12-06 Thread Joshua D. Drake
ted to each MSA. The performance for the money is incredible. Sincerely, Joshua D. Drake > > - Luke > > > > ---(end of broadcast)--- > TIP 5: don't forget to increase your free space map settings > -- ===

Re: [PERFORM] New to PostgreSQL, performance considerations

2006-12-13 Thread Joshua D. Drake
On Wed, 2006-12-13 at 18:36 -0800, Josh Berkus wrote: > Bruce, > > > pgbench is designed to be a general benchmark, meanining it exercises > > all parts of the system. I am thinking just reexecuting a single SELECT > > over and over again would be a better test of the CPU optimizations. > > Most

Re: [PERFORM] URGENT: Out of disk space pg_xlog

2006-12-22 Thread Joshua D. Drake
of entire thing 3. Move pg_xlog somehwere that has space 4. ln postgresql to new pg_xlog directory 5. Start postgresql 6. Look for errors 7. Report back Sincerely. Joshua D. Drake > -- === The PostgreSQL Company: Command Prompt, Inc. === Sales/Support: +1.503.667.4564 || 24x7/Emerg

Re: [PERFORM] PostgreSQL to host e-mail?

2007-01-04 Thread Joshua D. Drake
s. > How much RAM would I need? Lots... which is about all I can tell you without more information. How many customers? Are you using table partitioning? How will you be searching? Full text or regex? Joshua D. Drake > I expect my users to have a 10GB quota per > e-m

Re: [PERFORM] High update activity, PostgreSQL vs BigDBMS

2007-01-06 Thread Joshua D. Drake
> Regarding shared_buffers=750MB, the last discussions I remember on this > subject said that anything over 10,000 (8K buffers = 80 MB) had unproven > benefits. So I'm surprised to see such a large value suggested. I'll > certainly give it a try and see what happens. > That is old news :) A

Re: [PERFORM] High update activity, PostgreSQL vs BigDBMS

2007-01-07 Thread Joshua D. Drake
Count(*) still seems to use a full table scan rather than an index scan. > There is a TODO out there to help this. Don't know if it will get done. Joshua D. Drake -- === The PostgreSQL Company: Command Prompt, Inc. === Sales/Support: +1.503.667.4564 || 24x7/Emergency: +1.80

Re: [PERFORM] max() versus order/limit (WAS: High update

2007-01-15 Thread Joshua D. Drake
Luke Lonergan wrote: > Adam, > > This optimization would require teaching the planner to use an index for > MAX/MIN when available. It seems like an OK thing to do to me. Uhmmm I thought we did that already in 8.1? Joshua D. Drake > > - Luke > >> -Original M

Re: [PERFORM] Monitoring Transaction Log size

2007-01-17 Thread Joshua D. Drake
Ziegelwanger, Silvio wrote: > Hi, > > > > how can I monitor the size of the transaction log files using SQL Statements? You can't. You would have to write a custom function to heck the size of the xlog directory. Sincerely, Joshua D. Drake > > > >

Re: [PERFORM] Configuration Advice

2007-01-17 Thread Joshua D. Drake
refer to the other actually helpful posts on the topic. Sincerely, Joshua D. Drake > > ---(end of broadcast)--- > TIP 5: don't forget to increase your free space map settings > -- === The PostgreSQL Company: Command Pr

Re: [PERFORM] [pgsql-advocacy] Postgres and really huge tables

2007-01-18 Thread Joshua D. Drake
in the world would you do that? That is what partitioning is for. Regardless, appropriate use of things like partial indexes should make it possible. Joshua D. Drake > > Brian > > > > ---(end of broadcast)--- > TIP 7: You can hel

Re: [HACKERS] [PERFORM] how to plan for vacuum?

2007-01-25 Thread Joshua D. Drake
n the system. Most of our systems run anywhere from 10-25ms. I find that any more than that, Vacuum takes too long. Joshua D. Drake -- === The PostgreSQL Company: Command Prompt, Inc. === Sales/Support: +1.503.667.4564 || 24x7/Emergency: +1.800.492.2240 Providing the most comprehen

Re: [PERFORM] trouble with a join on OS X

2007-02-02 Thread Joshua D. Drake
ully for exactly this purpose. > > Now he's got to worry about how to page through 8GB of results in something > less than geological time with the space bar ;-) \o /tmp/really_big_cursor_return ;) Joshua D. Drake > > - Luke > > > > ---

Re: [PERFORM] trouble with a join on OS X

2007-02-02 Thread Joshua D. Drake
Luke Lonergan wrote: >> \o /tmp/really_big_cursor_return >> >> ;) > > Tough crowd :-D Yeah well Andrew probably would have said use sed and pipe it through awk to get the data you want. Joshua D. Drake > > - Luke > > > > --

Re: [PERFORM] trouble with a join on OS X

2007-02-02 Thread Joshua D. Drake
Geoffrey wrote: > Joshua D. Drake wrote: >> Luke Lonergan wrote: >>>> \o /tmp/really_big_cursor_return >>>> >>>> ;) >>> Tough crowd :-D >> >> Yeah well Andrew probably would have said use sed and pipe it through >> awk to get

Re: [PERFORM] trouble with a join on OS X

2007-02-02 Thread Joshua D. Drake
esults of the join. If there > is a way to do this without a SELECT, please share. INSERT INTO foo SELECT * FROM BAR JOIN baz USING (id) Joshua D. Drake > > ---(end of broadcast)--- > TIP 4: Have you searched our list archives? > &g

Re: [PERFORM] slow update on 1M rows (worse with indexes)

2007-02-22 Thread Joshua D. Drake
n i tried adding an index to the table on the column date (int) that > stores unix timestamps. > TOTO=# CREATE INDEX versions_index ON versions_9d (date); > (-60M) disk space goes down on index creation > [EMAIL PROTECTED]:~$ time psql TOTO -c "UPDATE versions_9d SET flag=9" > UPDATE 976009 > real

Re: [PERFORM] which Xeon processors don't have the context switching problem

2007-02-23 Thread Joshua D. Drake
; including AMD and Sparc. It's just *worse* on the PIII and P4 generation > Xeons. > Also isn't it pretty much *not* a problem with current versions of PostgreSQL? Joshua D. Drake -- === The PostgreSQL Company: Command Prompt, Inc. === Sales/Support: +1.503.667.4564

Re: [PERFORM] which Xeon processors don't have the context switching problem

2007-02-24 Thread Joshua D. Drake
They are all different *major* releases. IMO, nobody should be running anything less than 8.1.8. Sincerely, Joshua D. Drake -- === The PostgreSQL Company: Command Prompt, Inc. === Sales/Support: +1.503.667.4564 || 24x7/Emergency: +1.800.492.2240 Providing the most comprehensive Postg

Re: [PERFORM] Writting a "search engine" for a pgsql DB

2007-02-26 Thread Joshua D. Drake
ying hardware will be important, > but a sane as possible query structure helps to start with. See search.postgresql.org, you can download all source from gborg.postgresql.org. Joshua D. Drake > > Thanks all!! > > Madison > > ---(end of broadcast)---

Re: [PERFORM] low memory usage reported by 'top' indicates poor tuning?

2007-02-26 Thread Joshua D. Drake
Mark Stosberg wrote: > Hello, > > I'm trying to make sense of the memory usage reported by 'top', compared > to what "pg_database_size" shows. Here's one result:' You are missing the most important parts of the equation: 1. What version of PostgreSQL. 2. What operating system -- scratch , I s

Re: [PERFORM] Writting a "search engine" for a pgsql DB

2007-02-26 Thread Joshua D. Drake
>>> So I am hoping some of you guys and gals might be able to point me >>> towards some resources or offer some tips or gotcha's before I get >>> started on this. I'd really like to come up with a more intelligent >>> search engine that doesn't take two minutes to return results. :) I >>> know,

Re: [PERFORM] increasing database connections

2007-02-28 Thread Joshua D. Drake
discussion, these are on systems with 4+ cores. Usually 8+ and significant ram 16/32 gig fo ram. Sincerely, Joshua D. Drake > -- === The PostgreSQL Company: Command Prompt, Inc. === Sales/Support: +1.503.667.4564 || 24x7/Emergency: +1.800.492.2240 Providing the most comp

Re: [PERFORM] increasing database connections

2007-03-01 Thread Joshua D. Drake
one installation which runs with > 5000+ connections, and it works fine. We have one that high as well and it does fine. Although I wouldn't suggest it on less than 8.1 ;). 8.2 handles it even better since 8.2 handles >8 cores better than 8.1. Joshua D. Drake -- === The P

Re: [PERFORM] strange performance regression between 7.4 and 8.1

2007-03-01 Thread Joshua D. Drake
in the old sun server. I've tried > adjusting just about every option in the postgres config file, but > performance remains the same. Any ideas? Vacuum? Analayze? default_statistics_target? How many shared_buffers? effective_cache_size? work_mem? Sincerely, Joshua D. Drake

Re: [PERFORM] strange performance regression between 7.4 and 8.1

2007-03-01 Thread Joshua D. Drake
\ >> Is the SAN being shared between the database servers and other >> servers? Maybe >> it was just random timing that gave you the poor write performance on >> the old >> server which might be also yielding occassional poor performance on >> the new >> one. >> > > The direct attached scsi discs

Re: [PERFORM] strange performance regression between 7.4 and 8.1

2007-03-01 Thread Joshua D. Drake
Alex Deucher wrote: > On 3/1/07, Joshua D. Drake <[EMAIL PROTECTED]> wrote: >> \ >> >> Is the SAN being shared between the database servers and other >> >> servers? Maybe >> >> it was just random timing that gave you the poor write performanc

Re: [PERFORM] stats collector process high CPU utilization

2007-03-02 Thread Joshua D. Drake
Bruce Momjian wrote: > Sorry, I introduced this bug. To the gallows with you! :) Don't feel bad, there were several hackers that missed the math on that one. Joshua D. Drake > > --- > > Tom Lan

Re: [PERFORM] Autocommit in libpq

2007-03-13 Thread Joshua D. Drake
transaction, and COMMIT to commit it. Other > than that, no. > And very on topic, you need to upgrade ASAP to the latest 7.4.x. Joshua D. Drake -- === The PostgreSQL Company: Command Prompt, Inc. === Sales/Support: +1.503.667.4564 || 24x7/Emergency: +1.800.492.2240 Providing the m

Re: [PERFORM] Postgres batch write very slow - what to do

2007-03-16 Thread Joshua D. Drake
femski wrote: > Folks ! > > I have a batch application that writes approx. 4 million rows into a narrow > table. I am using JDBC addBatch/ExecuteBatch with auto commit turned off. > Batch size is 100. So far I am seeing Postgres take roughly five times the > time it takes to do this in the Oracle.

Re: [PERFORM] Postgres batch write very slow - what to do

2007-03-16 Thread Joshua D. Drake
Carlos Moreno wrote: > Joshua D. Drake wrote: > >> insert into foo(bar) values (bang) (bong) (bing) ...? >> >> >> > > Nit pick (with a "correct me if I'm wrong" disclaimer :-)) : > > Wouldn't t

Re: [PERFORM] SATA RAID: Promise vs. 3ware

2007-03-20 Thread Joshua D. Drake
> Is this technically a good idea to take Promise instead of 3ware or > rather I definitely should insist on 3ware and wait for it? Use 3Ware they are proven to provide a decent raid controller for SATA/PATA. Promise on the other hand... not so much. Joshua D. Drake > &g

Re: [PERFORM] linux - server configuration for small database

2007-03-23 Thread Joshua D. Drake
s/postgresql/binary/v8.2.3/linux/rpms/redhat/ Sincerely, Joshua D. Drake -- === The PostgreSQL Company: Command Prompt, Inc. === Sales/Support: +1.503.667.4564 || 24x7/Emergency: +1.800.492.2240 Providing the most comprehensive PostgreSQL solutions since 1997 http://www.c

Re: [PERFORM] How to enable jdbc???

2007-03-27 Thread Joshua D. Drake
Michael Dengler wrote: Hi, In postgres 7.4.* I had to pass --with-java to the configure script for jdbc support. Does postgres 8.2* include it by default? If not, how do I enable it? Just download the driver from jdbc.postgresql.org Thanks Miguel ---(end of broadc

Re: [PERFORM] Improving performance on system catalog

2007-03-28 Thread Joshua D. Drake
probably gain from calling the specific query underneath instead of calling the view pg_stat_user_tables. Joshua D. Drake -- === The PostgreSQL Company: Command Prompt, Inc. === Sales/Support: +1.503.667.4564 || 24x7/Emergency: +1.800.492.2240 Providing the most comprehensive PostgreSQL

Re: [PERFORM] scalablility problem

2007-03-31 Thread Joshua D. Drake
anged with PostgreSQL since 7.3 (7.3 is really god awful old) that allow it to more effectively access shared memory and thus provide better performance. Joshua D. Drake -- === The PostgreSQL Company: Command Prompt, Inc. === Sales/Support: +1.503.667.4564 || 24x7/Emergency: +1.800.492

Re: [PERFORM] SCSI vs SATA

2007-04-04 Thread Joshua D. Drake
others in the general and enterprise marketplace? SATAII brute forces itself through some of its performance, for example 16MB write cache on each drive. Sincerely, Joshua D. Drake -- === The PostgreSQL Company: Command Prompt, Inc. === Sales/Support: +1.503.667.4564 || 24x7/Emergency: +1.8

Re: [PERFORM] SCSI vs SATA

2007-04-04 Thread Joshua D. Drake
off the cache? world) or rely on the OS/raidcontroller implementing some sort of FUA/write barrier feature(which linux for example only does in pretty recent kernels) Sincerely, Joshua D. Drake Stefan ---(end of broadcast)--- TIP 6: explain

Re: [PERFORM] SCSI vs SATA

2007-04-04 Thread Joshua D. Drake
difference. OTOH, the SCSI discs were way less reliable than the SATA discs, that might have been bad luck. Probably bad luck. I find that SCSI is very reliable, but I don't find it any more reliable than SATA. That is assuming correct ventilation etc... Sincerely, Joshua D.

  1   2   3   4   5   6   >