Re: [PERFORM] Slow query

2004-06-09 Thread scott.marlowe
On Tue, 24 Feb 2004, Ivan Voras wrote: > -> Nested Loop (cost=1.04..788.76 rows=3 width=500) (actual > time=4078.85..20185.89 rows=38999 loops=1) > -> Nested Loop (cost=1.04..771.27 rows=3 width=485) > (actual time=4078.71..14673.27 rows=38999 loops=1) >

Re: [PERFORM] General performance questions about postgres on Apple

2004-06-05 Thread scott.marlowe
On Fri, 20 Feb 2004, Sean Shanny wrote: > max_connections = 100 > > # - Memory - > > shared_buffers = 16000 # min 16, at least max_connections*2, > 8KB each > sort_mem = 256000 # min 64, size in KB You might wanna drop sort_mem somewhat and just set it during your impor

Re: [PERFORM] Tables on multiple disk drives

2004-06-03 Thread scott.marlowe
On Tue, 17 Feb 2004, Craig Thomas wrote: > > On Tue, 17 Feb 2004, Konstantin Tokar wrote: > > > >> Hi! > >> Does PostgreSQL allow to create tables and indices of a single > >> database on multiple disk drives with a purpose of increase > >> performance as Oracle database does? If a symbolic refere

Re: [PERFORM] Disappointing performance in db migrated from MS SQL

2004-06-03 Thread scott.marlowe
On Fri, 13 Feb 2004 [EMAIL PROTECTED] wrote: > > Josh, the disks in the new system should be substantially faster than > > the old. Both are Ultra160 SCSI RAID 5 arrays, but the new system has > > 15k RPM disks, as opposed to the 10k RPM disks in the old system. > > Spindle speed does not correla

Re: [ADMIN] [PERFORM] Quad processor options

2004-05-12 Thread scott.marlowe
On Wed, 12 May 2004, Grega Bremec wrote: > ...and on Tue, May 11, 2004 at 03:02:24PM -0600, scott.marlowe used the keyboard: > > > > If you get the LSI megaraid, make sure you're running the latest megaraid > > 2 driver, not the older, slower 1.18 series. If you ar

Re: [PERFORM] Quad processor options

2004-05-11 Thread scott.marlowe
On Tue, 11 May 2004, Allan Wind wrote: > On 2004-05-11T15:29:46-0600, scott.marlowe wrote: > > The other nice thing about the LSI cards is that you can install >1 and > > the act like one big RAID array. i.e. install two cards with a 20 drive > > RAID0 then make a RAID1

Re: [PERFORM] Configuring PostgreSQL to minimize impact of checkpoints

2004-05-11 Thread scott.marlowe
On Tue, 11 May 2004, Rob Sell wrote: > > If you don't mind slumming on ebay :-) keep an eye out for PERC III cards, > they are dell branded LSI cards. Perc = Power Edge Raid Controller. There > are models on there dual channel u320 and dell usually sells them with > battery backed cache. That's

Re: [PERFORM] Configuring PostgreSQL to minimize impact of checkpoints

2004-05-11 Thread scott.marlowe
On Tue, 11 May 2004, Paul Tuckfield wrote: > Love that froogle. > > It looks like a nice card. One thing I didn't get straight is if > the cache is writethru or write back. > > If the original posters problem is truly a burst write problem (and not > linux caching or virtual memory overcom

Re: [PERFORM] Quad processor options

2004-05-11 Thread scott.marlowe
On Tue, 11 May 2004, Bjoern Metzdorf wrote: > scott.marlowe wrote: > > Sure, adaptec makes one, so does lsi megaraid. Dell resells both of > > these, the PERC3DI and the PERC3DC are adaptec, then lsi in that order, I > > believe. We run the lsi megaraid with 64 megs

Re: [PERFORM] Quad processor options

2004-05-11 Thread scott.marlowe
On Tue, 11 May 2004, Bjoern Metzdorf wrote: > scott.marlowe wrote: > > > Well, from what I've read elsewhere on the internet, it would seem the > > Opterons scale better to 4 CPUs than the basic Xeons do. Of course, the > > exception to this is SGI's altix

Re: [PERFORM] Configuring PostgreSQL to minimize impact of checkpoints

2004-05-11 Thread scott.marlowe
On Tue, 11 May 2004, Paul Tuckfield wrote: > If you are having a "write storm" or bursty writes that's burying > performance, a scsi raid controler with writeback cache will greatly > improve the situation, but I do believe they run around $1-2k. If > it's write specific problem, the cache ma

Re: [PERFORM] Quad processor options

2004-05-11 Thread scott.marlowe
On Tue, 11 May 2004, Bjoern Metzdorf wrote: > Hi, > > I am curious if there are any real life production quad processor setups > running postgresql out there. Since postgresql lacks a proper > replication/cluster solution, we have to buy a bigger machine. > > Right now we are running on a dual

Re: [PERFORM] Configuring PostgreSQL to minimize impact of checkpoints

2004-05-11 Thread scott.marlowe
On Tue, 11 May 2004 [EMAIL PROTECTED] wrote: > Quoting Rob Fielding <[EMAIL PROTECTED]>: > > > Assuming you're running with optimal schema and index design (ie you're > > not doing extra work unnecessarily), and your backend has > > better-then-default config options set-up (plenty of tips arou

Re: [PERFORM] Help how to tune-up my Database

2004-05-10 Thread scott.marlowe
Sorry about that, I meant kbytes, not megs. My point being it's NOT measured in 8k blocks, like a lot of other settings. sorry for the mixup. On Fri, 7 May 2004, Bricklen wrote: > scott.marlowe wrote: > > sort_mem might do with a small bump, especially if you're only

Re: [PERFORM] Why queries takes too much time to execute?

2004-05-10 Thread scott.marlowe
On Mon, 10 May 2004, Anderson Boechat Lopes wrote: > Hum... now i think i´m beginning to understand. > > The vacuum analyse is recommended to perform at least every day, after > adding or deleting a large number of records, and not vacuum full analyse. > I´ve performed the vacuum full ana

Re: [PERFORM] Help how to tune-up my Database

2004-05-07 Thread scott.marlowe
On Fri, 7 May 2004, Michael Ryan S. Puncia wrote: > Hi, > > I am a newbie here and just starting to use postgresql. My > problems is how to tune up my server because it its too slow. First, read this: http://www.varlena.com/varlena/GeneralBits/Tidbits/perf.html > This is my PC spec

Re: [PERFORM] [OFF-TOPIC] - Known maximum size of the PostgreSQL

2004-05-05 Thread scott.marlowe
On Sat, 5 Jun 2004, Carlos Eduardo Smanioto wrote: > Hello all, > > What's the case of bigger database PostgreSQL (so greate and amount of > registers) that they know??? http://www.postgresql.org/docs/faqs/FAQ.html#4.5 ---(end of broadcast)--- TI

Re: [PERFORM] cache table

2004-05-04 Thread scott.marlowe
On Mon, 3 May 2004, Joseph Shraibman wrote: > I have a big table with some int fields. I frequently need to do > queries like: > > SELECT if2, count(*) FROM table WHERE if1 = 20 GROUP BY if2; > > The problem is that this is slow and frequently requires a seqscan. I'd > like to cache the resul

Re: [PERFORM] [ADMIN] 7.4.2 out of memory

2004-04-28 Thread scott.marlowe
On Wed, 28 Apr 2004, Jie Liang wrote: > All, > After I upgraded postgres from 7.3.4 to 7.4.2, one of my program got following error: > DRROR:out of memory > DETAIL: Fail on request of size 92. > > any idea?? > does memory management have big difference between 7.3.4 and 7.4.2??? > t

Re: [PERFORM] index usage

2004-04-28 Thread scott.marlowe
On Mon, 26 Apr 2004, Stephan Szabo wrote: > > On Fri, 23 Apr 2004 [EMAIL PROTECTED] wrote: > > > I have a query which I think should be using an index all of the time but > > postgres only uses the index part of the time. The index > > (ticket_crm_map_crm_id_suppid) has the where clause column

Re: [PERFORM] OT: Help with performance problems

2004-04-27 Thread scott.marlowe
On Mon, 26 Apr 2004, Rob Fielding wrote: > scott.marlowe wrote: > > On Fri, 23 Apr 2004, Chris Hoover wrote: > > > > > >>DB's on Powervaults 220S using raid 5 (over 6 disks) > > > > > > What controller is this, the adaptec? We'

Re: [PERFORM] Help with performance problems

2004-04-23 Thread scott.marlowe
On Fri, 23 Apr 2004, Chris Hoover wrote: > On Friday 23 April 2004 13:21, scott.marlowe wrote: > > On Fri, 23 Apr 2004, Chris Hoover wrote: > > > DB's on Powervaults 220S using raid 5 (over 6 disks) > > > > What controller is this, the adaptec? We'v

Re: [PERFORM] Help with performance problems

2004-04-23 Thread scott.marlowe
On Fri, 23 Apr 2004, Chris Hoover wrote: > DB's on Powervaults 220S using raid 5 (over 6 disks) What controller is this, the adaptec? We've found it to be slower than the LSI megaraid based controller, but YMMV. > Running RH ES 2.1 Are you running the latest kernel for ES 2.1? Early 2.4 kern

Re: [PERFORM] Looking for ideas on how to speed up warehouse loading

2004-04-23 Thread scott.marlowe
On Thu, 22 Apr 2004, Sean Shanny wrote: > I should have included this as well: > fsync | on > shared_buffers | 4000 > sort_mem | 64000 For purposes of loading only, you can try turning off fsync, assuming this is a virgin load an

Re: [PERFORM] Setting Shared Buffers , Effective Cache, Sort Mem

2004-04-22 Thread scott.marlowe
On Thu, 22 Apr 2004, Pallav Kalva wrote: > Hi > > We are in the process of building a new machine for our production > database. Below you will see some of the harware specs for the machine. > I need some help with setting these parameters (shared buffers, > effective cache, sort mem) in t

Re: [PERFORM] Wierd context-switching issue on Xeon

2004-04-19 Thread scott.marlowe
On Mon, 19 Apr 2004, Bruce Momjian wrote: > Josh Berkus wrote: > > Tom, > > > > > So in the short term I think we have to tell people that Xeon MP is not > > > the most desirable SMP platform to run Postgres on. (Josh thinks that > > > the specific motherboard chipset being used in these machine

Re: [PERFORM] Postgresql educational sources

2004-04-07 Thread scott.marlowe
On Wed, 7 Apr 2004, Nid wrote: > Rather than ask some general, unanswerable question on how to tune my > database...I thought I ask where I might find an introduction to...or > manual/tutorial for the depths of managing a postgres db. Books? > Websites? Assume a basic to intermediate knowled

Re: [PERFORM] good pc but bad performance,why?

2004-04-07 Thread scott.marlowe
On Wed, 7 Apr 2004, Andrew McMillan wrote: > On Wed, 2004-04-07 at 20:56, huang yaqin wrote: > > Hello, Richard Huxton, > > > > You said turning fsync off may cause losing data, that's terrible. > > I use SCSI disk, and file system is ext3. I tune postgresql.conf and can't ge

Re: [PERFORM] atrocious update performance

2004-04-05 Thread scott.marlowe
On Mon, 5 Apr 2004, Kevin Barnard wrote: > On 5 Apr 2004 at 12:05, Rosser Schwarz wrote: > > > Just this morning, however, I created a copy of the target table (all > > 4.7M rows), with absolutely no foreign keys referring to it, and ran > > the update against the copy. That update took 2300 sec

Re: [PERFORM] postgres eating CPU on HP9000

2004-03-26 Thread scott.marlowe
On Tue, 23 Mar 2004, Fabio Esposito wrote: > > Hello fellow PostgreSQL users. > > We've been working on this interesting issue for some time now, and we're > hoping that someone can help. > > We've recently integrated postgres into an existing mature app. Its a > time sensitive 24x7 system. I

Re: [PERFORM] odd planner choice

2004-03-26 Thread scott.marlowe
On Thu, 25 Mar 2004, Ara Anjargolian wrote: > I've run into this odd planner choice which I don't quite understand. > > I have two tables articles, users and > articles.article_id and users.user_id are primary keys. > > Insides articles there are two optional fields author_id1, author_id2 > whic

Re: [PERFORM] postgres eating CPU on HP9000

2004-03-26 Thread scott.marlowe
On Fri, 26 Mar 2004, Fabio Esposito wrote: > > On Fri, 26 Mar 2004, scott.marlowe wrote: > > > > It maintains 48hours of data, so its not a large database; roughly > > > <600mbs. We do this by running a housekeeping program in a cron job. > > > It de

Re: [PERFORM] slow vacuum performance

2004-03-24 Thread scott.marlowe
On Wed, 24 Mar 2004, pginfo wrote: > Hi, > > scott.marlowe wrote: > > > On Wed, 24 Mar 2004, pginfo wrote: > > > > > Hi, > > > > > > I am running pg 7.4.1 on linux box. > > > I have a midle size DB with many updates and after it I try

Re: [PERFORM] slow vacuum performance

2004-03-24 Thread scott.marlowe
On Wed, 24 Mar 2004, pginfo wrote: > Hi, > > I am running pg 7.4.1 on linux box. > I have a midle size DB with many updates and after it I try to run > vacuum full analyze. Is there a reason to not use just regular vacuum / analyze (i.e. NOT full)? > It takes about 2 h. Full vacuums, by the

Re: [PERFORM] [ADMIN] Benchmarking postgres on Solaris/Linux

2004-03-23 Thread scott.marlowe
On Tue, 23 Mar 2004, Josh Berkus wrote: > Matt, Stalin, > > > As for the compute intensive side (complex joins & sorts etc), the Dell will > most likely beat the Sun by some distance, although > > what the Sun lacks in CPU power it may make up a bit in memory bandwidth/ > latency. > > Personall

Re: [PERFORM] [ADMIN] syslog slowing the database?

2004-03-15 Thread scott.marlowe
On Mon, 15 Mar 2004, Bruce Momjian wrote: > scott.marlowe wrote: > > On Thu, 11 Mar 2004, Christopher Kings-Lynne wrote: > > > > > > You could also consider not using syslog at all: let the postmaster > > > > output to its stderr, and pipe that into a log-r

Re: [PERFORM] [ADMIN] syslog slowing the database?

2004-03-15 Thread scott.marlowe
On Thu, 11 Mar 2004, Christopher Kings-Lynne wrote: > > You could also consider not using syslog at all: let the postmaster > > output to its stderr, and pipe that into a log-rotation program. > > I believe some people use Apache's log rotator for this with good > > results. > > Not an option I'm

Re: [PERFORM] optimizing large query with IN (...)

2004-03-10 Thread scott.marlowe
On Wed, 10 Mar 2004, Marcus Andree S. Magalhaes wrote: > > Guys, > > I got a Java program to tune. It connects to a 7.4.1 postgresql server > running Linux using JDBC. > > The program needs to update a counter on a somewhat large number of > rows, about 1200 on a ~130k rows table. The query is

Re: [PERFORM] Scaling further up

2004-03-04 Thread scott.marlowe
On Thu, 4 Mar 2004, Paul Thomas wrote: > On 03/03/2004 18:23 scott.marlowe wrote: > > [snip] > > There are three factors that affect how fast you can get to the next > > sector: > > > > seek time > > settle time > > rotational latency > > >

Re: [PERFORM] Scaling further up

2004-03-03 Thread scott.marlowe
On Wed, 3 Mar 2004, Paul Thomas wrote: > > On 02/03/2004 23:25 johnn wrote: > > [snip] > > random_page_cost should be set with the following things taken into > > account: > > - seek speed > > Which is not exactly the same thing as spindle speed as it's a combination > of spindle speed an

Re: [PERFORM] Scaling further up

2004-03-02 Thread scott.marlowe
On Tue, 2 Mar 2004, Anjan Dave wrote: > That was part of my original question - whether it makes sense to go for > a mid-range SunFire machine (64bit HW, 64bit OS), which is scalable to > high amounts of memory, and shouldn't have any issues addressing it all. > I've had that kind of setup once te

Re: [PERFORM] Scaling further up

2004-03-02 Thread scott.marlowe
On Tue, 2 Mar 2004, Anjan Dave wrote: > "By lots I mean dozen(s) in a raid 10 array with a good controller." > > I believe, for RAID-10, I will need even number of drives. Correct. > Currently, > the size of the database is about 13GB, and is not expected to grow > exponentially with thousands

Re: [PERFORM] FreeBSD config

2004-02-27 Thread scott.marlowe
On Fri, 27 Feb 2004, Shridhar Daithankar wrote: > Dror Matalon wrote: > > > Let me try and say it again. I know that setting effective_cache_size > > doesn't affect the OS' cache. I know it just gives Postgres the *idea* > > of how much cache the OS is using. I know that. I also know that a > > c

Re: [PERFORM] FreeBSD config

2004-02-26 Thread scott.marlowe
On Thu, 26 Feb 2004, Dror Matalon wrote: > On Thu, Feb 26, 2004 at 11:55:31AM -0700, scott.marlowe wrote: > > On Thu, 26 Feb 2004, Dror Matalon wrote: > > > > > Hi, > > > > > > We have postgres running on freebsd 4.9 with 2 Gigs of memory. As per >

Re: [PERFORM] A cache for the results of queries ?

2004-02-26 Thread scott.marlowe
On Thu, 26 Feb 2004, David Pradier wrote: > Hi everybody, > > i'd like to know if it exists a system of cache for the results of > queries. I believe there are some external libs that provide this at the application level. PHP's adodb is purported to do so. ---(end of

Re: [PERFORM] FreeBSD config

2004-02-26 Thread scott.marlowe
On Thu, 26 Feb 2004, Dror Matalon wrote: > Hi, > > We have postgres running on freebsd 4.9 with 2 Gigs of memory. As per > repeated advice on the mailing lists we configured effective_cache_size > = 25520 which you get by doing `sysctl -n vfs.hibufspace` / 8192 > > Which results in using 200Megs

Re: [PERFORM] General performance questions about postgres on Apple

2004-02-23 Thread scott.marlowe
On Sun, 22 Feb 2004, Sean Shanny wrote: > Tom, > > We have the following setting for random page cost: > > random_page_cost = 1# units are one sequential page fetch cost > > Any suggestions on what to bump it up to? > > We are waiting to hear back from Apple on the speed issues, so

Re: [PERFORM] Slow response of PostgreSQL

2004-02-17 Thread scott.marlowe
On Wed, 18 Feb 2004, Christopher Kings-Lynne wrote: > >>> 1- How can I lock a single record so that other users can only read > >>> it. ?? > >> > >> > >> You cannot do that in PostgreSQL. > > > > > > How about SELECT ... FOR UPDATE? > > No, because users cannot read the locked row in that case

Re: [PERFORM] Tables on multiple disk drives

2004-02-17 Thread scott.marlowe
On Tue, 17 Feb 2004, Craig Thomas wrote: > > On Tue, 17 Feb 2004, Craig Thomas wrote: > > > >> > On Tue, 17 Feb 2004, Konstantin Tokar wrote: > >> > > >> >> Hi! > >> >> Does PostgreSQL allow to create tables and indices of a single > >> database on multiple disk drives with a purpose of increase >

Re: [PERFORM] Tables on multiple disk drives

2004-02-17 Thread scott.marlowe
On Tue, 17 Feb 2004, Konstantin Tokar wrote: > Hi! > Does PostgreSQL allow to create tables and indices of a single > database on multiple disk drives with a purpose of increase > performance as Oracle database does? If a symbolic reference is the > only method then the next question is: how can i

Re: [PERFORM] Slow response of PostgreSQL

2004-02-17 Thread scott.marlowe
Easy two step procedure for speeding this up: 1: Upgrade to 7.4.1 2: Read this: http://www.varlena.com/varlena/GeneralBits/Tidbits/perf.html ---(end of broadcast)--- TIP 6: Have you searched our list archives? http://archives.po

Re: [PERFORM] Disappointing performance in db migrated from MS SQL

2004-02-12 Thread scott.marlowe
On Thu, 12 Feb 2004, Leon Out wrote: > Hello all. I am in the midst of porting a large web application from a > MS SQL Server backend to PostgreSQL. The migration work is basically > complete, and we're at the testing and optimization phase of the > project. The results so far have been disappo

Re: [PERFORM] slow database

2004-02-11 Thread scott.marlowe
ENCES public.fabricante > (cd_fabricante) ON UPDATE NO ACTION ON DELETE NO ACTION, > CONSTRAINT "$7" FOREIGN KEY (cd_produto, cd_fornecedor) REFERENCES > public.fornecedor_produto (cd_produto, cd_fornecedor) ON UPDATE NO ACTION ON > DELETE NO ACTION, > CONSTRAINT "$8"

Re: [PERFORM] slow database

2004-02-11 Thread scott.marlowe
On Wed, 11 Feb 2004 [EMAIL PROTECTED] wrote: > I already came back the old conditions and I continue slow in the same > way! OK, we need some things from you to help troubleshoot this problem. Postgresql version schema of your tables output of "explain analyze your query here" a chicken foot (ha

Re: [PERFORM] update performance

2004-02-11 Thread scott.marlowe
On Wed, 11 Feb 2004, scott.marlowe wrote: > On Wed, 11 Feb 2004, stefan bogdan wrote: > > > hello > > i have postgres 7.3.2.,linux redhat 9.0 > > a database,and 20 tables > > a lot of fields are char(x) > > when i have to make update for all the fields except

Re: [PERFORM] slow database

2004-02-11 Thread scott.marlowe
If my boss came to me and asked me to make my database server run as slowly as possible, I might come up with the exact same postgresql.conf file as what you posted. Just installing the default postgresql.conf that came with postgresql should make this machine run faster. Read this: http://ww

Re: [PERFORM] update performance

2004-02-11 Thread scott.marlowe
On Wed, 11 Feb 2004, stefan bogdan wrote: > hello > i have postgres 7.3.2.,linux redhat 9.0 > a database,and 20 tables > a lot of fields are char(x) > when i have to make update for all the fields except index > postgres works verry hard > what should i've changed in configuration to make it work

Re: [PERFORM] select count(*) from anIntColumn where int_value = 0;

2004-02-11 Thread scott.marlowe
On Wed, 11 Feb 2004, David Teran wrote: > Hi, > > > Is your int_value data type int4? If not then use "... from > > job_property > > where int_value = '0'" > > Indexes are used only if datatypes matches. > > > tried those variations already. Strange enough, after dropping and > recreating the i

Re: [PERFORM] Compile Vs RPMs

2004-02-04 Thread scott.marlowe
On Tue, 3 Feb 2004, Christopher Browne wrote: > [EMAIL PROTECTED] ("Anjan Dave") writes: > > I would like to know whether there are any significant performance > > advantages of compiling (say, 7.4) on your platform (being RH7.3, 8, > > and 9.0, and Fedora especially) versus getting the relevant b

Re: [PERFORM] Database conversion woes...

2004-02-03 Thread scott.marlowe
On Tue, 3 Feb 2004, Kevin Carpenter wrote: > Hello everyone, > > I am doing a massive database conversion from MySQL to Postgresql for a > company I am working for. This has a few quirks to it that I haven't > been able to nail down the answers I need from reading and searching > through previou

Re: [PERFORM] [pgsql-advocacy] MySQL+InnoDB vs. PostgreSQL test?

2004-02-02 Thread scott.marlowe
On Tue, 3 Feb 2004, Christopher Kings-Lynne wrote: > > One more thing that annoyed me. If you started a process, such as a > > large DDL operation, or heaven forbid, a cartesian join (what? I never > > do that!). > > I believe InnoDB also has O(n) rollback time. eg. if you are rolling > bac

Re: [PERFORM] Increasing number of PG connections.

2004-02-02 Thread scott.marlowe
On Mon, 2 Feb 2004, Kevin Barnard wrote: > On 2 Feb 2004 at 13:58, scott.marlowe wrote: > > > what do you mean at 2 GB? Is that how much is in kernel cache plus > > buffer, plus used, plus etc??? Could you give us the top of top output to > > make sure? If most of th

Re: [PERFORM] Increasing number of PG connections.

2004-02-02 Thread scott.marlowe
On Mon, 2 Feb 2004, Kevin Barnard wrote: > I am running a Dual Xeon hyperthreaded server with 4GB RAM RAID-5. The only > thing running on the server is Postgres running under Fedora. I have a 700 > connection limit. > > The DB is setup as a backend for a very high volume website. Most of the

inserting large number of rows was: Re: [PERFORM] Increasing number of PG connections.

2004-02-02 Thread scott.marlowe
On Mon, 2 Feb 2004, Qing Zhao wrote: > I am new here. I have a question related to this in some way. > > Our web site needs to upload a large volume of data into Postgres at a > time. The performance deterioates as number of rows becomes larger. > When it reaches 2500 rows, it never come back

Re: [PERFORM] "Overlaping" indexes

2004-02-02 Thread scott.marlowe
On Mon, 2 Feb 2004, Tomasz Myrta wrote: > Dnia 2004-02-02 19:30, U¿ytkownik scott.marlowe napisa³: > > Not entirely, since it only has to sort two columns, it will be smaller, > > and will therefore be somewhat faster. > > Can you say something more about it? Will it be

Re: [PERFORM] "Overlaping" indexes

2004-02-02 Thread scott.marlowe
On Mon, 2 Feb 2004, Tomasz Myrta wrote: > Dnia 2004-02-02 15:46, U?ytkownik Rigmor Ukuhe napisa3: > > Hi, > > > > I have many indexes somehow overlaping like: > > ... btree ("STATUS", "VISIBLE", "NP_ID"); > > ... btree ("STATUS", "VISIBLE"); > > > > is perfomance gained by "more exact" index wor

Re: [PERFORM] shared_buffer value

2004-01-16 Thread scott.marlowe
On Fri, 16 Jan 2004, Anjan Dave wrote: > 68 processes: 67 sleeping, 1 running, 0 zombie, 0 stopped > CPU0 states: 3.1% user 4.4% system0.0% nice 0.0% iowait 92.0% > idle > CPU1 states: 0.0% user 3.2% system0.0% nice 0.0% iowait 96.3% > idle > CPU2 states: 0.4% user 0.3% s

Re: [PERFORM] COUNT & Pagination

2004-01-14 Thread scott.marlowe
On Wed, 14 Jan 2004, Rajesh Kumar Mallah wrote: > scott.marlowe wrote: > > >On Tue, 13 Jan 2004, David Shadovitz wrote: > > > > > > > >>>We avert the subsequent execution of count(*) by passing the > >>>value of count(*) as a

Re: [PERFORM] 100 simultaneous connections, critical limit?

2004-01-14 Thread scott.marlowe
On Wed, 14 Jan 2004, Adam Alkins wrote: > scott.marlowe wrote: > > >A few tips from an old PHP/Apache/Postgresql developer. > > > >1: Avoid pg_pconnect unless you are certain you have load tested the > >system and it will behave properly. pg_pconnect often cr

Re: [PERFORM] 100 simultaneous connections, critical limit?

2004-01-14 Thread scott.marlowe
On Wed, 14 Jan 2004, Jón Ragnarsson wrote: > I am writing a website that will probably have some traffic. > Right now I wrap every .php page in pg_connect() and pg_close(). > Then I read somewhere that Postgres only supports 100 simultaneous > connections (default). Is that a limitation? Should I

Re: [PERFORM] COUNT & Pagination

2004-01-13 Thread scott.marlowe
On Tue, 13 Jan 2004, David Shadovitz wrote: > > We avert the subsequent execution of count(*) by passing the > > value of count(*) as a query parameter through the link in page > > numbers. > > Mallah, and others who mentioned caching the record count: > > Yes, I will certainly do this. I can d

Re: [PERFORM] Index creation

2004-01-07 Thread scott.marlowe
On Wed, 7 Jan 2004, Eric Jain wrote: > Any tips for speeding up index creation? > > I need to bulk load a large table with 100M rows and several indexes, > some of which span two columns. > > By dropping all indexes prior to issuing the 'copy from' command, the > operation completes 10x as fast

Re: [PERFORM] general peformance question

2003-12-22 Thread scott.marlowe
On Thu, 18 Dec 2003, Conny Thimren wrote: > Hi, > This a kind of newbie-question. I've been using Postgres for a long time in a low > transction environment - and it is great. > > Now I've got an inquiry for using Postgresql in a heavy-load on-line system. This > system must handle something li

Re: [PERFORM] a lot of problems with pg 7.4

2003-12-16 Thread scott.marlowe
On Sat, 13 Dec 2003, Kari Lavikka wrote: > > Hi! > > We have been running a rather busy website using pg 7.3 as the database. > Peak hitrate is something like 120 request / second without images and > other static stuff. The site is a sort of image gallery for IRC users. > > I evaluated pg 7.4

Re: [PERFORM] [ADMIN] ODBC Driver generates a too big "windows swap file" and

2003-12-12 Thread scott.marlowe
On Fri, 12 Dec 2003, Rhaoni Chiu Pereira wrote: Hi, is there a switch in your pgsql/odbc connector to enable cursors? If so, try turning that on. ---(end of broadcast)--- TIP 5: Have you checked our extensive FAQ? http://www.post

Re: [PERFORM] Hardware suggestions for Linux/PGSQL server

2003-12-11 Thread scott.marlowe
Just one more piece of advice, you might want to look into a good battery backed cache hardware RAID controller. They work quite well for heavily updated databases. The more drives you throw at the RAID array the faster it will be. ---(end of broadcast)--

Re: [PERFORM] tuning questions

2003-12-04 Thread scott.marlowe
On Thu, 4 Dec 2003, Jack Coates wrote: > On Thu, 2003-12-04 at 12:27, Richard Huxton wrote: > > On Thursday 04 December 2003 19:50, Jack Coates wrote: > > > > > > I'm trying to set Postgres's shared memory usage in a fashion that > > > allows it to return requested results quickly. Unfortunately,

Re: [PERFORM] tuning questions

2003-12-04 Thread scott.marlowe
On Thu, 4 Dec 2003, Josh Berkus wrote: > Scott, > > > Just to add to what the others have said here, you probably want to run > > the pg_autovacuum daemon in the background. It comes with 7.4 but will > > work fine with 7.3. > > I don't recommend using pg_autovacuum with a data transformati

Re: [PERFORM] tuning questions

2003-12-04 Thread scott.marlowe
On Thu, 4 Dec 2003, Jack Coates wrote: > Another problem is that performance of the 6 million row job is decent > if I stop the job and run a vacuumdb --analyze before letting it > continue; is this something that 7.4 will help with? vacuumb --analyze > doesn't seem to have much effect on the 18 m

Re: [PERFORM] Minimum hardware requirements for Postgresql db

2003-12-03 Thread scott.marlowe
On Wed, 3 Dec 2003 [EMAIL PROTECTED] wrote: > Dear all > > We would be recommending to our ct. on the use of Postgresql db as compared > to MS SQL Server. We are targetting to use Redhat Linux ES v2.1, Postgresql > v7.3.4 and Postgresql ODBC 07.03.0100. > > We would like to know the minimum spec

Re: [PERFORM] Value of Quad vs. Dual Processor machine

2003-11-12 Thread scott.marlowe
As another post pointed out, you need to set cflags to get optimization under Solaris on that flavor of Postgresql. Also, Postgresql tends to get its best performance from the free unixes, Linux and BSD. those are available for Sun Sparcs, but postgresql in 64 bit mode on those boxes is still

Re: [PERFORM] Value of Quad vs. Dual Processor machine

2003-11-11 Thread scott.marlowe
On Tue, 11 Nov 2003, Rod Taylor wrote: > On Tue, 2003-11-11 at 18:32, Chris Field wrote: > > We are getting ready to spec out a new machine and are wondering about > > the wisdom of buying a quad versus a dual processor machine. Seing as > > how postgres in not a threaded application, and this se

Re: [PERFORM] *very* slow query to summarize data for a month ...

2003-11-11 Thread scott.marlowe
On 11 Nov 2003, Greg Stark wrote: > "Marc G. Fournier" <[EMAIL PROTECTED]> writes: > > > On Tue, 11 Nov 2003, Greg Stark wrote: > > > > > Actually you might be able to get the same effect using function indexes > > > like: > > > > > > create index i on traffic_log (month_trunc(runtime), company_

Re: [PERFORM] Pg+Linux swap use

2003-10-31 Thread scott.marlowe
We had a problem at work that when a windows box would connect to a samba share with a lot of files in it, the kswapd was going nuts, even though we weren't low on memory at all. Updating to the 2.4.18 or so of the later redhats fixed that issue. It might be related. I think the kflush daemon

Re: [PERFORM] Pg+Linux swap use

2003-10-30 Thread scott.marlowe
On Thu, 30 Oct 2003, alexandre :: aldeia digital wrote: > Hi, > > Old: Post 7.3.2, P4 1.8, 1 MB RAM, 2 x IDE SW RAID 1, RedHat 8 > New: Post 7.3.4, Xeon 2.4, 1 MB RAM, 2 x SCSI 15k SW RAID 1, RedHat 9 > > Both use: Only postgresql on server. Buffers = 8192, effective cache = 10 > > In old p

Re: [PERFORM] vacuum locking

2003-10-30 Thread scott.marlowe
On Thu, 30 Oct 2003, Rob Nagler wrote: > scott.marlowe writes: > > t2 was 'vacuum full'ed and analyzed, right? Just guessing. > > Fresh import. I've been told this includes a ANALYZE. You should probably run analyze by hand just to be sure. If the planner is

Re: [PERFORM] vacuum locking

2003-10-30 Thread scott.marlowe
On Thu, 30 Oct 2003, Rob Nagler wrote: > The vacuum problem is very serious for the problematic database to the > point that one of my customer's customers said: > > However, I am having a hard time understanding why the system is so > slow... from my perspective it seems like you have so

Re: [PERFORM] vacuum locking

2003-10-30 Thread scott.marlowe
On Wed, 29 Oct 2003, Rob Nagler wrote: > Greg Stark writes: > > > > SELECT a, (SELECT name FROM t2 WHERE t2.f2 = t1.f2) > > > > FROM t1 > > > > GROUP BY f2 > > > > > > This doesn't solve the problem. It's the GROUP BY that is doing the > > > wrong thing. It's grouping, then aggregating. > >

Re: [PERFORM] PostgreSQL 7.4beta5 vs MySQL 4.0.16 with

2003-10-29 Thread scott.marlowe
On Thu, 30 Oct 2003 [EMAIL PROTECTED] wrote: > >> So its not just PostgreSQL that is suffering from the bad SQL but MySQL also. > >> But the > >> question is my does PostgreSQL suffer so badly ?? I think not all developers > >> write very nice > >> SQLs. > >> > >> Its really sad to see that a

pgsql-performance@postgresql.org

2003-10-24 Thread scott.marlowe
On Fri, 24 Oct 2003, Vivek Khera wrote: > > "AL" == Allen Landsidel <[EMAIL PROTECTED]> writes: > > AL> Well I had the vacuums running every 15 minutes for a while.. via a > AL> simple cron script I wrote just to make sure no more than one vacuum > AL> ran at once, and to 'nice' the job.. but

Re: [PERFORM] RAID controllers etc... was: PostgreSQL data on aNAS

2003-10-23 Thread scott.marlowe
On Thu, 23 Oct 2003, Alexander Priem wrote: > I have been searching (www.lsil.com) for this megaraid_2 driver you > mentioned. > > What kind of MegaRaid card does the Perc4/Di match? Elite1600? Elite1650? > > I picked Elite1600 and the latest driver I found was version 2.05.00. Is > this one OK

Re: [PERFORM] Processors vs Memory

2003-10-22 Thread scott.marlowe
On Wed, 22 Oct 2003, Hilary Forbes wrote: > If I have a fixed amount of money to spend as a general rule is it > better to buy one processor and lots of memory or two processors and > less memory for a system which is transactional based (in this case > it's handling reservations). I realise t

Re: [PERFORM] Tuning for mid-size server

2003-10-21 Thread scott.marlowe
On Tue, 21 Oct 2003, Andrew Sullivan wrote: > On Tue, Oct 21, 2003 at 11:51:02AM -0700, Josh Berkus wrote: > > > Of course, if you have anecdotal evidence to the contrary, then the > > only way to work this would be to have OSDL help us sort it out. > > Nope. I too have such anecdotal evidence

[PERFORM] RAID controllers etc... was: PostgreSQL data on a NAS device ?

2003-10-21 Thread scott.marlowe
On 21 Oct 2003, Will LaShell wrote: > On Tue, 2003-10-21 at 08:40, scott.marlowe wrote: > > > So that brings up my question, which is better, the Perc4 or Perc3 > > controllers, and what's the difference between them? I find Dell's > > tendency to hide other

Re: [PERFORM] Tuning for mid-size server

2003-10-21 Thread scott.marlowe
On Tue, 21 Oct 2003, Josh Berkus wrote: > Anjan, > > > From what I know, there is a cache-row-set functionality that doesn't > > exist with the newer postgres... > > What? PostgreSQL has always used the kernel cache for queries. > > > Concurrent users will start from 1 to a high of 5000 or mor

Re: [PERFORM] Tuning for mid-size server

2003-10-21 Thread scott.marlowe
On Tue, 21 Oct 2003, Josh Berkus wrote: > Scott, > > > Also, if it's a read only environment, RAID5 with n drives equals the > > performance of RAID0 with n-1 drives. > > True. > > > Josh, you gotta get out more. IA32 has supported >4 gig ram for a long > > time now, and so has the linux kerne

Re: [PERFORM] Tuning for mid-size server

2003-10-21 Thread scott.marlowe
On Tue, 21 Oct 2003, Josh Berkus wrote: > Anjan, > > > Pretty soon, a PowerEdge 6650 with 4 x 2Ghz XEONs, and 8GB Memory, with > > internal drives on RAID5 will be delivered. Postgres will be from RH8.0. > > How many drives? RAID5 sucks for heavy read-write databases, unless you have > 5+ dri

Re: [PERFORM] PostgreSQL data on a NAS device ?

2003-10-21 Thread scott.marlowe
On Tue, 21 Oct 2003, Alexander Priem wrote: > The machine is going to be used for a pretty large database (well over 100 > tables with some of them containing over a million records from the start, > number of tables and records will grow (much?) larger in the future). This > database is going to

Re: [PERFORM] PostgreSQL data on a NAS device ?

2003-10-20 Thread scott.marlowe
On Mon, 20 Oct 2003, Alexander Priem wrote: > Hi all, > > Does anyone have any experience with putting PostgreSQL data on a NAS > device? > > I am asking this because a NAS device is much cheaper to set up than a > couple of SCSI disks. I would like to use a relatively cheap NAS device > which u

Re: [PERFORM] further testing on IDE drives

2003-10-14 Thread scott.marlowe
On Tue, 14 Oct 2003, Tom Lane wrote: > "scott.marlowe" <[EMAIL PROTECTED]> writes: > > open_sync was WAY faster at this than the other two methods. > > Do you not have open_datasync? That's the preferred method if > available. Nope, when I try to star

  1   2   >