Re: [PERFORM] Config review

2004-12-07 Thread Andrew Sullivan
into the array. We've had some remarkably good experiences with our recently-acquired EMC. A -- Andrew Sullivan | [EMAIL PROTECTED] When my information changes, I alter my conclusions. What do you do sir? --attr. John Maynard Keynes ---(end of broadcast

Re: [PERFORM] Alternatives to Dell?

2004-12-06 Thread Andrew Sullivan
walk off a short pier. Their service people sure _try_ hard in the field, but some machines required three and four visits to fix. I also find the Sun Opteron offering to be way overpriced compared to the competition. In case it's not obvious, I don't speak for my employer. A -- Andrew

Re: [PERFORM] preloading indexes

2004-11-04 Thread Andrew Sullivan
On Wed, Nov 03, 2004 at 03:53:16PM -0500, Andrew Sullivan wrote: and may bust your query out of the cache. Also, we'd need some more Uh, the data you're querying, of course. Queries themselves aren't cached. A -- Andrew Sullivan | [EMAIL PROTECTED] I remember when computers were

Re: [PERFORM] Restricting Postgres

2004-11-03 Thread Andrew Sullivan
to a relatively low level. What that ought to mean is that, under heavy load, some queries will abort. A -- Andrew Sullivan | [EMAIL PROTECTED] When my information changes, I alter my conclusions. What do you do sir? --attr. John Maynard Keynes ---(end

Re: [PERFORM] preloading indexes

2004-11-03 Thread Andrew Sullivan
nasty things to the cache. It is hoped that nastiness is fixed in 8.0. -- Andrew Sullivan | [EMAIL PROTECTED] The plural of anecdote is not data. --Roger Brinner ---(end of broadcast)--- TIP 8: explain analyze is your friend

Re: [PERFORM] preloading indexes

2004-11-03 Thread Andrew Sullivan
. Also, we'd need some more info about how you've tuned this thing. Maybe check out the archives first for some tuning pointers to help you. A -- Andrew Sullivan | [EMAIL PROTECTED] In the future this spectacle of the middle classes shocking the avant- garde will probably become the textbook

Re: [PERFORM] Performance Anomalies in 7.4.5

2004-10-22 Thread Andrew Sullivan
imagine that there's going to be a lot of enthusiasm for hints, so anything that isn't a sure-fire planner helper is a potential loss, at least to me. A -- Andrew Sullivan | [EMAIL PROTECTED] I remember when computers were frustrating because they *did* exactly what you told them to. That actually

Re: [PERFORM] Why isn't this index being used?

2004-10-19 Thread Andrew Sullivan
such a feature too. Sure enough, quoting the constants fixes the problem. Is it a best practice to always quote constants? No, but it's very useful in these cases. The problem is I believe this is fixed in 8.0, BTW. See the FAQ, question 4.8 A -- Andrew Sullivan | [EMAIL PROTECTED] I

IBM P-series machines (was: [PERFORM] Excessive context switching on SMP Xeons)

2004-10-11 Thread Andrew Sullivan
On Tue, Oct 05, 2004 at 09:47:36AM -0700, Josh Berkus wrote: As long as you're on x86, scaling outward is the way to go. If you want to continue to scale upwards, ask Andrew Sullivan about his experiences running PostgreSQL on big IBM boxes. But if you consider an quad-Opteron server

Re: [PERFORM] [ADMIN] Benchmarking postgres on Solaris/Linux

2004-03-23 Thread Andrew Sullivan
, at least when it comes to managing the largish number of processes that Postgres requires. If pure speed is what you're after, I have found that 2-way, 32 bit Linux on P-IIIs compares very favourably to 4 way 64 bit Ultra SPARC IIs. A -- Andrew Sullivan | [EMAIL PROTECTED] The fact

Re: [PERFORM] [ADMIN] Benchmarking postgres on Solaris/Linux

2004-03-23 Thread Andrew Sullivan
a bad batch of Dell hardware recently, which makes me second this opinion. I should say, also, that my initial experience of AIX has been extremely good. I can't comment on the fun it might involve in the long haul, of course. A -- Andrew Sullivan | [EMAIL PROTECTED] This work was visionary

Re: [PERFORM] rapid degradation after postmaster restart

2004-03-17 Thread Andrew Sullivan
is not notoriously useful. You may want to have a look at what the example stuff in the SE Toolkit tells you, or what you get from sar. I believe you have to use a special kernel setting on Solaris to mark shared memory as being ineligible for swap. A -- Andrew Sullivan | [EMAIL PROTECTED] This work

Re: [PERFORM] Scaling further up

2004-03-15 Thread Andrew Sullivan
? How do I configure that, for knowledge? You don't. It'll automatically be in memory if (a) you have enough memory, (b) you don't have anything else on the machine using the memory, and (c) it's been read at least one time. A -- Andrew Sullivan | [EMAIL PROTECTED

Re: [PERFORM] Drop Tables Very Slow in Postgresql 7.2.1

2004-03-14 Thread Andrew Sullivan
a VACUUM FULL and a complete REINDEX of the system tables next. A -- Andrew Sullivan | [EMAIL PROTECTED] I remember when computers were frustrating because they *did* exactly what you told them to. That actually seems sort of quaint now. --J.D. Baldwin

Re: [PERFORM] [ADMIN] syslog slowing the database?

2004-03-14 Thread Andrew Sullivan
, if anyone thinks it'll be worth having around. FWIW, we use ours in production. A -- Andrew Sullivan | [EMAIL PROTECTED] The plural of anecdote is not data. --Roger Brinner ---(end of broadcast)--- TIP 8: explain analyze is your

Re: [PERFORM] compiling 7.4.1 on Solaris 9

2004-03-11 Thread Andrew Sullivan
On Wed, Mar 10, 2004 at 11:07:28AM -0500, Andrew Sullivan wrote: At work, we have been doing a number of tests on 7.4. The performance is such an improvement over 7.2 that the QA folks thought there must be something wrong. So I suppose the defaults are ok. I know, I know, replying

Re: [PERFORM] compiling 7.4.1 on Solaris 9

2004-03-10 Thread Andrew Sullivan
now. Again, this is on 8, not 9. At work, we have been doing a number of tests on 7.4. The performance is such an improvement over 7.2 that the QA folks thought there must be something wrong. So I suppose the defaults are ok. A -- Andrew Sullivan | [EMAIL PROTECTED

Re: [PERFORM] Using bigint needs explicit cast to use the index

2004-03-08 Thread Andrew Sullivan
far nobody's come up with a solution. There was a proposal to put in a special-case automatic fix for int4/int8 in 7.4, but I don't know whether it made it in. A -- Andrew Sullivan | [EMAIL PROTECTED] I remember when computers were frustrating because they *did* exactly what you told them

Re: [PERFORM] Scaling further up

2004-03-03 Thread Andrew Sullivan
disposal. A -- Andrew Sullivan | [EMAIL PROTECTED] The fact that technology doesn't work is no bar to success in the marketplace. --Philip Greenspun ---(end of broadcast)--- TIP 2: you can get off all lists at once with the unregister

Re: [PERFORM] compiling 7.4.1 on Solaris 9

2004-03-01 Thread Andrew Sullivan
On Thu, Feb 26, 2004 at 12:46:23PM +, teknokrat wrote: I've read about the place. Would using -O3 be an improvement? In my experience, it's not only not an improvement, it sometimes breaks the code. That's on 8, though, not 9. A -- Andrew Sullivan | [EMAIL PROTECTED] The plural

Re: [PERFORM] Slow in morning hours

2004-02-20 Thread Andrew Sullivan
on the machine during those hours? Maybe VACUUM is sucking up all your bandwidth. Or your backups. Or some other cron job. Note that 7.2 is pretty old. There are several performance improvements in subsequent versions. A -- Andrew Sullivan ---(end of broadcast

Re: [PERFORM] Disappointing performance in db migrated from MS SQL Server

2004-02-13 Thread Andrew Sullivan
the cache or when doing cache maintenance. A -- Andrew Sullivan ---(end of broadcast)--- TIP 2: you can get off all lists at once with the unregister command (send unregister YourEmailAddressHere to [EMAIL PROTECTED])

Re: [PERFORM] High Performance/High Reliability File system on SuSE64

2004-01-23 Thread Andrew Sullivan
gave me fits. But XFS was nice. -- Andrew Sullivan | [EMAIL PROTECTED] In the future this spectacle of the middle classes shocking the avant- garde will probably become the textbook definition of Postmodernism. --Brad Holland ---(end of broadcast

Re: [PERFORM] High Performance/High Reliability File system on SuSE64

2004-01-23 Thread Andrew Sullivan
be about the degree of testing the filesystem has received on Linux. On the other hand, I wouldn't be surprised if it were no worse than the other options. A -- Andrew Sullivan | [EMAIL PROTECTED] The fact that technology doesn't work is no bar to success in the marketplace

[PERFORM] failures on machines using jfs

2004-01-07 Thread Andrew Sullivan
, on the principle of better safe than sorry. A -- Andrew Sullivan 204-4141 Yonge Street Afilias CanadaToronto, Ontario Canada [EMAIL PROTECTED] M2P 2A8 +1 416 646 3304 x110

Re: [PERFORM] Tuning for mid-size server

2003-12-14 Thread Andrew Sullivan
buffers under certain perverse loads is lousy database performance _precisely_ when we need it. I expect some testing of this type some time in January. A -- Andrew Sullivan 204-4141 Yonge Street Afilias CanadaToronto, Ontario Canada [EMAIL

Re: [PERFORM] tuning questions

2003-12-04 Thread Andrew Sullivan
patterns -- and at that very moment, the power goes away -- the data that was reported to have been on the disk, but which was actually _not_ on the disk, is no longer anywhere. (Well, except in the past. But time travel was disabled some versions ago. ;-) A -- Andrew Sullivan

Re: [PERFORM] Various Questions

2003-12-01 Thread Andrew Sullivan
and pg_attribute more frequently than you might have thought. A -- Andrew Sullivan 204-4141 Yonge Street Afilias CanadaToronto, Ontario Canada [EMAIL PROTECTED] M2P 2A8 +1 416 646 3304

[PERFORM] strange estimate for number of rows

2003-11-13 Thread Andrew Sullivan
. A -- Andrew Sullivan 204-4141 Yonge Street Afilias CanadaToronto, Ontario Canada [EMAIL PROTECTED] M2P 2A8 +1 416 646 3304 x110 ---(end of broadcast

Re: [PERFORM] strange estimate for number of rows

2003-11-13 Thread Andrew Sullivan
. A -- Andrew Sullivan 204-4141 Yonge Street Afilias CanadaToronto, Ontario Canada [EMAIL PROTECTED] M2P 2A8 +1 416 646 3304 x110 ---(end of broadcast

Re: [PERFORM] strange estimate for number of rows

2003-11-13 Thread Andrew Sullivan
On Thu, Nov 13, 2003 at 04:37:03PM -0500, Andrew Sullivan wrote: Actually, this one's on an internal box, and I think 1.5 is too low -- it's really just a pair of mirrored SCSI disks on a PCI controller in this case. That does the trick, though, so maybe I'm just being too conservantive. I

Re: [PERFORM] Response time

2003-11-05 Thread Andrew Sullivan
On Wed, Nov 05, 2003 at 11:35:22AM -0600, [EMAIL PROTECTED] wrote: The \timing psql command gives different time for the same query executed repeatedly. Why do you believe that the same query will always take the same time to execute? A -- Andrew Sullivan 204

Re: [PERFORM] Pg+Linux swap use

2003-10-31 Thread Andrew Sullivan
? A -- Andrew Sullivan 204-4141 Yonge Street Afilias CanadaToronto, Ontario Canada [EMAIL PROTECTED] M2P 2A8 +1 416 646 3304 x110 ---(end of broadcast

Re: [PERFORM] vacuum locking

2003-10-23 Thread Andrew Sullivan
On Wed, Oct 22, 2003 at 09:27:47PM -0400, Tom Lane wrote: trace. What is causing that? Not VACUUM I don't think. It doesn't have any huge memory demand. But swapping out processes could account for What about if you've set vacuum_mem too high? A -- Andrew Sullivan

Re: [PERFORM] vacuum locking

2003-10-23 Thread Andrew Sullivan
didn't know if the memory was actually taken by vacuum at the beginning (like shared memory is) or what-all happened. A -- Andrew Sullivan 204-4141 Yonge Street Afilias CanadaToronto, Ontario Canada [EMAIL PROTECTED] M2P

Re: [PERFORM] index file bloating still in 7.4 ?

2003-10-21 Thread Andrew Sullivan
on query echoing. A -- Andrew Sullivan 204-4141 Yonge Street Afilias CanadaToronto, Ontario Canada [EMAIL PROTECTED] M2P 2A8 +1 416 646 3304 x110

Re: [PERFORM] Tuning for mid-size server

2003-10-21 Thread Andrew Sullivan
similar is at work here. Not that I've had a reason to play with 4G ix86 machines, anyway. A -- Andrew Sullivan 204-4141 Yonge Street Afilias CanadaToronto, Ontario Canada [EMAIL PROTECTED] M2P 2A8

Re: [PERFORM] Tuning for mid-size server

2003-10-21 Thread Andrew Sullivan
Bruce's 2-way machine is within that threshold. A -- Andrew Sullivan 204-4141 Yonge Street Afilias CanadaToronto, Ontario Canada [EMAIL PROTECTED] M2P 2A8 +1 416 646 3304 x110

Re: [PERFORM] Tuning for mid-size server

2003-10-21 Thread Andrew Sullivan
heavily on what you're trying to optimise for and what platform you have. But I'm glad to hear (again) that people seem to think the 25% too high for most cases. I don't feel so much like I'm tilting against windmills. A -- Andrew Sullivan 204-4141 Yonge Street

Re: [PERFORM] Tuning for mid-size server

2003-10-21 Thread Andrew Sullivan
started taking a long time. The buffer algorithm is just not that clever, was my conclusion. (Standard disclaimer: not a long, controlled test. It's just a bit of gossip.) A -- Andrew Sullivan 204-4141 Yonge Street Afilias CanadaToronto, Ontario

Re: [PERFORM] PostgreSQL vs. MySQL

2003-10-09 Thread Andrew Sullivan
with the new probe-to-set-shared-buffers bit at install time, I think the reports of 400 billion times worse performance than MySQL will probably diminish. A -- Andrew Sullivan 204-4141 Yonge Street Afilias CanadaToronto, Ontario Canada [EMAIL

Re: [PERFORM] Sun performance - Major discovery!

2003-10-09 Thread Andrew Sullivan
with the concern. I'd rather have slow'n'stable than fast-but-broken. A -- Andrew Sullivan 204-4141 Yonge Street Afilias CanadaToronto, Ontario Canada [EMAIL PROTECTED] M2P 2A8

Re: [HACKERS] [PERFORM] Sun performance - Major discovery!

2003-10-09 Thread Andrew Sullivan
didn't work for gcc at the time. A -- Andrew Sullivan 204-4141 Yonge Street Afilias CanadaToronto, Ontario Canada [EMAIL PROTECTED] M2P 2A8 +1 416 646 3304 x110

Re: [PERFORM] Sun performance - Major discovery!

2003-10-08 Thread Andrew Sullivan
than 5 connections). It might be worth trying again, though, since we moved to Sol 8. Thanks for the result. -- Andrew Sullivan 204-4141 Yonge Street Afilias CanadaToronto, Ontario Canada [EMAIL PROTECTED] M2P 2A8

Re: [PERFORM] reindex/vacuum locking/performance?

2003-10-05 Thread Andrew Sullivan
your database is small. So you'll end up expiring potentially useful data in the buffer. A -- Andrew Sullivan 204-4141 Yonge Street Afilias CanadaToronto, Ontario Canada [EMAIL PROTECTED] M2P 2A8

Re: [PERFORM] reindex/vacuum locking/performance?

2003-10-05 Thread Andrew Sullivan
idea how to give it such intelligence. A -- Andrew Sullivan 204-4141 Yonge Street Afilias CanadaToronto, Ontario Canada [EMAIL PROTECTED] M2P 2A8 +1 416 646 3304 x110

Re: [PERFORM] reindex/vacuum locking/performance?

2003-10-04 Thread Andrew Sullivan
On Fri, Oct 03, 2003 at 02:24:42PM -0600, Rob Nagler wrote: I've read some posts that says vacuum doesn't lock, but my experience today indicates the opposite. It seemed that vacuum full analyze VACUUM doesn't. VACUUM FULL does. -- Andrew Sullivan 204-4141 Yonge

Re: [PERFORM] reindex/vacuum locking/performance?

2003-10-04 Thread Andrew Sullivan
On Fri, Oct 03, 2003 at 11:49:03PM -0400, Tom Lane wrote: What if said SELECTs are using the index in question? That's a good reason to build a new index and, when it's done, drop the old one. It still prevents writes, of course. A -- Andrew Sullivan 204-4141

Re: [PERFORM] reindex/vacuum locking/performance?

2003-10-04 Thread Andrew Sullivan
_way_ cheaper than it used to be, though. A -- Andrew Sullivan 204-4141 Yonge Street Afilias CanadaToronto, Ontario Canada [EMAIL PROTECTED] M2P 2A8 +1 416 646 3304 x110

Re: [PERFORM] TPC-R benchmarks

2003-09-29 Thread Andrew Sullivan
On Mon, Sep 29, 2003 at 05:43:26PM -, [EMAIL PROTECTED] wrote: Anyone have a rough idea of the costs involved? I did a back-of-an-envelope calculation one day and stopped when I got to $10,000. A -- Andrew Sullivan 204-4141 Yonge Street Afilias Canada

Re: [PERFORM] Query on Postgresql performance

2003-09-04 Thread Andrew Sullivan
. The 7.2 branch is no longer being maintained, so you really probably should use the 7.3 branch. I'm unaware of others having stability problems with 7.3.4, so if you see them, you should find your core dump and talk to the people on -hackers. A -- Andrew Sullivan 204

Re: [PERFORM] PostgreSQL is slow...HELP

2003-09-03 Thread Andrew Sullivan
On Wed, Sep 03, 2003 at 06:08:57AM -0700, Azlin Ghazali wrote: I find that PostgreSQL runs up to 10 times slower than MySQL. For small records Have you done any tuning on PostgreSQL? Have you vacuumed, c.? All the usual questions. A -- Andrew Sullivan 204-4141

Re: [PERFORM] opinion on RAID choice

2003-09-02 Thread Andrew Sullivan
On Thu, Aug 28, 2003 at 03:26:14PM -0600, scott.marlowe wrote: My experience has been that once you get past 6 disks, RAID5 is faster than RAID1+0. Also depends on your filesystem and volume manager. As near as I can tell, you do _not_ want to use RAID 5 with Veritas. A -- Andrew

Re: [PERFORM] opinion on RAID choice

2003-09-02 Thread Andrew Sullivan
. Nobody's ever been able/willing to tell me. A Andrew Sullivan 204-4141 Yonge Street Liberty RMS Toronto, Ontario Canada [EMAIL PROTECTED] M2P 2A8 +1 416 646 3304 x110

Re: [PERFORM] Hardware recommendations to scale to silly load

2003-08-29 Thread Andrew Sullivan
with how the shared memory is handled. You'll want to dig through the -general or -hackers archives from somewhere between 9 and 14 months ago, IIRC. A -- Andrew Sullivan 204-4141 Yonge Street Liberty RMS Toronto, Ontario Canada [EMAIL

Re: [PERFORM] Force table to be permanently in cache?

2003-08-29 Thread Andrew Sullivan
in the archives of this list for thoughts on how big that should be. A -- Andrew Sullivan 204-4141 Yonge Street Liberty RMS Toronto, Ontario Canada [EMAIL PROTECTED] M2P 2A8 +1

Re: [PERFORM] PL/pgSQL functions - text / varchar - havy performance

2003-08-29 Thread Andrew Sullivan
syntactic sugar for text. In fact, text and varchar() are supposed to be exactly the same. A -- Andrew Sullivan 204-4141 Yonge Street Liberty RMS Toronto, Ontario Canada [EMAIL PROTECTED] M2P 2A8

Re: [PERFORM] sourcecode for newly release eRServer?

2003-08-29 Thread Andrew Sullivan
On Fri, Aug 29, 2003 at 01:19:35PM -0400, george young wrote: Does anyone know how and when the actual release will happen? See the erserver project on gborg. It's out. There's a list, too; any problems, send 'em there. A Andrew Sullivan 204-4141 Yonge Street

Re: [PERFORM] Hardware recommendations to scale to silly load

2003-08-28 Thread Andrew Sullivan
write transactions per second is probably too much to ask for any standard hardware. But given that you are batching this once a week, and trying to avoid big expenses, are you use this is the right approach? Perhaps you should consider a redesign using COPY and such? A -- Andrew Sullivan

Re: [PERFORM] On Linux Filesystems

2003-08-14 Thread Andrew Sullivan
something like metadata journalling. Maybe others have more time to spare. perhaps even including performance metrics for *BSD. That, not Linux-baiting, is the answer... I didn't see anyone Linux-baiting. A -- Andrew Sullivan 204-4141 Yonge Street Liberty RMS

Re: [PERFORM] Perfomance Tuning

2003-08-14 Thread Andrew Sullivan
have to have all sorts of nice tools to cope with the things that (for instance) fsck handles. I think the reaction of most developers has been, Why reinvent the wheel? A -- Andrew Sullivan 204-4141 Yonge Street Liberty RMS Toronto, Ontario

Re: [PERFORM] How can I Improve performance in Solaris?

2003-08-14 Thread Andrew Sullivan
SELECTs, though, I can't see what exactly might be causing you so much difficulty. A -- Andrew Sullivan 204-4141 Yonge Street Liberty RMS Toronto, Ontario Canada [EMAIL PROTECTED] M2P 2A8

Re: [PERFORM] Perfomance Tuning

2003-08-08 Thread Andrew Sullivan
usually write journalled or equivalent for this reason. I think UFS with soft updates is a good example of this. You also don't need complete journalling in most cases -- metadata is probably sufficient, given fsync. A -- Andrew Sullivan 204-4141 Yonge Street Liberty

Re: [PERFORM] Odd explain estimate

2003-07-31 Thread Andrew Sullivan
might want to investigate expainding the statistics on the indexed column, increasing the correlation through clustering, and other such tricks. A -- Andrew Sullivan 204-4141 Yonge Street Liberty RMS Toronto, Ontario Canada [EMAIL PROTECTED

Re: [PERFORM] Mapping a database completly into Memory

2003-07-28 Thread Andrew Sullivan
at managing very large buffer sets. A -- Andrew Sullivan 204-4141 Yonge Street Liberty RMS Toronto, Ontario Canada [EMAIL PROTECTED] M2P 2A8 +1 416 646 3304 x110

Re: [PERFORM] Clearing rows periodically

2003-07-18 Thread Andrew Sullivan
want to increase your FSM settings. See the docs. A -- Andrew Sullivan 204-4141 Yonge Street Liberty RMS Toronto, Ontario Canada [EMAIL PROTECTED] M2P 2A8 +1 416 646 3304

Re: [PERFORM] Hardware performance

2003-07-17 Thread Andrew Sullivan
RAID boxes :-( ), putting WAL on a disk of its own yielded something like 30% improvement in throughput on high transaciton volumes. So it's definitely important in some cases. A Andrew Sullivan 204-4141 Yonge Street Liberty RMS Toronto, Ontario

Re: [PERFORM] Dual Xeon + HW RAID question

2003-07-14 Thread Andrew Sullivan
failure, you need 1 (or some combination of 0 and 1, or 5). A -- Andrew Sullivan 204-4141 Yonge Street Liberty RMS Toronto, Ontario Canada [EMAIL PROTECTED] M2P 2A8 +1 416

Re: [PERFORM] Pgsql - Red Hat Linux - VS MySQL VS MSSQL

2003-07-14 Thread Andrew Sullivan
of thing in the application come to regret it. You probably want to look somewhere else to solve your performance difficulties from FKs. A -- Andrew Sullivan 204-4141 Yonge Street Liberty RMS Toronto, Ontario Canada [EMAIL PROTECTED

Re: [PERFORM] Pgsql - Red Hat Linux - VS MySQL VS MSSQL

2003-07-14 Thread Andrew Sullivan
everytime a new release comes out would be way too much work. It's not clear that the RPMs will help you in ease of upgrade. More precisely, be real sure you dump your database before upgrading major versions (e.g. 7.3.x to 7.4.x). A -- Andrew Sullivan 204-4141 Yonge

Re: [PERFORM] Strange result: UNIX vs. TCP/IP sockets

2003-07-08 Thread Andrew Sullivan
results. If we discover any more, I'll post it here. A -- Andrew Sullivan 204-4141 Yonge Street Liberty RMS Toronto, Ontario Canada [EMAIL PROTECTED] M2P 2A8 +1 416 646 3304

<    1   2