Re: [PERFORM] Hardware suggestions for maximum read performance

2013-05-03 Thread Arjen van der Meijden
3x200GB suggests you want to use RAID5? Perhaps you should just pick 2x200GB and set them to RAID1. With roughly 200GB of storage, that should still easily house your potentially 10GB-database with ample of room to allow the SSD's to balance the writes. But you save the investment and its

Re: [PERFORM] fast read of binary data

2012-11-12 Thread Arjen van der Meijden
On 12-11-2012 11:45, Eildert Groeneveld wrote: Dear All I am currently implementing using a compressed binary storage scheme genotyping data. These are basically vectors of binary data which may be megabytes in size. Our current implementation uses the data type bit varying. Wouldn't 'bytea'

Re: [PERFORM] SSD options, small database, ZFS

2011-11-17 Thread Arjen van der Meijden
On 18-11-2011 4:44 CSS wrote: Resurrecting this long-dormant thread... Btw, the 5500 and 5600 Xeons are normally more efficient with a multiple of 6 ram-modules, so you may want to have a look at 24GB (6x4), 36GB (6x4+6x2) or 48GB (12x4 or 6x8) RAM. Thanks - I really had a hard time

Re: [PERFORM] SSD options, small database, ZFS

2011-10-14 Thread Arjen van der Meijden
On 14-10-2011 10:23, CSS wrote: -I'm calling our combined databases at 133GB small, fair assumption? -Is there any chance that a server with dual quad core xeons, 32GB RAM, and 2 or 4 SSDs (assume mirrored) could be slower than the 4 old servers described above? I'm beating those on raw cpu,

Re: [PERFORM] Adding more memory = hugh cpu load [solved]

2011-10-11 Thread Arjen van der Meijden
On 11-10-2011 20:05 Claudio Freire wrote: On Tue, Oct 11, 2011 at 3:02 PM, alexandre - aldeia digital adald...@gmail.com wrote: 2) Change all memory chips to new others, instead of maintain the old (16 GB) + new (32 GB). Of course, mixing disables double/triple/whatuple channel, and makes

Re: [PERFORM] Suggestions for Intel 710 SSD test

2011-10-02 Thread Arjen van der Meijden
Anandtech took the trouble of doing that: http://www.anandtech.com/show/4902/intel-ssd-710-200gb-review I think the main advantage of the 710 compared to the 320 is its much heavier over-provisioning and better quality MLC-chips. Both the 320 and 710 use the same controller and offer similar

Re: [PERFORM] RAID Controller (HP P400) beat by SW-RAID?

2011-09-13 Thread Arjen van der Meijden
On 12-9-2011 0:44 Anthony Presley wrote: A few weeks back, we purchased two refurb'd HP DL360's G5's, and were hoping to set them up with PG 9.0.2, running replicated. These machines have (2) 5410 Xeon's, 36GB of RAM, (6) 10k SAS drives, and are using the HP SA P400i with 512MB of BBWC. PG is

Re: [PERFORM] Linux: more cores = less concurrency.

2011-04-12 Thread Arjen van der Meijden
On 11-4-2011 22:04 da...@lang.hm wrote: in your case, try your new servers without hyperthreading. you will end up with a 4x4 core system, which should handily outperform the 2x4 core system you are replacing. the limit isn't 8 cores, it's that the hyperthreaded cores don't work well with the

Re: [PERFORM] Request for feedback on hardware for a new database server

2011-03-18 Thread Arjen van der Meijden
On 18-3-2011 4:02 Scott Marlowe wrote: On Thu, Mar 17, 2011 at 6:51 PM, Oliver Charles postgresql-p...@ocharles.org.uk wrote: Another point. My experience with 1U chassis and cooling is that they don't move enough air across their cards to make sure they stay cool. You'd be better off

Re: [PERFORM] Request for feedback on hardware for a new database server

2011-03-18 Thread Arjen van der Meijden
On 18-3-2011 10:11, Scott Marlowe wrote: On Fri, Mar 18, 2011 at 1:16 AM, Arjen van der Meijden acmmail...@tweakers.net wrote: On 18-3-2011 4:02 Scott Marlowe wrote: We have several 1U boxes (mostly Dell and Sun) running and had several in the past. And we've never had any heating problems

Re: [PERFORM] Anyone tried Flashcache with PostgreSQL?

2011-03-03 Thread Arjen van der Meijden
On 2-3-2011 16:29 Robert Haas wrote: On Mon, Feb 28, 2011 at 2:09 PM, Josh Berkusj...@agliodbs.com wrote: Does anyone have the hardware to test FlashCache with PostgreSQL? http://perspectives.mvdirona.com/2010/04/29/FacebookFlashcache.aspx I'd be interested to hear how it performs ... It'd

Re: [PERFORM] Hardware recommendations

2010-12-10 Thread Arjen van der Meijden
On 10-12-2010 14:58 Andy wrote: We use ZFS and use SSDs for both the log device and L2ARC. All disks and SSDs are behind a 3ware with BBU in single disk mode. Out of curiosity why do you put your log on SSD? Log is all sequential IOs, an area in which SSD is not any faster than HDD. So I'd

Re: [PERFORM] Hardware recommendations

2010-12-10 Thread Arjen van der Meijden
On 10-12-2010 18:57 Arjen van der Meijden wrote: Have a look here: http://www.anandtech.com/show/2829/21 The sequential writes-graphs consistently put several SSD's at twice the performance of the VelociRaptor 300GB 10k rpm disk and that's a test from over a year old, current SSD's have

Re: [PERFORM] best db schema for time series data?

2010-11-16 Thread Arjen van der Meijden
On 16-11-2010 11:50, Louis-David Mitterrand wrote: I have to collect lots of prices from web sites and keep track of their changes. What is the best option? 1) one 'price' row per price change: create table price ( id_price primary key, id_product

Re: [PERFORM] turn off caching for performance test

2010-08-26 Thread Arjen van der Meijden
Isn't it more fair to just flush the cache before doing each of the queries? In real-life, you'll also have disk caching... Flushing the buffer pool is easy, just restart PostgreSQL (or perhaps there is a admin command for it too?). Flushing the OS-disk cache is obviously OS-dependent, for

Re: [PERFORM] Completely un-tuned Postgresql benchmark results: SSD vs desktop HDD

2010-08-12 Thread Arjen van der Meijden
On 12-8-2010 2:53 gnuo...@rcn.com wrote: - The value of SSD in the database world is not as A Faster HDD(tm). Never was, despite the naive' who assert otherwise. The value of SSD is to enable BCNF datastores. Period. If you're not going to do that, don't bother. Silicon storage will never

Re: [PERFORM] Completely un-tuned Postgresql benchmark results: SSD vs desktop HDD

2010-08-12 Thread Arjen van der Meijden
On 13-8-2010 1:40 Scott Carey wrote: Agreed. There is a HUGE gap between ooh ssd's are fast, look! and engineering a solution that uses them properly with all their strengths and faults. And as 'gnuoytr' points out, there is a big difference between an Intel SSD and say, this thing:

Re: [PERFORM] Using high speed swap to improve performance?

2010-04-02 Thread Arjen van der Meijden
What about FreeBSD with ZFS? I have no idea which features they support and which not, but it at least is a bit more free than Solaris and still offers that very nice file system. Best regards, Arjen On 2-4-2010 21:15 Christiaan Willemsen wrote: Hi there, About a year ago we setup a

Re: [PERFORM] mysql to postgresql, performance questions

2010-03-18 Thread Arjen van der Meijden
On 18-3-2010 16:50 Scott Marlowe wrote: It's different because it only takes pgsql 5 milliseconds to run the query, and 40 seconds to transfer the data across to your applicaiton, which THEN promptly throws it away. If you run it as MySQL's client lib doesn't transfer over the whole thing.

Re: [PERFORM] SSD + RAID

2010-02-21 Thread Arjen van der Meijden
On 22-2-2010 6:39 Greg Smith wrote: But the point of this whole testing exercise coming back into vogue again is that SSDs have returned this negligent behavior to the mainstream again. See http://opensolaris.org/jive/thread.jspa?threadID=121424 for a discussion of this in a ZFS context just

Re: [PERFORM] renice on an I/O bound box

2010-01-19 Thread Arjen van der Meijden
On 19-1-2010 13:59 Willy-Bas Loos wrote: Hi, I have a query that runs for about 16 hours, it should run at least weekly. There are also clients connecting via a website, we don't want to keep them waiting because of long DSS queries. We use Debian Lenny. I've noticed that renicing the process

Re: [PERFORM] Air-traffic benchmark

2010-01-07 Thread Arjen van der Meijden
On 7-1-2010 13:38 Lefteris wrote: I decided to run the benchmark over postgres to get some more experience and insights. Unfortunately, the query times I got from postgres were not the expected ones: Why were they not expected? In the given scenario, column databases are having a huge

Re: [PERFORM] PostgreSQL 8.4 performance tuning questions

2009-07-30 Thread Arjen van der Meijden
On 30-7-2009 20:46 Scott Carey wrote: Of course Compression has a HUGE effect if your I/O system is half-decent. Max GZIP compression speed with the newest Intel CPU's is something like 50MB/sec (it is data dependant, obviously -- it is usually closer to 30MB/sec). Max gzip decompression ranges

Re: [PERFORM] AMD Shanghai versus Intel Nehalem

2009-05-14 Thread Arjen van der Meijden
On 13-5-2009 20:39 Scott Carey wrote: Excellent! That is a pretty huge boost. I'm curious which aspects of this new architecture helped the most. For Postgres, the following would seem the most relevant: 1. Shared L3 cache per processors -- more efficient shared datastructure access. 2.

Re: [PERFORM] AMD Shanghai versus Intel Nehalem

2009-05-13 Thread Arjen van der Meijden
We have a dual E5540 with 16GB (I think 1066Mhz) memory here, but no AMD Shanghai. We haven't done PostgreSQL benchmarks yet, but given the previous experiences, PostgreSQL should be equally faster compared to mysql. Our databasebenchmark is actually mostly a cpu/memory-benchmark. Comparing

Re: [PERFORM] linux deadline i/o elevator tuning

2009-04-09 Thread Arjen van der Meijden
On 9-4-2009 16:09 Kevin Grittner wrote: I haven't benchmarked it, but when one of our new machines seemed a little sluggish, I found this hadn't been set. Setting this and rebooting Linux got us back to our normal level of performance. Why would you reboot after changing the elevator? For

Re: [PERFORM] suggestions for postgresql setup on Dell 2950 , PERC6i controller

2009-02-06 Thread Arjen van der Meijden
On 4-2-2009 22:36 Scott Marlowe wrote: We purhcased the Perc 5E, which dell wanted $728 for last fall with 8 SATA disks in an MD-1000 and the performance is just terrible. No matter what we do the best throughput on any RAID setup was about 30 megs/second write and 60 Megs/second read. I can

Re: [PERFORM] suggestions for postgresql setup on Dell 2950 , PERC6i controller

2009-02-06 Thread Arjen van der Meijden
On 6-2-2009 16:27 Bruce Momjian wrote: The experiences I have heard is that Dell looks at server hardware in the same way they look at their consumer gear, If I put in a cheaper part, how much will it cost Dell to warranty replace it. Sorry, but I don't look at my performance or downtime in the

Re: [PERFORM] suggestions for postgresql setup on Dell 2950 , PERC6i controller

2009-02-04 Thread Arjen van der Meijden
On 4-2-2009 21:09 Scott Marlowe wrote: I have little experience with the 6i. I do have experience with all the Percs from the 3i/3c series to the 5e series. My experience has taught me that a brand new, latest model $700 Dell RAID controller is about as good as a $150 LSI, Areca, or

Re: [PERFORM] large tables and simple = constant queries using indexes

2008-04-10 Thread Arjen van der Meijden
rows=2455 loops=1) Recheck Cond: (gene_ref = 301) - Bitmap Index Scan on ix_gene_prediction_view_gene_ref (cost=0.00..43.65 rows=2404 width=0) (actual time=38.472..38.472 rows=2455 loops=1) Index Cond: (gene_ref = 301) Total runtime: 94.622 ms Arjen van der

Re: [PERFORM] large tables and simple = constant queries using indexes

2008-04-09 Thread Arjen van der Meijden
First of all, there is the 'explain analyze' output, which is pretty helpful in postgresql. My guess is, postgresql decides to do a table scan for some reason. It might not have enough statistics for this particular table or column, to make a sound decision. What you can try is to increase

Re: [PERFORM] SSDs

2008-04-02 Thread Arjen van der Meijden
My colleague has tested a single Mtron Mobo's and a set of 4. He also mentioned the write performance was pretty bad compared to a Western Digital Raptor. He had a solution for that however, just plug the SSD in a raid-controller with decent cache performance (his favorites are the Areca

Re: [PERFORM] Anyone using a SAN?

2008-02-13 Thread Arjen van der Meijden
On 13-2-2008 22:06 Tobias Brox wrote: What I'm told is that the state-of-the-art SAN allows for an insane amount of hard disks to be installed, much more than what would fit into any decent database server. We've ended up buying a SAN, the physical installation was done last week, and I will be

Re: [PERFORM] 8x2.5 or 6x3.5 disks

2008-01-29 Thread Arjen van der Meijden
There are several suppliers who offer Seagate's 2.5 15k rpm disks, I know HP, Dell are amongst those. So I was actually refering to those, rather than to the 10k one's. Best regards, Arjen [EMAIL PROTECTED] wrote: On Mon, 28 Jan 2008, Arjen van der Meijden wrote: On 28-1-2008 20:25

Re: [PERFORM] 8x2.5 or 6x3.5 disks

2008-01-28 Thread Arjen van der Meijden
On 28-1-2008 20:25 Christian Nicolaisen wrote: So, my question is: should I go for the 2.5 disk setup or 3.5 disk setup, and does the raid setup in either case look correct? Afaik they are about equal in speed. With the smaller ones being a bit faster in random access and the larger ones a

Re: [PERFORM] Hardware for PostgreSQL

2007-10-31 Thread Arjen van der Meijden
On 31-10-2007 17:45 Ketema wrote: I understand query tuning and table design play a large role in performance, but taking that factor away and focusing on just hardware, what is the best hardware to get for Pg to work at the highest level (meaning speed at returning results)? It really depends

Re: [PERFORM] Problems with + 1 million record table

2007-10-05 Thread Arjen van der Meijden
On 5-10-2007 16:34 Cláudia Macedo Amorim wrote: [13236.470] statement_type=0, statement='select a_teste_nestle.CODCLI, a_teste_nestle.CODFAB, a_teste_nestle.CODFAMILIANESTLE, a_teste_nestle.CODFILIAL, a_teste_nestle.CODGRUPONESTLE, a_teste_nestle.CODSUBGRUPONESTLE,

Re: [PERFORM] SAN vs Internal Disks

2007-09-06 Thread Arjen van der Meijden
On 6-9-2007 14:35 Harsh Azad wrote: 2x Quad Xeon 2.4 Ghz (4-way only 2 populated right now) I don't understand this sentence. You seem to imply you might be able to fit more processors in your system? Currently the only Quad Core's you can buy are dual-processor processors, unless you

Re: [PERFORM] SAN vs Internal Disks

2007-09-06 Thread Arjen van der Meijden
On 6-9-2007 20:42 Scott Marlowe wrote: On 9/6/07, Harsh Azad [EMAIL PROTECTED] wrote: Hi, How about the Dell Perc 5/i card, 512MB battery backed cache or IBM ServeRAID-8k Adapter? All Dell Percs have so far been based on either adaptec or LSI controllers, and have ranged from really bad to

Re: [PERFORM] SAN vs Internal Disks

2007-09-06 Thread Arjen van der Meijden
On 6-9-2007 20:29 Mark Lewis wrote: Maybe I'm jaded by past experiences, but the only real use case I can see to justify a SAN for a database would be something like Oracle RAC, but I'm not aware of any PG equivalent to that. PG Cluster II seems to be able to do that, but I don't know whether

Re: [PERFORM] Dell Hardware Recommendations

2007-08-09 Thread Arjen van der Meijden
On 9-8-2007 23:50 Merlin Moncure wrote: Where the extra controller especially pays off is if you have to expand to a second tray. It's easy to add trays but installing controllers on a production server is scary. For connectivity-sake that's not a necessity. You can either connect (two?)

Re: [PERFORM] disable archiving

2007-07-23 Thread Arjen van der Meijden
Perhaps you should've read the configuration-manual-page more carefully. ;) Besides, WAL-archiving is turned off by default, so if you see them being archived you actually enabled it earlier The archive_command is empty by default: If this is an empty string (the default), WAL archiving is

Re: [PERFORM] insert vs select into performance

2007-07-17 Thread Arjen van der Meijden
Have you also tried the COPY-statement? Afaik select into is similar to what happens in there. Best regards, Arjen On 17-7-2007 21:38 Thomas Finneid wrote: Hi I was doing some testing on insert compared to select into. I inserted 100 000 rows (with 8 column values) into a table, which took

Re: [PERFORM] Append table

2007-06-02 Thread Arjen van der Meijden
There are two solutions: You can insert all data from tableB in tableA using a simple insert select-statement like so: INSERT INTO tabelA SELECT EmpId, EmpName FROM tabelB; Or you can visually combine them without actually putting the records in a single table. That can be with a normal

Re: [PERFORM] Postgres Benchmark Results

2007-05-20 Thread Arjen van der Meijden
I assume red is PostgreSQL and green is MySQL. That reflects my own benchmarks with those two. But I don't fully understand what the graph displays. Does it reflect the ability of the underlying database to support a certain amount of users per second given a certain database size? Or is the

Re: [PERFORM] Diminishing bandwidth performance with multiple quad core X5355s

2007-05-20 Thread Arjen van der Meijden
van der Meijden ---(end of broadcast)--- TIP 5: don't forget to increase your free space map settings

Re: [PERFORM] Postgres Benchmark Results

2007-05-20 Thread Arjen van der Meijden
?) which eliminates several scaling issues in InnoDB, but afaik not all of them. Besides that, it just can be pretty painful to get a certain query fast, although we've not very often seen it failing completely in the last few years. Best regards, Arjen van der Meijden

Re: [PERFORM] index structure for 114-dimension vector

2007-04-27 Thread Arjen van der Meijden
On 21-4-2007 1:42 Mark Kirkwood wrote: I don't think that will work for the vector norm i.e: |x - y| = sqrt(sum over j ((x[j] - y[j])^2)) I don't know if this is usefull here, but I was able to rewrite that algorithm for a set of very sparse vectors (i.e. they had very little overlapping

Re: [PERFORM] fast DISTINCT or EXIST

2007-04-07 Thread Arjen van der Meijden
Can't you use something like this? Or is the distinct on the t.cd_id still causing the major slowdown here? SELECT ... FROM cd JOIN tracks ... WHERE cd.id IN (SELECT DISTINCT t.cd_id FROM tracks t WHERE t.tstitle @@ plainto_tsquery('simple','education') LIMIT 10) If that is your main

Re: [PERFORM] fast DISTINCT or EXIST

2007-04-07 Thread Arjen van der Meijden
On 7-4-2007 18:24 Tilo Buschmann wrote: Unfortunately, the query above will definitely not work correctly, if someone searches for a or the. That are two words you may want to consider not searching on at all. As Tom said, its not very likely to be fixed in PostgreSQL. But you can always

Re: [PERFORM] SCSI vs SATA

2007-04-05 Thread Arjen van der Meijden
If the 3U case has a SAS-expander in its backplane (which it probably has?) you should be able to connect all drives to the Adaptec controller, depending on the casing's exact architecture etc. That's another two advantages of SAS, you don't need a controller port for each harddisk (we have a

Re: [PERFORM] SCSI vs SATA

2007-04-05 Thread Arjen van der Meijden
On 5-4-2007 17:58 [EMAIL PROTECTED] wrote: On Apr 5, 2007, at 4:09 AM, Ron wrote: BE VERY WARY OF USING AN ADAPTEC RAID CONTROLLER! Thanks - I received similar private emails with the same advice. I will change the controller to a LSI MegaRAID SAS 8408E -- any feedback on this one? We

Re: [PERFORM] SCSI vs SATA

2007-04-04 Thread Arjen van der Meijden
On 4-4-2007 0:13 [EMAIL PROTECTED] wrote: We need to upgrade a postgres server. I'm not tied to these specific alternatives, but I'm curious to get feedback on their general qualities. SCSI dual xeon 5120, 8GB ECC 8*73GB SCSI 15k drives (PERC 5/i) (dell poweredge 2900) This is a SAS

Re: [PERFORM] SCSI vs SATA

2007-04-04 Thread Arjen van der Meijden
On 4-4-2007 21:17 [EMAIL PROTECTED] wrote: fwiw, I've had horrible experiences with areca drivers on linux. I've found them to be unreliable when used with dual AMD64 processors 4+ GB of ram. I've tried kernels 2.16 up to 2.19... intermittent yet inevitable ext3 corruptions. 3ware cards, on

Re: [PERFORM] [EMAIL PROTECTED]: Progress on scaling of FreeBSD on 8 CPU systems]

2007-03-05 Thread Arjen van der Meijden
And here is that latest benchmark we did, using a 8 dual core opteron Sun Fire x4600. Unfortunately PostgreSQL seems to have some difficulties scaling over 8 cores, but not as bad as MySQL. http://tweakers.net/reviews/674 Best regards, Arjen Arjen van der Meijden wrote: Alvaro Herrera

Re: [PERFORM] [EMAIL PROTECTED]: Progress on scaling of FreeBSD on 8 CPU systems]

2007-03-05 Thread Arjen van der Meijden
Stefan Kaltenbrunner wrote: ouch - do I read that right that even after tom's fixes for the regressions in 8.2.0 we are still 30% slower then the -HEAD checkout from the middle of the 8.2 development cycle ? Yes, and although I tested about 17 different cvs-checkouts, Tom and I weren't

Re: [PERFORM] Opinions on Raid

2007-03-03 Thread Arjen van der Meijden
On 28-2-2007 0:42 Geoff Tolley wrote: [2] How do people on this list monitor their hardware raid? Thus far we have used Dell and the only way to easily monitor disk status is to use their openmanage application. Do other controllers offer easier means of monitoring individual disks in a raid

Re: [PERFORM] [EMAIL PROTECTED]: Progress on scaling of FreeBSD on 8 CPU systems]

2007-03-02 Thread Arjen van der Meijden
Alvaro Herrera wrote: Interesting -- the MySQL/Linux graph is very similar to the graphs from the .nl magazine posted last year. I think this suggests that the MySQL deficiency was rather a performance bug in Linux, not in MySQL itself ... The latest benchmark we did was both with Solaris and

Re: [PERFORM] quad or dual core Intel CPUs

2007-02-13 Thread Arjen van der Meijden
the processors/memory from the big disk array. Best regards and good luck, Arjen van der Meijden ---(end of broadcast)--- TIP 3: Have you checked our extensive FAQ? http://www.postgresql.org/docs/faq

Re: [PERFORM] Configuration Advice

2007-01-18 Thread Arjen van der Meijden
On 18-1-2007 0:37 Adam Rich wrote: 4) Complex queries that might take advantage of the MySQL Query Cache since the base data never changes Have you ever compared MySQL's performance with complex queries to PostgreSQL's? I once had a query which would operate on a recordlist and see whether

Re: [PERFORM] Configuration Advice

2007-01-18 Thread Arjen van der Meijden
On 18-1-2007 17:20 Scott Marlowe wrote: Besides that, mysql rewrites the entire table for most table-altering statements you do (including indexes). Note that this applies to the myisam table type. innodb works quite differently. It is more like pgsql in behaviour, and is an mvcc storage

Re: [PERFORM] Configuration Advice

2007-01-18 Thread Arjen van der Meijden
On 18-1-2007 18:28 Jeremy Haile wrote: I once had a query which would operate on a recordlist and see whether there were any gaps larger than 1 between consecutive primary keys. Would you mind sharing the query you described? I am attempting to do something similar now. Well it was over

Re: [PERFORM] Configuration Advice

2007-01-18 Thread Arjen van der Meijden
On 18-1-2007 23:11 Tom Lane wrote: Increase work_mem? It's not taking the hash because it thinks it won't fit in memory ... When I increase it to 128MB in the session (arbitrarily selected relatively large value) it indeed has the other plan. Best regards, Arjen

Re: [PERFORM] opportunity to benchmark a quad core Xeon

2006-12-16 Thread Arjen van der Meijden
On 16-12-2006 4:24 Jeff Frost wrote: We can add more RAM and drives for testing purposes. Can someone suggest what benchmarks with what settings would be desirable to see how this system performs. I don't believe I've seen any postgres benchmarks done on a quad xeon yet. We've done our

Re: [PERFORM] 8.2rc1 (much) slower than 8.2dev?

2006-12-07 Thread Arjen van der Meijden
On 7-12-2006 7:01 Jim C. Nasby wrote: Can you post them on the web somewhere so everyone can look at them? No, its not (only) the size that matters, its the confidentiality I'm not allowed to just break by myself. Well, at least not on a scale like that. I've been mailing off-list with Tom and

Re: [PERFORM] Core 2 or Opteron

2006-12-07 Thread Arjen van der Meijden
These benchmarks are all done using 64 bit linux: http://tweakers.net/reviews/646 Best regards, Arjen On 7-12-2006 11:18 Mindaugas wrote: Hello, We're planning new server or two for PostgreSQL and I'm wondering Intel Core 2 (Woodcrest for servers?) or Opteron is faster for PostgreSQL now?

Re: [PERFORM] Core 2 or Opteron

2006-12-07 Thread Arjen van der Meijden
On 7-12-2006 12:05 Mindaugas wrote: Now about 2 core vs 4 core Woodcrest. For HP DL360 I see similarly priced dual core [EMAIL PROTECTED] and four core [EMAIL PROTECTED] According to article's scaling data PostgreSQL performance should be similar (1.86GHz * 2 * 80% = ~3GHz). And quad core has

Re: [PERFORM] 8.2rc1 (much) slower than 8.2dev?

2006-12-04 Thread Arjen van der Meijden
Tom Lane wrote: Arjen van der Meijden [EMAIL PROTECTED] writes: I'll run another analyze on the database to see if that makes any difference, but after that I'm not sure what to check first to figure out where things go wrong? Look for changes in plans? Yeah, there are a few number

[PERFORM] 8.2rc1 (much) slower than 8.2dev?

2006-12-03 Thread Arjen van der Meijden
another analyze on the database to see if that makes any difference, but after that I'm not sure what to check first to figure out where things go wrong? Best regards, Arjen van der Meijden Tweakers.net ---(end of broadcast)--- TIP 5: don't forget

Re: [PERFORM] availability of SATA vendors

2006-11-23 Thread Arjen van der Meijden
and they have been excellent. Here (on your site) are results that bear this out: http://tweakers.net/reviews/639/9 - Luke On 11/22/06 11:07 AM, Arjen van der Meijden [EMAIL PROTECTED] wrote: Jeff, You can find some (Dutch) results here on our website: http://tweakers.net/reviews/647/5 You'll

Re: [PERFORM] availability of SATA vendors

2006-11-22 Thread Arjen van der Meijden
Jeff, You can find some (Dutch) results here on our website: http://tweakers.net/reviews/647/5 You'll find the AMCC/3ware 9550SX-12 with up to 12 disks, Areca 1280 and 1160 with up to 14 disks and a Promise and LSI sata-raid controller with each up to 8 disks. Btw, that Dell Perc5 (sas) is

Re: [PERFORM] availability of SATA vendors

2006-11-17 Thread Arjen van der Meijden
On 17-11-2006 18:45 Jeff Frost wrote: I see many of you folks singing the praises of the Areca and 3ware SATA controllers, but I've been trying to price some systems and am having trouble finding a vendor who ships these controllers with their systems. Are you rolling your own white boxes or

Re: [PERFORM] Query plan for heavy SELECT with lite sub-SELECTs

2006-11-03 Thread Arjen van der Meijden
Alvaro Herrera wrote: Performance analysis of strange queries is useful, but the input queries have to be meaningful as well. Otherwise you end up optimizing bizarre and useless cases. I had a similar one a few weeks ago. I did some batch-processing over a bunch of documents and discovered

Re: [PERFORM] New hardware thoughts

2006-10-23 Thread Arjen van der Meijden
On 20-10-2006 22:33 Ben Suffolk wrote: How about the Fujitsu Siemens Sun Clones? I have not really looked at them but have heard the odd good thing about them. Fujitsu doesn't build Sun clones! That really is insulting for them ;-) They do offer Sparc-hardware, but that's a bit higher up the

Re: [PERFORM] New hardware thoughts

2006-10-22 Thread Arjen van der Meijden
On 20-10-2006 16:58 Dave Cramer wrote: Ben, My option in disks is either 5 x 15K rpm disks or 8 x 10K rpm disks (all SAS), or if I pick a different server I can have 6 x 15K rpm or 8 x 10K rpm (again SAS). In each case controlled by a PERC 5/i (which I think is an LSI Mega Raid SAS 8408E

Re: [PERFORM] Hints proposal

2006-10-12 Thread Arjen van der Meijden
On 12-10-2006 21:07 Jeff Davis wrote: On Thu, 2006-10-12 at 19:15 +0200, Csaba Nagy wrote: To formalize the proposal a litte, you could have syntax like: CREATE HINT [FOR USER username] MATCHES regex APPLY HINT some_hint; Where some_hint would be a hinting language perhaps like Jim's, except

Re: [PERFORM] Opteron vs. Xeon benchmark

2006-09-22 Thread Arjen van der Meijden
Try the translation ;) http://tweakers.net/reviews/646/13 On 22-9-2006 10:32 Hannes Dorbath wrote: A colleague pointed me to this site tomorrow: http://tweakers.net/reviews/642/13 I can't read the language, so can't get a grip on what exactly the benchmark was about. Their diagrams show

Re: [PERFORM] Opteron vs. Xeon benchmark

2006-09-22 Thread Arjen van der Meijden
with previous processors they were the slower player ;) Best regards, Arjen van der Meijden ---(end of broadcast)--- TIP 3: Have you checked our extensive FAQ? http://www.postgresql.org/docs/faq

Re: [PERFORM] PostgreSQL and sql-bench

2006-09-21 Thread Arjen van der Meijden
, is when you have to service a lot of concurrent visitors. But if you benchmark only with a single thread or do benchmarks that are no where near a real-life environment, it may show very different results of course. Best regards, Arjen van der Meijden ---(end of broadcast

Re: [PERFORM] Optimize SQL

2006-09-15 Thread Arjen van der Meijden
On 15-9-2006 17:53 Tom Lane wrote: If that WHERE logic is actually what you need, then getting this query to run quickly seems pretty hopeless. The database must form the full outer join result: it cannot discard any listing0_ rows, even if they have lastupdate outside the given range, because

Re: [PERFORM] Xeon Woodcrest/Dempsey vs Opteron Socket F/940 with

2006-09-08 Thread Arjen van der Meijden
Dave Cramer wrote: Hi, Arjen, The Woodcrest is quite a bit faster than the Opterons. Actually... With Hyperthreading *enabled* the older Dempsey-processor is also faster than the Opterons with PostgreSQL. But then again, it is the top-model Dempsey and not a top-model Opteron so that isn't

Re: [PERFORM] Xeon Woodcrest/Dempsey vs Opteron Socket F/940 with

2006-09-08 Thread Arjen van der Meijden
On 8-9-2006 15:01 Dave Cramer wrote: But then again, systems with the Woodcrest 5150 (the subtop one) and Opteron 280 (also the subtop one) are about equal in price, so its not a bad comparison in a bang-for-bucks point of view. The Dempsey was added to show how both the Opteron and the

Re: [PERFORM] Xeon Woodcrest/Dempsey vs Opteron Socket F/940 with

2006-09-08 Thread Arjen van der Meijden
On 8-9-2006 18:18 Stefan Kaltenbrunner wrote: interesting - so this is a mostly CPU-bound benchmark ? Out of curiousity have you done any profiling on the databases under test to see where they are spending their time ? Yeah, it is. We didn't do any profiling. We had a Sun-engineer visit us

[PERFORM] Xeon Woodcrest/Dempsey vs Opteron Socket F/940 with postgresql and some SAS raid-figures

2006-09-07 Thread Arjen van der Meijden
postgresql, so you shouldn't read them as absolute for all your situations ;-) But you can get a good impression I think. Best regards, Arjen van der Meijden Tweakers.net ---(end of broadcast)--- TIP 3: Have you checked our extensive FAQ

Re: [PERFORM] most bang for buck with ~ $20,000

2006-08-18 Thread Arjen van der Meijden
weeks/months for Dell to release something newer? -Kenji On Wed, Aug 09, 2006 at 07:35:22AM +0200, Arjen van der Meijden wrote: With such a budget you should easily be able to get something like: - A 1U high-performance server (for instance the Dell 1950 with 2x Woodcrest 5160, 16GB of FB-Dimm

Re: [PERFORM] most bang for buck with ~ $20,000

2006-08-18 Thread Arjen van der Meijden
a load average of about .5 on a dual Xeon 3.06Ghz P4 setup. How much CPU performance improvement do you think the new woodcrest cpus are over these? -Kenji On Fri, Aug 18, 2006 at 09:41:55PM +0200, Arjen van der Meijden wrote: Hi Kenji, I'm not sure what you mean by 'something newer

Re: [PERFORM] PostgreSQL runs a query much slower than BDE and MySQL

2006-08-16 Thread Arjen van der Meijden
On 16-8-2006 18:48, Peter Hardman wrote: Using identically structured tables and the same primary key, if I run this on Paradox/BDE it takes about 120ms, on MySQL (5.0.24, local server) about 3ms, and on PostgresSQL (8.1.3, local server) about 1290ms). All on the same Windows XP Pro machine

Re: [PERFORM] most bang for buck with ~ $20,000

2006-08-09 Thread Arjen van der Meijden
with SCSI interface connectors? I didn't see these types of boxes availble on Dell website, I'll look again. -Kenji On Wed, Aug 09, 2006 at 07:35:22AM +0200, Arjen van der Meijden wrote: With such a budget you should easily be able to get something like: - A 1U high-performance server (for instance

Re: [PERFORM] most bang for buck with ~ $20,000

2006-08-08 Thread Arjen van der Meijden
(amd opteron 285 or intel woorcrest 5160) and 16GB of memory (even FB Dimm, which is pretty expensive). Best regards, Arjen van der Meijden On 8-8-2006 22:43, Kenji Morishige wrote: I've asked for some help here a few months ago and got some really helpfull answers regarding RAID controllers

Re: [PERFORM] PostgreSQL scalability on Sun UltraSparc T1

2006-08-07 Thread Arjen van der Meijden
Hi Markus, As said, our environment really was a read-mostly one. So we didn't do much inserts/updates and thus spent no time tuning those values and left them as default settings. Best regards, Arjen Markus Schaber wrote: Hi, Arjen, Arjen van der Meijden wrote: It was the 8core

Re: [PERFORM] PostgreSQL scalability on Sun UltraSparc T1

2006-08-01 Thread Arjen van der Meijden
On 1-8-2006 19:26, Jim C. Nasby wrote: On Sat, Jul 29, 2006 at 08:43:49AM -0700, Joshua D. Drake wrote: I'd love to get an english translation that we could use for PR. Actually, we have an english version of the Socket F follow-up. http://tweakers.net/reviews/638 which basically displays

Re: [PERFORM] PostgreSQL scalability on Sun UltraSparc T1

2006-07-31 Thread Arjen van der Meijden
tuning of the OS, nor did Hans for the MySQL-optimizations (afaik, but then again, he knows best). Best regards, Arjen van der Meijden Jignesh Shah wrote: Hi Arjen, I am curious about your Sun Studio compiler options also. Can you send that too ? Any other tweakings that you did on Solaris

Re: [PERFORM] Performances with new Intel Core* processors

2006-07-31 Thread Arjen van der Meijden
regards, Arjen van der Meijden Tweakers.net ---(end of broadcast)--- TIP 6: explain analyze is your friend

Re: [PERFORM] PostgreSQL scalability on Sun UltraSparc T1

2006-07-29 Thread Arjen van der Meijden
On 29-7-2006 17:43, Joshua D. Drake wrote: I would love to get my hands on that postgresql version and see how much farther it could be optimized. You probably mean the entire installation? As said in my reply to Jochem, I've spent a few days testing all queries to improve their

Re: [HACKERS] [PERFORM] Sun Donated a Sun Fire T2000 to the PostgreSQL

2006-06-22 Thread Arjen van der Meijden
On 22-6-2006 15:03, David Roussel wrote: Sureky the 'perfect' line ought to be linear? If the performance was perfectly linear, then the 'pages generated' ought to be G times the number (virtual) processors, where G is the gradient of the graph. In such a case the graph will go through the

Re: [HACKERS] [PERFORM] Sun Donated a Sun Fire T2000 to the PostgreSQL

2006-06-18 Thread Arjen van der Meijden
On 17-6-2006 1:24, Josh Berkus wrote: Arjen, I can already confirm very good scalability (with our workload) on postgresql on that machine. We've been testing a 32thread/16G-version and it shows near-linear scaling when enabling 1, 2, 4, 6 and 8 cores (with all four threads enabled). Keen.

Re: [PERFORM] Sun Donated a Sun Fire T2000 to the PostgreSQL community

2006-06-16 Thread Arjen van der Meijden
On 16-6-2006 17:18, Robert Lor wrote: I think this system is well suited for PG scalability testing, among others. We did an informal test using an internal OLTP benchmark and noticed that PG can scale to around 8 CPUs. Would be really cool if all 32 virtual CPUs can be utilized!!! I can

[PERFORM] Pgsql (and mysql) benchmark on T2000/Solaris and some profiling

2006-05-16 Thread Arjen van der Meijden
Hi List, In the past few weeks we have been developing a read-heavy mysql-benchmark to have an alternative take at cpu/platform-performance. Not really to have a look at how fast mysql can be. This benchmark runs on mysql 4.1.x, 5.0.x and 5.1.x and is modelled after our website's production

Re: [PERFORM] Pgsql (and mysql) benchmark on T2000/Solaris and some

2006-05-16 Thread Arjen van der Meijden
Qingqing Zhou wrote: Arjen van der Meijden [EMAIL PROTECTED] wrote Some sort of web query behavior is quite optimized in MySQL. For example, the query below is runing very fast due to the query result cache implementation in MySQL. Loop N times SELECT * FROM A WHERE i = 1; End loop. Yeah

Re: [PERFORM] Pgsql (and mysql) benchmark on T2000/Solaris and some

2006-05-16 Thread Arjen van der Meijden
aren't actively read in this benchmark. But I'll give it a try. Best regards, Arjen Arjen van der Meijden wrote: Hi List, In the past few weeks we have been developing a read-heavy mysql-benchmark to have an alternative take at cpu/platform-performance. Not really to have a look at how

  1   2   >