Re: [PERFORM] Recommended optimisations slows down PostgreSQL 8.4

2011-08-12 Thread Merlin Moncure
On Thu, Aug 11, 2011 at 7:27 PM, Waldo Nell pwn...@telkomsa.net wrote: On 2011-08-11, at 17:18 , k...@rice.edu wrote: One guess is that you are using the defaults for other costing parameters and they do not accurately reflect your system. This means that it will be a crap shoot as to

Re: [PERFORM] Streaming replication performance

2011-08-12 Thread Merlin Moncure
On Thu, Aug 11, 2011 at 9:46 AM, Antonin Faltynek pin...@gmail.com wrote: Hi all, I'm testing Streamin replication with one hot standby node and I'm experiencing high delay of hot standby node. When I reach aprox. 50 transactions per second where every transaction includes only simple

Re: [PERFORM] Variable versus constrant size tuples

2011-08-19 Thread Merlin Moncure
On Fri, Aug 19, 2011 at 4:03 AM, Krzysztof Chodak krzysztof.cho...@gmail.com wrote: Is there any performance benefit of using constant size tuples? not really. If your tuple size is under a known maximum length, then a toast table doesn't have to be created. that's a pretty minor detail

Re: [PERFORM] Intel 320 SSD info

2011-08-24 Thread Merlin Moncure
On Wed, Aug 24, 2011 at 11:58 AM, David Boreham david_l...@boreham.org wrote: Apologies if this has already been posted here (I hadn't seen it before today, and can't find a previous post). This will be of interest to anyone looking at using SSDs for database storage :

Re: [PERFORM] Intel 320 SSD info

2011-08-24 Thread Merlin Moncure
On Wed, Aug 24, 2011 at 12:23 PM, Andy angelf...@yahoo.com wrote: According to the specs for database storage: Random 4KB arites: Up to 600 IOPS Is that for real? 600 IOPS is *atrociously terrible* for an SSD. Not much faster than mechanical disks. Has anyone done any performance benchmark of

Re: [PERFORM] Reports from SSD purgatory

2011-08-24 Thread Merlin Moncure
On Wed, Aug 24, 2011 at 1:48 PM, gnuo...@rcn.com wrote: Original message Date: Mon, 15 Aug 2011 19:49:52 -0400 From: pgsql-performance-ow...@postgresql.org (on behalf of Greg Smith g...@2ndquadrant.com) Subject: [PERFORM] Reports from SSD purgatory To:

Re: [PERFORM] Reports from SSD purgatory

2011-08-24 Thread Merlin Moncure
On Wed, Aug 24, 2011 at 2:32 PM, Tomas Vondra t...@fuzzy.cz wrote: On 24 Srpen 2011, 20:48, gnuo...@rcn.com wrote: It's worth knowing exactly what that means.  Turns out that NAND quality is price specific.  There's gooduns and baduns.  Is this a failure in the controller(s) or the NAND?

Re: [PERFORM] how fast index works?

2011-09-08 Thread Merlin Moncure
On Tue, Sep 6, 2011 at 1:31 PM, Anibal David Acosta a...@devshock.com wrote: Hi everyone, My question is, if I have a table with 500,000 rows, and a SELECT of one row is returned in 10 milliseconds, if the table has 6,000,000 of rows and everything is OK (statistics, vacuum etc) can i

Re: [PERFORM] Re: How to track number of connections and hosts to Postgres cluster

2011-09-12 Thread Merlin Moncure
On Tue, Aug 30, 2011 at 12:55 AM, Venkat Balaji venkat.bal...@verse.in wrote: Thanks to all for your very helpful replies ! As Greg Smith rightly said, i faced a problem of missing connections between the runs. I even ran the cron every less than a second, but, still that would become too many

Re: [PERFORM] raid array seek performance

2011-09-14 Thread Merlin Moncure
On Wed, Sep 14, 2011 at 2:44 AM, Greg Smith g...@2ndquadrant.com wrote: If you want to get a useful measurement of seeks/second, setup pgbench-tools with a SELECT-only test, and create a database that's 2 to 4X as big as RAM.  The TPS result you get from that is a much more useful number for

Re: [PERFORM] Hash index use presently(?) discouraged since 2005: revive or bury it?

2011-09-15 Thread Merlin Moncure
On Wed, Sep 14, 2011 at 4:03 AM, Heikki Linnakangas heikki.linnakan...@enterprisedb.com wrote: On 14.09.2011 03:24, Tom Lane wrote: The big picture though is that we're not going to remove hash indexes, even if they're nearly useless in themselves, because hash index opclasses provide the

Re: [PERFORM] Hash index use presently(?) discouraged since 2005: revive or bury it?

2011-09-15 Thread Merlin Moncure
On Thu, Sep 15, 2011 at 3:28 PM, Claudio Freire klaussfre...@gmail.com wrote: On Thu, Sep 15, 2011 at 5:00 PM, Merlin Moncure mmonc...@gmail.com wrote: HM, what if you junked the current hash indexam, and just implemented a wrapper over btree so that the 'hash index' was just short hand

Re: [PERFORM] Hash index use presently(?) discouraged since 2005: revive or bury it?

2011-09-15 Thread Merlin Moncure
On Thu, Sep 15, 2011 at 5:38 PM, Tom Lane t...@sss.pgh.pa.us wrote: Merlin Moncure mmonc...@gmail.com writes: HM, what if you junked the current hash indexam, and just implemented a wrapper over btree so that the 'hash index' was just short hand for hashing the value into a standard index

Re: [PERFORM] Hash index use presently(?) discouraged since 2005: revive or bury it?

2011-09-16 Thread Merlin Moncure
On Thu, Sep 15, 2011 at 8:00 PM, Merlin Moncure mmonc...@gmail.com wrote: On Thu, Sep 15, 2011 at 5:38 PM, Tom Lane t...@sss.pgh.pa.us wrote: Merlin Moncure mmonc...@gmail.com writes: HM, what if you junked the current hash indexam, and just implemented a wrapper over btree so that the 'hash

Re: [PERFORM] Hash index use presently(?) discouraged since 2005: revive or bury it?

2011-09-17 Thread Merlin Moncure
On Sat, Sep 17, 2011 at 4:48 PM, Jeff Janes jeff.ja...@gmail.com wrote: On Tue, Sep 13, 2011 at 5:04 PM, Peter Geoghegan pe...@2ndquadrant.com wrote: On 14 September 2011 00:04, Stefan Keller sfkel...@gmail.com wrote: Has this been verified on a recent release? I can't believe that hash

Re: [PERFORM] Hash index use presently(?) discouraged since 2005: revive or bury it?

2011-09-19 Thread Merlin Moncure
On Sun, Sep 18, 2011 at 9:59 AM, Stefan Keller sfkel...@gmail.com wrote: Merlin and Jeff, General remark again:It's hard for me to imagine that btree is superior for all the issues mentioned before. I still believe in hash index for primary keys and certain unique constraints where you need

Re: [PERFORM] Hash index use presently(?) discouraged since 2005: revive or bury it?

2011-09-19 Thread Merlin Moncure
On Mon, Sep 19, 2011 at 10:19 AM, Robert Klemme shortcut...@googlemail.com wrote: On Mon, Sep 19, 2011 at 4:04 PM, Merlin Moncure mmonc...@gmail.com wrote: On Sun, Sep 18, 2011 at 9:59 AM, Stefan Keller sfkel...@gmail.com wrote: Merlin and Jeff, General remark again:It's hard for me

Re: [PERFORM] Hash index use presently(?) discouraged since 2005: revive or bury it?

2011-09-20 Thread Merlin Moncure
On Mon, Sep 19, 2011 at 1:53 PM, Claudio Freire klaussfre...@gmail.com wrote: On Mon, Sep 19, 2011 at 3:43 PM, Merlin Moncure mmonc...@gmail.com wrote: To make the test into i/o bound, I change the setrandom from 10 to 1000; this produced some unexpected results. The hash index

Re: [PERFORM] Prepared statements and suboptimal plans

2011-09-21 Thread Merlin Moncure
On Tue, Sep 20, 2011 at 5:44 PM, Royce Ausburn esapers...@royce.id.au wrote: Hi all, It looks like I've been hit with this well known issue.  I have a complicated query that is intended to run every few minutes, I'm using JDBC's Connection.prepareStatement() mostly for nice parameterisation,

Re: [PERFORM] : Create table taking time

2011-09-29 Thread Merlin Moncure
On Wed, Sep 28, 2011 at 12:06 PM, Venkat Balaji venkat.bal...@verse.in wrote: Hello Everyone, I am back with an issue (likely). I am trying to create a table in our production database, and is taking 5 seconds. We have executed VACUUM FULL and yet to run ANALYZE. Can i expect the CREATE

Re: [PERFORM] array_except -- Find elements that are not common to both arrays

2011-09-29 Thread Merlin Moncure
On Thursday, September 29, 2011, bricklen brick...@gmail.com wrote: I recently had need of an array_except function but couldn't find any good/existing examples. Based off the neat array_intersect function at http://www.postgres.cz/index.php/PostgreSQL_SQL_Tricks#Intersection_of_arrays , I put

Re: [PERFORM] the number of child tables --table partitioning

2011-09-30 Thread Merlin Moncure
2011/9/29 Ondrej Ivanič ondrej.iva...@gmail.com: Hi, On 30 September 2011 01:08, Kevin Grittner kevin.gritt...@wicourts.gov wrote: Is there a suggested number of child tables for table partitioning, Generally, don't go over about 100 partitions per table. Having 365 partitions per table

Re: [PERFORM] array_except -- Find elements that are not common to both arrays

2011-09-30 Thread Merlin Moncure
On Fri, Sep 30, 2011 at 3:15 PM, Ben Chobot be...@silentmedia.com wrote: On Sep 30, 2011, at 12:07 PM, bricklen wrote: I've been informed that this type of operation is called symmetric difference[1], and can be represented by A ∆ B.  A couple of alternative names were proposed,

Re: [PERFORM] array_except -- Find elements that are not common to both arrays

2011-10-04 Thread Merlin Moncure
On Tue, Oct 4, 2011 at 2:16 AM, Gavin Flower gavinflo...@archidevsys.co.nz wrote: On 01/10/11 01:23, Vitalii Tymchyshyn wrote: Since you are using except and not except all, you are not looking at arrays with duplicates. For this case next function what the fastest for me: create or replace

Re: [PERFORM] Rapidly finding maximal rows

2011-10-19 Thread Merlin Moncure
On Tue, Oct 11, 2011 at 8:05 PM, Dave Crooke dcro...@gmail.com wrote: Hi James I'm guessing the problem is that the combination of using a view and the way the view is defined with an in-line temporary table is too complex for the planner to introspect into, transform and figure out the

Re: [PERFORM] Choosing between Intel 320, Intel 510 or OCZ Vertex 3 SSD for db server

2011-10-24 Thread Merlin Moncure
On Mon, Oct 24, 2011 at 11:53 AM, David Boreham david_l...@boreham.org wrote: A few quick thoughts: 1. 320 would be the only SSD I'd trust from your short-list. It's the only one with proper protection from unexpected power loss. yeah. 2. Multiple RAID'ed SSDs sounds like (vast) overkill

Re: [PERFORM] CTE vs Subquery

2011-10-25 Thread Merlin Moncure
On Tue, Oct 25, 2011 at 11:47 AM, Linos i...@linos.es wrote: El 25/10/11 18:43, Tom Lane escribió: Linos i...@linos.es writes:     i am having any problems with performance of queries that uses CTE, can the join on a CTE use the index of the original table? CTEs act as optimization fences.

Re: [PERFORM] CTE vs Subquery

2011-10-26 Thread Merlin Moncure
On Wed, Oct 26, 2011 at 4:00 AM, Linos i...@linos.es wrote: El 25/10/11 19:11, Merlin Moncure escribió: On Tue, Oct 25, 2011 at 11:47 AM, Linos i...@linos.es wrote: El 25/10/11 18:43, Tom Lane escribió: Linos i...@linos.es writes:     i am having any problems with performance of queries

Re: [PERFORM] backups blocking everything

2011-10-27 Thread Merlin Moncure
On Thu, Oct 27, 2011 at 11:47 AM, Samuel Gendler sgend...@ideasculptor.com wrote: I've got a large mixed-used database, with the data warehouse side of things consisting of several tables at hundreds of millions of rows, plus a number of tables with tens of millions.  There is partitioning, but

Re: [PERFORM] WAL in RAM

2011-10-28 Thread Merlin Moncure
On Fri, Oct 28, 2011 at 10:28 AM, Marcus Engene meng...@engene.se wrote: Hi list, Every now and then I have write peaks which causes annoying delay on my website. No particular reason it seems, just that laws of probability dictates that there will be peaks every now and then. Anyway,

Re: [PERFORM] WAL in RAM

2011-10-28 Thread Merlin Moncure
On Fri, Oct 28, 2011 at 1:26 PM, Tomas Vondra t...@fuzzy.cz wrote: On 28 Říjen 2011, 18:11, Merlin Moncure wrote: On Fri, Oct 28, 2011 at 10:28 AM, Marcus Engene meng...@engene.se wrote: Hi list, Every now and then I have write peaks which causes annoying delay on my website. No particular

Re: [PERFORM] backups blocking everything

2011-10-28 Thread Merlin Moncure
On Thu, Oct 27, 2011 at 6:29 PM, Samuel Gendler sgend...@ideasculptor.com wrote: On Thu, Oct 27, 2011 at 2:15 PM, Samuel Gendler sgend...@ideasculptor.com wrote: There are definitely no bloated tables.  The large tables are all insert-only, and old data is aggregated up and then removed by

Re: [PERFORM] SSL encryption makes bytea transfer slow

2011-10-31 Thread Merlin Moncure
On Mon, Oct 31, 2011 at 10:34 AM, Albe Laurenz laurenz.a...@wien.gv.at wrote: Heikki Linnakangas wrote: We selected a 30MB bytea with psql connected with -h localhost and found that it makes a huge difference whether we have SSL encryption on or off. Without SSL the SELECT finished in about

Re: [PERFORM] Intel 710 pgbench write latencies

2011-11-02 Thread Merlin Moncure
On Wed, Nov 2, 2011 at 8:05 AM, Yeb Havinga yebhavi...@gmail.com wrote: Hello list, A OCZ Vertex 2 PRO and Intel 710 SSD, both 100GB, in a software raid 1 setup. I was pretty convinced this was the perfect solution to run PostgreSQL on SSDs without a IO controller with BBU. No worries for

Re: [PERFORM] Intel 710 pgbench write latencies

2011-11-02 Thread Merlin Moncure
On Wed, Nov 2, 2011 at 10:16 AM, Yeb Havinga yebhavi...@gmail.com wrote: On 2011-11-02 15:26, Merlin Moncure wrote: On Wed, Nov 2, 2011 at 8:05 AM, Yeb Havingayebhavi...@gmail.com  wrote: Hello list, A OCZ Vertex 2 PRO and Intel 710 SSD, both 100GB, in a software raid 1 setup. I was pretty

Re: [PERFORM] Intel 710 pgbench write latencies

2011-11-02 Thread Merlin Moncure
On Wed, Nov 2, 2011 at 3:45 PM, Yeb Havinga yebhavi...@gmail.com wrote: On 2011-11-02 16:16, Yeb Havinga wrote: On 2011-11-02 15:26, Merlin Moncure wrote: I would keep at least 20-30% of both drives unpartitioned to leave the controller room to wear level and as well as other stuff.  I'd try

Re: [PERFORM] Intel 710 pgbench write latencies

2011-11-03 Thread Merlin Moncure
On Thu, Nov 3, 2011 at 4:38 AM, Yeb Havinga yebhavi...@gmail.com wrote: On 2011-11-02 22:08, Merlin Moncure wrote: On Wed, Nov 2, 2011 at 3:45 PM, Yeb Havingayebhavi...@gmail.com  wrote: Intel latency graph at http://imgur.com/Hh3xI Ocz latency graph at http://imgur.com/T09LG curious: what

Re: [PERFORM] Subquery in a JOIN not getting restricted?

2011-11-09 Thread Merlin Moncure
On Wed, Nov 9, 2011 at 9:15 AM, Kevin Grittner kevin.gritt...@wicourts.gov wrote: Jay Levitt jay.lev...@gmail.com wrote: I don't get why the GROUP BY in this subquery forces it to scan the entire users table (seq scan here, index scan on a larger table) when there's only one row in users that

Re: [PERFORM] Intersect/Union X AND/OR

2011-12-02 Thread Merlin Moncure
On Fri, Dec 2, 2011 at 1:49 PM, Bruce Momjian br...@momjian.us wrote: Thiago Godoi wrote: Hi all, I found this presentation from B.  Momjian: http://momjian.us/main/writings/pgsql/performance.pdf I'm interested in what he said about Intersect/Union X AND/OR , Can I find a transcription

Re: [PERFORM] copy vs. C function

2011-12-12 Thread Merlin Moncure
On Sat, Dec 10, 2011 at 7:27 PM, Jon Nelson jnelson+pg...@jamponi.net wrote: I was experimenting with a few different methods of taking a line of text, parsing it, into a set of fields, and then getting that info into a table. The first method involved writing a C program to parse a file,

Re: [PERFORM] Performance costs of various PL languages

2011-12-27 Thread Merlin Moncure
On Tue, Dec 27, 2011 at 4:20 PM, Pavel Stehule pavel.steh...@gmail.com wrote: Hello 2011/12/27 Carlo Stonebanks stonec.regis...@sympatico.ca: We are currently using pltclu as our PL of choice AFTER plpgSql. I'd like to know if anyone can comment on the performance costs of the various PL

Re: [PERFORM] Postgresql Replication Performance

2011-12-29 Thread Merlin Moncure
On Thu, Dec 29, 2011 at 3:33 AM, sgupta saurabh@gmail.com wrote: I am doing POC on Posgtresql replication. I am using latest version of postgresql i.e. 9.1. There are multiple replication solutions avaliable in the market (PGCluster, Pgpool-II, Slony-I). Postgresql also provide in-built

Re: [PERFORM] Query performance - normal on 9.0.4, slow from 9.0.5 onwards

2011-12-30 Thread Merlin Moncure
On Fri, Dec 30, 2011 at 10:39 AM, Miguel Silva miguel.si...@tactis.pt wrote: Hi all! I've ran into a performance problem a few time ago and I've been trying to figure out a solution until now. But since I've failed to come up with anything conclusive, it's time to ask some help from people

Re: [PERFORM] spikes in pgbench read-only results

2012-01-23 Thread Merlin Moncure
2012/1/22 Tomas Vondra t...@fuzzy.cz: Hi, I'm working on a benchmark that demonstrates the effects of moving tables or indexes to separate devices (SSD and HDD), and one thing that really caught my eye are spikes in the tps charts. See this:  

Re: [PERFORM] PostgreSQL Parallel Processing !

2012-01-25 Thread Merlin Moncure
On Wed, Jan 25, 2012 at 7:43 AM, Claudio Freire klaussfre...@gmail.com wrote: I know squat about how to implement this, but I've been considering picking the low hanging fruit on that tree and patching up PG to try the concept. Many of the items above would require a thread-safe execution

Re: [PERFORM] pl/pgsql functions outperforming sql ones?

2012-01-27 Thread Merlin Moncure
On Thu, Jan 26, 2012 at 6:09 PM, Carlo Stonebanks stonec.regis...@sympatico.ca wrote: Assuming there was some sort of cost to pl/pgsql, I rewrote a bunch of stored functions s in straight SQL. Each stored proc was calling the next, so to get the full effect I had to track down all the pl/pgsql

Re: [PERFORM] How to improve insert speed with index on text column

2012-01-31 Thread Merlin Moncure
On Tue, Jan 31, 2012 at 12:46 PM, Josh Berkus j...@agliodbs.com wrote: Shared buffers is the cache maintained by PostgreSQL. All all the data that you read/write need to go through shared buffers. While this is technically true, I need to point out that you generally increase shared_buffers

Re: [PERFORM] Index with all necessary columns - Postgres vs MSSQL

2012-02-01 Thread Merlin Moncure
On Wed, Feb 1, 2012 at 11:10 AM, Gudmundur Johannesson gudmundur.johannes...@gmail.com wrote: Hi, I have a table in Postgres like: CREATE TABLE test (   id integer,   dtstamp timestamp without time zone,   rating real ) CREATE INDEX test_all   ON test   USING btree   (id , dtstamp ,

Re: [PERFORM] Index with all necessary columns - Postgres vs MSSQL

2012-02-01 Thread Merlin Moncure
On Wed, Feb 1, 2012 at 12:50 PM, Gudmundur Johannesson gudmundur.johannes...@gmail.com wrote: Here are the answers to your questions: 1) I change the select statement so I am refering to 1 day at a time.  In that case the response time is similar.  Basically, the data is not in cache when I do

Re: [PERFORM] From Simple to Complex

2012-02-02 Thread Merlin Moncure
On Wed, Feb 1, 2012 at 12:48 PM, Alessandro Gagliardi alessan...@path.com wrote: LIMIT 65536; Total query runtime: 14846 ms. - http://explain.depesz.com/s/I3E LIMIT 69632: Total query runtime: 80141 ms. - http://explain.depesz.com/s/9hp So it looks like when the limit crosses a certain

Re: [PERFORM] Index with all necessary columns - Postgres vs MSSQL

2012-02-02 Thread Merlin Moncure
On Thu, Feb 2, 2012 at 10:41 AM, Gudmundur Johannesson gudmundur.johannes...@gmail.com wrote: Do you think I should try using the latest build of the source for 9.2 since index-only-scan is ready according to http://www.depesz.com/index.php/2011/10/08/waiting-for-9-2-index-only-scans/ ? hm,

Re: [PERFORM] Index with all necessary columns - Postgres vs MSSQL

2012-02-07 Thread Merlin Moncure
On Tue, Feb 7, 2012 at 11:59 AM, Gudmundur Johannesson gudmundur.johannes...@gmail.com wrote: On Tue, Feb 7, 2012 at 3:11 PM, Igor Neyman iney...@perceptron.com wrote: From: Gudmundur Johannesson [mailto:gudmundur.johannes...@gmail.com] Sent: Thursday, February 02, 2012 11:42 AM To: Merlin

Re: [PERFORM] index scan forward vs backward = speed difference of 357X slower!

2012-02-08 Thread Merlin Moncure
On Wed, Feb 8, 2012 at 1:58 PM, Kevin Traster ktras...@freshgrillfoods.com wrote: Typo: Work_mem = 32 MB The definition for both column and index:  shareschange                  | numeric | changes_shareschange btree (shareschange) Index created using: CREATE INDEX changes_shareschange ON

Re: [PERFORM] Performance on large, append-only tables

2012-02-10 Thread Merlin Moncure
On Wed, Feb 8, 2012 at 12:03 PM, David Yeu david@skype.net wrote: Hi there, We've got a pretty large table that sees millions of new rows a day, and we're trying our best to optimize queries against it. We're hoping to find some guidance on this list. Thankfully, the types of queries

Re: [PERFORM] Query slow as function

2012-02-20 Thread Merlin Moncure
On Sat, Feb 18, 2012 at 8:50 AM, Steve Horn st...@stevehorn.cc wrote: Hello all! I have a very simple query that I am trying to wrap into a function: SELECT gs.geo_shape_id AS gid, gs.geocode FROM geo_shapes gs WHERE gs.geocode = 'xyz' AND geo_type = 1 GROUP BY gs.geography,

Re: [PERFORM] Joining tables by UUID field - very slow

2012-02-27 Thread Merlin Moncure
On Fri, Feb 24, 2012 at 4:46 PM, Cherio che...@gmail.com wrote: We are experiencing an unusual slowdown when using UUID field in JOIN when updating a table. SQL looks like this: UPDATE dst SET data_field = src.data_field FROM src WHERE dst.uuid_field = src.uuid_field; This statement takes

[PERFORM] Repeat execution of stable expressions

2012-03-05 Thread Merlin Moncure
I've complained many times that select (f()).*; will execute f() once for each returned field of f() since the server essentially expands that into: select f().a, f().b; try it yourself, see: create function f(a out text, b out text) returns record as $$ begin perform pg_sleep(1); a := 'a';

Re: [PERFORM] Repeat execution of stable expressions

2012-03-06 Thread Merlin Moncure
On Mon, Mar 5, 2012 at 6:41 PM, Peter van Hardenberg p...@pvh.ca wrote: On Mon, Mar 5, 2012 at 3:15 PM, Merlin Moncure mmonc...@gmail.com wrote: I've complained many times that select (f()).*; will execute f() once for each returned field of f() since the server essentially expands

Re: [PERFORM] Repeat execution of stable expressions

2012-03-06 Thread Merlin Moncure
On Tue, Mar 6, 2012 at 10:21 AM, Jan Otto as...@me.com wrote: hi, I've complained many times that select (f()).*; will execute f() once for each returned field of f() since the server essentially expands that into: select f().a, f().b; try it yourself, see: create function f(a out

Re: [PERFORM] Advice sought : new database server

2012-03-07 Thread Merlin Moncure
On Mon, Mar 5, 2012 at 10:56 AM, Craig James cja...@emolecules.com wrote: On Sun, Mar 4, 2012 at 10:36 AM, Rory Campbell-Lange r...@campbell-lange.net wrote: We do have complex transactions, but I haven't benchmarked the performance so I can't describe it. Few of the databases are at the many

Re: [PERFORM] Comments requested on IO performance : new db server

2012-03-09 Thread Merlin Moncure
On Fri, Mar 9, 2012 at 5:15 AM, Rory Campbell-Lange r...@campbell-lange.net wrote: I've taken the liberty of reposting this message as my addendum to a long thread that I started on the subject of adding a new db server to our existing 4-year old workhorse got lost in discussion. Our workload

Re: [PERFORM] slow self-join query

2012-03-19 Thread Merlin Moncure
On Sun, Mar 18, 2012 at 10:57 PM, Robert Poor rdp...@gmail.com wrote: On Sun, Mar 18, 2012 at 08:30, Scott Marlowe scott.marl...@gmail.com wrote: Why are you joining twice to the parent table?  If you're trying to recurse without a with clause, then wouldn't you join the last table to the one

Re: [PERFORM] Write workload is causing severe slowdown in Production

2012-03-22 Thread Merlin Moncure
On Thu, Mar 22, 2012 at 10:13 AM, Kevin Grittner kevin.gritt...@wicourts.gov wrote: In particular, I recommend that you *never* leave transactions open or hold locks while waiting for user response or input.  They *will* answer phone calls or go to lunch with things pending, potentially

Re: [PERFORM] Distinct + Limit

2012-03-28 Thread Merlin Moncure
On Wed, Mar 28, 2012 at 9:13 AM, Tom Lane t...@sss.pgh.pa.us wrote: Francois Deliege fdeli...@gmail.com writes: I have the following table with millions of rows: CREATE TABLE table1 (   col1 text,   col2 text,   col3 text,   col4 text,   col5 text,   col6 text ) select col1 from

Re: [PERFORM] Tablespaces on a raid configuration

2012-03-30 Thread Merlin Moncure
On Fri, Mar 30, 2012 at 10:02 AM, Andrew Dunstan and...@dunslane.net wrote: Not answering your question, but standard advice is not to use RAID 5 or 6, but RAID 10 for databases. Not sure if that still hold if you're using SSDs. Yeah, for SSD the equations may change. Parity based RAID has two

Re: [PERFORM] H800 + md1200 Performance problem

2012-04-03 Thread Merlin Moncure
On Tue, Apr 3, 2012 at 7:20 AM, Cesar Martin cmart...@gmail.com wrote: Hello there, I am having performance problem with new DELL server. Actually I have this two servers Server A (old - production) - 2xCPU Six-Core AMD Opteron 2439 SE 64GB RAM Raid controller Perc6 512MB

Re: [PERFORM] H800 + md1200 Performance problem

2012-04-03 Thread Merlin Moncure
On Tue, Apr 3, 2012 at 1:01 PM, Tomas Vondra t...@fuzzy.cz wrote: On 3.4.2012 17:42, Cesar Martin wrote: Yes, setting is the same in both machines. The results of bonnie++ running without arguments are: Version      1.96   --Sequential Output-- --Sequential Input- --Random-        

Re: [PERFORM] Update join performance issues

2012-04-03 Thread Merlin Moncure
On Tue, Apr 3, 2012 at 12:29 PM, Kevin Kempter cs_...@consistentstate.com wrote: Hi All; I have a query that wants to update a table based on a join like this: update test_one set f_key = t.f_key from    upd_temp1 t,    test_one t2 where    t.id_number = t2.id_number upd_temp1 has

Re: [PERFORM] H800 + md1200 Performance problem

2012-04-04 Thread Merlin Moncure
On Wed, Apr 4, 2012 at 4:42 AM, Cesar Martin cmart...@gmail.com wrote: Hello, Yesterday I changed the kernel setting, that said Scott, vm.zone_reclaim_mode = 0. I have done new benchmarks and I have noticed changes at least in Postgres: First exec: EXPLAIN ANALYZE SELECT * from

Re: [PERFORM] H800 + md1200 Performance problem

2012-04-04 Thread Merlin Moncure
On Wed, Apr 4, 2012 at 1:55 PM, Scott Marlowe scott.marl...@gmail.com wrote: On Wed, Apr 4, 2012 at 12:46 PM, Cesar Martin cmart...@gmail.com wrote: Raid controller issue or driver problem was the first problem that I studied. I installed Centos 5.4 al the beginning, but I had performance

Re: [PERFORM] H800 + md1200 Performance problem

2012-04-05 Thread Merlin Moncure
On Thu, Apr 5, 2012 at 10:49 AM, Tomas Vondra t...@fuzzy.cz wrote: On 5.4.2012 17:17, Cesar Martin wrote: Well, I have installed megacli on server and attach the results in file megacli.txt. Also we have Dell Open Manage install in server, that can generate a log of H800. I attach to mail with

Re: [PERFORM] about multiprocessingmassdata

2012-04-09 Thread Merlin Moncure
On Thu, Apr 5, 2012 at 9:47 AM, Tomas Vondra t...@fuzzy.cz wrote: On 5.4.2012 15:44, superman0920 wrote: Sure, i will post that at tomorrow. Today I install PG and MySQL at a  Server. I insert 85 rows record to each db. I execute select count(*) from poi_all_new at two db. MySQL takes

Re: [PERFORM] about multiprocessingmassdata

2012-04-10 Thread Merlin Moncure
On Mon, Apr 9, 2012 at 6:50 PM, Tomas Vondra t...@fuzzy.cz wrote: On 10.4.2012 00:37, Merlin Moncure wrote: On Thu, Apr 5, 2012 at 9:47 AM, Tomas Vondra t...@fuzzy.cz wrote: If you have slower drives, the dependency is about linear (half the speed - twice the time). So either your drives

Re: [PERFORM] scale up (postgresql vs mssql)

2012-04-16 Thread Merlin Moncure
On Wed, Apr 11, 2012 at 5:11 PM, Eyal Wilde e...@impactsoft.co.il wrote: hi, i had a stored procedure in ms-sql server. this stored procedure gets a parameter (account-id), dose about 20 queries, fills some temporary tables, and finally, returns a few result-sets. this stored procedure

Re: [PERFORM] H800 + md1200 Performance problem

2012-04-16 Thread Merlin Moncure
On Mon, Apr 16, 2012 at 10:45 AM, Scott Marlowe scott.marl...@gmail.com wrote: On Mon, Apr 16, 2012 at 8:13 AM, Cesar Martin cmart...@gmail.com wrote: Hi, Finally the problem was BIOS configuration. DBPM had was set to Active Power Controller I changed this to Max Performance. 

Re: [PERFORM] SeqScan with full text search

2012-04-16 Thread Merlin Moncure
On Mon, Apr 16, 2012 at 9:02 AM, Tomek Walkuski tomek.walku...@gmail.com wrote: Hello group! I have query like this: SELECT  employments.candidate_id AS candidate_id,  SUM(TS_RANK(employers.search_vector, TO_TSQUERY('simple', 'One:* | Two:* | Three:* | Four:*'), 2)) AS ts_rank FROM  

Re: [PERFORM] scale up (postgresql vs mssql)

2012-04-18 Thread Merlin Moncure
On Wed, Apr 18, 2012 at 2:32 AM, Eyal Wilde e...@impactsoft.co.il wrote: hi all, i ran vmstat during the test : [yb@centos08 ~]$ vmstat 1 15 procs ---memory-- ---swap-- -io --system-- -cpu-  r  b   swpd   free   buff  cache   si   so    bi    bo   in   cs us

Re: [PERFORM] Parallel Scaling of a pgplsql problem

2012-04-25 Thread Merlin Moncure
On Wed, Apr 25, 2012 at 1:52 PM, Venki Ramachandran venki_ramachand...@yahoo.com wrote: Hi all: Can someone please guide me as to how to solve this problem? If this is the wrong forum, please let me know which one to post this one in. I am new to Postgres (about 3 months into it) I have

Re: [PERFORM] Tuning Postgres 9.1 on Windows

2012-04-30 Thread Merlin Moncure
On Mon, Apr 30, 2012 at 8:49 AM, Walker, James Les jawal...@cantor.com wrote: I’m trying to benchmark Postgres vs. several other databases on my workstation. My workstation is running 64 bit Windows 7. It has 12 gb of RAM and a W3550 @ 3 Ghz. I installed Postgres 9.1 using the windows

Re: [PERFORM] Tuning Postgres 9.1 on Windows

2012-04-30 Thread Merlin Moncure
On Mon, Apr 30, 2012 at 5:00 PM, Thomas Kellerer spam_ea...@gmx.net wrote: Merlin Moncure wrote on 30.04.2012 23:43: Trying turning off fsync in postgrsql.conf to be sure. This is a dangerous advise. Turning off fsync can potentially corrupt the database in case of a system failure (e.g

Re: [PERFORM] Tuning Postgres 9.1 on Windows

2012-05-01 Thread Merlin Moncure
On Tue, May 1, 2012 at 7:51 AM, Walker, James Les jawal...@cantor.com wrote: Exactly, if turning off fsync gives me 100 commits/sec then I know where my bottleneck is and I can attack it. Keep in mind though that I already turned off synchronous commit -- *really* dangerous -- and it didn't

Re: [PERFORM] Tuning Postgres 9.1 on Windows

2012-05-01 Thread Merlin Moncure
On Tue, May 1, 2012 at 8:14 AM, Walker, James Les jawal...@cantor.com wrote: SSD is OCZ-VERTEX3 MI. Controller is LSI SAS2 2008 Falcon. I'm working on installing EDB. Then I can give you some I/O numbers. It looks like the ssd doesn't have a nv cache and the raid card is a simple sas hba

Re: [PERFORM] Tuning Postgres 9.1 on Windows

2012-05-01 Thread Merlin Moncure
On Tue, May 1, 2012 at 9:44 AM, Walker, James Les jawal...@cantor.com wrote: I installed the enterprisedb distribution and immediately saw a 400% performance increase. Turning off fsck made it an order of magnitude better. I'm now peaking at over 400 commits per second. Does that sound right?

Re: [PERFORM] scale up (postgresql vs mssql)

2012-05-03 Thread Merlin Moncure
On Sun, Apr 29, 2012 at 8:21 AM, Eyal Wilde e...@impactsoft.co.il wrote: hi, all. well, i wondered why there is high rate of bo (blocks out). the procedure is practically read-only during the whole test. although it's not strictly read-only, because in a certain condition, there might be

Re: [PERFORM] Result Set over Network Question

2012-05-03 Thread Merlin Moncure
On Mon, Apr 30, 2012 at 1:32 PM, Ronald Hahn, DOCFOCUS INC. rh...@docfocus.ca wrote: Hi,     We have recently switch our product from MS SQL 2000 to Postgresql 9.0.7. We have tuned the searches and indexes so that they are very close (often better) to what sql2k was giving us.  We are noticing

Re: [PERFORM] Result Set over Network Question

2012-05-03 Thread Merlin Moncure
On Thu, May 3, 2012 at 10:28 AM, Ronald Hahn, DOCFOCUS INC. rh...@docfocus.ca wrote: After some testing using wiershark (poor mans profiler) to see what was going on with the network I found that it was the tools I've been using. Both Aqua and PGadminIII have a large overhead per column to get

Re: [PERFORM] scale up (postgresql vs mssql)

2012-05-04 Thread Merlin Moncure
On Thu, May 3, 2012 at 12:07 PM, Eyal Wilde e...@impactsoft.co.il wrote: guess what: after reducing bo (blocks out) to ~10% by using a ramdisk (improving overall performance by ~15-20%), i now managed to reduced it to ~3% by removing the analyze temp-table statements. it also : reduced

Re: [PERFORM] scale up (postgresql vs mssql)

2012-05-09 Thread Merlin Moncure
On Wed, May 9, 2012 at 2:11 AM, Robert Klemme shortcut...@googlemail.com wrote: On Fri, May 4, 2012 at 3:04 PM, Merlin Moncure mmonc...@gmail.com wrote: let's see the query plan...when you turned it off, did it go faster? put your suspicious plans here: http://explain.depesz.com/ I suggest

Re: [PERFORM] Could synchronous streaming replication really degrade the performance of the primary?

2012-05-09 Thread Merlin Moncure
On Wed, May 9, 2012 at 8:06 AM, MauMau maumau...@gmail.com wrote: Hello, I've heard from some people that synchronous streaming replication has severe performance impact on the primary. They said that the transaction throughput of TPC-C like benchmark (perhaps DBT-2) decreased by 50%. I'm

Re: [PERFORM] Could synchronous streaming replication really degrade the performance of the primary?

2012-05-09 Thread Merlin Moncure
On Wed, May 9, 2012 at 12:03 PM, Robert Klemme shortcut...@googlemail.com wrote: On Wed, May 9, 2012 at 5:45 PM, Claudio Freire klaussfre...@gmail.com wrote: On Wed, May 9, 2012 at 12:41 PM, Robert Klemme shortcut...@googlemail.com wrote: I am not sure whether the replicant can be triggered to

Re: [PERFORM] Could synchronous streaming replication really degrade the performance of the primary?

2012-05-10 Thread Merlin Moncure
On Wed, May 9, 2012 at 5:34 PM, MauMau maumau...@gmail.com wrote: Yes, I understand it is natural for the response time of each transaction to double or more. But I think the throughput drop would be amortized among multiple simultaneous transactions. So, 50% throughput decrease seems

Re: [PERFORM] SSD selection

2012-05-15 Thread Merlin Moncure
On Tue, May 15, 2012 at 12:08 PM, David Boreham david_l...@boreham.org wrote: We've reached to the point when we would like to try SSDs. We've got a central DB currently 414 GB in size and increasing. Working set does not fit into our 96GB RAM server anymore. So, the main question is what to

Re: [PERFORM] [pgsql-performance] Daily digest v1.3606 (10 messages)

2012-05-15 Thread Merlin Moncure
On Tue, May 15, 2012 at 4:09 PM, John Lister john.lis...@kickstone.com wrote: We've reached to the point when we would like to try SSDs. We've got a central DB currently 414 GB in size and increasing. Working set does not fit into our 96GB RAM server anymore. So, the main question is what to

Re: [PERFORM] SSD selection

2012-05-16 Thread Merlin Moncure
On Tue, May 15, 2012 at 3:00 PM, David Boreham david_l...@boreham.org wrote: On 5/15/2012 12:16 PM, Rosser Schwarz wrote: As the other posters in this thread have said, your best bet is probably the Intel 710 series drives, though I'd still expect some 320-series drives in a RAID

Re: [PERFORM] SSD selection

2012-05-16 Thread Merlin Moncure
On Wed, May 16, 2012 at 12:45 PM, David Boreham david_l...@boreham.org wrote: On 5/16/2012 11:01 AM, Merlin Moncure wrote: Although your assertion 100% supported by intel's marketing numbers, there are some contradicting numbers out there that show the drives offering pretty similar

Re: [PERFORM] heavly load system spec

2012-05-24 Thread Merlin Moncure
On Thu, Apr 5, 2012 at 10:39 AM, Gregg Jaskiewicz gryz...@gmail.com wrote: I know this is a very general question. But if you guys had to specify system (could be one server or cluster), with sustainable transaction rate of 1.5M tps running postgresql, what configuration and hardware would you

Re: [PERFORM] Recover rows deleted

2012-06-04 Thread Merlin Moncure
On Mon, Jun 4, 2012 at 12:46 PM, Alejandro Carrillo faster...@yahoo.es wrote: How I can compile in Windows? I tried to compile using Dev-C++ 4.9 and show It's probably going to take some extra effort to compile backend libraries with that compiler. The two supported compiling environments on

Re: [PERFORM] scale up (postgresql vs mssql)

2012-06-20 Thread Merlin Moncure
On Wed, Jun 20, 2012 at 8:43 AM, Andy Colson a...@squeakycode.net wrote: this is an obligation from the past: http://archives.postgresql.org/pgsql-performance/2012-05/msg00017.php the same test, that did ~230 results, is now doing ~700 results. that is, BTW even better than mssql. the

Re: [PERFORM] Can I do better than this heapscan and sort?

2012-06-26 Thread Merlin Moncure
On Thu, Jun 21, 2012 at 3:07 PM, Andy Halsall halsall_a...@hotmail.com wrote: I have two tables node and relationship. Each relationship record connects two nodes and has an application keys (unfortunately named) that can be used by the application to look-up a relationship and get from one

Re: [PERFORM] Can I do better than this heapscan and sort?

2012-06-26 Thread Merlin Moncure
On Tue, Jun 26, 2012 at 8:36 AM, Merlin Moncure mmonc...@gmail.com wrote: On Thu, Jun 21, 2012 at 3:07 PM, Andy Halsall halsall_a...@hotmail.com wrote: I have two tables node and relationship. Each relationship record connects two nodes and has an application keys (unfortunately named

<    3   4   5   6   7   8   9   10   11   >