Re: [PERFORM] How to access data of SQL server database from PostgreSQL

On 07/31/2017 09:25 PM, Daulat Ram wrote: Hi team, I need to connect to MS-SQL server 2008/2012 from PostgreSQL 9.5 in Windows7 environment to fetch the tables of SQL server. Please help on this. https://github.com/tds-fdw/tds_fdw JD Regards, Daulat

Re: [PERFORM] Very poor read performance, query independent

On 07/11/2017 04:15 PM, Merlin Moncure wrote: On Mon, Jul 10, 2017 at 9:03 AM, Charles Nadeau wrote: I’m running PostgreSQL 9.6.3 on Ubuntu 16.10 (kernel 4.4.0-85-generic). Hardware is: *2x Intel Xeon E5550 *72GB RAM *Hardware RAID10 (4 x 146GB SAS 10k) P410i

Re: [PERFORM] [ADMIN] Monitoring tool for Postgres Database

On 05/25/2017 07:15 PM, Scott Mead wrote: Thanks ravi We use Zabbix. JD -- Command Prompt, Inc. http://the.postgres.company/ +1-503-667-4564 PostgreSQL Centered full stack support, consulting and development.

Re: [PERFORM] Questionaire: Common WAL write rates on busy servers.

On 04/27/2017 09:34 AM, Andres Freund wrote: On 2017-04-27 09:31:34 -0700, Joshua D. Drake wrote: On 04/27/2017 08:59 AM, Andres Freund wrote: I would agree it isn't yet a widespread issue. I'm not yet sure about that actually. I suspect a large percentage of people with such workloads

Re: [PERFORM] Questionaire: Common WAL write rates on busy servers.

On 04/27/2017 08:59 AM, Andres Freund wrote: Ok, based on the, few, answers I've got so far, my experience is indeed skewed. A number of the PG users I interacted with over the last couple years had WAL write ranges somewhere in the range of 500MB/s to 2.2GB/s (max I'veseen). At that point

Re: [PERFORM] How can I find the source of postgresql per-connection memory leaks?

On 01/12/2017 09:08 AM, Eric Jensen wrote: I'm using postgresql 9.5.4 on amazon RDS with ~1300 persistent connections from rails 4.2 with "prepared_statements: false". Over the enter image description here PostgreSQL on RDS is a closed product. My recommendation would be to contact Amazon

Re: [PERFORM] Isolation of tx logs on VMware

On 12/13/2016 12:16 PM, ProPAAS DBA wrote: Hi All; I'm not a VMware expert, however I thought VMware would allow the creation of multiple disk volumes and attach them via separate mount points. Is this not true? If it is an option can someone point me to a how to... Yes it is possible to

Re: [PERFORM] Big Memory Boxes and pgtune

On 10/28/2016 08:44 AM, Warner, Gary, Jr wrote: I've recently been blessed to move one of my databases onto a huge IBM P8 computer. Its a power PC architecture with 20 8-way cores (so postgres SHOULD believe there are 160 cores available) and 1 TB of RAM. I've always done my postgres tuning

Re: [PERFORM] Indexes for hashes

On 06/15/2016 07:20 AM, Ivan Voras wrote: Hi, Just for testing... is there a fast (i.e. written in C) crc32 or a similar small hash function for PostgreSQL? https://www.postgresql.org/docs/9.5/static/pgcrypto.html We also have a builtin md5(). JD -- Command Prompt, Inc.

Re: [PERFORM] checkpoints, proper config

On 12/10/2015 10:35 AM, Tory M Blue wrote: Thiis valid regardless of the workload? Yes. Seems that I would be storing a ton of data and writing it once an hour, so would have potential perf hits on the hour. I guess I'm not too up to date on the checkpoint configuration. No, that isn't

Re: [PERFORM] checkpoints, proper config

On 12/10/2015 01:12 AM, Tory M Blue wrote: checkpoint_timeout = 5min checkpoint_completion_target = 0.9 The above is your problem. Make checkpoint_timeout = 1h . Also, considering turning synchronous_commit off. JD -- Command Prompt, Inc. - http://www.commandprompt.com/ 503-667-4564

Re: [PERFORM] checkpoints, proper config

On 12/10/2015 12:58 PM, Tory M Blue wrote: synchronous is commented out, is it on by default? Yes it is on by default. This is a slony slave node, so I'm not too worried about this particular host losing it's data, thus fsync is off, thanks again sir Tory -- Command Prompt, Inc. -

Re: [PERFORM] Hmmm... why does CPU-intensive pl/pgsql code parallelise so badly when queries parallelise fine? Anyone else seen this?

On 07/08/2015 10:48 AM, Craig James wrote: I admit that I haven't read this whole thread but: Using Apache Fast-CGI, you are going to fork a process for each instance of the function being executed and that in turn will use all CPUs up to the max available resource. With

Re: [PERFORM] Hmmm... why does CPU-intensive pl/pgsql code parallelise so badly when queries parallelise fine? Anyone else seen this?

On 07/07/2015 08:05 PM, Craig James wrote: No ideas, but I ran into the same thing. I have a set of C/C++ functions that put some chemistry calculations into Postgres as extensions (things like, calculate the molecular weight of this molecule). As SQL functions, the whole thing bogged down,

Re: [PERFORM] New server: SSD/RAID recommendations?

On 07/06/2015 09:56 AM, Steve Crawford wrote: On 07/02/2015 07:01 AM, Wes Vaske (wvaske) wrote: For what it's worth, in my most recent iteration I decided to go with the Intel Enterprise NVMe drives and no RAID. My reasoning was thus: 1. Modern SSDs are so fast that even if you had an

Re: [PERFORM] Do work_mem and shared buffers have 1g or 2g limit on 64 bit linux?

On 06/13/2015 10:27 AM, Kaijiang Chen wrote: Hi, I am using postgresql 9.2.10 on centos 6.2, 64 bit version. The server has 512 GB mem. The jobs are mainly OLAP like. So I need larger work_mem and shared buffers. From the source code, there is a constant MaxAllocSize==1GB. So, I wonder whether

Re: [PERFORM] Are there tuning parameters that don't take effect immediately?

On 06/12/2015 01:37 PM, Michael Nolan wrote: Last night I was doing some tuning on a database The longest query I was running was taking around 160 seconds. I didn't see much change in the running time for that query, even after restarting PG. Today, with roughly the same system load

Re: [PERFORM] How to reduce writing on disk ? (90 gb on pgsql_tmp)

On 06/03/2015 03:16 PM, Tomas Vondra wrote: What is more important, though, is the amount of memory. OP reported the query writes ~95GB of temp files (and dies because of full disk, so there may be more). The on-disk format is usually more compact than the in-memory representation - for

Re: [PERFORM] PostgreSQL disk fragmentation causes performance problems on Windows

On 04/29/2015 01:08 AM, Andres Freund wrote: Which OS and filesystem is this done on? Because many halfway modern systems, like e.g ext4 and xfs, implement this in the background as 'delayed allocation'. Oh, it's in the subject. Stupid me, sorry for that. I'd consider testing how much better

Re: [PERFORM] [ADMIN] Hardware Configuration and other Stuff

of a rather complex solution and a migration. Sincerely, Joshua D. Drake -- Command Prompt, Inc. - http://www.commandprompt.com/ 503-667-4564 PostgreSQL Support, Training, Professional Services and Development High Availability, Oracle Conversion, @cmdpromptinc Now I get it: your service is designed

Re: [PERFORM] MusicBrainz postgres performance issues

On 03/15/2015 09:43 AM, Scott Marlowe wrote: * Consider installing perf (linux-utils-$something) and doing a systemwide profile. 3.2 isn't the greatest kernel around, efficiency wise. At some point you might want to upgrade to something newer. I've seen remarkable differences around this.

Re: [PERFORM] MusicBrainz postgres performance issues

On 03/15/2015 05:08 AM, Robert Kaye wrote: On Mar 15, 2015, at 12:41 PM, Andreas Kretschmer akretsch...@spamfence.net wrote: just a wild guess: raid-controller BBU faulty We don’t have a BBU in this server, but at least we have redundant power supplies. In any case, how would a fault

Re: [PERFORM] Turn off Hyperthreading! WAS: 60 core performance with 9.3

On 08/21/2014 04:29 PM, Josh Berkus wrote: On 08/21/2014 04:08 PM, Steve Crawford wrote: On 08/21/2014 03:51 PM, Josh Berkus wrote: On 08/21/2014 02:26 PM, Scott Marlowe wrote: I'm running almost the exact same setup in production as a spare. It has 4 of those CPUs, 256G RAM, and is

Re: [PERFORM] pg_dump vs pg_basebackup

On 03/25/2014 05:05 AM, Claudio Freire wrote: On Tue, Mar 25, 2014 at 4:39 AM, David Johnston pol...@yahoo.com wrote: Hai, Can anyone tell me the difference and performance between pgdump and pg_basebackup if I want to backup a large database. Honestly, Neither is particularly good at

Re: [PERFORM] pg_dump vs pg_basebackup

On 03/25/2014 08:18 AM, Ilya Kosmodemiansky wrote: Joshua, that is really good point: an alternative is to use pg_basebackup through ssh tunnel with compression, but rsync is much simpler. Or rsync over ssh. The advantage is that you can create backups that don't have to be restored, just

Re: [PERFORM] pg_dump vs pg_basebackup

On 03/25/2014 08:21 AM, Magnus Hagander wrote: I would say that's the one thing that rsync is *not*. pg_basebackup takes care of a lot of things under the hood. rsync is a lot more complicated, in particular in failure scenarios, since you have to manually deal with pg_start/stop_backup().

Re: [PERFORM] One huge db vs many small dbs

One of the many questions we have is about performance of the db if we work with only one (using a ClientID to separete de clients info) or thousands of separate dbs. The management of the dbs is not a huge concert as we have an automated tool. If you are planning on using persisted

Re: [PERFORM] How clustering for scale out works in PostgreSQL

On 08/29/2013 07:59 AM, Richard Huxton wrote: On 29/08/13 13:14, bsreejithin wrote: I am *expecting 1000+ hits to my PostgreSQL DB* and I doubt my standalone DB will be able to handle it. We are going to need a little more detail here. In a normal environment 1000+ hits isn't that much,

Re: [PERFORM] How clustering for scale out works in PostgreSQL

On 08/29/2013 09:42 AM, bsreejithin wrote: The performance test that was conducted was for 1 Hour. There are 6 transactions. 2 DB inserts and 4 SELECTs. Every 2 minutes there will be 4 SELECTs. And every 3 minutes there will be 2 DB inserts. This shouldn't be a problem with proper hardware

Re: [PERFORM] Performance autovaccum

On 07/09/2013 03:14 PM, Josh Berkus wrote: On 07/08/2013 09:14 AM, Jeison Bedoya wrote: Hi, i have a postgresql 9.2.2, but i don´t use autovaccum but i want to begin to use it. some recommendation about the optimal configuration? or some link to explain it. Initial configuration:

Re: [PERFORM] Reliability with RAID 10 SSD and Streaming Replication

On 05/22/2013 11:06 AM, Greg Smith wrote: I have some moderately fast SSD based transactional systems that are still using traditional drives with battery-backed cache for the sequential writes of the WAL volume, where the data volume is on Intel 710 disks. WAL writes really burn through

Re: [PERFORM] Reliability with RAID 10 SSD and Streaming Replication

but it sure seems like a very reasonable drive for the price: http://www.newegg.com/Product/Product.aspx?Item=20-148-695ParentOnly=1IsVirtualParent=1 Sincerely, Joshua D. Drake -- Command Prompt, Inc. - http://www.commandprompt.com/ 509-416-6579 PostgreSQL Support, Training, Professional

Re: [PERFORM] Reliability with RAID 10 SSD and Streaming Replication

On 05/22/2013 04:37 PM, Merlin Moncure wrote: On Wed, May 22, 2013 at 5:42 PM, Joshua D. Drake j...@commandprompt.com wrote: I am curious how the 710 or S3700 stacks up against the new M500 from Crucial? I know Intel is kind of the goto for these things but the m500 is power off protected

Re: [PERFORM] Reliability with RAID 10 SSD and Streaming Replication

On 05/22/2013 07:17 PM, Merlin Moncure wrote: According the the data sheet it is power safe. http://investors.micron.com/releasedetail.cfm?ReleaseID=732650 http://www.micron.com/products/solid-state-storage/client-ssd/m500-ssd Wow, that seems like a pretty good deal then assuming it

Re: [PERFORM] Setup of four 15k SAS disk with LSI raid controller

On 03/13/2013 11:45 AM, Vasilis Ventirozos wrote: Its better to split WAL segments and data just because these two have different io requirements and because its easier to measure and tune things if you have them on different disks. Generally speaking you are correct but we are talking about

Re: [PERFORM] Optimize SELECT * from table WHERE foreign_key_id IN (key1,key2,key3,key4...)

On 03/05/2013 03:51 PM, Niels Kristian Schjødt wrote: 3ms isn't slow Sorry, it's 3323ms! Can I do anything to optimize that query or maybe the index or something? your index is already used Okay this leaves me with - get better hardware or? What does explain analyze say versus just

Re: [PERFORM] Request for help with slow query

default_statistics_target? Joshua D. Drake -- Command Prompt, Inc. - http://www.commandprompt.com/ PostgreSQL Support, Training, Professional Services and Development High Availability, Oracle Conversion, Postgres-XC @cmdpromptinc - 509-416-6579 -- Sent via pgsql-performance mailing list (pgsql-performance

Re: [PERFORM] auto-vacuum vs. full table update

On 04/26/2012 12:49 PM, Craig James wrote: An update to our system means I'm going to be rewriting every row of some large tables (20 million rows by 15 columns). In a situation like this, can auto-vacuum take care of it, or should I plan on vacuum-full/reindex to clean up? If you rewrite

Re: [PERFORM] Performance

On 04/13/2011 05:03 PM, Tom Lane wrote: That 4:1 ratio is based on some rather extensive experimentation that I did back in 2000. In the interim, disk transfer rates have improved quite a lot more than disk seek times have, and the CPU cost to process a page's worth of data has also improved

Re: [PERFORM] Linux: more cores = less concurrency.

On Mon, 11 Apr 2011 13:09:15 -0500, Kevin Grittner kevin.gritt...@wicourts.gov wrote: Glyn Astill glynast...@yahoo.co.uk wrote: The new server uses 4 x 8 core Xeon X7550 CPUs at 2Ghz Which has hyperthreading. our current servers are 2 x 4 core Xeon E5320 CPUs at 2Ghz. Which

Re: [PERFORM] Performance Test for PostgreSQL9

to help you with your performance tests because you are not going to be able to adequately tune PostgreSQL for a proper test. That said, the reason you can't find make is that you don't have the proper development tools installed. +1 to what Robert said. Sincerely, Joshua D. Drake

Re: [PERFORM] Performance Test for PostgreSQL9

On Thu, 2011-03-03 at 13:16 +0800, Selva manickaraja wrote: Thanks for the enlightenment. I will then look into other tools that help with performance testing. Is pgbench really useful? We need to produce the reports and statistics to our management as we are planning to migrate one system

Re: [PERFORM] Write-heavy pg_stats_collector on mostly idle server

On Mon, 2011-02-07 at 14:58 -0800, Josh Berkus wrote: Anyone seen anything like this before? it is the expected behavior, IIRC OK. It just seems kind of pathological for stats file writing to be 10X the volume of data writing. I see why it's happening, but I think it's something we

Re: [HACKERS] [PERFORM] Slow count(*) again...

On Thu, 2011-02-03 at 18:33 -0500, Mladen Gogala wrote: Exactly what we don't want. Who is we? The majority of long term hackers. -- PostgreSQL.org Major Contributor Command Prompt, Inc: http://www.commandprompt.com/ - 509.416.6579 Consulting, Training, Support, Custom

Re: [HACKERS] [PERFORM] Slow count(*) again...

On Thu, 2011-02-03 at 18:12 -0800, Conor Walsh wrote: I can't remember anyone ever complaining ANALYZE took too long to run. I only remember complaints of the form I had to remember to manually run it and I wish it had just happened by itself. Robert, This sounds like an argument in

Re: [PERFORM] SELECT INTO large FKyed table is slow

On Sun, 2010-11-28 at 12:46 +0100, Mario Splivalo wrote: The database for monitoring certain drone statuses is quite simple: This is the slow part: INSERT INTO drones_history (sample_id, drone_id, drone_log_notice, drone_temperature, drone_pressure) SELECT * FROM tmpUpdate; For 100

Re: [PERFORM] partitioning question 1

to look into expression indexes, not clustered ones. Sincerely, Joshua D. Drake -- PostgreSQL.org Major Contributor Command Prompt, Inc: http://www.commandprompt.com/ - 509.416.6579 Consulting, Training, Support, Custom Development, Engineering http://twitter.com/cmdpromptinc | http://identi.ca

Re: [PERFORM] partitioning question 1

actually want to look into expression indexes, not clustered ones. Take a look at the docs: http://www.postgresql.org/docs/8.4/interactive/indexes-expressional.html It could be considered partitioning without breaking up the table, just the indexes. Sincerely, Joshua D. Drake

Re: [PERFORM] partitioning question 1

On Thu, 2010-10-28 at 12:25 -0700, Ben wrote: i think we are talking about two different things here: the constraints on the table, and the where-clause constraints in a query which may or may not trigger constraint exclusion. i understand that table constraints have to be constants -- it

Re: [PERFORM] partitioning question 1

On Thu, 2010-10-28 at 12:59 -0700, Ben wrote: On Oct 28, 2010, at 12:44 PM, Joshua D. Drake wrote: My tests show you are incorrect: part_test=# explain analyze select * from foo join bar using (i) where i=9; QUERY PLAN

Re: [PERFORM] Postgres insert performance and storage requirement compared to Oracle

. This is interesting, are you using libpq or libpqXX? Joshua D. Drake -- PostgreSQL.org Major Contributor Command Prompt, Inc: http://www.commandprompt.com/ - 509.416.6579 Consulting, Training, Support, Custom Development, Engineering http://twitter.com/cmdpromptinc | http://identi.ca/commandprompt

Re: [PERFORM] XFS vs Ext3, and schedulers, for WAL

On Mon, 2010-10-11 at 10:50 -0700, Josh Berkus wrote: There's a number of blog tests floating around comparing XFS and Ext3, and the various Linux schedulers, for PGDATA or for an all-in-one mount. However, the WAL has a rather particular write pattern, and it's reasonable to assume

Re: [PERFORM] Issue for partitioning with extra check constriants

On Mon, 2010-10-04 at 11:34 -0700, Josh Berkus wrote: And your point is? The design center for the current setup is maybe 5 or 10 partitions. We didn't intend it to be used for more partitions than you might have spindles to spread the data across. Where did that come from? Yeah that

Re: [PERFORM] Query much faster with enable_seqscan=0

cpu_tuple_cost instead. Sincerely, Joshua D. Drake -- PostgreSQL.org Major Contributor Command Prompt, Inc: http://www.commandprompt.com/ - 509.416.6579 Consulting, Training, Support, Custom Development, Engineering http://twitter.com/cmdpromptinc | http://identi.ca/commandprompt -- Sent via pgsql

Re: [PERFORM] Held idle connections vs use of a Pooler

pgbouncer. It is what Skype uses. Sincerely, Joshua D. Drake -- PostgreSQL.org Major Contributor Command Prompt, Inc: http://www.commandprompt.com/ - 509.416.6579 Consulting, Training, Support, Custom Development, Engineering http://twitter.com/cmdpromptinc | http://identi.ca/commandprompt

Re: [PERFORM] Where does data in pg_stat_user_tables come from?

) Joshua D. Drake -- PostgreSQL.org Major Contributor Command Prompt, Inc: http://www.commandprompt.com/ - 509.416.6579 Consulting, Training, Support, Custom Development, Engineering http://twitter.com/cmdpromptinc | http://identi.ca/commandprompt -- Sent via pgsql-performance mailing list (pgsql

Re: [PERFORM] Testing Sandforce SSD

a moderately priced SSD I can recommend to people for database use. And I fear I'll be out of excuses to avoid buying one as a toy for my home system. That is quite the toy. I can get 4 SATA-II with RAID Controller, with battery backed cache, for the same price or less :P Sincerely, Joshua D

Re: [PERFORM] Pooling in Core WAS: Need help in performance tuning.

but even it has limitations (such as auth). Sincerely, Joshua D. Drake -- PostgreSQL.org Major Contributor Command Prompt, Inc: http://www.commandprompt.com/ - 509.416.6579 Consulting, Training, Support, Custom Development, Engineering http://twitter.com/cmdpromptinc | http://identi.ca

Re: [PERFORM] Strange explain on partitioned tables

has to do with the planning time. As the number of children increases, so does the planning time. Joshua D. Drake -- PostgreSQL.org Major Contributor Command Prompt, Inc: http://www.commandprompt.com/ - 509.416.6579 Consulting, Training, Support, Custom Development, Engineering http

Re: [PERFORM] Pooling in Core WAS: Need help in performance tuning.

On Thu, 2010-07-22 at 14:36 -0400, Robert Haas wrote: On Mon, Jul 12, 2010 at 6:58 AM, Craig Ringer cr...@postnewspapers.com.au wrote: So rather than asking should core have a connection pool perhaps what's needed is to ask what can an in-core pool do that an external pool cannot do?

Re: [PERFORM] Identical query slower on 8.4 vs 8.3

, Joshua D. Drake Thanks! Patrick -- PostgreSQL.org Major Contributor Command Prompt, Inc: http://www.commandprompt.com/ - 509.416.6579 Consulting, Training, Support, Custom Development, Engineering -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make

Re: [PERFORM] partition queries hitting all partitions even though check key is specified

of our partitions. I don't think extract() is immutable, which would pretty much invalidate your check constraints as far as CE is concerned. Correct. Joshua D. Drake -- PostgreSQL.org Major Contributor Command Prompt, Inc: http://www.commandprompt.com/ - 509.416.6579 Consulting, Training

Re: [PERFORM] performance on new linux box

. Sincerely, Joshua D. Drake -- PostgreSQL.org Major Contributor Command Prompt, Inc: http://www.commandprompt.com/ - 509.416.6579 Consulting, Training, Support, Custom Development, Engineering -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes

Re: [PERFORM] PostgreSQL as a local in-memory cache

On Thu, 2010-06-24 at 21:14 +0200, Pavel Stehule wrote: 2010/6/24 Josh Berkus j...@agliodbs.com: And I'm also planning to implement unlogged tables, which have the same contents for all sessions but are not WAL-logged (and are truncated on startup). this is similar MySQL's memory

Re: [PERFORM] Occasional giant spikes in CPU load

is happening during one of the CPU spikes. checkpoint causing IO Wait. What does sar say about these times? Joshua D. Drake -- PostgreSQL.org Major Contributor Command Prompt, Inc: http://www.commandprompt.com/ - 509.416.6579 Consulting, Training, Support, Custom Development, Engineering

Re: [PERFORM] slow index lookup

On Tue, 2010-06-22 at 18:00 -0700, Anj Adu wrote: i have several partitions like this (similar size ...similar data distribution)..these partitions are only inserted..never updated. Why would I need to vacuum.. An explain analyze is what is in order for further diagnosis. JD I can

Re: [PERFORM] Very high effective_cache_size == worse performance?

, this post doesn't mean a whole lot. Further, effective_cash_size is not likely to effect a bulk load at all. Joshua D. Drake Thanks! Dave -- PostgreSQL.org Major Contributor Command Prompt, Inc: http://www.commandprompt.com/ - 503.667.4564 Consulting, Training, Support, Custom Development

Re: [PERFORM] Occasional giant spikes in CPU load

of the spike. What does iostat 5 say during the jump? Joshua D. Drake -- PostgreSQL.org Major Contributor Command Prompt, Inc: http://www.commandprompt.com/ - 503.667.4564 Consulting, Training, Support, Custom Development, Engineering Respect is earned, not gained through arbitrary and repetitive use

Re: [PERFORM] Occasional giant spikes in CPU load

On Wed, 2010-04-07 at 14:45 -0700, Craig James wrote: On 4/7/10 2:40 PM, Joshua D. Drake wrote: On Wed, 2010-04-07 at 14:37 -0700, Craig James wrote: Most of the time Postgres runs nicely, but two or three times a day we get a huge spike in the CPU load that lasts just a short time

Re: [PERFORM] disk space usage unexpected

,...filenode.43) created in the database subdirectory within PGDATA/base. This caused the disk space quickly used up. Is this expected? Yes. Especially if autovacuum is not keeping up with the number of updates. Joshua D. Drake Thanks for any information Best Regards Rose Zhou

Re: [PERFORM] Dell PERC H700/H800

of the comments points out, that kind of makes them no longer SATA or SAS compatible, and they shouldn't be allowed to use those acronyms any more. That's interesting. I know that IBM at least on some of their models have done the same. Glad I use HP :) Joshua D. Drake Matthew

Re: [PERFORM] New server to improve performance on our large and busy DB - advice?

), it may be time to move to 8.4.2 instead. Joshua D. Drake Thanks, Carlo The details of our use: . The DB hosts is a data warehouse and a knowledgebase (KB) tracking the professional information of 1.3M individuals. . The KB tables related to these 130M individuals are naturally also

Re: [PERFORM] 8.4.1 ubuntu karmic slow createdb

a mini xfs. Do not turn fsync off. That is bad advice. I would not suggest ext4 at this point for database operations. Use ext3. It is backward compatible. Joshua D. Drake -- PostgreSQL.org Major Contributor Command Prompt, Inc: http://www.commandprompt.com/ - 503.667.4564 Consulting, Training

Re: [PERFORM] 8.4.1 ubuntu karmic slow createdb

intentionally or not. Joshua D. Drake -- PostgreSQL.org Major Contributor Command Prompt, Inc: http://www.commandprompt.com/ - 503.667.4564 Consulting, Training, Support, Custom Development, Engineering If the world pushes look it in the eye and GRR. Then push back harder. - Salamander -- Sent via

Re: [PERFORM] truncate in transaction blocks read access

partitioning so you can roll off data. http://www.postgresql.org/docs/8.3/interactive/ddl-partitioning.html Joshua D. Drake Thanks, Craig -- PostgreSQL.org Major Contributor Command Prompt, Inc: http://www.commandprompt.com/ - 503.667.4564 Consulting, Training, Support, Custom Development

Re: [PERFORM] database size growing continously

will need to cluster or reindex. Joshua D. Drake -- PostgreSQL.org Major Contributor Command Prompt, Inc: http://www.commandprompt.com/ - 503.667.4564 Consulting, Training, Support, Custom Development, Engineering If the world pushes look it in the eye and GRR. Then push back harder

Re: [PERFORM] dump time increase by 1h with new kernel

On Thu, 2009-10-08 at 10:44 -0700, Justin T Pryzby wrote: Hi Everyone Did your scheduler change between the kernel versions? Not sure if sar can provide other data included by vmstat: IO merged in/out, {,soft}irq ticks? Thanks, Justin -- PostgreSQL.org Major Contributor Command

Re: [PERFORM] Bottleneck?

recall it uses the same interface as dtrace. The front end is just different. Joshua D. Drake -- PostgreSQL - XMPP: jdr...@jabber.postgresql.org Consulting, Development, Support, Training 503-667-4564 - http://www.commandprompt.com/ The PostgreSQL Company, serving since 1997 -- Sent via

Re: [PERFORM] Bottleneck?

On Thu, 2009-08-06 at 12:38 -0400, Ray Stell wrote: On Thu, Aug 06, 2009 at 09:12:22AM -0700, Joshua D. Drake wrote: Why aren't you using systemtap again? 1. significant solaris responsibilites There is your problem right there ;) 2. significant linux responsibilities 3. tool

Re: [PERFORM] Postgres replication: dump/restore, PITR, Slony,...?

Then there are Slony-I, Buchardo, Mamoth Replicator from CMO, simple replication in Postgres 8.4 and other projects... CMO? :) Joshua D. Drake Suggestions? Thanks, -- Shaul -- PostgreSQL - XMPP: jdr...@jabber.postgresql.org Consulting, Development, Support, Training 503-667

Re: [PERFORM] Postgres replication: dump/restore, PITR, Slony,...?

: Two shots of brandy One shot of rum Vanilla Ice cream Cherries Blend to perfection. Joshua D. Drake -- PostgreSQL - XMPP: jdr...@jabber.postgresql.org Consulting, Development, Support, Training 503-667-4564 - http://www.commandprompt.com/ The PostgreSQL Company, serving since 1997

Re: [PERFORM] Hosted servers with good DB disk performance?

On Tue, 2009-05-26 at 19:52 -0600, Scott Marlowe wrote: On Tue, May 26, 2009 at 7:41 PM, Scott Carey sc...@richrelevance.com wrote: On 5/26/09 6:17 PM, Greg Smith gsm...@gregsmith.com wrote: On Tue, 26 May 2009, Joshua D. Drake wrote: CMD doesn't rent hardware you would have

Re: [PERFORM] Hosted servers with good DB disk performance?

that, Rack Space does. Joshua D. Drake -- PostgreSQL - XMPP: jdr...@jabber.postgresql.org Consulting, Development, Support, Training 503-667-4564 - http://www.commandprompt.com/ The PostgreSQL Company, serving since 1997 -- Sent via pgsql-performance mailing list (pgsql-performance

Re: [PERFORM] raid10 hard disk choice

sata drives, mount raid 1 and put the o/s on those. +1 on that. Joshua D. Drake merlin -- PostgreSQL - XMPP: jdr...@jabber.postgresql.org Consulting, Development, Support, Training 503-667-4564 - http://www.commandprompt.com/ The PostgreSQL Company, serving since 1997 -- Sent via

Re: [PERFORM] Any better plan for this query?..

the connections live then no. Joshua D. Drake -- PostgreSQL - XMPP: jdr...@jabber.postgresql.org Consulting, Development, Support, Training 503-667-4564 - http://www.commandprompt.com/ The PostgreSQL Company, serving since 1997 -- Sent via pgsql-performance mailing list (pgsql-performance

Re: [PERFORM] Any better plan for this query?..

On Tue, 2009-05-12 at 20:34 -0400, Aidan Van Dyk wrote: * Joshua D. Drake j...@commandprompt.com [090512 19:27]: Apache solved this problem back when it was still called NSCA HTTPD. Why aren't we preforking again? Of course, preforking and connection pooling are totally different beast

Re: [PERFORM] PostgreSQL with PostGIS on embedded hardware

On Fri, 2009-05-08 at 18:06 +0200, Paolo Rizzi wrote: Hi all, recently I came across a question from a customer of mine, asking me if it would feasible to run PostgreSQL along with PostGIS on embedded hardware. They didn't give me complete information, but it should be some kind of

Re: [PERFORM] performance for high-volume log insertion

commit. Based on 20ms round trip time, you are talking 20seconds additional overhead. Joshua D. Drake -- PostgreSQL - XMPP: jdr...@jabber.postgresql.org Consulting, Development, Support, Training 503-667-4564 - http://www.commandprompt.com/ The PostgreSQL Company, serving since 1997

Re: [PERFORM] Using IOZone to simulate DB access patterns

and -r8k. Those options are basically use a 1000 meg file (like our data files) with 8k chunks (like our pages). Based on your partitioning scheme, what is the break out? Can you reasonably expect all partitions to be used equally? Sincerely, Joshua D. Drake --Josh -- PostgreSQL - XMPP: jdr

Re: [PERFORM] Performance of archive logging in a PITR restore

logs are restored in a serialized manner so they will be slower to restore in general. Joshua D. Drake -- PostgreSQL - XMPP: jdr...@jabber.postgresql.org Consulting, Development, Support, Training 503-667-4564 - http://www.commandprompt.com/ The PostgreSQL Company, serving since 1997

Re: [PERFORM] suggestions for postgresql setup on Dell 2950 , PERC6i controller

On Thu, 2009-02-05 at 12:40 +, Matt Burke wrote: Arjen van der Meijden wrote: Are there any reasonable choices for bigger (3+ shelf) direct-connected RAID10 arrays, or are hideously expensive SANs the only option? I've checked out the latest Areca controllers, but the manual available

Re: [PERFORM] Using multiple cores for index creation?

with a group of indexes to create. Then call pg_restore multiple times in a script against the individual TOC and you will use all cores. Joshua D. Drake P.S. Increase maintenance_work_mem can help too ...Robert -- PostgreSQL - XMPP: jdr...@jabber.postgresql.org Consulting, Development, Support

Re: [PERFORM] [PERFORMANCE] Buying hardware

than somewhat. Maybe, a bit? ;) Joshua D. Drake -- PostgreSQL - XMPP: jdr...@jabber.postgresql.org Consulting, Development, Support, Training 503-667-4564 - http://www.commandprompt.com/ The PostgreSQL Company, serving since 1997 -- Sent via pgsql-performance mailing list (pgsql

Re: [PERFORM] postgresql 8.3 tps rate

is going on. Run 5 or so and see how it looks. Joshua D. Drake -- PostgreSQL - XMPP: jdr...@jabber.postgresql.org Consulting, Development, Support, Training 503-667-4564 - http://www.commandprompt.com/ The PostgreSQL Company, serving since 1997 -- Sent via pgsql-performance mailing

Re: [PERFORM] Need help with 8.4 Performance Testing

=15222LowPrice=$1,899.00familyviewgroup=757viewtype=Matrix Retail cost, 15k, 36GB drives, ~ 12k. A phone call and threat of buying dell gets its for ~ 10k. Joshua D. Drake -- PostgreSQL Consulting, Development, Support, Training 503-667-4564 - http://www.commandprompt.com/ The PostgreSQL

Re: [PERFORM] Need help with 8.4 Performance Testing

On Sat, 2008-12-13 at 12:45 -0700, Scott Marlowe wrote: On Sat, Dec 13, 2008 at 11:37 AM, Joshua D. Drake j...@commandprompt.com wrote: On Sat, 2008-12-13 at 07:44 -0800, da...@lang.hm wrote: On Sat, 13 Dec 2008, Robert Haas wrote: http://h71016.www7.hp.com/ctoBases.asp?oi=E9CEDBEID

Re: [PERFORM] Need help with 8.4 Performance Testing

On Sat, 2008-12-13 at 12:57 -0700, Scott Marlowe wrote: On Sat, Dec 13, 2008 at 12:47 PM, Joshua D. Drake j...@commandprompt.com wrote: On Sat, 2008-12-13 at 12:45 -0700, Scott Marlowe wrote: On Sat, Dec 13, 2008 at 11:37 AM, Joshua D. Drake j...@commandprompt.com wrote: On Sat, 2008

Re: [PERFORM] Need help with 8.4 Performance Testing

On Sat, 2008-12-13 at 19:16 -0700, Scott Marlowe wrote: Isn't it amazing how many small businesses won't buy from other small businesses? They'd much rather give their money to a company they don't like because they'll be around a while (the big company). True enough! Joshua D. Drake

Re: [PERFORM] Experience with HP Smart Array P400 and SATA drives?

. The HP SmartArray series is quite common, so a lot of users would have the same problem. Yes the SmartArray series is quite common and actually know to perform reasonably well, in RAID 10. You still appear to be trying RAID 5. Joshua D. Drake Thanks! -- PostgreSQL Consulting

Re: [PERFORM] Experience with HP Smart Array P400 and SATA drives?

On Tue, 2008-12-09 at 18:27 +0200, Peter Eisentraut wrote: Aidan Van Dyk wrote: * Joshua D. Drake [EMAIL PROTECTED] [081209 11:01]: Yes the SmartArray series is quite common and actually know to perform reasonably well, in RAID 10. You still appear to be trying RAID 5. *boggle

  1   2   3   4   5   >