Re: [PERFORM] postgresql tuning with perf

2017-10-23 Thread Steve Atkins
FROM dept_new > WHERE c1 = p1; > END; Perhaps I'm confused, but I didn't think PostgreSQL had stored procedures. If the code you're actually running looks like this then I don't think you're using PostgreSQL. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-perfor

Re: [PERFORM] More cores or higer frequency ?

2017-05-23 Thread Steve Crawford
mmit to disk is a win - think SSD or RAID with BBU cache and with a relatively modest 13GB database you should be able to spec enough RAM to keep everything in memory. Cheers, Steve

Re: [PERFORM] More cores or higer frequency ?

2017-05-23 Thread Steve Crawford
. But CPU is often not the limiting factor. With a better understanding of your needs, people here can offer suggestions for memory, storage, pooling, network, etc. Cheers, Steve On Tue, May 23, 2017 at 11:29 AM, Jarek <ja...@poczta.srv.pl> wrote: > Hello! > > I've heavy loaded Postgr

Re: [PERFORM] Performance problems with 9.2.15

2016-05-27 Thread Steve Crawford
est and will get critical updates without worrying about any distribution packager delays. Cheers, Steve

Re: [PERFORM] New server: SSD/RAID recommendations?

2015-07-06 Thread Steve Crawford
/when-solid-state-drives-are-not-that-solid/ Cheers, Steve

Re: [PERFORM] Query running slow for only one specific id. (Postgres 9.3) version

2015-06-05 Thread Steve Crawford
Total runtime: 19.769 ms A couple initial questions: 1. Does the result change if you analyze the table and rerun the query? 2. Are there any non-default settings for statistics collection on your database? -Steve

Re: [PERFORM] Re: [GENERAL] Re: Query running slow for only one specific id. (Postgres 9.3) version

2015-06-05 Thread Steve Crawford
On 06/05/2015 12:28 PM, Steve Crawford wrote: On 06/05/2015 11:38 AM, Sheena, Prabhjot wrote: When I run vacuum analyze it fixes the problem but after 1 or 2 days the problem comes back Is autovacuum running and using what settings? (select name, setting from pg_settings where name

[PERFORM] Re: [GENERAL] Re: Query running slow for only one specific id. (Postgres 9.3) version

2015-06-05 Thread Steve Crawford
';) Cheers, Steve P.S. The convention on the PostgreSQL mailing lists it to bottom-post, not top-post replies. Konsole outpor name ~ 'statistics';)

Re: [PERFORM] Fastest Backup Restore for perf testing

2015-05-27 Thread Steve Atkins
to be. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

[PERFORM] New server optimization advice

2015-01-09 Thread Steve Crawford
leave indexes as is and evaluate which ones to drop later? Any recommendations on distribution and/or kernels (and kernel tuning)? PostgreSQL tuning starting points? Whatever comes to mind. Thanks, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make

Re: [PERFORM] Turn off Hyperthreading! WAS: 60 core performance with 9.3

2014-08-21 Thread Steve Crawford
. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] DB sessions 100 times of DB connections

2014-07-08 Thread Steve Crawford
, a query holding locks that prevent the other connections' queries from completing or a variety of other things. If you are looking to solve/prevent the undescribed issue, please provide more detail. -Steve

Re: [PERFORM] IP addresses, NetBlocks, and ASNs

2014-04-20 Thread Steve Atkins
in the database to do the work. It's faster still, at the cost of a fair bit more work during import. (It's also a little more accurate in some cases, as the mapping of IP address to list of ASNs is dynamic, and you usually want the ASN at the time of an incident, not the one now.) Cheers, Steve

Re: [PERFORM] Regarding Hardware Tuning

2013-12-19 Thread Steve Crawford
they most likely couldn't answer this. The closest you are likely to come is to read and reread PostgreSQL High Performance which is an invaluable resource. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http

Re: [PERFORM] Performance of complicated query

2013-05-28 Thread Steve Crawford
to use an index on, say, a varchar column being compared to, perhaps, a text value or column in which case casting to the exact data-type being indexed can be a big win. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your

Re: [PERFORM] Performance of complicated query

2013-05-23 Thread Steve Crawford
? Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] Performance of complicated query

2013-05-23 Thread Steve Crawford
or patients are issued devices at overlapping times (i.e. using two devices at one time) then the query gets more complicated but with... is still a likely usable construct. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription

Re: [PERFORM] performance database for backup/restore

2013-05-21 Thread Steve Crawford
a nasty security issue. Upgrade. Now. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] Issues with OSX and SHMMAX?

2013-04-22 Thread Steve Atkins
starting when I removed that). Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] slow bitmap heap scans on pg 9.2

2013-04-14 Thread Steve Singer
On 13-04-13 04:54 PM, Jeff Janes wrote: On Sat, Apr 13, 2013 at 9:14 AM, Steve Singer ssin...@ca.afilias.info mailto:ssin...@ca.afilias.info wrote: indexTotalCost += index-pages * spc_random_page_cost / 10.0; Is driving my high costs on the inner loop. The index has 2-5

Re: [PERFORM] slow bitmap heap scans on pg 9.2

2013-04-13 Thread Steve Singer
On 13-04-12 09:20 PM, Jeff Janes wrote: On Thursday, April 11, 2013, Steve Singer wrote: I think the reason why it is picking the hash join based plans is because of Index Scan using table_b_1_ptid_orgid_ym_unq on table_b_1 b (cost=0.00..503.86 rows=1 width=10) (actual time

Re: [PERFORM] slow bitmap heap scans on pg 9.2

2013-04-11 Thread Steve Singer
On 13-04-10 07:54 PM, Steve Singer wrote: On 13-04-10 02:06 PM, Jeff Janes wrote: On Wed, Apr 10, 2013 at 6:49 AM, Steve Singer ssin...@ca.afilias.info mailto:ssin...@ca.afilias.info wrote: I think the index recheck means your bitmap is overflowing (i.e. needing more space than work_mem

[PERFORM] slow bitmap heap scans on pg 9.2

2013-04-10 Thread Steve Singer
expects? Steve HashAggregate (cost=11972282.27..11972448.32 rows=11070 width=51) (actual time=3523526.572..3523526.646 rows=30 loops=1) - Hash Join (cost=1287232.78..11220656.06 rows=724459 width=51) (actual time=1702760.590..1898522.706 rows=662583 loops=1) Hash Cond

Re: [PERFORM] slow bitmap heap scans on pg 9.2

2013-04-10 Thread Steve Singer
On 13-04-10 09:56 AM, k...@rice.edu wrote: On Wed, Apr 10, 2013 at 09:49:55AM -0400, Steve Singer wrote: Hi Steve, The one thing that stands out to me is that you are working with 200GB of data on a machine with 4-8GB of ram and you have the random_page_cost set to 2.0. That is almost

Re: [PERFORM] slow bitmap heap scans on pg 9.2

2013-04-10 Thread Steve Singer
On 13-04-10 02:06 PM, Jeff Janes wrote: On Wed, Apr 10, 2013 at 6:49 AM, Steve Singer ssin...@ca.afilias.info mailto:ssin...@ca.afilias.info wrote: I think the index recheck means your bitmap is overflowing (i.e. needing more space than work_mem) and so keeping only the pages which have

Re: [PERFORM] New server setup

2013-03-13 Thread Steve Crawford
/understanding-robustness-ssds-under-power-fault Kind of messes with the D in ACID. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] Slow concurrent processing

2013-03-12 Thread Steve Crawford
schemas and the type of processing you are attempting on them. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] Slow concurrent processing

2013-03-12 Thread Steve Crawford
On 03/12/2013 08:06 AM, Misa Simic wrote: Thanks Steve Well, the full story is too complex - but point was - whatever blackbox does - it last 0.5 to 2secs per 1 processed record (maybe I was wrong but I thought the reason why it takes the time how much it needs to actually do the task -CPU

Re: [PERFORM] Savepoints in transactions for speed?

2012-11-27 Thread Steve Atkins
of millions of rows) bulk inserts. It's not as fast as you can get, but it's probably as fast as you can get with perl. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql

Re: [PERFORM] Query with limit goes from few ms to hours

2012-10-23 Thread Steve Crawford
that the statistics will not have been automatically updated before the subsequent query is planned so an explicit ANALYZE between the update and the query can be of value. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription

Re: [PERFORM] Scaling 10 million records in PostgreSQL table

2012-10-08 Thread Steve Crawford
is the structure of your table? You can use \d+ dealer_vehicle_details in psql. Have you tuned PostgreSQL in any way? If so, what? Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref

Re: [PERFORM] Two identical systems, radically different performance

2012-10-08 Thread Steve Crawford
, Steve

Re: [PERFORM] [ADMIN] Messed up time zones

2012-08-03 Thread Steve Crawford
-datetime.html will be time well spent. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] PostgreSQL db, 30 tables with number of rows 100 (not huge) - the fastest way to clean each non-empty table and reset unique identifier column of empty ones.

2012-07-06 Thread Steve Crawford
or tables whenever the reset script isn't actively working on that same table leading to unexplained weird test results. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql

Re: [PERFORM] pgbouncer - massive overhead?

2012-06-20 Thread Steve Crawford
. If you were to add -C so each query required a new client connection a different picture would emerge. Same thing if you had 2000 client connections of which only a handful were running queries at any moment. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance

Re: [PERFORM] High load average in 64-core server , no I/O wait and CPU is idle

2012-05-24 Thread Steve Crawford
to the question: what, other than the db, runs on this machine? Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] auto-vacuum vs. full table update

2012-04-26 Thread Steve Crawford
/) Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] scale up (postgresql vs mssql)

2012-04-13 Thread Steve Crawford
and attempting to create an unlogged temporary table will raise an error. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] scale up (postgresql vs mssql)

2012-04-13 Thread Steve Crawford
On 04/13/2012 09:43 AM, Claudio Freire wrote: On Fri, Apr 13, 2012 at 1:36 PM, Steve Crawford scrawf...@pinpointresearch.com wrote: If they are permanent tables used for temporary storage then making them unlogged may be beneficial. But actual temporary tables *are* unlogged and attempting

Re: [PERFORM] Linux machine aggressively clearing cache

2012-04-12 Thread Steve Crawford
On 03/30/2012 05:51 PM, Josh Berkus wrote: So this turned out to be a Linux kernel issue. Will document it on www.databasesoup.com. Anytime soon? About to build two PostgreSQL servers and wondering if you have uncovered a kernel version or similar issue to avoid. Cheers, Steve -- Sent via

Re: [PERFORM] anyone tried to use hoard allocator?

2012-03-26 Thread Steve Atkins
incompatible with postgresql too. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] Advice sought : new database server

2012-03-06 Thread Steve Crawford
and a bit offtopic. Why do you take SAS disks for the OS and not much cheaper SATA ones? Here's Intel's (very general) take. Your OS disks may not justify SAS on performance alone but other aspects may sway you. http://www.intel.com/support/motherboards/server/sb/CS-031831.htm Cheers, Steve

Re: [PERFORM] Very long deletion time on a 200 GB database

2012-02-24 Thread Steve Crawford
if you are short on disk-space. You may be able to start by clustering your smaller tables and move toward the larger ones as you free disk-space. Be sure to run ANALYZE on any table that you have CLUSTERed. You might find it useful to make CLUSTER part of your regular maintenance. Cheers, Steve

Re: [PERFORM] Very long deletion time on a 200 GB database

2012-02-23 Thread Steve Crawford
options are limited, but word-on-the-street is that for high-performance production use, install PostgreSQL on *nix. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] set autovacuum=off

2012-02-23 Thread Steve Crawford
on table vacuuming and analyzing: select relname, last_vacuum, last_autovacuum, last_analyze, last_autoanalyze, vacuum_count, autovacuum_count, analyze_count, autoanalyze_count from pg_stat_user_tables; Cheers, Steve

Re: [PERFORM] set autovacuum=off

2012-02-23 Thread Steve Crawford
On 02/23/2012 10:38 AM, Alessandro Gagliardi wrote: On Thu, Feb 23, 2012 at 10:01 AM, Steve Crawford scrawf...@pinpointresearch.com mailto:scrawf...@pinpointresearch.com wrote: The documentation has information like This parameter can only be set in the postgresql.conf file

Re: [PERFORM] set autovacuum=off

2012-02-23 Thread Steve Crawford
data into a temp table then move the data with a variant of: INSERT INTO main_table (SELECT ... FROM incoming_table WHERE NOT EXISTS ((SELECT 1 from main_table WHERE ...)) Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your

Re: [PERFORM] Insertions slower than Updates?

2012-02-20 Thread Steve Horn
subscription: http://www.postgresql.org/mailpref/pgsql-performance -- Steve Horn http://www.stevehorn.cc st...@stevehorn.cc http://twitter.com/stevehorn 740-503-2300

[PERFORM] Query slow as function

2012-02-19 Thread Steve Horn
Hello all! I have a very simple query that I am trying to wrap into a function: SELECT gs.geo_shape_id AS gid, gs.geocode FROM geo_shapes gs WHERE gs.geocode = 'xyz' AND geo_type = 1 GROUP BY gs.geography, gs.geo_shape_id, gs.geocode; This query runs in about 10 milliseconds. Now my goal is to

[PERFORM] Query slow as Function

2012-02-18 Thread Steve Horn
Hello all! I have a very simple query that I am trying to wrap into a function: SELECT gs.geo_shape_id AS gid, gs.geocode FROM geo_shapes gs WHERE gs.geocode = 'xyz' AND geo_type = 1 GROUP BY gs.geography, gs.geo_shape_id, gs.geocode; This query runs in about 10 milliseconds. Now my goal is to

Re: [PERFORM] Query slow as Function

2012-02-18 Thread Steve Horn
SQL (EXECUTE 'your query string' inside the function) Steve *is* using EXECUTE, so that doesn't seem to be the answer. I'm wondering about datatype mismatches myself --- the function form is forcing the parameter to be char(9), which is not a constraint imposed in the written-out query

Re: [PERFORM] Why so slow?

2012-02-17 Thread Steve Crawford
seen_its table just grows and grows but is rarely, if ever, modified. If it is basically a log-type table it will be a prime candidate for partitioning on date and queries like this will only need to access a couple relatively small child tables instead of one massive one. Cheers, Steve -- Sent

Re: [PERFORM] index usage for min() vs. order by asc limit 1

2011-11-17 Thread Steve Atkins
On Nov 17, 2011, at 5:12 PM, Ben Chobot wrote: I have two queries in PG 9.1. One uses an index like I would like, the other does not. Is this expected behavior? If so, is there any way around it? I don't think you want the group by in that first query. Cheers, Steve postgres

Re: [PERFORM] table size is bigger than expected

2011-08-04 Thread Steve Crawford
to intervene. The CLUSTER statement will completely rewrite and reindex your table (and will physically reorder the table based on the selected index). Note: CLUSTER requires an exclusive lock on the table. Cheers, Steve

Re: [PERFORM] Speeding up loops in pl/pgsql function

2011-05-26 Thread Steve Crawford
is the octal representation of an un-encoded sequence of bytes or represents a string of ASCII/UTF-8/whatever... encoded text. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref

Re: [PERFORM] Speeding up loops in pl/pgsql function

2011-05-25 Thread Steve Crawford
or replace function octal_string_to_text(someoctal text) returns text as $$ declare binstring text; begin execute 'select E''' || regexp_replace($1, E'(\\d{3})', E'\\1', 'g') || into binstring; return binstring; end $$ language plpgsql; Cheers, Steve -- Sent via pgsql-performance

Re: [PERFORM] Linux: more cores = less concurrency.

2011-04-11 Thread Steve Clark
On 04/11/2011 02:32 PM, Scott Marlowe wrote: On Mon, Apr 11, 2011 at 12:12 PM, Joshua D. Drakej...@commandprompt.com wrote: On Mon, 11 Apr 2011 13:09:15 -0500, Kevin Grittner kevin.gritt...@wicourts.gov wrote: Glyn Astillglynast...@yahoo.co.uk wrote: The new server uses 4 x 8 core Xeon

Re: [PERFORM] Request for feedback on hardware for a new database server

2011-03-17 Thread Steve Atkins
for whichever RAID controller you need, or it won't be able to safely do writeback caching, and you'll lose a lot of the benefit. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql

Re: [PERFORM] big joins not converging

2011-03-10 Thread Steve Atkins
tends to get better in newer versions of postgresql. You might want to upgrade to 9.0.3 too.) Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] pg_dumpall affecting performance

2011-02-15 Thread Steve Crawford
. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] How to boost performance of queries containing pattern matching characters

2011-02-14 Thread Steve Atkins
better, but an index on the reverse of the domain is still useful for working with subdomains). Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

[PERFORM] MVCC and Implications for (Near) Real-Time Application

2010-10-29 Thread Steve Wong
different query threads are seeing which version)? (2) Are there any available benchmarks that can measure this delay? (3) What are relevant config parameters that will reduce this delay? Thanks for your patience with my ignorance of MVCC (still learning more about it), Steve

Re: [PERFORM] Postgres insert performance and storage requirement compared to Oracle

2010-10-27 Thread Steve Singer
On 10-10-27 02:14 PM, Divakar Singh wrote: yes this is a very clearly visible problem. The difference b/w oracle and PG increases with more rows. when oracle takes 3 GB, PG takes around 6 GB. I only use varchar. I will try to use your tips on smart table layout, toast compression. Assuming these

Re: [PERFORM] BBU Cache vs. spindles

2010-10-21 Thread Steve Crawford
On 10/20/2010 09:45 PM, Scott Marlowe wrote: On Wed, Oct 20, 2010 at 8:25 PM, Joshua D. Drakej...@commandprompt.com wrote: On Wed, 2010-10-20 at 22:13 -0400, Bruce Momjian wrote: Ben Chobot wrote: On Oct 7, 2010, at 4:38 PM, Steve Crawford wrote: I'm weighing

[PERFORM] BBU Cache vs. spindles

2010-10-07 Thread Steve Crawford
adding a second RAID-set and splitting off the WAL traffic? Or something else? Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] Using more tha one index per table

2010-07-21 Thread Steve Atkins
. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] PostgreSQL as a local in-memory cache

2010-06-15 Thread Steve Wampler
-backed file systems? I wouldn't think the performance impact of leaving the rest of the stuff on disk would be that large. Or does losing WAL files mandate a new initdb? -- Steve Wampler -- swamp...@noao.edu The gods that smiled on your birth are now laughing out loud. -- Sent via pgsql

Re: [PERFORM] Occasional giant spikes in CPU load

2010-04-07 Thread Steve Crawford
in the PostgreSQL logs? Anything interesting, there? Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] How to fast the REINDEX

2010-04-01 Thread Steve Clark
On 03/31/2010 11:11 PM, Craig Ringer wrote: Jaime Casanova wrote: On Wed, Mar 31, 2010 at 5:33 PM, raghavendra t raagavendra@gmail.com wrote: Why are you doing that? Our table face lot of updates and deletes in a day, so we prefer reindex to update the indexes as well overcome with a

Re: [PERFORM] DB is slow until DB is reloaded

2010-01-04 Thread Steve Crawford
will bloat and you won't be getting appropriate analyze runs. Speaking of which, what happens if you just run analyze? And as long as you are dumping and reloading anyway, how about version upgrading for bug reduction, performance improvement, and cool new features. Cheers, Steve -- Sent via

Re: [PERFORM] DB is slow until DB is reloaded

2010-01-04 Thread Steve Crawford
Madison Kelly wrote: Steve Crawford wrote: Madison Kelly wrote: Hi all, I've got a fairly small DB... It slows down over time and I can't seem to find a way to get the performance to return without doing a dump and reload of the database... Yup, I even tried manually running 'VACUUM

Re: [PERFORM] DB is slow until DB is reloaded

2010-01-04 Thread Steve Crawford
But this is duct-tape and bailing-wire. You REALLY need to make sure that autovacuum is running - you are likely to have much better results with less pain. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http

Re: [PERFORM] DB is slow until DB is reloaded

2010-01-04 Thread Steve Crawford
): autovacuum = on autovacuum_naptime = 300# time between autovacuum runs, in secs Then you can tune it if you need to but at least it will be looking for things that are vacuumworthy every 5 minutes. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance

Re: [PERFORM] RAID card recommendation

2009-11-25 Thread Steve Crawford
strung along for a couple months before calling my supplier and telling him to swap it out for a 3ware. The 3ware just works. I currently have a couple dozen Linux servers, including some PostgreSQL machines, running the 3ware cards. Cheers, Steve -- Sent via pgsql-performance mailing list

Re: [PERFORM] database size growing continously

2009-10-29 Thread Steve Crawford
with numerous improvements not directly related to your question. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] database size growing continously

2009-10-29 Thread Steve Crawford
can ignore prior-days' static child-tables (and you could keep historical-data-dumps off-line for later use if desired). Read up on it here: http://www.postgresql.org/docs/8.4/interactive/ddl-partitioning.html Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance

Re: [PERFORM] PostgreSQL 8.4 performance tuning questions

2009-07-30 Thread Steve Crawford
on pg_dump and the --jobs option in pg_restore for details. Cheers, Steve

Re: [PERFORM] PostgreSQL 8.4 performance tuning questions

2009-07-30 Thread Steve Crawford
Kevin Grittner wrote: Steve Crawford scrawf...@pinpointresearch.com wrote: benchmarks I've seen suggest that with 8 cores you may even see an almost 8x restore speedup I'm curious what sort of data in what environment showed that ratio. Was going on memory from a presentation I

[PERFORM] Query performance over a large proportion of data

2009-03-10 Thread Steve McLellan
Hi, I'd be grateful for any advice we can get... we recently switched from MySQL to PostgreSQL on the basis of some trials we carried out with datasets of varying sizes and varying rates of contention. For the most part we've been pleased with performance, but one particular application runs

Re: [PERFORM] Query performance over a large proportion of data

2009-03-10 Thread Steve McLellan
*Tom Lane t...@sss.pgh.pa.us* Sent by: pgsql-performance-ow...@postgresql.org 03/10/2009 08:16 PM AST Steve McLellan smclel...@mintel.com writes: lc_messages = 'en_US.UTF-8' lc_monetary = 'en_US.UTF-8' lc_numeric = 'en_US.UTF-8' lc_time = 'en_US.UTF-8' BTW, aside from the points

Re: [PERFORM] Query performance over a large proportion of data

2009-03-10 Thread Steve McLellan
*Scott Marlowe scott.marl...@gmail.com* 03/10/2009 05:19 PM Nested Loop (cost=466.34..192962.24 rows=15329 width=12) (actual time=13653.238..31332.113 rows=131466 loops=1) Both your query plans end with this nested loop join which is taking up about half your time in your query.

Re: [PERFORM] Query performance over a large proportion of data

2009-03-10 Thread Steve McLellan
for this query. Removing the nested loop seems to be what makes a difference. We'll continue to play with these and check there are no adverse effects on other queries. Thanks again, Steve

Re: [PERFORM] Abnormal performance difference between Postgres and MySQL

2009-02-26 Thread Steve Clark
downloading the source code and reading through the README files and comments in the source code. -Kevin Hello List, Can this be set in the postgresql.conf file? default_statistics_target = 50 Thanks, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org

Re: [PERFORM] query slow only after reboot

2009-02-09 Thread Steve Crawford
to tackle the problem? What OS, amount of RAM, DB size...? If the queries get progressively faster as you use the system then slow again after a reboot, my initial guess would be that you are getting more and more disk-cache hits the longer you use the system. Cheers, Steve -- Sent via pgsql

Re: [PERFORM] Perc 3 DC

2008-11-24 Thread Steve Clark
Glyn Astill wrote: --- On Sat, 22/11/08, Scott Marlowe [EMAIL PROTECTED] wrote: You really have two choices. First is to try and use it as a plain SCSI card, maybe with caching turned on, and do the raid in software. Second is to cut it into pieces and make jewelry out of it. Haha, I'm

Re: [PERFORM] speeding up table creation

2008-10-14 Thread Steve Crawford
much data. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] Intel's X25-M SSD

2008-09-24 Thread Steve Clark
Scott Carey wrote: A fantastic review on this issue appeared in July: http://www.alternativerecursion.info/?p=106 And then the same tests on a RiData SSD show that they are the same drive with the same characteristics: http://www.alternativerecursion.info/?p=276 Most blamed it on MLC being

Re: [PERFORM] select on 22 GB table causes An I/O error occured while sending to the backend. exception

2008-08-28 Thread Steve Atkins
will fit in RAM. Neither swapping nor OOM killing are particularly good - it's just a consequence of the amount of memory needed being unpredictable. Probably the best solution is to just tell the kernel somehow to never kill the postmaster. Or configure adequate swap space? Cheers, Steve

Re: [PERFORM] Mailing list hacked by spammer?

2008-07-18 Thread Steve Atkins
now. It would be really, really unfortunate if this list fell to the spammers. It's not been hacked by spammers. It's a valid From address, probably coincidentally. Nothing worth discussing. *Definitely* not something worth discussing on the list. Cheers, Steve -- Sent via pgsql

Re: [PERFORM] 2GB or not 2GB

2008-05-28 Thread Steve Crawford
Josh Berkus wrote: Folks, Subsequent to my presentation of the new annotated.conf at pgCon last week,... Available online yet? At?... Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org

Re: [PERFORM] What constitutes a complex query

2008-05-06 Thread Steve Atkins
. As I get a better feel for the planner, some queries that used to be complex become simple. :) Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

Re: [PERFORM] Where do a novice do to make it run faster?

2008-04-28 Thread Steve Crawford
but frequent query. Or add a useful index on the server. Cheers, Steve -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-performance

[PERFORM] Planning hot/live backups?

2008-03-24 Thread Steve Poe
Bay area. Outside of sharing your experiences/input with me, I would not mind if you/your company do this type of consulting offline. Thank you. Steve - Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make changes to your subscription: http://www.postgresql.org

Re: [PERFORM] Planning hot/live backups?

2008-03-24 Thread Steve Poe
version? Steve On Mon, Mar 24, 2008 at 3:23 PM, Tom Lane [EMAIL PROTECTED] wrote: Matthew T. O'Connor [EMAIL PROTECTED] writes: Steve Poe wrote: The owners of the animal hospital where I work at want to consider live/hot backups through out the day so we're less likely to lose a whole

[PERFORM] How to choose a disc array for Postgresql?

2008-03-02 Thread Steve Poe
vendors that have been supportive of Postgresql? Thanks for your help/feedback. Steve

Re: [PERFORM] How to choose a disc array for Postgresql?

2008-03-02 Thread Steve Poe
. It seems the RAID card manufacturers have more to do with failures than the drives themselves. Have you found a RAID card you did not have to drop to U160? Thanks again for sharing your feedback. Steve On Sun, Mar 2, 2008 at 7:11 PM, Vivek Khera [EMAIL PROTECTED] wrote: On Mar 2, 2008, at 2

Re: [PERFORM] Best way to index IP data?

2008-01-11 Thread Steve Atkins
. But that's a longer term thought. Cheers, Steve ---(end of broadcast)--- TIP 7: You can help support the PostgreSQL project by donating at http://www.postgresql.org/about/donate

Re: [PERFORM] Best way to index IP data?

2008-01-11 Thread Steve Atkins
missing something? There is ambiguity when you feed non dotted-quads into the existing cidr I/O functions[1], but that's both a dead horse, and not something likely to actually affect users negatively. Cheers, Steve [1] Because postgresql copied obsolete pre-CIDR code from libbind

Re: [PERFORM] Best way to index IP data?

2008-01-11 Thread Steve Atkins
On Jan 11, 2008, at 3:00 PM, Andrew Sullivan wrote: On Fri, Jan 11, 2008 at 02:38:27PM -0800, Steve Atkins wrote: I don't think there's ambiguity about what an dotted-quad without a netmask means, and hasn't been for a long time. Am I missing something? Well, maybe. The problem is actually

Re: [PERFORM] Best way to index IP data?

2008-01-11 Thread Steve Atkins
On Jan 11, 2008, at 3:52 PM, Joshua D. Drake wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Fri, 11 Jan 2008 15:37:37 -0800 Steve Atkins [EMAIL PROTECTED] wrote: Well, maybe. The problem is actually that, without a netmask under CIDR, the address alone isn't really enough. You

  1   2   3   >