[PERFORM] Affect of Reindexing on Vacuum Times

2007-07-25 Thread Y Sidhu
I am wondering if reindexing heavily used tables can have an impact on vacuum times. If it does, will the impact be noticeable the next time I vacuum? Please note that I am doing vacuum, not vacuum full. I am on a FreeBSD 6.1 Release, Postgresql is 8.09 Currently I seeing a phenomenon where vacu

Re: [PERFORM] improvement suggestions for performance design

2007-07-05 Thread Y Sidhu
On 7/5/07, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: > On 7/5/07, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: > > I don't know much about this EAV stuff. Except to say that my company is > in > a situation with a lot of adds and bulk deletes and I wish the tables were > designed with partiti

Re: [PERFORM] improvement suggestions for performance design

2007-07-05 Thread Y Sidhu
On 7/5/07, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: > I would strongly suggest that you use a proper relational schema, > instead of storing everything in two tables. I don't know your > application, but a schema like that is called an Entity-Attribute-Value > (though your entity seems to be

Re: [PERFORM] PostgreSQL Configuration Tool for Dummies

2007-06-19 Thread Y Sidhu
On 6/19/07, Campbell, Lance <[EMAIL PROTECTED]> wrote: Below is a link to the HTML JavaScript configuration page I am creating: http://www.webservices.uiuc.edu/postgresql/ I had many suggestions. Based on the feedback I received, I put together the initial list of questions. This list o

Re: [PERFORM] PostgreSQL Configuration Tool for Dummies

2007-06-19 Thread Y Sidhu
On 6/19/07, Francisco Reyes <[EMAIL PROTECTED]> wrote: Campbell, Lance writes: > Francisco and Richard, > Why ask about disk or raid? How would that impact any settings in > postgresql.conf? If the user has 2 disks and says that he will do a lot of updates he could put pg_xlog in the second d

Re: [PERFORM] [DOCS] Volunteer to build a configuration tool

2007-06-18 Thread Y Sidhu
On 6/18/07, Campbell, Lance <[EMAIL PROTECTED]> wrote: Mario, The JavaScript configuration tool I proposed would not be in the install of PostgreSQL. It would be an HTML page. It would be part of the HTML documentation or it could be a separate HTML page that would be linked from the HTML docu

Re: [PERFORM] Parsing VACUUM VERBOSE

2007-06-18 Thread Y Sidhu
On 6/18/07, Sabin Coanda <[EMAIL PROTECTED]> wrote: ""Guillaume Smet"" <[EMAIL PROTECTED]> wrote in message news:[EMAIL PROTECTED] > Sabin, > > On 6/14/07, Sabin Coanda <[EMAIL PROTECTED]> wrote: >> I'd like to understand completely the report generated by VACUUM VERBOSE. >> Please tell me wher

Re: [PERFORM] Parsing VACUUM VERBOSE

2007-06-14 Thread Y Sidhu
On 6/14/07, Guillaume Smet <[EMAIL PROTECTED]> wrote: On 6/14/07, Y Sidhu <[EMAIL PROTECTED]> wrote: > Can anyone share what value they have set log_min_duration_statement to? It's OT but we use different values for different databases and needs. On a very loaded da

Re: [PERFORM] Parsing VACUUM VERBOSE

2007-06-14 Thread Y Sidhu
On 6/14/07, Dimitri Fontaine <[EMAIL PROTECTED]> wrote: Le jeudi 14 juin 2007, Sabin Coanda a écrit: > I'd like to understand completely the report generated by VACUUM VERBOSE. > Please tell me where is it documented ? Try the pgfouine reporting tool : http://pgfouine.projects.postgresql.org/

[PERFORM] How Are The Variables Related?

2007-06-07 Thread Y Sidhu
On a FreeBSD system, is page size for shared_buffers calculation 8K? And is page size for shmall calculation 4K? The documentation hints at these values. Anyone know? -- Yudhvir Singh Sidhu 408 375 3134 cell

Re: [PERFORM] Thousands of tables versus on table?

2007-06-04 Thread Y Sidhu
On 6/4/07, Thomas Andrews <[EMAIL PROTECTED]> wrote: On 6/4/07 3:43 PM, "Gregory Stark" <[EMAIL PROTECTED]> wrote: > > "Thomas Andrews" <[EMAIL PROTECTED]> writes: > >> I guess my real question is, does it ever make sense to create thousands of >> tables like this? > > Sometimes. But usually

Re: [PERFORM] Database connection for Tbl_B established

2007-05-30 Thread Y Sidhu
You are referring to pgpool? BTW, thanks for this insight. Yudhvir On 5/30/07, Tom Lane <[EMAIL PROTECTED]> wrote: "Y Sidhu" <[EMAIL PROTECTED]> writes: > The question is: Is this method of repeatedly establishing and > re-establishing database connec

[PERFORM] Database connection for Tbl_B established

2007-05-30 Thread Y Sidhu
I have a question regarding "connection for xxyy established" The situation below shows records being added to 3 tables which are heavily populated. We never "update" any table, only read from them. Or we delete a full-day worth of records from them. The question is: Is this method of repeatedly

[PERFORM] Simulate database fragmentation

2007-05-23 Thread Y Sidhu
Is there any easy way to take a database and add/delete records to create fragmentation of the records and indexes. I am trying to recreate high vacuum times. -- Yudhvir Singh Sidhu 408 375 3134 cell

Re: [PERFORM] max_fsm_pages, shared_buffers and checkpoint_segments

2007-05-23 Thread Y Sidhu
== On 5/23/07, Ben <[EMAIL PROTECTED]> wrote: Do you have an overall plan (besides "make it go faster!") or are you just trying out the knobs as you find them? This may be helpful: http://www.powerpostgresql.com/Downloads/annotated_conf_80.html On May 23, 2007, at 9:22 AM, Y S

[PERFORM] max_fsm_pages, shared_buffers and checkpoint_segments

2007-05-23 Thread Y Sidhu
I am a newbie, as you all know, but I am still embarassed asking this question. I started my tuning career by changing shared_buffers. Soon I discovered that I was hitting up against the available RAM on the system. So, I brought the number down. Then I discovered max_fsm_pages. I could take that

Re: [PERFORM] pg_stats how-to?

2007-05-21 Thread Y Sidhu
Thanks again! I'll make the change and get those numbers. Yudhvir On 5/21/07, Jim C. Nasby <[EMAIL PROTECTED]> wrote: On Fri, May 18, 2007 at 04:26:05PM -0700, Y Sidhu wrote: > >To answer your original question, a way to take a look at how bloated > >your tables are woul

Re: [PERFORM] pg_stats how-to?

2007-05-18 Thread Y Sidhu
On 5/15/07, Jim C. Nasby <[EMAIL PROTECTED]> wrote: On Mon, May 14, 2007 at 08:20:49PM -0400, Tom Lane wrote: > "Y Sidhu" <[EMAIL PROTECTED]> writes: > > it may be table fragmentation. What kind of tables? We have 2 of them which > > experience lots of ad

Re: [PERFORM] reading large BYTEA type is slower than expected

2007-05-18 Thread Y Sidhu
Mark, I am no expert but this looks like a file system I/O thing. I set hw.ata.wc=1 for a SATA drive and =0 for a SCSI drive in /boot/loader.conf on my FreeBSD systems. That seems to provide some needed tweaking. Yudhvir == On 5/18/07, Mark Harris <[EMAIL PROTECTED]> wrote: We have re

Re: [PERFORM] Disk Fills Up and fsck "Compresses" it

2007-05-16 Thread Y Sidhu
ace freed by a delete will actually show up as available. On Tue, May 15, 2007 at 01:18:42PM -0700, Y Sidhu wrote: > Anyone seen PG filling up a 66 GB partition from say 40-ish percentage to > 60-ish percentage in a manner of minutes. When I run a 'fsck' the disk usage > comes dow

[PERFORM] How to Run a pg_stats Query

2007-05-15 Thread Y Sidhu
I turned on all the stats in the conf file (below) and restarted the server. Question is, what's the name of the database and how do I run a simple select query? stats_start_collector = true stats_command_string = true stats_block_level = true stats_row_level = true stats_reset_on_server_start =

[PERFORM] Disk Fills Up and fsck "Compresses" it

2007-05-15 Thread Y Sidhu
Anyone seen PG filling up a 66 GB partition from say 40-ish percentage to 60-ish percentage in a manner of minutes. When I run a 'fsck' the disk usage comes down to 40-ish percentage. That's about 10+ GB's variance. This is a FreeBSD 6.2 RC2, 4GB memory, Xeon 3.2 GHz '4' of the '8' CPUs in use -

Re: [PERFORM] pg_stats how-to?

2007-05-14 Thread Y Sidhu
<[EMAIL PROTECTED]> wrote: In response to "Y Sidhu" <[EMAIL PROTECTED]>: > My immediate problem is to decrease vacuum times. Don't take this as being critical, I'm just trying to point out a slight difference between what you're doing and what you

Re: [PERFORM] pg_stats how-to?

2007-05-14 Thread Y Sidhu
My immediate problem is to decrease vacuum times. Yudhvir === On 5/14/07, Jim C. Nasby <[EMAIL PROTECTED]> wrote: On Mon, May 14, 2007 at 12:02:03PM -0700, Y Sidhu wrote: > I am sorry about this Jim, please understand that I am a newbie and am > trying to solve long vacuum t

Re: [PERFORM] pg_stats how-to?

2007-05-14 Thread Y Sidhu
s for following up on this with me. Yudhvir === On 5/14/07, Jim C. Nasby <[EMAIL PROTECTED]> wrote: On Mon, May 14, 2007 at 11:09:21AM -0700, Y Sidhu wrote: > The stats_block_level and stats_row_level are NOT enabled. The question is > how to use pg_stats. Do I access/see them via th

Re: [PERFORM] pg_stats how-to?

2007-05-14 Thread Y Sidhu
wrote: Please include the list in your replies... Ok, so you've got stats collection turned on. What's the question then? And are stats_block_level and stats_row_level also enabled? On Mon, May 14, 2007 at 09:28:46AM -0700, Y Sidhu wrote: > yes > > Yudhvir > === > >

Re: [PERFORM] pg_stats how-to?

2007-05-14 Thread Y Sidhu
I am trying to use them. I have set these values in my conf file: stats_start_collector TRUE stats_reset_on_server_start FALSE stats_command_string TRUE now what? Yudhvir == On 5/13/07, Shoaib Mir <[EMAIL PROTECTED]> wrote: Can you be a little more specific? What exactly are you tryi

[PERFORM] Vacuum Times - Verbose and maintenance_work_mem

2007-05-09 Thread Y Sidhu
How do you specify a log file for vacuum verbose to send info to? I have verbose turned on but cannot see any log messages. I have upped maintenance_work_mem setting from 32768 to 98304. This is on a 4 GB, 3.2 GHz Xeon, dual core, dual cpu with HTT turned on. I hope that helps with vacuum times.

[PERFORM] What's The Difference Between VACUUM and VACUUM ANALYZE?

2007-05-08 Thread Y Sidhu
I am trying to follow a message thread. One guy says we should be running vacuum analyze daily and the other says we should be running vacuum multiple times a day. I have tried looking for what a vacuum analyze is to help me understand but no luck. -- Yudhvir Singh Sidhu 408 375 3134 cell

[PERFORM] DISTINCT Question

2007-05-08 Thread Y Sidhu
Does using DISTINCT in a query force PG to abandon any index search it might have embarked upon? -- Yudhvir Singh Sidhu 408 375 3134 cell