Re: [HACKERS] Views, views, views: Summary of Arguments

2005-05-12 Thread Josh Berkus
), and PostgreSQL beginners. Power users could presumably find and install them from pgFoundry. -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 3: if posting/reading through Usenet, please send

Re: [HACKERS] Views, views, views: Summary of Arguments

2005-05-13 Thread Josh Berkus
was explicitly granted to them. But there would be lots of testing and thinking to be done before releasing it into the wild :-) plugDoesn't it seem like a really complete set of system views (based on information_schema or otherwise) would potentially allow securing the pg_catalog?/plug -- Josh

Re: [HACKERS] Views, views, views: Summary of Arguments

2005-05-13 Thread Josh Berkus
the sysviews project, but the more oversold, hyped and promoted with bogus arguments it gets the more skeptical I become. Geez, who poured Drano on your breakfast cereal? Lighten up. ;-) -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast

Re: [HACKERS] Catalog Security WAS: Views, views, views: Summary of Arguments

2005-05-13 Thread Josh Berkus
to hide all catalog information from the users except the database owner or superuser. 2) The Enterprise server setting, where you want to allow catalog access (for example, for pgAdmin) restricted to the current user permissions. -- --Josh Josh Berkus Aglio Database Solutions San Francisco

Re: [HACKERS] Fix PID file location?

2005-05-13 Thread Josh Berkus
in the conf directory is not removed on shutdown. -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 9: the planner will ignore your desire to choose an index scan if your joining column's datatypes do

Re: [HACKERS] Views, views, views: Summary of Arguments

2005-05-13 Thread Josh Berkus
missed it I apologise. No, you're right, we need that.  I'll work on it over the weekend. -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 1: subscribe and unsubscribe commands go to [EMAIL PROTECTED]

Re: [HACKERS] Do you have any objections on contributing your improvements of the PostgreSQL core back into the product?

2005-05-13 Thread Josh Berkus
know that's not the way it works. All patches ... including mine, Bruce's, Jan's, and even sometimes Tom's, have to be evaluated for usefulness, clean code, bugs, etc. -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast

Re: [HACKERS] Do you have any objections on contributing your improvements of the PostgreSQL core back into the product?

2005-05-13 Thread Josh Berkus
may very well want it for Bizgres as well. -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 6: Have you searched our list archives? http://archives.postgresql.org

Re: [HACKERS] postgreSQL as deductive DBMS

2005-05-16 Thread Josh Berkus
a PostgreSQL-parse-tree-to-DataLog converter: http://research.csc.ncsu.edu/selftune/Report_031005.pdf -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 2: you can get off all lists at once with the unregister command

Re: [HACKERS] pgFoundry

2005-05-16 Thread Josh Berkus
. If you can find a volunteer, it'd be worth discussing -- I can see a way we can make a roadmap without being deceptive about how we get features. -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 3

Re: Learning curves and such (was Re: [HACKERS] pgFoundry)

2005-05-16 Thread Josh Berkus
Lamar, To put it much more bluntly: PostgreSQL development (both the process and the codebase) has one of the steepest learning curves around, You haven't looked at the OpenOffice.org code. wince -- Josh Berkus Aglio Database Solutions San Francisco ---(end

Re: Learning curves and such (was Re: [HACKERS] pgFoundry)

2005-05-17 Thread Josh Berkus
Russell, What should be performance tested (I assume new code, like the bitmap scan).   I've been meaning to put a task list for performance testing up on the TestPerf project. Yet another personal TODO ... -- Josh Berkus Aglio Database Solutions San Francisco

Re: Learning curves and such (was Re: [HACKERS] pgFoundry)

2005-05-17 Thread Josh Berkus
will not use a web interface. -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 7: don't forget to increase your free space map settings

Re: Learning curves and such (was Re: [HACKERS] pgFoundry)

2005-05-17 Thread Josh Berkus
. -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 2: you can get off all lists at once with the unregister command (send unregister YourEmailAddressHere to [EMAIL PROTECTED])

Re: Learning curves and such (was Re: [HACKERS] pgFoundry)

2005-05-18 Thread Josh Berkus
). The issue in all cases is upkeep. -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 4: Don't 'kill -9' the postmaster

Re: [HACKERS] Contributing

2005-05-19 Thread Josh Berkus
is on vacation right now) does localization of PostgreSQL documentation and messages. For my stuff, I'd be happy to add you to the translators@ mailing list. For Peter, I suggest that you subscribe to [EMAIL PROTECTED] Or contact our German community through [EMAIL PROTECTED] -- Josh Berkus Aglio

Re: [HACKERS] patches for items from TODO list

2005-05-20 Thread Josh Berkus
it on pgFoundry, though. -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 2: you can get off all lists at once with the unregister command (send unregister YourEmailAddressHere to [EMAIL PROTECTED])

Re: [HACKERS] Two-phase commit issues

2005-05-20 Thread Josh Berkus
replication tools, like C-JDBC. And is useful for some other use cases, like slow-WAN-based financial transactions. We know you don't like it, Tom. ;-) -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 2: you

Re: [HACKERS] Obtaining Firing Statement clause in (pl/perlu) Trigger Function

2005-05-23 Thread Josh Berkus
substructures like where clauses (let alone join clauses). DF and I have talked about it, but it would take some major back-end hacking to enable it. :-( -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 5: Have you checked

Re: [HACKERS] IN/OUT parameters

2005-05-24 Thread Josh Berkus
SQL2003 cover IN/OUT parameters? I don't see anything in SQL99. -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 6: Have you searched our list archives? http://archives.postgresql.org

Re: [HACKERS] postmaster.pid disappeared

2005-05-24 Thread Josh Berkus
in postgresql.conf? -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 3: if posting/reading through Usenet, please send an appropriate subscribe-nomail command to [EMAIL PROTECTED] so that your

Re: [HACKERS] IN/OUT parameters

2005-05-24 Thread Josh Berkus
, IMHO, aren't terribly important unless SQL2003 demands them; MSSQL didn't even bother to implement them. Anyone know what SQL3 says? -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 1: subscribe

Re: [HACKERS] postmaster.pid disappeared

2005-05-24 Thread Josh Berkus
, but the other backends are not ... they're hanging around as zombies. Not sure why, but I'm chatting with him on IRC. -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 2: you can get off all lists at once

Re: [HACKERS] postmaster.pid disappeared

2005-05-24 Thread Josh Berkus
, I think I spoke too soon. What it looks like is that pg_ctl is reporting success while actually failing to shut down the postmaster. Solaris makes it a little hard to read; parent-process relationships aren't as clear as they are in Linux. -- --Josh Josh Berkus Aglio Database Solutions San

Re: [HACKERS] IN/OUT parameters

2005-05-24 Thread Josh Berkus
), in the backend, not just JDBC. As you can imagine, though, SQL03 does nothing to clarify calling rules for IN/OUT params. -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 4: Don't 'kill -9' the postmaster

[HACKERS] OSCON field trip, Friday afternoon

2005-05-27 Thread Josh Berkus
to me and to Brian at SRA ( [EMAIL PROTECTED] ) as soon as you know that you're available. See you at OSCON! -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 7: don't forget to increase your free space map

Re: [HACKERS] Interval-day proposal

2005-05-30 Thread Josh Berkus
of the SQL spec which has only the two partitions ( year/month ; week/day/hour/minute/second ). Have they changed this in SQL 2003?If not, do we want to do it anyway, perhaps using a 2nd interval type? -- Josh Berkus Aglio Database Solutions San Francisco ---(end

Re: [HACKERS] Oracle Style packages on postgres

2005-05-31 Thread Josh Berkus
... was there a reason we decided not to just make this explicitly tied to SQL2003 TYPES? -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 4: Don't 'kill -9' the postmaster

Re: [HACKERS] ddl triggers

2005-05-31 Thread Josh Berkus
Tom, I was wondering whether it will be useful to extend postgreSQL support to ddl triggers. This has been proposed and rejected before ... see the archives. Eh? I thought it was a TODO. --Josh -- Josh Berkus Aglio Database Solutions San Francisco ---(end

Re: [HACKERS] Suggestion: additional system views

2005-06-06 Thread Josh Berkus
view for error codes and not one for, say, operators? -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 7: don't forget to increase your free space map settings

[HACKERS] The Contrib Roundup (long)

2005-06-07 Thread Josh Berkus
required? If utilities/. xml and xml2: both by John Gray ([EMAIL PROTECTED]). John, why do we have two of these? Otherwise, data_types/. -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 5: Have you checked our

Re: [HACKERS] The Contrib Roundup (long)

2005-06-07 Thread Josh Berkus
, but I'll happily admit to not really understanding it. -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 7: don't forget to increase your free space map settings

Re: [HACKERS] The Contrib Roundup (long)

2005-06-08 Thread Josh Berkus
Peter, Packagers should simply build all contrib items. No extra options are needed. No, they shoudn't. 3 of the packages currently in /contrib are GPL. Building them makes all of PostgreSQL GPL. -- Josh Berkus Aglio Database Solutions San Francisco ---(end

Re: [HACKERS] The Contrib Roundup (long)

2005-06-08 Thread Josh Berkus
is looking better and better ... Packagers should simply build all contrib items. No extra options are needed. Hmmm, when an RPM builds a contrib item, where does the .sql file go? How does an RPM user actually add the functions/datatypes/etc to their database? -- Josh Berkus Aglio Database

Re: [HACKERS] The Contrib Roundup (long)

2005-06-08 Thread Josh Berkus
Tom, The fix for that is to remove or relicense those packages, not to complicate the build process. OK. Then we'll make BSD licensing an absolute requirement for /contrib? Also, we'll add --build-all-contrib to ./configure? -- Josh Berkus Aglio Database Solutions San Francisco

Re: [HACKERS] The Contrib Roundup (long)

2005-06-08 Thread Josh Berkus
them seems the easiest answer. -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 9: the planner will ignore your desire to choose an index scan if your joining column's datatypes do not match

Re: [HACKERS] Account in postgresql database

2005-06-08 Thread Josh Berkus
on it. -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 4: Don't 'kill -9' the postmaster

Re: [HACKERS] The Contrib Roundup (long)

2005-06-08 Thread Josh Berkus
on this. Frankly, until Marc posted I wasn't aware that it was *possible* to have differently-licensed stuff except in /contrib. -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 1: subscribe and unsubscribe commands go

Re: [HACKERS] The Contrib Roundup (long)

2005-06-09 Thread Josh Berkus
Marc, What did I post? *raised eyebrow* Didn't you grep the source for GPL? Or was it someone else? -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 6: Have you searched our list archives

Re: [HACKERS] User Quota Implementation

2005-06-10 Thread Josh Berkus
user quotas, and per-database users, it would pretty much wind up all of the issues which ISPs have with Postgres. -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 5: Have you checked our extensive FAQ

Re: [HACKERS] User Quota Implementation

2005-06-10 Thread Josh Berkus
to th elogs files letting the admin extend the volum(s) by time. Hmmm ... Tablespace quotas would be *even more* useful than database quotas. If it's just as easy for you? -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast

Re: [HACKERS] User Quota Implementation

2005-06-13 Thread Josh Berkus
serious implementation issues with user-based quotas. But I'm not the target audience so maybe I just don't understand. -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 6: Have you searched our list archives

Re: [HACKERS] User Quota Implementation

2005-06-13 Thread Josh Berkus
Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 8: explain analyze is your friend

Re: [HACKERS] User Quota Implementation

2005-06-13 Thread Josh Berkus
Jonah, Was someone going to implement this?  If not, I can probably get it done in a couple days. Don't let me stop you. I'd like to avoid a GUC for percent_full_warning if we can. Can anyone see a way around this? Should we just assume 90% full? -- --Josh Josh Berkus Aglio Database

Re: [HACKERS] User Quota Implementation

2005-06-14 Thread Josh Berkus
= % with the default being 0 (don't log). -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 6: Have you searched our list archives? http://archives.postgresql.org

Re: [HACKERS] interval-day first cut

2005-06-14 Thread Josh Berkus
-spec form. This could be exposed to let people reduce their intervals. However, I'm concerned this is surprising behavior. Yes, well, we'll have to document it prominently in the release notes and elsewhere. -- Josh Berkus Aglio Database Solutions San Francisco

Re: [HACKERS] User Quota Implementation

2005-06-14 Thread Josh Berkus
: ALTER TABLESPACE tbsp1 SET MAXSIZE 128M MAXWARN 80 That would be ideal, since the % you might want could vary per tablespace. This would be emitted as a WARNING to the log every time you run a check (e.g. after each commit). -- Josh Berkus Aglio Database Solutions San Francisco

Re: [HACKERS] LGPL

2005-06-15 Thread Josh Berkus
the horse's mouth. -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 9: the planner will ignore your desire to choose an index scan if your joining column's datatypes do not match

Re: [HACKERS] Autovacuum in the backend

2005-06-15 Thread Josh Berkus
the FSM was, overall. something like: pg_stats_fsm_usage fsm_relations fsm_relations_used fsm_pages fsm_pages_used 1000312 20 11579 This would allow for other schemes of vacuum automation. -- Josh Berkus Aglio Database

Re: [HACKERS] max_fsm_pages 800k ... ?

2005-06-15 Thread Josh Berkus
VACUUM in a few days. Or like you deleted and re-loaded a large table multiple times. BTW, this is really more of a pgsql-performance question ... -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 3

Re: [HACKERS] Autovacuum in the backend

2005-06-15 Thread Josh Berkus
? -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 2: you can get off all lists at once with the unregister command (send unregister YourEmailAddressHere to [EMAIL PROTECTED])

Re: [HACKERS] Autovacuum in the backend

2005-06-15 Thread Josh Berkus
, period, for the cluster, if you can manage that. Let's stick to simple for now. Most users have their database on a single disk or array, so multiple concurrent vacuums will compete for I/O regardless of different databases. -- Josh Berkus Aglio Database Solutions San Francisco

Re: [HACKERS] Autovacuum in the backend

2005-06-15 Thread Josh Berkus
, and had this conversation about 1,100 times: NB: After a week, my database got really slow. Me: How often are you running VACUUM ANALYZE? NB: Running what? -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 9

Re: [HACKERS] PROPOSAL - User's exception in PL/pgSQL

2005-06-16 Thread Josh Berkus
messages. -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 6: Have you searched our list archives? http://archives.postgresql.org

Re: [HACKERS] Autovacuum in the backend

2005-06-16 Thread Josh Berkus
. There's been 2 years to question its position there. Now people are bringing up objections when there's no time for discussion left? This stinks. -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 6: Have you searched

Re: [HACKERS] Autovacuum in the backend

2005-06-16 Thread Josh Berkus
, not the problems with the current patch. -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 6: Have you searched our list archives? http://archives.postgresql.org

Re: [HACKERS] Autovacuum in the backend

2005-06-16 Thread Josh Berkus
* to be an optional add-in, even if it was stored in pg_catalog. I can see a lot of uses for a back-end job scheduler myself, but it would need to go through the gauntlet of design criticism first wry grin. -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast

Re: [HACKERS] Proposal - Continue stmt for PL/pgSQL

2005-06-16 Thread Josh Berkus
a little better what CONTINUE does that's different from EXIT? -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 6: Have you searched our list archives? http://archives.postgresql.org

[HACKERS] Spikesource now doing automated testing, sponsorship of PostgreSQL

2005-06-16 Thread Josh Berkus
a lot). This should supplement pgBuildfarm and limit future accidental plug-in breakage. -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 4: Don't 'kill -9' the postmaster

[HACKERS] DTrace Probes?

2005-06-16 Thread Josh Berkus
Hey, Folks, I need to find someone who's really interesed in working with DTrace. Sun has offered to help put DTrace probes into PostgreSQL for advanced profiling, but need to know where to probe. Anyone? I'm afraid that I won't get around to this quickly enough. -- --Josh Josh Berkus

Re: [HACKERS] Autovacuum in the backend

2005-06-17 Thread Josh Berkus
* to integrate it.This isn't a debating society. Folks, I'm sorry to be so grumpy about this, but so far 80% of the posts on this thread have been re-arguing a discussion we had in 2004. Which isn't helping Alvaro get anything done. -- Josh Berkus Aglio Database Solutions San Francisco

[HACKERS] Checkpointing problem with new buffer mgr.

2005-06-18 Thread Josh Berkus
activity to recover from a checkpoint. So this is obviously a major performance problem. It could be fixed by turning off checkpointing completely, but I don't think that's really feasable. Any clue on why clock-sweep should be so slammed by checkpoints? -- Josh Berkus Aglio Database Solutions

Re: [HACKERS] Checkpointing problem with new buffer mgr.

2005-06-19 Thread Josh Berkus
Tom, (I assume this *is* CVS tip, or near to it? The recent CRC32 and omit-the-hole changes should affect the costs of this quite a bit.) It was a recent build. When was CRC32 checked in? -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast

Re: [HACKERS] buildfarm notifications

2005-06-19 Thread Josh Berkus
was thinking of writing a widget which would e-mail notices of failures. Maybe I should send them to your list so that it's all one digest? -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 8: explain analyze

Re: [HACKERS] [PATCHES] default database creation with initdb

2005-06-19 Thread Josh Berkus
ignore it. -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 7: don't forget to increase your free space map settings

Re: [HACKERS] buildfarm notifications

2005-06-19 Thread Josh Berkus
be happy to have suggestions ... BTW, these list are being set up only for announcements, so I would have to grant permission before any results started flowing. Yep, that's why I'm mentioning it. -- Josh Berkus Aglio Database Solutions San Francisco ---(end

Re: [HACKERS] SERIAL type feature request

2005-12-03 Thread Josh Berkus
Zoltan, I would like to add an entry to PostgreSQL 8.2 TODO: - Extend SERIAL to a full-featured auto-incrementer type. I believe that our SERIAL/SEQUENCE stuff is already in compliance with the SQL standard for sequences (in SQL03). Why would we change it? -- --Josh Josh Berkus Aglio

Re: [HACKERS] Please Help: PostgreSQL Query Optimizer

2005-12-11 Thread Josh Berkus
that would be directly related to using a disk/not using a disk. How are you handling shared memory and work memory? I look forward to hearing more about your test! -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast

Re: [HACKERS] Please Help: PostgreSQL Query Optimizer

2005-12-12 Thread Josh Berkus
and maintenance_mem. You didn't answer last time. -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 3: Have you checked our extensive FAQ? http://www.postgresql.org/docs/faq

Re: [HACKERS] Which qsort is used

2005-12-12 Thread Josh Berkus
Tom,  IIRC, the reason we reject Solaris' qsort is not that it is so bad in the typical case, but that it has some horrible corner-case behaviors. Sun claims to have fixed these. Hopefully they'll do some testing which will prove it. -- Josh Berkus Aglio Database Solutions San Francisco

Re: [HACKERS] [Bizgres-general] WAL bypass for INSERT, UPDATE and

2006-01-03 Thread Josh Berkus
discussion volume for no purpose. Zowie!! Surely you didn't mean that the way it sounded? -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 4: Have you searched our list archives? http

[HACKERS] Inconsistent syntax in GRANT

2006-01-03 Thread Josh Berkus
. This is inconsistent. Do people agree with me that the parser should accept SEQUENCE there, since the optional object name works for all other objects? Is there some technical reason this is difficult to do? -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end

Re: [HACKERS] Improving N-Distinct estimation by ANALYZE

2006-01-04 Thread Josh Berkus
that we can get within +/- 5x for 80-90% of all cases, instead of 40-50% of cases like now. We can't be perfectly accurate, but we can be *more* accurate. -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 6

Re: [HACKERS] Improving N-Distinct estimation by ANALYZE

2006-01-04 Thread Josh Berkus
gets larger. Chaudhuri's estimator is based on a least risk approach, rather than a greatest accuracy approach, which does sound appealing should we not be able to apply an improved estimator. As I point out above, though, Chaudhuri's understanding of least risk is flawed. -- --Josh Josh

Re: [HACKERS] Improving N-Distinct estimation by ANALYZE

2006-01-04 Thread Josh Berkus
-sample-size approach now, and it's not working very well for large tables. --Josh Berkus ---(end of broadcast)--- TIP 4: Have you searched our list archives? http://archives.postgresql.org

Re: [HACKERS] Improving N-Distinct estimation by ANALYZE

2006-01-04 Thread Josh Berkus
Greg, Only if your sample is random and independent. The existing mechanism tries fairly hard to ensure that every record has an equal chance of being selected. If you read the entire block and not appropriate samples then you'll introduce systematic sampling errors. For example, if you read an

Re: [HACKERS] Improving N-Distinct estimation by ANALYZE

2006-01-04 Thread Josh Berkus
Folks, Nope, it's definitely proportional. As a simple example, a sample of 500 rows in a table of 1000 rows should yeild stats estimates with 90%+ accuracy. But a sample of 500 rows in a 600,000,000 row table is so small as to be nearly useless; it's quite possible to get all the same

Re: [HACKERS] Improving N-Distinct estimation by ANALYZE

2006-01-05 Thread Josh Berkus
Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 6: explain analyze is your friend

Re: [HACKERS] Improving N-Distinct estimation by ANALYZE

2006-01-06 Thread Josh Berkus
seeking is the bane of many access methods. Anyway, since the proof is in the pudding, Simon and I will be working on some demo code for different sampling methods so that we can debate results rather than theory. -- --Josh Josh Berkus Aglio Database Solutions San Francisco

Re: [HACKERS] Question about Postgresql time fields(possible bug)

2006-01-10 Thread Josh Berkus
languages (including PHP, I think) use this number to express midnight. I personally also find it a useful way to distinguish between blank time (00:00) an specifically intentionally midnight (24:00). -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end

Re: [HACKERS] Contrib Schemas

2006-01-12 Thread Josh Berkus
the same issue. -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 4: Have you searched our list archives? http://archives.postgresql.org

Re: [HACKERS] Contrib Schemas

2006-01-13 Thread Josh Berkus
. -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 3: Have you checked our extensive FAQ? http://www.postgresql.org/docs/faq

Re: [HACKERS] Improving N-Distinct estimation by ANALYZE

2006-01-13 Thread Josh Berkus
ANALYZE check for UNIQUE constraints? Most unique values are going to have a constraint, in which case we don't need to sample them at all for N-distinct. -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP

Re: [HACKERS] Surrogate keys (Was: enums)

2006-01-18 Thread Josh Berkus
key is a data management disaster. Without a key, it's not data, it's garbage. -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 6: explain analyze is your friend

Re: FW: [HACKERS] Surrogate keys (Was: enums)

2006-01-18 Thread Josh Berkus
with me there. -- Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 5: don't forget to increase your free space map settings

Re: [HACKERS] Surrogate keys (Was: enums)

2006-01-19 Thread Josh Berkus
Martjin, In any of these either misspellings, changes of names, ownership or even structure over time render the obvious useless as keys. There are techniques for detecting and reducing duplication but the point is that for any of these duplicates *can* be valid data. Please point me out

Re: [HACKERS] Surrogate keys (Was: enums)

2006-01-19 Thread Josh Berkus
Jim, So ISTM it's much easier to just use surrogate keys and be done with it. Only deviate when you have a good reason to do so. The lazy man's guide to SQL database design, but Jim Nasby. ;-) --Josh ---(end of broadcast)--- TIP 3: Have you

Re: [HACKERS] No heap lookups on index

2006-01-19 Thread Josh Berkus
Jonah, David has stated that the index to heap visibility check is slowing him down, so what are the possible options: - Visibility in indexes (-hackers archives cover the pros/cons) - True organized heaps - Block level index (Tom/Simon's earlier discussion) also - Frozen relations This

Re: [HACKERS] PostgreSQL Solaris packages now in beta

2006-01-25 Thread Josh Berkus
and physical media. This means that we need feedback on these packages, as much as we can get. Once Sun starts distributing them via Solaris it will be harder to make architectural changes. Thanks! -- Josh Berkus Aglio Database Solutions San Francisco ---(end

Re: [HACKERS] stats for failed transactions (was Re: [GENERAL] VACUUM

2006-01-28 Thread Josh Berkus
Tom, I'd argue it's fine: there are tons of people using row-level stats via autovacuum, and (AFAICT) just about nobody using 'em for any other purpose. Certainly you never see anyone suggesting them as a tool for investigating problems on pgsql-performance. Actually, I use the stats for

Re: [HACKERS] New project launched : PostgreSQL GUI Installer for

2006-01-30 Thread Josh Berkus
Jeff, So why don't you just do that with Postgres? You could call it Bootable PostgreSQL. It would be a big hit. When a new version comes out, you can just mail out a new DVD. Actually, we have these. We give them out at conferences. --Josh ---(end of

Re: [HACKERS] Configuration WAS: New project launched : PostgreSQL GUI Installer for

2006-01-31 Thread Josh Berkus
to *me*, compared with static configuration. If you have ideas for runtime analysis of configuration criteria, I'd be thrilled to hear them. From my perspective, most of them depend on backend monitoring that we don't have yet (like querying how full the FSM is). -- --Josh Josh Berkus Aglio

Re: [HACKERS] Configuration WAS: New project launched : PostgreSQL

2006-01-31 Thread Josh Berkus
possible to determine this at runtime Vacuum* - may be possible to determine vacuum impact on concurrent queries Great. Wanna join the configurator project? I won't have much time to work on it before March, but anyone with ideas is welcome. -- --Josh Josh Berkus Aglio Database Solutions San

Re: [HACKERS] Multiple logical databases

2006-02-02 Thread Josh Berkus
looked at pgPool? -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 5: don't forget to increase your free space map settings

Re: [HACKERS] Multiple logical databases

2006-02-03 Thread Josh Berkus
get general agreement on easily. The feature you proposed is a way to make your idiosyncratic setup easier to manage, but doesn't apply to anyone else's problems on this list, so you're going to have a hard time drumming up enthusiasm. -- --Josh Josh Berkus Aglio Database Solutions San

Re: [HACKERS] Passing arguments to views

2006-02-03 Thread Josh Berkus
estimate variable to the function (i.e. average rows returned = 5'). This doesn't solve the whole problem of SRF estimates but it would be a significant step forwards in being able to use them in queries. -- --Josh Josh Berkus Aglio Database Solutions San Francisco

Re: [HACKERS] Function Stats WAS: Passing arguments to views

2006-02-03 Thread Josh Berkus
* for several more versions. What I'd like to do is implement the constant method for 8.2, and work on doing the S() method later on. Does that make sense? -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 4: Have

Re: [HACKERS] Multiple logical databases

2006-02-03 Thread Josh Berkus
the way to go for the core code. -- --Josh Josh Berkus Aglio Database Solutions San Francisco ---(end of broadcast)--- TIP 6: explain analyze is your friend

Re: [HACKERS] Function Stats WAS: Passing arguments to views

2006-02-03 Thread Josh Berkus
either (a) a fixed number of rows, or (b) a fixed multiple of the number of rows passed to the function. These simple cases should be easy to build. For more complex estimation, I personally don't see a problem with forcing people to hack it in C. -- --Josh Josh Berkus Aglio Database Solutions

Re: [HACKERS] Copy From Insert UNLESS

2006-02-05 Thread Josh Berkus
James, I am seeking, as many others are or have, to improve the performance on bulk loads to live systems where constraint violations may occur and filtering can be done more efficiently within the backend. Primarily, I'm concerned with UNIQUE violations. However, I think tackling the general

<    2   3   4   5   6   7   8   9   10   11   >