Re: [PERFORM] Storing Digital Video

2006-02-06 Thread Albert Cervera Areny
A Dimecres 01 Febrer 2006 01:32, Rodrigo Madera va escriure:
 I am concerned with performance issues involving the storage of DV on
 a database.

 I though of some options, which would be the most advised for speed?

 1) Pack N frames inside a container and store the container to the db.
 2) Store each frame in a separate record in the table frames.
 3) (type something here)

 Thanks for the help,


What if you store meta data in the database and use some PL/Python/Java/Perl 
functions to store and retrieve video files from the server. The function 
would store files to the files system, not a table. This avoids the need for 
a file server for your application while making your relational queries fast.

Any experiences/thoughts on this solution?


 Rodrigo

 ---(end of broadcast)---
 TIP 9: In versions below 8.0, the planner will ignore your desire to
choose an index scan if your joining column's datatypes do not
match

 

---(end of broadcast)---
TIP 2: Don't 'kill -9' the postmaster


Re: [PERFORM] Default autovacuum settings too conservative

2006-02-06 Thread Vivek Khera


On Feb 1, 2006, at 4:37 PM, Matthew T. O'Connor wrote:

As far I as I know, we are still looking for real world feedback.   
8.1 is the first release to have the integrated autovacuum.  The  
thresholds in 8.1 are a good bit less conservative than the  
thresholds in the contrib version.  The contrib thresholds were  
universally considered WAY to conservative, but that was somewhat  
necessary since you couldn't set them on a per table basis as you  
can in 8.1.  If we continue to hear from people that the current  
8.1 default thresholds are still to conservative we can look into  
lowering them.


I spent the weekend researching and pondering this topic as well.

For me the per-table tuning is vital, since I have some tables that  
are very small and implement a queue (ie, update very often several  
million times per day and have at most 10 or so rows), some that are  
fairly stable with O(10k) rows which update occasionally, and a  
couple of tables that are  quite large: 20 million rows which updates  
a few million times per day and inserts a few thousand, and another  
table with ~275 million rows in which we insert and update roughly 3  
million per day.


The 40% overhead would kill these large tables both in terms of  
performance and disk usage. I'm pondering a global 10% and having the  
big tables at or below 1% based on the rate of change.


Is there a way to make the autovacuum process log more verbosely  
while leaving the rest of the logging minimal?  This would help tune it.



---(end of broadcast)---
TIP 9: In versions below 8.0, the planner will ignore your desire to
  choose an index scan if your joining column's datatypes do not
  match


Re: [PERFORM] execution plan : Oracle vs PostgreSQL

2006-02-06 Thread Andrew Lazarus
Indeed there is: you can use an ARRAY constructor with SELECT. Here's 
some PGPLSQL code I have (simplified and with the variable names shrouded).


 SELECT INTO m
   ARRAY(SELECT d FROM hp
   WHERE hp.ss=$1
ORDER BY 1);


FERREIRA, William (VALTECH) wrote:


maybe there is an other way to query children directly into an array and having 
query plan caching ?


begin:vcard
fn:Andrew Lazarus
n:Lazarus;Andrew
org:Pillette Investment Management;Research and Development
adr;dom:;;3028 Fillmore;San Francisco;CA;94123
email;internet:[EMAIL PROTECTED]
title:Director
tel;work:800-366-0688
tel;fax:415-440-4093
url:http://www.pillette.com
version:2.1
end:vcard


---(end of broadcast)---
TIP 2: Don't 'kill -9' the postmaster


Re: [PERFORM] Default autovacuum settings too conservative

2006-02-06 Thread Chris Browne
matthew@zeut.net (Matthew T. O'Connor) writes:
 I think the default settings should be designed to minimize the
 impact autovacuum has on the system while preventing the system from
 ever getting wildly bloated (also protect xid wraparound, but that
 doesn't have anything to do with the thresholds).

That would suggest setting the base threshold
autovacuum_vacuum_threshold relatively low, and the scale factor
autovacuum_vacuum_scale_factor fairly high.
-- 
let name=cbbrowne and tld=ntlug.org in name ^ @ ^ tld;;
http://cbbrowne.com/info/nonrdbms.html
I think  it may be  possible to simplify  and condense the  content of
this thread somewhat:
 GX is an ex-API.  It is no longer supported - The Rest of Us
 No it isn't.  It's just pining for the fjords! - Lawson
-- Michael Paquette

---(end of broadcast)---
TIP 3: Have you checked our extensive FAQ?

   http://www.postgresql.org/docs/faq