Re: [GENERAL] vacuum error

2007-03-06 Thread Peter Eisentraut
Ed L. wrote: > Right. I'm asking if the fix for this problem is in the new > 8.1.8 software, or in the new DB structure resulting from the > initdb, or perhaps both. There is no new DB structure in 8.1.8, which is why you can update without initdb. Consult the release notes for details. -- Pe

Re: [GENERAL] No buffer space available

2007-03-06 Thread Martijn van Oosterhout
On Tue, Mar 06, 2007 at 08:38:22PM +0200, andyk wrote: >This error is returned by libpq, as a reaction on WSANOBUFS error > from Windows Socket System. This means, applications tries to send much > data, and system can't do it the same quickly. Possible, libpq should > handle this error more ca

Re: [GENERAL] Can I getting a unique ID from a select

2007-03-06 Thread Bruno Wolff III
On Mon, Mar 05, 2007 at 17:07:25 -0800, Timasmith <[EMAIL PROTECTED]> wrote: > > > > > > > create view myview as > > > > > select rownum, t1.field, t2.field > > > > > from tableOne t1, tableTwo t2 > > > > > where t1.key = t2.fkey > > Multiple rows with the same key renders Hibernate useless as i

Re: [GENERAL] Database slowness -- my design, hardware, or both?

2007-03-06 Thread Reuven M. Lerner
Hi, Alvaro Herrera. You wrote: Don't assume -- measure. I had a query which ran orders of magnitude faster because I interpolated the constant list in the big query. The table from which the interpolated values were being extracted had about 30 rows or so. OK, I modified things to use inte

Re: [GENERAL] Importing *huge* mysql database into pgsql

2007-03-06 Thread Chris
.ep wrote: Hello, I would like to convert a mysql database with 5 million records and growing, to a pgsql database. All the stuff I have come across on the net has things like "mysqldump" and "psql -f", which sounds like I will be sitting forever getting this to work. If you can convert the

Re: [GENERAL] vacuum error

2007-03-06 Thread Ed L.
On Tuesday March 6 2007 3:53 pm, Joshua D. Drake wrote: > > > Is restarting with 8.1.8 a known solution for this problem? > > Or is an initdb required to fix it? > > You can update to 8.1.8 (if you are running 8.1.x) without an > initdb. Right. I'm asking if the fix for this problem is in the n

Re: [GENERAL] vacuum error

2007-03-06 Thread Joshua D. Drake
If initdb is required, we might as well move to the latest stable 8.2 version. I understand my options to minimize downtime to be limited to async replication. Other ideas? BTW, the RAM looks good. You can update to 8.1.8 (if you are running 8.1.x) without an initdb. Joshua D. Drake

Re: [GENERAL] vacuum error

2007-03-06 Thread Ed L.
On Tuesday March 6 2007 12:20 pm, Peter Eisentraut wrote: > Ed L. wrote: > > I am seeing the following error in pgsql 8.1.2: > > > > ERROR: could not access status of transaction 3229475082 > > DETAIL: could not open file "pg_clog/0C07": No such file or > > directory > > > > What does it mean, an

Re: [GENERAL] postgres slower on nested queries

2007-03-06 Thread Tom Lane
Richard Huxton writes: > Alexander Elgert wrote: >> I found the postgres version VERY slow, so a decided to fetch > Define VERY - it took what, milliseconds to do this? Seconds? Hours? I think he's complaining that the standards-conformant view in Postgres is slower than the specialized SHOW com

Re: [GENERAL] postgres slower on nested queries

2007-03-06 Thread Richard Huxton
Alexander Elgert wrote: Hello, I programmed a little script which iterates over all databases in a DBMS, iterating over all tables and then over all columns. This skript works for mysql and postgres. 1. Solution overview foreach database { foreach table { forea

Re: [GENERAL] Database slowness -- my design, hardware, or both?

2007-03-06 Thread Alvaro Herrera
Reuven M. Lerner escribió: > Hi, Webb Sprague. You wrote: > >... but I see two seq scans in your explain in a loop -- this is > >probably not good. If you can find a way to rewrite the IN clause > >(either de-normalizing through triggers to save whatever you need on > >an insert and not have to d

[GENERAL] postgres slower on nested queries

2007-03-06 Thread Alexander Elgert
Hello, I programmed a little script which iterates over all databases in a DBMS, iterating over all tables and then over all columns. This skript works for mysql and postgres. 1. Solution overview foreach database { foreach table { foreach column { do

Re: [GENERAL] No buffer space available

2007-03-06 Thread Andrej Ricnik-Bay
On 3/7/07, andyk <[EMAIL PROTECTED]> wrote: 1) try to use client software, which is not depends on libpq, or 2) divide your query into smaller parts, or 3) use software which parses long queries, separates them into single SQL commands and then executes this commands one by one. 4) use Postgres

Re: [GENERAL] vacuum error

2007-03-06 Thread Peter Eisentraut
Ed L. wrote: > I am seeing the following error in pgsql 8.1.2: > ERROR: could not access status of transaction 3229475082 > DETAIL: could not open file "pg_clog/0C07": No such file or directory > > What does it mean, and what should I do about it? 1. Read this thread: http://archives.postgresq

Re: [GENERAL] RFC tool to support development / operations work with slony replicated databases

2007-03-06 Thread Andrew Hammond
On Mar 6, 5:44 am, [EMAIL PROTECTED] (Kenneth Downs) wrote: > Andrew Hammond wrote: > > Each release will include a directory that has the same name as the > > full release tag. This directory must contain all the scripts to be > > applied. > > Have you considered using a data dictionary instead,

Re: [GENERAL] Database slowness -- my design, hardware, or both?

2007-03-06 Thread Reuven M. Lerner
Hi, Webb Sprague. You wrote: ... but I see two seq scans in your explain in a loop -- this is probably not good. If you can find a way to rewrite the IN clause (either de-normalizing through triggers to save whatever you need on an insert and not have to deal with a set, or by using except in t

Re: [GENERAL] No buffer space available

2007-03-06 Thread andyk
Nik wrote: I have an SQL file with a set of about 3000 insert statements. This file is executed twice from a remote client machine running Windows XP. The first time it is executed against a Windows 2003 Server running PostgreSQL 8.0. The second time it is executed against a Windows 2003 Server r

Re: [GENERAL] \set a multılıne varıable

2007-03-06 Thread Peter Eisentraut
samı wrote: > How do you set a multılıne varıable usıng psql ? peter=# \set foo 'abc\ndef' peter=# \echo :foo abc def -- Peter Eisentraut http://developer.postgresql.org/~petere/ ---(end of broadcast)--- TIP 1: if posting/reading through Usenet, p

[GENERAL] vacuum error

2007-03-06 Thread Ed L.
I am seeing the following error in pgsql 8.1.2: 2007-03-05 10:00:51.106 PST [9834]DEBUG: vacuuming "pg_toast.pg_toast_1260" 2007-03-05 10:00:51.106 PST [9834]DEBUG: index "pg_toast_1260_index" now contains 0 row versions in 1 pages 2007-03-05 10:00:51.106 PST [9834]DETAIL: 0 index

Re: [GENERAL] Bulk insert new and update out of temp table

2007-03-06 Thread Martijn van Oosterhout
On Mon, Mar 05, 2007 at 08:21:10AM -0800, Dustin Withers wrote: > Hello All, > > I have an accounting system doing nightly dumps of tables out of a 4D > database. It only dumps out stuff that has changed within the last 24 > hours. So these dumps only contain the last changed data. The dumps > g

Re: [GENERAL] Importing *huge* mysql database into pgsql

2007-03-06 Thread Raymond O'Donnell
On 06/03/2007 16:53, Chris Browne wrote: Where's the "*huge*" database? 5 million records is nothing; I'll run ...unless they're all biggish BLOBs. ;-P Ray. --- Raymond O'Donnell, Director of Music, Galway Cathedral, Ireland [

Re: [GENERAL] Database slowness -- my design, hardware, or both?

2007-03-06 Thread Webb Sprague
I am not able to look as closely as it deserves ... ... but I see two seq scans in your explain in a loop -- this is probably not good. If you can find a way to rewrite the IN clause (either de-normalizing through triggers to save whatever you need on an insert and not have to deal with a set, o

Re: [GENERAL] Postgres Mailing List management solution

2007-03-06 Thread Jeff Ross
Desire Athow wrote: I am looking for a email list management solution (can be a script, an open source application etc), which uses Postgre SQL (AKA Postgres) as database. Can you let me know whether this rare bird exist? ---(end of broadcast)---

Re: [GENERAL] Importing *huge* mysql database into pgsql

2007-03-06 Thread Chris Browne
".ep" <[EMAIL PROTECTED]> writes: > Hello, > > I would like to convert a mysql database with 5 million records and > growing, to a pgsql database. > > All the stuff I have come across on the net has things like > "mysqldump" and "psql -f", which sounds like I will be sitting forever > getting this

Re : [GENERAL] Importing *huge* mysql database into pgsql

2007-03-06 Thread Laurent ROCHE
In addtion to mysql2pgsql (which we used and worked fine for us), you might want to have a look DDL-Utils http://db.apache.org/ddlutils/ It can convert a schema and data from one RDBMs to another. It is supposed to work from MySQL to PG, although I haven't used it this way (I use it from PG to

Re: [GENERAL] Database slowness -- my design, hardware, or both?

2007-03-06 Thread Reuven M. Lerner
Hi, Webb Sprague. You wrote: How much concurrency is there on your database? Almost none. I'm generally running one client against the server. I often have a second client connected simultaneously, just for the purpose of answering short questions. I'm now thinking of separating each activ

Re: [GENERAL] M:M table conditional delete for parents

2007-03-06 Thread MargaretGillon
Kenneth Downs <[EMAIL PROTECTED]> wrote on 03/06/2007 05:48:05 AM: > [EMAIL PROTECTED] wrote: > > Postgresql 8.1.4 on Redhat 9 > > I have a table which stores M:M relationships. I can't put foreign > keys to the parents of this table because the relationships being > stored go to several tab

Re: [GENERAL] COPY FROM and multiple null strings

2007-03-06 Thread Angva
On Mar 3, 2:12 pm, [EMAIL PROTECTED] ("Joshua D. Drake") wrote: > There are two immediate ways I can think of to handle this. > > 1. Write a parser in before insertion > > 2. copy everything into text columns and clean from there. > > Joshua D. Drake That's what I feared. :) Thanks, Joshua. Mark

[GENERAL] Runaway Instances of Postmaster

2007-03-06 Thread ccannick
Seeing dozens of postmasters running on my server. Depleting all my memory. Some as old as 300 hours. They don't change into backend postgres: some service processes as you'd expect. Nothing obviously misconfigured in the .conf file. I'm running v8.0 no linux. Any help would be appreciated.

[GENERAL] privileges of views and sequences

2007-03-06 Thread Marek
Hi, how is it with privileges for views and sequences? User other from owner is set to have full access to DB, this is applied to tables and functions, but not to views and sequences. I have to specifically give permission to each view and sequence. ---(end of broadcast)--

[GENERAL] Bulk insert new and update out of temp table

2007-03-06 Thread Dustin Withers
Hello All, I have an accounting system doing nightly dumps of tables out of a 4D database. It only dumps out stuff that has changed within the last 24 hours. So these dumps only contain the last changed data. The dumps get inserted into temp tables. Now the problem comes from getting the info o

[GENERAL] aggregate planning with partitions

2007-03-06 Thread Jonathan Ellis
I have a table, "connection_events", partitioned via inheritance on a column "logtime." I'm running 8.2. Mostly the partitioning works pretty well. I have noticed though that the query select max(logtime) from connection_events always uses seq_scan across all partitions, which is painful. (Re

[GENERAL] Permission problem using lo_export

2007-03-06 Thread pascalvdg
Hi, We are running a web application based on ColdFusion 7 and PostgreSQL 8 on 2 Windows 2003 servers. On server 1 (ColdFusion side) a query uses the lo_export function to get a blob out of the database on server 2. This blob must be written to disk but since the postgres user is only known on se

Re: [GENERAL] how to pass an array to the plpgsql function from Java Code

2007-03-06 Thread [EMAIL PROTECTED]
On Mar 4, 11:34 am, [EMAIL PROTECTED] ("Sandeep Kumar Jakkaraju") wrote: > how to pass an array to the plpgsql function from Java Code ?? If nothing else, you could use the ARRAY[] constructor: int [] ar = {1,2,3}; PreparedStament pre= connection.prepareStatement( " select test(ARRAY[?,?,?]) ");

[GENERAL] \set a multılıne varıable

2007-03-06 Thread samı
Hı How do you set a multılıne varıable usıng psql ? eg I am tryıng to add a multılıne varıable: somethıng on the lınes of : \set ADD_REMOTE_LINK 'SELECT ' ' name from ' ' mytable' and then call ıt usıng \echo :ADD_REMOTE_LINK Addıng a \ at the end of the lıne does not help - I am not sure wh

Re: [GENERAL] Importing *huge* mysql database into pgsql

2007-03-06 Thread Andy
.ep wrote: Hello, I would like to convert a mysql database with 5 million records and growing, to a pgsql database. All the stuff I have come across on the net has things like "mysqldump" and "psql -f", which sounds like I will be sitting forever getting this to work. Is there anything else?

[GENERAL] No buffer space available

2007-03-06 Thread Nik
I have an SQL file with a set of about 3000 insert statements. This file is executed twice from a remote client machine running Windows XP. The first time it is executed against a Windows 2003 Server running PostgreSQL 8.0. The second time it is executed against a Windows 2003 Server running Postgr

Re: [GENERAL] Can I getting a unique ID from a select

2007-03-06 Thread Timasmith
On Mar 5, 3:35 am, [EMAIL PROTECTED] (Bruno Wolff III) wrote: > On Sat, Mar 03, 2007 at 16:46:45 -0800, > Timasmith<[EMAIL PROTECTED]> wrote: > > > On Mar 3, 7:12 pm, [EMAIL PROTECTED] (Bruno Wolff III) wrote: > > > On Thu, Mar 01, 2007 at 06:16:02 -0800, > > > Timasmith<[EMAIL PROTECTED]> wrote:

[GENERAL] Postgres ebmail and hermes

2007-03-06 Thread lissette
Hello!! I have perfectly installed ebmail and Hermes 2 whith JDK 1.4.2 ,postgreSQL 8.1 and Tomacat 5.0.28 and all good works. I send messages whith ebmail and it`s writing in Postgresql but I have some mistakes: 2007-02-02 16:41:03 [Thread-6] 2007-02-02 16:41:13 [Thread-39 ] 2007-02-02

Re: [GENERAL] Cannot digest subscribe

2007-03-06 Thread Tom Lane
Don Lavelle <[EMAIL PROTECTED]> writes: > I just signed up for the mailing list, but when I tried to change > over to a digest subscription, I got an error back from the server. I'm fairly sure that the way you do that involves some kind of "set mode" command, not a new "subscribe" command.

Re: [GENERAL] FreeBSD kernel configuration

2007-03-06 Thread Vivek Khera
On Mar 6, 2007, at 3:42 AM, veejar wrote: Hi! I have server such configuration: 2 x Xeon LV DualCore 1.66GHz MEM 4Gb DDR2-400 2 x 250Gb SATA HDD how are you using the drives? software mirror? I have 20 databases on PostgreSQL 8. 2 of them are more than 1GB. I have ~50 requests per second.

Re: [GENERAL] plpythonu and PYTHONPATH/sys.path

2007-03-06 Thread Korin Richmond
On Tue, 6 Mar 2007, Korin Richmond wrote: On Tue, 6 Mar 2007, Richard Huxton wrote: Korin Richmond wrote: Hi, I want to use python modules I have written in plpythonu. I can load these modules in functions within postgres if they are installed in the "official" python module directories (

Re: [GENERAL] Importing *huge* mysql database into pgsql

2007-03-06 Thread Richard Huxton
.ep wrote: Hello, I would like to convert a mysql database with 5 million records and growing, to a pgsql database. And where's the huge database? All the stuff I have come across on the net has things like "mysqldump" and "psql -f", which sounds like I will be sitting forever getting this t

Re: [GENERAL] Importing *huge* mysql database into pgsql

2007-03-06 Thread Csaba Nagy
> I would like to convert a mysql database with 5 million records and > growing, to a pgsql database. I wouldn't qualify 5 million as "huge". We have here several 100 million sized tables, and I still think it's a medium sized DB... > All the stuff I have come across on the net has things like >

Re: [GENERAL] plpythonu and PYTHONPATH/sys.path

2007-03-06 Thread Korin Richmond
On Tue, 6 Mar 2007, Richard Huxton wrote: Korin Richmond wrote: Hi, I want to use python modules I have written in plpythonu. I can load these modules in functions within postgres if they are installed in the "official" python module directories (e.g. /blah/site-packages etc.) However, I

Re: [GENERAL] Importing *huge* mysql database into pgsql

2007-03-06 Thread Webb Sprague
I would like to convert a mysql database with 5 million records and growing, to a pgsql database. All the stuff I have come across on the net has things like "mysqldump" and "psql -f", which sounds like I will be sitting forever getting this to work. Have you tried it? 5 million rows seem doab

[GENERAL] Importing *huge* mysql database into pgsql

2007-03-06 Thread .ep
Hello, I would like to convert a mysql database with 5 million records and growing, to a pgsql database. All the stuff I have come across on the net has things like "mysqldump" and "psql -f", which sounds like I will be sitting forever getting this to work. Is there anything else? Thanks. ---

Re: [GENERAL] Does it has a way to compact the database size?

2007-03-06 Thread Merlin Moncure
On 3/6/07, Premsun Choltanwanich <[EMAIL PROTECTED]> wrote: I use PostgreSQL 8.0.3 for store my data started on Sep'06. Today, I use database_size('name') function for checking my database size and found that it's about 1209715345. I think that something maybe wrong on my database because I ba

Re: [GENERAL] M:M table conditional delete for parents

2007-03-06 Thread Kenneth Downs
[EMAIL PROTECTED] wrote: Postgresql 8.1.4 on Redhat 9 I have a table which stores M:M relationships. I can't put foreign keys to the parents of this table because the relationships being stored go to several tables. This was done so that only two fields have to be searched in order for all r

Re: [GENERAL] RFC tool to support development / operations work with slony replicated databases

2007-03-06 Thread Kenneth Downs
Andrew Hammond wrote: Each release will include a directory that has the same name as the full release tag. This directory must contain all the scripts to be applied. Have you considered using a data dictionary instead, so that you can simply diff the structures and generate DDL to bring a dat

Re: [GENERAL] Re : Re : COPY form stdin and file

2007-03-06 Thread senges
As u said it's working with the 'psql' client after replaceing $$PATH$ $ with the directory where i unpacked the backup file. /> psql -f restore.sql Thanx, Chris On 5 Mrz., 15:23, [EMAIL PROTECTED] (Laurent ROCHE) wrote: > COPY FROM stdin works only from a console ... and PGAdmin is not a console

Re: [GENERAL] plpythonu and PYTHONPATH/sys.path

2007-03-06 Thread Richard Huxton
Korin Richmond wrote: Hi, I want to use python modules I have written in plpythonu. I can load these modules in functions within postgres if they are installed in the "official" python module directories (e.g. /blah/site-packages etc.) However, I want to use modules which are in my home fil

[GENERAL] plpythonu and PYTHONPATH/sys.path

2007-03-06 Thread Korin Richmond
Hi, I want to use python modules I have written in plpythonu. I can load these modules in functions within postgres if they are installed in the "official" python module directories (e.g. /blah/site-packages etc.) However, I want to use modules which are in my home file space, but I can't g

Re: [GENERAL] Postgres Mailing List management solution

2007-03-06 Thread Magnus Hagander
On Tue, Mar 06, 2007 at 10:02:31AM +, Desire Athow wrote: > I am looking for a email list management solution (can be a script, an > open source application etc), which uses Postgre SQL (AKA Postgres) as > database. > > Can you let me know whether this rare bird exist? IIRC, Sympa (www.sympa.

Re: [GENERAL] Postgres Mailing List management solution

2007-03-06 Thread Richard Huxton
Desire Athow wrote: I am looking for a email list management solution (can be a script, an open source application etc), which uses Postgre SQL (AKA Postgres) as database. Can you let me know whether this rare bird exist? I don't know of anything myself - actually, I'm not sure if any of the

Re: [GENERAL] Does it has a way to compact the database size?

2007-03-06 Thread Richard Huxton
Premsun Choltanwanich wrote: Does it has a way to schedule the process for make sure that i'm running VACUUM often enough? How? (ie. create some script on PostgreSQL from running VACUUM FULL on 3.00 AM for first date of every month.) You might want to look at "autovacuum" in the contrib/ direc

Re: [GENERAL] Does it has a way to compact the database size?

2007-03-06 Thread Premsun Choltanwanich
Does it has a way to schedule the process for make sure that i'm running VACUUM often enough? How? (ie. create some script on PostgreSQL from running VACUUM FULL on 3.00 AM for first date of every month.)     >>> Richard Huxton 3/6/2007 16:50 >>>Premsun Choltanwanich wrote:> Dear All,>  > I use

[GENERAL] Postgres Mailing List management solution

2007-03-06 Thread Desire Athow
I am looking for a email list management solution (can be a script, an open source application etc), which uses Postgre SQL (AKA Postgres) as database. Can you let me know whether this rare bird exist? ---(end of broadcast)--- TIP 6: explain analyz

Re: [GENERAL] postgresql vs mysql

2007-03-06 Thread Richard Huxton
Andreas 'ads' Scherbaum wrote: Hello, On Thu, 22 Feb 2007 00:16:24 +0800 Lincoln Yeoh wrote: Want transactions? Use innoDB. Want to restore a multi-gigabyte database fast from backups, sure use MyISAM (too many people seem to have probs doing that with innoDB). sure you want to do this? h

Re: [GENERAL] Does it has a way to compact the database size?

2007-03-06 Thread Richard Huxton
Premsun Choltanwanich wrote: Dear All, I use PostgreSQL 8.0.3 for store my data started on Sep'06. Today, I use database_size('name') function for checking my database size and found that it's about 1209715345. I think that something maybe wrong on my database because I backup my database

Re: [GENERAL] Does it has a way to compact the database size?

2007-03-06 Thread A. Kretschmer
am Tue, dem 06.03.2007, um 15:28:01 +0700 mailte Premsun Choltanwanich folgendes: > Dear All, > > I use PostgreSQL 8.0.3 for store my data started on Sep'06. Today, I > use database_size('name') function for checking my database size and > found that it's about 1209715345. > ... > Any Idea? Y

[GENERAL] Does it has a way to compact the database size?

2007-03-06 Thread Premsun Choltanwanich
Dear All,   I use PostgreSQL 8.0.3 for store my data started on Sep'06. Today, I use database_size('name') function for checking my database size and found that it's about 1209715345.   I think that something maybe wrong on my database because I backup my database everyday and the backup size is

[GENERAL] FreeBSD kernel configuration

2007-03-06 Thread veejar
Hi! I have server such configuration: 2 x Xeon LV DualCore 1.66GHz MEM 4Gb DDR2-400 2 x 250Gb SATA HDD I have 20 databases on PostgreSQL 8. 2 of them are more than 1GB. I have ~50 requests per second. What kernel setting can you recommend me? in /boot/loader.conf ??? kern.ipc.semmni= kern.ipc.

Re: Wikipedia on Postgres (was Re: [GENERAL] postgresql vs mysql)

2007-03-06 Thread brian
While no one in thier right mind should be using wikipgedia, I'm sympathetic to those who might still be stuck on it for some reason, so if you guys can produce a patch against the wikipgedia cvs, I'd be happy to apply it. I'd like to patch that name. ---(end of broad