Re: [Dspace-tech] Postgres optimizations

2007-07-13 Thread Jayan Chirayath Kurian
Hi! Mika,

I was able to try backup and reinstate dspace. Thanks.

I deleted few items from DSpace. I believe their handle details still exist in 
postgres. I executed VACUUMDB and then the display in the DOS command line was 
VACCUM. I hope the command was executed successfully. IS there any way to 
flush out the items that are permanently deleted from DSPace. Does vacuumdb 
remove deleted collections/items which are permanently deleted and not shown on 
the DSpace GUI collection/item interface. Please suggest.

Thanks,
jayan

-Original Message-
From: Mika Stenberg [mailto:[EMAIL PROTECTED] 
Sent: Tuesday, May 29, 2007 5:40 PM
To: Jayan Chirayath Kurian
Subject: Re: [Dspace-tech] Postgres optimizations

Hi,

Im using pg_dump to backup db:
pg_dump dspace  /dspace/dbbackup/dspace.db

And rsync to backup dspace-directory and assetsore
rsync -av --delete /usr/local/dspace-1.4/ 
/usr/local/dspace_backup/weekly/dspace-1.4/

Then my local backups are transferred to another server via WinScp 
script, which if very useful. You can actually skip rsync if you use 
Winscp with /synchronize option.

You could also Zip the contents to save some space.

Did this help?

-Mika



 Hi! Mika,
 
 Could you please suggest regarding how to take backups for DSpace
 instances. I am using Dspace 1.4.1 on windows 2003. 
 
 Thanks,
 Jayan
 
 -Original Message-
 From: [EMAIL PROTECTED]
 [mailto:[EMAIL PROTECTED] On Behalf Of Mika
 Stenberg
 Sent: Tuesday, May 29, 2007 4:13 PM
 To: 'dspace-tech@lists.sourceforge.net'
 Subject: [Dspace-tech] Postgres optimizations
 
 Im hoping to get some hints for postgres performance optimization. Our 
 DSpace (1.4.1) has started to run really slow after the number of items 
 exceeded 40 000 (mainly metadata, few full texts only).
 
 I tried increasing work_memory and max_fsm_pages in postgres.conf but 
 with little help. Im also running regular vacuum and reindex for the db.
 
 Any help would be appreaciated,
 -Mika
 
 
 -
 This SF.net email is sponsored by DB2 Express
 Download DB2 Express C - the FREE version of DB2 express and take
 control of your XML. No limits. Just data. Click to get it now.
 http://sourceforge.net/powerbar/db2/
 ___
 DSpace-tech mailing list
 DSpace-tech@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/dspace-tech


-- 
Mika Stenberg
IT-asiantuntija

Terveystieteiden Keskuskirjasto
Lääketieteellinen tdk
PL 61 (Haartmaninkatu 4)
Helsingin Yliopisto
00290 Helsinki

puh. +358-9-191 26807

-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech


Re: [Dspace-tech] Postgres optimizations

2007-07-13 Thread Christophe Dupriez

Hi Jayan!

Postgresql  ANALYZE option is very useful: it calculate statistics for 
the query optimizer. It is very speedy.
VACUUM is a lot slower and reclaims internal unused space. It is useful 
if you have deleted a lot of data.
It does not make any data change or logical change. If the DSpace delete 
does not clean its data correctly, VACUUM will not change anything.


I suspect DSpace may keep handle records to never reallocate handles to 
different documents.


One way to do anything you want (at your own risks) is to use pgAdmin 
III to make any change you need at SQL level.
Just remind that items are also indexed by Lucene and you will have to 
run the DSIndexer if you change any text field.


Have a nice week-end!

Christophe

Jayan Chirayath Kurian a écrit :

Hi! Mika,

I was able to try backup and reinstate dspace. Thanks.

I deleted few items from DSpace. I believe their handle details still exist in postgres. 
I executed VACUUMDB and then the display in the DOS command line was VACCUM. 
I hope the command was executed successfully. IS there any way to flush out the items 
that are permanently deleted from DSPace. Does vacuumdb remove deleted collections/items 
which are permanently deleted and not shown on the DSpace GUI collection/item interface. 
Please suggest.

Thanks,
jayan

-Original Message-
From: Mika Stenberg [mailto:[EMAIL PROTECTED] 
Sent: Tuesday, May 29, 2007 5:40 PM

To: Jayan Chirayath Kurian
Subject: Re: [Dspace-tech] Postgres optimizations

Hi,

Im using pg_dump to backup db:
pg_dump dspace  /dspace/dbbackup/dspace.db

And rsync to backup dspace-directory and assetsore
rsync -av --delete /usr/local/dspace-1.4/ 
/usr/local/dspace_backup/weekly/dspace-1.4/


Then my local backups are transferred to another server via WinScp 
script, which if very useful. You can actually skip rsync if you use 
Winscp with /synchronize option.


You could also Zip the contents to save some space.

Did this help?

-Mika



  

Hi! Mika,

Could you please suggest regarding how to take backups for DSpace
instances. I am using Dspace 1.4.1 on windows 2003. 


Thanks,
Jayan

-Original Message-
From: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] On Behalf Of Mika
Stenberg
Sent: Tuesday, May 29, 2007 4:13 PM
To: 'dspace-tech@lists.sourceforge.net'
Subject: [Dspace-tech] Postgres optimizations

Im hoping to get some hints for postgres performance optimization. Our 
DSpace (1.4.1) has started to run really slow after the number of items 
exceeded 40 000 (mainly metadata, few full texts only).


I tried increasing work_memory and max_fsm_pages in postgres.conf but 
with little help. Im also running regular vacuum and reindex for the db.


Any help would be appreaciated,
-Mika


-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/
___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech




  


begin:vcard
fn:Christophe Dupriez
n:Dupriez;Christophe
org:DESTIN inc. SSEB
adr;quoted-printable:;;rue des Palais 44, bo=C3=AEte 1;Bruxelles;;B-1030;Belgique
email;internet:[EMAIL PROTECTED]
title:Informaticien
tel;work:+32/2/216.66.15
tel;fax:+32/2/242.97.25
tel;cell:+32/475.77.62.11
note;quoted-printable:D=C3=A9veloppement de Syst=C3=A8mes de Traitement de l'Information
x-mozilla-html:TRUE
url:http://www.destin.be
version:2.1
end:vcard

-
This SF.net email is sponsored by DB2 Express
Download DB2 Express C - the FREE version of DB2 express and take
control of your XML. No limits. Just data. Click to get it now.
http://sourceforge.net/powerbar/db2/___
DSpace-tech mailing list
DSpace-tech@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-tech