Re: [Dspace-general] Storage capacity of Dspace to version 1.7.1 - Help

2011-06-20 Thread Mark H. Wood
On Fri, Jun 17, 2011 at 10:27:26AM -0500, Tim Donohue wrote:
 DSpace itself uses the filesystem for storage. So you are only limited 
 by your available file system space. So, if your 3 million items take up 
 3TB of space, then you will need to ensure DSpace has access to 3TB 
 worth of local (or mounted) storage space.

You also need enough administrative overhead storage (inodes on Unix,
index blocks or some such thing on Windows) to account for your
millions of files.  Likely this will not be a problem, but if you have
a good estimate of the number of bitstreams (files) you expect then it
wouldn't hurt to check.

Also, most object types in the database have a unique identifier which
is an SQL INTEGER.  If you're using PostgreSQL then, for example, you
can't create more than 2,147,483,647 Items.  A few millions should not
hit any hard limit.

-- 
Mark H. Wood, Lead System Programmer   mw...@iupui.edu
Asking whether markets are efficient is like asking whether people are smart.


pgppORHDqxlsi.pgp
Description: PGP signature
--
EditLive Enterprise is the world's most technically advanced content
authoring tool. Experience the power of Track Changes, Inline Image
Editing and ensure content is compliant with Accessibility Checking.
http://p.sf.net/sfu/ephox-dev2dev___
Dspace-general mailing list
Dspace-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-general


Re: [Dspace-general] Storage capacity of Dspace to version 1.7.1 - Help

2011-06-17 Thread Tim Donohue
Hi PatrĂ­cia,

DSpace itself uses the filesystem for storage. So you are only limited 
by your available file system space. So, if your 3 million items take up 
3TB of space, then you will need to ensure DSpace has access to 3TB 
worth of local (or mounted) storage space.

In the past (DSpace 1.6 and previous) there were some performance issues 
with DSpace when you stored millions of items. However, we've made some 
significant performance/scalability improvements to DSpace 1.7.x.  So, 
at this point in time, we believe you will achieve good performance when 
storing millions of items (admittedly, most large DSpace installs just 
store hundreds of thousands of items, so we haven't done much testing 
with millions of items).

That being said, to achieve optimal performance, you likely will need to 
ensure your server has appropriate memory and processing power.

We have some hints on ways to performance tune your DSpace installation 
on our wiki at:

* https://wiki.duraspace.org/display/DSPACE/SystemAdministrators
* https://wiki.duraspace.org/display/DSPACE/HowToPerformanceTuneForDspace

If you run into any issues, please feel free to email our DSpace 
Technology list: https://lists.sourceforge.net/lists/listinfo/dspace-tech/

Good luck,

- Tim


On 6/16/2011 5:00 PM, Patricia Coelho Ferreira Meneses da Silva wrote:
 Hi!
 Anyone know what the storage capacity of Dspace to version 1.7.1? Does
 anyone know the capacity of items that can be included in each collection?

 We want to store more than 3 million items and do not know if the system
 supports.
 Thanks.
 PatrĂ­cia Coelho



 --
 EditLive Enterprise is the world's most technically advanced content
 authoring tool. Experience the power of Track Changes, Inline Image
 Editing and ensure content is compliant with Accessibility Checking.
 http://p.sf.net/sfu/ephox-dev2dev



 ___
 Dspace-general mailing list
 Dspace-general@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/dspace-general

--
EditLive Enterprise is the world's most technically advanced content
authoring tool. Experience the power of Track Changes, Inline Image
Editing and ensure content is compliant with Accessibility Checking.
http://p.sf.net/sfu/ephox-dev2dev
___
Dspace-general mailing list
Dspace-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/dspace-general