Re: [Dspace-tech] Assetstore physical storage (Amazon's Simple Storage Service: S3)

2007-04-19 Thread Richard MAHONEY
Dear Richard, On Thu, 2007-04-19 at 04:23, Richard Rodgers wrote: Richard: I'm putting up a prototype implementation of (inter alia) an S3 backend on the DSpace wiki. (see 'PluggableStorage' page). Would love volunteers to vet it (not ready for production). Thanks, Richard R. Without

Re: [Dspace-tech] Assetstore physical storage (Amazon's Simple Storage Service: S3)

2007-04-19 Thread Richard Rodgers
Hi Richard: A a quick reaction to your questions - I'll look into it more - is this: in principle it would certainly be doable, but the issue will likely be tolerance for performance tradeoffs. In my prototype I preserved the stream-oriented aspect of the API: which means I don't store a local

Re: [Dspace-tech] Assetstore physical storage (Amazon's Simple Storage Service: S3)

2007-04-18 Thread Richard Rodgers
Richard: I'm putting up a prototype implementation of (inter alia) an S3 backend on the DSpace wiki. (see 'PluggableStorage' page). Would love volunteers to vet it (not ready for production). Thanks, Richard R. On Thu, 2007-04-12 at 09:49 +1200, Richard MAHONEY wrote: Dear Robert et al.,

[Dspace-tech] Assetstore physical storage

2007-04-11 Thread Ryan Ordway
Is there a reason why only the metadata is stored in the database and not the actual assetstore bitstreams? Has anyone considered changing the physical storage from the filesystem to the database? I'm working on building some redundancy into my infrastructure and it's looking like the most

Re: [Dspace-tech] Assetstore physical storage

2007-04-11 Thread Cory Snavely
There's a whole discussioon there about what's the right tool for the job, but integration with Lucene would be my guess as to the practical reason. I'd be interested to learn if that, in fact, were not a constraint. Cory Snavely University of Michigan Library IT Core Services On Wed, 2007-04-11

Re: [Dspace-tech] Assetstore physical storage

2007-04-11 Thread Mark Diggory
Ryan, Yes, we have an ongoing project (PLEDGE) that is working to modify DSpace to support such capability. And we are working to get it into one of the next releases. http://pledge.mit.edu http://wiki.dspace.org/index.php/AipPrototype http://wiki.dspace.org/index.php/AssetStore Cheers,

Re: [Dspace-tech] Assetstore physical storage (Amazon's Simple Storage Service: S3)

2007-04-11 Thread Richard MAHONEY
Dear Robert et al., On Thu, 2007-04-12 at 07:15, Robert Tansley wrote: We considered this way back when (2001); we decided on using the filesystem because some files might be very very large, there might be lots of them and in general it's easier to split filesystem-based asset stores across