Eric,
That's a great question. To date, I don't know of any benchmarks, I just
know of guesses. For your situation, image files of less than 100 MB
should be fine. However, if you're going to use managed datastreams, then
you'll have to have enough disk space to copy them from their existing
location into Fedora. Using external datastreams would eliminate this
problem, but I agree with Justin: managed datastreams are easier than
external ones.
I have to use external datastreams for our video files with are hundreds of
MB, so your assumption is correct and you'll likely have to do the same
with your a/v files as well.
...adam
____________________________________________
Adam Wead
Systems and Digital Collections Librarian
Rock and Roll Hall of Fame and Museum
216.515.1960 (t)
215.515.1964 (f)
On Wed, Mar 6, 2013 at 9:40 AM, James, Eric <eric.ja...@yale.edu> wrote:
> Have any benchmarks been done regarding file size thresholds for managed
> datastreams? I.E. how many MB/GB would break the upload process or just be
> too slow to be practical? And are the other issues involved (network,
> storage, etc).
>
>
>
> I'm dealing with 500k images on disk, and am considering either to leave
> them where they are and use an external datastream to point to them, or
> transfer them into a managed datastreams. There is also another collection
> of large AV files in the GBs range which at this point seem like external
> is the way to go.
>
>
>
> Thanks,
>
> Eric
> ------------------------------
> *From:* Justin Coyne [jus...@curationexperts.com]
> *Sent:* Monday, March 04, 2013 9:44 PM
> *To:* Support and info exchange list for Fedora users.
> *Subject:* Re: [fcrepo-user] Managed vs. External Storage
>
> I find that it's much easier to put all your objects within the Fedora
> repository if you have the option. If you're storing externally, you loose
> the ability to do automatic checksum validation and versioning.
> Furthermore, you have to make certain that you maintain integrity between
> your external store and the reference within Fedora. To me external
> datastreams are a great workaround for when you have no other choice.
>
> Best Regards,
> Justin Coyne
> Data Curation Experts
>
> On Mon, Mar 4, 2013 at 4:30 PM, Schmidt, Lisa (lschmidt) <lschm...@msu.edu
> > wrote:
>
>> At the Michigan State University Archives, we are wrestling with the
>> question of where to store digital objects/AIPs: within our Fedora
>> repository (managed), or externally.
>>
>> What are the issues associated with each approach?
>>
>> We have external storage available on an IX Systems storage device, and
>> have been planning to use it for archival storage of AIPs with pointers in
>> the Fedora repository; it would be synched to a second IX storage device
>> that would function as our dark archive. We want to do our due diligence,
>> however, to ensure that this is the right approach.
>>
>> Thank you,
>> Lisa
>>
>> ____________________________________________________
>>
>> Lisa M. Schmidt
>> Electronic Records Archivist
>> University Archives & Historical Collections
>> 888 Wilson Road
>> Room 101 , Conrad Hall
>> Michigan State University
>> East Lansing, MI 48824
>>
>> lschm...@msu.edu
>> 1-517-884-6441
>>
>>
>>
>> ------------------------------------------------------------------------------
>> Everyone hates slow websites. So do we.
>> Make your web apps faster with AppDynamics
>> Download AppDynamics Lite for free today:
>> http://p.sf.net/sfu/appdyn_d2d_feb
>> _______________________________________________
>> Fedora-commons-users mailing list
>> Fedora-commons-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/fedora-commons-users
>>
>>
>
>
> ------------------------------------------------------------------------------
> Symantec Endpoint Protection 12 positioned as A LEADER in The Forrester
> Wave(TM): Endpoint Security, Q1 2013 and "remains a good choice" in the
> endpoint security space. For insight on selecting the right partner to
> tackle endpoint security challenges, access the full report.
> http://p.sf.net/sfu/symantec-dev2dev
> _______________________________________________
> Fedora-commons-users mailing list
> Fedora-commons-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/fedora-commons-users
>
>
------------------------------------------------------------------------------
Symantec Endpoint Protection 12 positioned as A LEADER in The Forrester
Wave(TM): Endpoint Security, Q1 2013 and "remains a good choice" in the
endpoint security space. For insight on selecting the right partner to
tackle endpoint security challenges, access the full report.
http://p.sf.net/sfu/symantec-dev2dev
_______________________________________________
Fedora-commons-users mailing list
Fedora-commons-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/fedora-commons-users
