Thanks a lot Chris, I'll give it a try when I get a chance.  Also, I see that 
the tool has the ability to migrate inline XML to Managed Content.  Are there 
any advantages to using Managed Content datastreams for DC, RELS-EXT, and 
RELS-INT?

    For all objects, migrate DC, RELS-EXT, and RELS-INT datastreams from inline 
XML to managed content:
       fcsu modify store1 --filter=inline-to-managed-xml 
--datastream-ids=DC,RELS-EXT,RELS-INT


I began writing a class that basically queries SOLR for all our PIDs and 
iterates through them to download the Managed datastream temporarily and then 
add it back.   I figured that was the "simple" solution.  My class also does 
some metadata transformation as well, as needed by our project.  But perhaps a 
general bulk metadata transformation tool may be something of use for everyone.


Vincent Vu Nguyen

-----Original Message-----
From: Chris Wilper [mailto:cwil...@duraspace.org] 
Sent: Thursday, July 19, 2012 11:24 AM
To: fedora-commons-developers@lists.sourceforge.net
Subject: Re: [fcrepo-dev] https://jira.duraspace.org/browse/FCREPO-724 - 
Rebuild Utility

Hi Vincent,

I've written a storage utility that may be of help here:

https://wiki.duraspace.org/display/~cwilper/A+New+Fedora+Storage+Utility

One of the filters that's included allows you to re-compute the SIZE
*and* checksum info for managed datastreams. I was actually talking with Ben 
Armintor recently about this recently and have copy-pasted my message below:

One of out-of-box the filters I wrote for it, 'SetFixity' is very similar to 
the need expressed by FCREPO-724. After pointing it to your storage via spring 
(see config/config.properties), the following example will iterate through all 
objects in your akubra-fs-based store and set the SIZE and DIGEST info for all 
datastreams where they're not already set:

./fcsu modify akubra --filter=set-fixity

It can also be used with "legacy" (pre-akubra-based) low level storage.

I never defined a filter that ONLY does size, though. That would require 
creating a new class similar to this:

https://github.com/cwilper/fcrepo-store/blob/master/fcrepo-store-util/src/main/java/com/github/cwilper/fcrepo/store/util/filters/ds/SetFixity.java

..then adding a new 'filter' bean file similar to this:

https://github.com/cwilper/fcrepo-store/blob/master/fcrepo-store-util/src/main/conf/filters/set-fixity.xml

...but naming it something different, like 'set-size' and omitting the 
digest-oriented bits, of course.

If you're interested in going down this road and have any questions or problems 
(or code to contribute!), let me know.

Thanks,
Chris

On Tue, Jul 10, 2012 at 9:16 AM, Nguyen, Vincent (CDC/OD/OADS) (CTR) 
<v...@cdc.gov> wrote:
> HI,
>
>
>
> We’re considering upgrading from Fedora 3.2 to 3.4.2 to take advantage 
> of the SIZE attribute fix in 3.4.2.  However, we’ll need a utility to 
> rebuild existing Datastreams (M) to take advantage of this.  Any idea 
> when this work will be completed?
>
>
>
> We may have to start working on this tool for our current project.  In 
> which case we can contribute any work done back to the community if needed.
>
>
>
> Any advice on how to go about this?  Is this the best way?
>
>
>
> -          Iterate through every object
>
> -          Download the datastream temporarily
>
> -          Purge the datastream
>
> -          Add the datastream back
>
>
>
> https://jira.duraspace.org/browse/FCREPO-724
>
>
>
> Vincent Vu Nguyen

------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and threat 
landscape has changed and how IT managers can respond. Discussions will include 
endpoint security, mobile security and the latest in malware threats. 
http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Fedora-commons-developers mailing list
Fedora-commons-developers@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/fedora-commons-developers
------------------------------------------------------------------------------
Live Security Virtual Conference
Exclusive live event will cover all the ways today's security and 
threat landscape has changed and how IT managers can respond. Discussions 
will include endpoint security, mobile security and the latest in malware 
threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/
_______________________________________________
Fedora-commons-developers mailing list
Fedora-commons-developers@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/fedora-commons-developers

Reply via email to