Hi, I flagged this thread before the holidays, intending to come back to it. Thanks for the reminder, Tim, I'm afraid I flag a lot of email with good intentions, and don't always follow up on those intentions. But, enough of regrets, it's a new year!
Nate, your AbstractBagitIngester.java (see [2] down-thread a bit) modifications look great, I plan to borrow them for my repository, and I thought I'd ask if you'd consider submitting a Pull Request for this work? I've taken the liberty of creating a JIRA issue for the Bagit package ingester (see https://jira.duraspace.org/browse/DS-1852), but we would need to create another issue for the community and collection deposit work you did at the same time -- I want to see that added, too. :-) Can you describe that work for me, so I can write a JIRA issue for it, or, even better, you can create a JIRA issue for the work yourself. https://jira.duraspace.org/secure/CreateIssue!default.jspa The topic of being able to load batches of items via SWORD to DSpace is one that comes up from time to time, and was a very hot topic of discussion at OR11 in Austin, if memory serves. See also DS-1641 (https://jira.duraspace.org/browse/DS-1641). As soon as a JIRA issue for the collection and community deposit features exists, you can submit a Pull Request for this work. Check out the Code Contribution Guidelines for more details: https://wiki.duraspace.org/display/DSPACE/Code+Contribution+Guidelines#Code ContributionGuidelines-1.Makeyourcodeavailable(preferrablyinGitHub)andcreat eaticketinourIssueTracker If you need help with any of this, let me (or any other DSpace committer) know. We are happy to help. -- HARDY POTTINGER <pottinge...@umsystem.edu> University of Missouri Library Systems http://lso.umsystem.edu/~pottingerhj/ https://MOspace.umsystem.edu/ "What day is it?" "It's today," squeaked Piglet. "My favorite day," said Pooh. On 1/3/14 9:08 AM, "Tim Donohue" <tdono...@duraspace.org> wrote: >Just a few minor clarifications.. > >The BagIt code for Replication Task Suite was actually written by >Richard Rodgers at MIT. I know it a little, but Richard R knows it even >better. :) > >Also, the Replication Task Suite code supports both METS and BagIt based >AIPs. The METS format is more built out/widely used, and actually >*should* work fine with SWORD (though it needs a SWORD ingest plugin >still). The ReplicationTaskSuite BagIt code is still more of "beta" >code, so it may need some updates/modifications to work better with >SWORD deposits. However, as mentioned, Richard R & I would welcome >anyone to send us Pull Requests or patches to improve the Replication >Task Suite: >https://github.com/DSpace/dspace-replicate > >In any case, I hope that everyone continues to post their work publicly >so that we can all take advantage and potentially work together on a >shared solution. > >Thanks, >- Tim > >On 12/26/2013 2:45 PM, Nathaniel Ryckman wrote: >> Hi Bill, >> >> During last summer, I also was led to believe the only significant work >> done on a Sword Baggit Ingester was performed by Tim Donohue and Richard >> Jones. Dryad appeared to have had plans to work on the system, but I did >> not find any code produced by them. >> >> I ended up testing the possibility of using Tim Donohue's >> ReplicationTaskSuite and discovered that it was specifically designed to >> restore data that had already been backed up and would not easily be >> modified to accept deposits from SWORD [1]. >> >> I, however, used Tim's code as a model to build an >> AbstractBagitIngester. The system allowed me to conform to SWORD v1.0 >> standards. I was able to deposit items using the system modifications >> that I wrote. If you are interested, see my AbstractBagitIngester for a >> good starting point [2]. >> >> If I remember correctly, I was asked to build an ingester that would >> depend solely on file hierarchy and Baggit standards rather than a >> manifest file, so I do not think I have support for OAI-ORE manifests. >> >> Anyway, good luck! If you have any questions, feel free to ask. >> >> Sincerely, >> Nate R. >> >> [1] >> >>http://dspace.2283337.n4.nabble.com/batch-import-of-Bagit-formated-collec >>tions-and-or-conversion-script-for-Bagit-to-SAF-td3697073.html#a4665944 >> [2] >> >>https://github.com/nryckman/DSpace-3.1/blob/master/dspace-api/src/main/ja >>va/org/dspace/content/packager/AbstractBagitIngester.java >> >> >> On Thu, Dec 19, 2013 at 11:53 AM, Ingram, William A >> <wingr...@illinois.edu <mailto:wingr...@illinois.edu>> wrote: >> >> Thanks for the feedback, guys. I'll report back once I've got >> something to look at. >> >> Thanks! >> Bill >> >> Bill Ingram >> University of Illinois >> Urbana, IL 61801 >> 217-333-4648 <tel:217-333-4648> >> wingr...@illinois.edu <mailto:wingr...@illinois.edu> >> >> -----Original Message----- >> From: Tim Donohue [mailto:tdono...@duraspace.org >> <mailto:tdono...@duraspace.org>] >> Sent: Thursday, December 19, 2013 9:21 AM >> To: Ingram, William A >> Cc: Richard Jones; sword-app-tech@lists.sourceforge.net >> <mailto:sword-app-tech@lists.sourceforge.net> >> Subject: Re: [sword-app-tech] DSpace SWORD deposit using BagIt and >> OAI:ORE >> >> Hi Bill, >> >> There's also some DSpace + BagIt work in the Replication Task Suite >> addon which can generate Archival Information Packages (AIPs), >> either METS-based AIPs or BagIt-based AIPs, for all content within >> DSpace. >> These AIPs can be used to backup/restore DSpace or copy/move content >> between DSpace instances. However, it does not involve OAI-ORE at >> this time. >> >> It also is not currently connected up to DSpace's SWORD server. So, >> you cannot currently deposit these AIPs via SWORD. Though, since >> DSpace's SWORD server is configurable, I suspect it should not be >> difficult to configure it to accept these AIPs (likely just need a >> simple SWORD plugin to call the Replication Task Suite code). This >> likely would be something that others would find useful as well. >> >> Overview: >>https://wiki.duraspace.org/display/DSPACE/ReplicationTaskSuite >> Code at: https://github.com/DSpace/dspace-replicate >> >> In any case, whatever work you do, I do suggest trying to post your >> code up in a public area (GitHub or similar) and making others aware >> of it. I keep hearing of folks that are interested in DSpace + >> BagIt, but the projects are not easy to locate. So, if you are >> looking for more collaborators, you also may wish to post about this >> on the dspace-devel mailing list, and/or create a wiki page in the >> DSpace Wiki. >> >> Good luck, >> >> Tim >> >> >> On 12/19/2013 8:18 AM, Richard Jones wrote: >> > I'm not aware of any work on DSpace with BagIt/OAI-ORE, although >>I >> > have done some BagIt package handling for a project I did with >>the >> > University of Oslo using a custom metadata format. >> > >> > Here's an example of the bagit format we were working with: >> > https://github.com/nye-duo/Duo-DSpace/tree/master/bagit >> > >> > Here's the SWORD plugin which deals with the bagit: >> > >> >>https://github.com/nye-duo/Duo-DSpace/blob/master/src/main/java/no/uio >> > /duo/FSBagItIngester.java >> > >> > And we also wrote a BagItLibrary to wrap our particular profile >> of the >> > format, so that it could be packed and unpacked at either end in >>a >> > consistent way: https://github.com/nye-duo/BagItLibrary >> > >> > Don't know if any of that is trivially re-usable, but hopefully >>it >> > will be helpful. >> > >> > Cheers, >> > >> > Richard >> > >> > >> > >> > >> > On 18 December 2013 19:30, Ingram, William A >> <wingr...@illinois.edu <mailto:wingr...@illinois.edu> >> > <mailto:wingr...@illinois.edu <mailto:wingr...@illinois.edu>>> >>wrote: >> > >> > I'm currently working on a research project investigating >> expanding >> > the capabilities of the IDEALS (DSpace) repository, allowing >>for >> > deposit of objects wrapped in BagIt packages and containing >> OAI-ORE >> > manifests.____ >> > >> > __ __ >> > >> > I saw online that there was a Summer of Code request for >> this, but >> > no one picked up on it. ____ >> > >> > __ __ >> > >> > Has anyone tried this? I don't want to repeat work that >> someone has >> > already done. ____ >> > >> > __ __ >> > >> > I wrote to the Dryad list, and based on the responses I got, >> this is >> > still something that people want. ____ >> > >> > __ __ >> > >> > Thanks!____ >> > >> > Bill____ >> >> >>------------------------------------------------------------------------- >>----- >> Rapidly troubleshoot problems before they affect your business. >>Most IT >> organizations don't have a clear picture of how application >>performance >> affects their revenue. With AppDynamics, you get 100% visibility >> into your >> Java,.NET, & PHP application. Start your 15-day FREE TRIAL of >> AppDynamics Pro! >> >>http://pubads.g.doubleclick.net/gampad/clk?id=84349831&iu=/4140/ostg.clkt >>rk >> _______________________________________________ >> sword-app-tech mailing list >> sword-app-tech@lists.sourceforge.net >> <mailto:sword-app-tech@lists.sourceforge.net> >> https://lists.sourceforge.net/lists/listinfo/sword-app-tech >> >> >> >> >> >>------------------------------------------------------------------------- >>----- >> Rapidly troubleshoot problems before they affect your business. Most IT >> organizations don't have a clear picture of how application performance >> affects their revenue. With AppDynamics, you get 100% visibility into >>your >> Java,.NET, & PHP application. Start your 15-day FREE TRIAL of >>AppDynamics Pro! >> >>http://pubads.g.doubleclick.net/gampad/clk?id=84349831&iu=/4140/ostg.clkt >>rk >> >> >> >> _______________________________________________ >> sword-app-tech mailing list >> sword-app-tech@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/sword-app-tech >> > >-------------------------------------------------------------------------- >---- >Rapidly troubleshoot problems before they affect your business. Most IT >organizations don't have a clear picture of how application performance >affects their revenue. With AppDynamics, you get 100% visibility into >your >Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics >Pro! >http://pubads.g.doubleclick.net/gampad/clk?id=84349831&iu=/4140/ostg.clktr >k >_______________________________________________ >sword-app-tech mailing list >sword-app-tech@lists.sourceforge.net >https://lists.sourceforge.net/lists/listinfo/sword-app-tech ------------------------------------------------------------------------------ Rapidly troubleshoot problems before they affect your business. Most IT organizations don't have a clear picture of how application performance affects their revenue. With AppDynamics, you get 100% visibility into your Java,.NET, & PHP application. Start your 15-day FREE TRIAL of AppDynamics Pro! http://pubads.g.doubleclick.net/gampad/clk?id=84349831&iu=/4140/ostg.clktrk _______________________________________________ sword-app-tech mailing list sword-app-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/sword-app-tech
