Re: [CODE4LIB] EAD in Blacklight (was: Re: [CODE4LIB] Batch loading in fedora)

2010-08-11 Thread [Your Name]
On Aug 9, 2010, at 11:00 PM, CODE4LIB automatic digest system wrote: From: Tom Cramer tcra...@stanford.edu Date: August 9, 2010 11:09:02 AM EDT Subject: Re: EAD in Blacklight (was: Re: [CODE4LIB] Batch loading in fedora) Adam, Is the EAD-to-RDF graphinator code you describe shareable? I'd

Re: [CODE4LIB] EAD in Blacklight (was: Re: [CODE4LIB] Batch loading in fedora)

2010-08-10 Thread Eric Lease Morgan
On Aug 10, 2010, at 11:59 AM, Ethan Gruber wrote: Sounds like a good plan, but I wanted to throw in my two cents on your workflow. unitid is intended to be an optional element and describe an actual unique identifier that the object or collection has been given by the hosting institution.

Re: [CODE4LIB] EAD in Blacklight (was: Re: [CODE4LIB] Batch loading in fedora)

2010-08-08 Thread [Your Name]
I'd like to share an alternative approach that we're pursuing here at UVa. It doesn't speak quite directly to operations on finding aids by themselves, with no attention to representing on-line the collection so described, but more to those situations where you make an attempt at a full digital

Re: [CODE4LIB] EAD in Blacklight (was: Re: [CODE4LIB] Batch loading in fedora)

2010-08-07 Thread Mark A. Matienzo
On Fri, Aug 6, 2010 at 2:17 PM, Bess Sadler bess.sad...@gmail.com wrote: +1. Potential options could include using an XML database like eXist, or using our approach at Yale (where EAD finding aids are stored as datastreams in Fedora objects). I've been eager to look at rethinking our approach,

Re: [CODE4LIB] EAD in Blacklight (was: Re: [CODE4LIB] Batch loading in fedora)

2010-08-06 Thread Ethan Gruber
Jason, Thanks for the info. Nokogiri is alright, but I've found that, as far as XML processing goes, Saxon is above and beyond the best. Is it possible fire off a Java call from Ruby to have Saxon handle it, or not? Are you using Nokogiri to call an XSLT process or using Ruby to generate the

Re: [CODE4LIB] EAD in Blacklight (was: Re: [CODE4LIB] Batch loading in fedora)

2010-08-06 Thread Bess Sadler
Hi, Ethan. You can see another example of blacklight being used to search and display EAD guides at http://nwda.projectblacklight.org/?f%5Bformat_facet%5D%5B%5D=Archival+Collection+Guide I've used solr and/or lucene for EAD documents a few times, and here are some observations: I've also

Re: [CODE4LIB] EAD in Blacklight (was: Re: [CODE4LIB] Batch loading in fedora)

2010-08-06 Thread Bess Sadler
On Aug 6, 2010, at 9:10 AM, Jonathan Rochkind wrote: We indexed each EAD guide into separate lucene documents for each EAD section, then collapsed them under the main EAD title in the search results, Curious how you impelemented that: Did you use the Solr field collapsing patch that's not

Re: [CODE4LIB] EAD in Blacklight (was: Re: [CODE4LIB] Batch loading in fedora)

2010-08-06 Thread Mark A. Matienzo
On Fri, Aug 6, 2010 at 1:09 PM, Bess Sadler bess.sad...@gmail.com wrote: On Aug 6, 2010, at 9:10 AM, Jonathan Rochkind wrote: We indexed each EAD guide into separate lucene documents for each EAD section, then collapsed them under the main EAD title in the search results, Curious how you

Re: [CODE4LIB] EAD in Blacklight (was: Re: [CODE4LIB] Batch loading in fedora)

2010-08-06 Thread Ethan Gruber
I also think it's better to store EAD in a separate system rather than in the Solr index, that way you can use blacklight to serialize it or store a reference to a separate delivery system. Bess's and Matt's approach to storing the whole collection (EAD file) as a solr document in addition to

Re: [CODE4LIB] EAD in Blacklight (was: Re: [CODE4LIB] Batch loading in fedora)

2010-08-06 Thread Bess Sadler
On Aug 6, 2010, at 10:53 AM, Mark A. Matienzo wrote: On Fri, Aug 6, 2010 at 1:09 PM, Bess Sadler bess.sad...@gmail.com wrote: On Aug 6, 2010, at 9:10 AM, Jonathan Rochkind wrote: We indexed each EAD guide into separate lucene documents for each EAD section, then collapsed them under the

Re: [CODE4LIB] EAD in Blacklight (was: Re: [CODE4LIB] Batch loading in fedora)

2010-08-06 Thread Adam Wead
(was: Re: [CODE4LIB] Batch loading in fedora) +1. Potential options could include using an XML database like eXist, or using our approach at Yale (where EAD finding aids are stored as datastreams in Fedora objects). I've been eager to look at rethinking our approach, especially given

Re: [CODE4LIB] EAD in Blacklight (was: Re: [CODE4LIB] Batch loading in fedora)

2010-08-06 Thread Ethan Gruber
on a private network here. ...adam -Original Message- From: Code for Libraries on behalf of Mark A. Matienzo Sent: Fri 8/6/2010 1:53 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] EAD in Blacklight (was: Re: [CODE4LIB] Batch loading in fedora) +1. Potential options could

Re: [CODE4LIB] EAD in Blacklight (was: Re: [CODE4LIB] Batch loading in fedora)

2010-08-06 Thread Jason Ronallo
On Fri, Aug 6, 2010 at 12:10 PM, Jonathan Rochkind rochk...@jhu.edu wrote: You can definitely have Blacklight handle the display while still keeping the EAD out of solr stored fields. There's no reason Blacklight can't fetch the EAD from some external store, keyed by Solr document ID (or by

Re: [CODE4LIB] EAD in Blacklight (was: Re: [CODE4LIB] Batch loading in fedora)

2010-08-06 Thread Ranti Junus
On Fri, Aug 6, 2010 at 2:17 PM, Bess Sadler bess.sad...@gmail.com wrote: On Aug 6, 2010, at 10:53 AM, Mark A. Matienzo wrote: We indexed each EAD guide into separate lucene documents for each EAD section, then collapsed them under the main EAD title in the search results, Curious how you

Re: [CODE4LIB] EAD in Blacklight (was: Re: [CODE4LIB] Batch loading in fedora)

2010-08-06 Thread Jonathan Rochkind
I wonder how the field collapsing patch holds up on an index that contains 3 million documents, probably larger than your EAD-only one, but thinking about combining EAD in an index with many many other documents (like with a library catalog). Might be fine, might not. (Even without field

Re: [CODE4LIB] EAD in Blacklight (was: Re: [CODE4LIB] Batch loading in fedora)

2010-08-06 Thread Bess Sadler
On Aug 6, 2010, at 8:07 PM, Jonathan Rochkind wrote: I've been brainstorming other weird ways to do this. This one is totally wacky and possibly a bad idea, but I'll throw it out there anyway. What if you only indexed the entire EAD as one document, BUT threw the entire EAD in a stored

Re: [CODE4LIB] EAD in Blacklight (was: Re: [CODE4LIB] Batch loading in fedora)

2010-08-06 Thread Jonathan Rochkind
] Sent: Saturday, August 07, 2010 12:41 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] EAD in Blacklight (was: Re: [CODE4LIB] Batch loading in fedora) On Aug 6, 2010, at 8:07 PM, Jonathan Rochkind wrote: I've been brainstorming other weird ways to do this. This one is totally wacky