Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-25 Thread Mollenauer, Tanya
-Original Message- From: Code for Libraries [mailto:[EMAIL PROTECTED] On Behalf Of Rob Styles Sent: Monday, January 22, 2007 4:26 AM To: CODE4LIB@listserv.nd.edu Subject: Re: [CODE4LIB] Getting data from Voyager into XML? I can't speak for other vendors, but historically for Talis it's

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-25 Thread Joe Shubitowski
@listserv.nd.edu Subject: Re: [CODE4LIB] Getting data from Voyager into XML? I can't speak for other vendors, but historically for Talis it's been a limitation of the contract with the RDBMS vendor. We ship Sybase as the RDBMS for our ILS and until recently that license was restricted to use of the RDBMS

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-22 Thread Rob Styles
for Libraries on behalf of Peter Schlumpf Sent: Fri 19/01/2007 2:26 PM To: CODE4LIB@listserv.nd.edu Subject: Re: [CODE4LIB] Getting data from Voyager into XML? Are there such limitations in contractual agreements with ILS vendors? That is weird. I agree generally that such a limitation should

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-19 Thread Erik Hatcher
On Jan 17, 2007, at 3:26 PM, Andrew Nagy wrote: One thing I am hoping that can come out of the preconference is a standard XSLT doc. I sat down with my metadata librarian to develop our XSLT doc -- determining what fields are to be searchable what fields should be left out to help speed up

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-19 Thread Birkin James Diana
On Wed, 17 Jan 2007, Nathan Vack wrote: Sure isn't elegant, but as our Real Systems Guys don't want us to look at the production Oracle instance (performance worries), we've had pretty good luck screen-scraping holdings and status data, once we get a Bib ID. Ugly, but functional, and

Re: [CODE4LIB] Limiting by availability (was Re: [CODE4LIB] Getting data from Voyager into XML?)

2007-01-19 Thread Emily Lynema
At NCSU, we don't have any survey or focus group data about user interest in limiting by availability. But we do have an availability limit on our catalog search results page. It's a link at the top of the page that says 'limit results to currently available items'.

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-19 Thread Erik Hatcher
Tod, Great information. I apologize for being a late comer to the game and bringing up FAQs. What about date normalization? One thing that must be considered when doing faceted browsing is that it works best with some pre-processed data, such as years rather than full dates. The question

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-19 Thread Doran, Michael D
:[EMAIL PROTECTED] On Behalf Of Eric Lease Morgan Sent: Friday, January 19, 2007 6:02 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] Getting data from Voyager into XML? On Jan 19, 2007, at 6:37 AM, Birkin James Diana wrote: Since we can't SQL-query our own ILS data directly... (ok

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-19 Thread Kevin S. Clarke
On 1/19/07, Jonathan Gorman [EMAIL PROTECTED] wrote: There's also been work done to provide libraries and the like in XSLT. EXSLT comes to mind right away. That's what I was wondering... and wondering whether CDL's date normalization library would be useful. Kevin

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-19 Thread Roy Tennant
Finally getting caught up on this discussion, see http://www.cdlib.org/inside/diglib/datenorm/ if you want to mess around with our date normalization utility (it's in Java). Roy On 1/19/07 7:52 AM, Kevin S. Clarke [EMAIL PROTECTED] wrote: On 1/19/07, Jonathan Gorman [EMAIL PROTECTED] wrote:

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-19 Thread Walker, David
To: CODE4LIB@listserv.nd.edu Subject: Re: [CODE4LIB] Getting data from Voyager into XML? On Fri, 19 Jan 2007, Erik Hatcher wrote: Tod, Great information. I apologize for being a late comer to the game and bringing up FAQs. What about date normalization? One thing that must be considered

Re: [CODE4LIB] Limiting by availability (was Re: [CODE4LIB] Getting data from Voyager into XML?)

2007-01-19 Thread Binkley, Peter
by availability (was Re: [CODE4LIB] Getting data from Voyager into XML?) On 1/19/07 9:26 AM, Steve Toub [EMAIL PROTECTED] wrote: Also, as a possible sweet-spot, I'm wondering if its practical to do post-search winnowing by availability after doing the FCLA-style real-time query, by doing indexing

Re: [CODE4LIB] Limiting by availability (was Re: [CODE4LIB] Getting data from Voyager into XML?)

2007-01-19 Thread Binkley, Peter
data from Voyager into XML?) Peter, What is a bitset? Is it a Java class or a more primitive data structure? Alan On 19-Jan-07, at 2:32 PM, Binkley, Peter wrote: This is why I think we should figure out smart ways to manage facets independently of Lucene index fields. Solr populates a facet

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-19 Thread Tod Olson
On Jan 19, 2007, at 6:53 AM, Erik Hatcher wrote: Great information. I apologize for being a late comer to the game and bringing up FAQs. Well, I'm not certain Q is A-ed very F. What about date normalization? One thing that must be considered when doing faceted browsing is that it works

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-17 Thread Ross Singer
Nathan, Ed Summers' ruby-marc is an excellent way to get Voyager's generally pretty crappy MARC batch export into XML. http://www.textualize.com/ruby_marc Use the MARC::ForgivingReader and then you output everything using MARC::XMLWriter. For a collection the size of yours it's going to take

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-17 Thread Andrew Nagy
Nathan Vack wrote: Hey cats, I'm starting to think (very excitedly) about the Lucene session, and realized that I'd better get our data into an XML form, so I can do interesting things with it. Anyone here have experience (or code I could steal) dumping data from Voyager into... anything? I'm

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-17 Thread Nathan Vack
On Jan 17, 2007, at 2:26 PM, Andrew Nagy wrote: Nate, it's pretty easy. Once you dump your records into a giant marc file, you can run marc2xml (http://search.cpan.org/~kados/MARC-XML-0.82/bin/marc2xml). Then run an XSLT against the marcxml file to create your SOLR xml docs. Unless I'm

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-17 Thread Jonathan Gorman
On Wed, 17 Jan 2007, Nathan Vack wrote: On Jan 17, 2007, at 2:26 PM, Andrew Nagy wrote: Nate, it's pretty easy. Once you dump your records into a giant marc file, you can run marc2xml (http://search.cpan.org/~kados/MARC-XML-0.82/bin/marc2xml). Then run an XSLT against the marcxml file to

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-17 Thread Bess Sadler
On Jan 17, 2007, at 3:26 PM, Andrew Nagy wrote: One thing I am hoping that can come out of the preconference is a standard XSLT doc. I sat down with my metadata librarian to develop our XSLT doc -- determining what fields are to be searchable what fields should be left out to help speed up

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-17 Thread Jonathan Gorman
Hi Nate, I've just started playing around with this a bit myself, although I have to confess that it's quite recent and a hack. But here's what I've been doing. Due to consortium issues and the like here's the track I'm taking. I'm using Perl, since I haven't yet started playing with Ruby. I

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-17 Thread Eric Lease Morgan
On Jan 17, 2007, at 3:59 PM, Bess Sadler wrote: Is there an elegant way to use your fancy new faceted browser to search against circ data w/out re-dumping the whole thing every night? I'm not sure about this, but given the unique identifier of a thing borrowed or in question, you might be

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-17 Thread Casey Durfee
Many ILSes give the ability to export item data in the MARC record in a 9xx tag, (usually the 949 since BT and other book jobbers like to put holdings data for newly-acquired items there so the ILS can automatically create an item record when the MARC record is loaded). That is how I've been

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-17 Thread Andrew Nagy
Bess Sadler wrote: As long as we're on the subject, does anyone want to share strategies for syncing circulation data? It sounds like we're all talking about the parallel systems á la NCSU's Endeca system, which I think is a great idea. It's the circ data that keeps nagging at me, though. Is

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-17 Thread Ross Singer
Bess, I do have a ruby class that gets current holdings, but it would only work for Voyager. My guess is it depend greatly on the ILS -- the RDBMS based ones (Voyager, Aleph, Horizon, VTLS, etc.) and the rest (Unicorn, III, etc.). Unicorn has its API to draw from, but you'd have problems

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-17 Thread Bess Sadler
Very cool, Andrew. I can't wait for your talk. Bess On Jan 17, 2007, at 5:10 PM, Andrew Nagy wrote: Bess Sadler wrote: As long as we're on the subject, does anyone want to share strategies for syncing circulation data? It sounds like we're all talking about the parallel systems á la NCSU's

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-17 Thread Jonathan Rochkind
Eric Lease Morgan wrote: I'm not sure about this, but given the unique identifier of a thing borrowed or in question, you might be able to write a Z39.50 query designed to return circulation status. Getting the circ data info a known item should be fairly trivial in any ILS. The problem is

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-17 Thread Doran, Michael D
/2007 2:59 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] Getting data from Voyager into XML? On Jan 17, 2007, at 3:26 PM, Andrew Nagy wrote: One thing I am hoping that can come out of the preconference is a standard XSLT doc. I sat down with my metadata librarian to develop our XSLT

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-17 Thread Andrew Nagy
Nathan Vack wrote: Unless I'm totally, hugely mistaken, MARC doesn't say anything about holdings data, right? If I want to facet on that, would it make more sense to add holdings data to the MARC XML data, or keep separate xml files for holdings that reference the item data? As others have

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-17 Thread Jonathan Gorman
On Wed, 17 Jan 2007, Doran, Michael D wrote: The mfhd has a location, but in Voyager I find the item perm_location to be more accurate, at least with our practice For Voyager, I've found this to be a useful algorithm for getting accurate location information: if item record then if item

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-17 Thread Binkley, Peter
data from Voyager into XML? On Jan 17, 2007, at 3:26 PM, Andrew Nagy wrote: One thing I am hoping that can come out of the preconference is a standard XSLT doc. I sat down with my metadata librarian to develop our XSLT doc -- determining what fields are to be searchable what fields should

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-17 Thread Nathan Vack
On Jan 17, 2007, at 2:59 PM, Bess Sadler wrote: As long as we're on the subject, does anyone want to share strategies for syncing circulation data? It sounds like we're all talking about the parallel systems á la NCSU's Endeca system, which I think is a great idea. It's the circ data that keeps

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-17 Thread Ross Singer
Nathan, I don't think that will scale to showing status information for a result set. I think a compromise needs to be reached with your Systems folks. Maybe they could review the queries? After all, hitting Oracle directly is more efficient than any single part of Voyager. -Ross. On

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-17 Thread Casey Durfee
Any Real System Guy worth their salt would know how to set up an account for you to use for SQL queries like these with read-only rights and low processing priority/throttling so there would be little to no chance of it affecting system performance. Even if they don't know, they could find out

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-17 Thread Doran, Michael D
] Getting data from Voyager into XML? On Jan 17, 2007, at 2:59 PM, Bess Sadler wrote: As long as we're on the subject, does anyone want to share strategies for syncing circulation data? It sounds like we're all talking about the parallel systems á la NCSU's Endeca system, which I think is a great

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-17 Thread Nathan Vack
On Jan 17, 2007, at 6:16 PM, Casey Durfee wrote: So it sounds to me like they're stonewalling you because they flat out don't know what they're doing and don't care to find out. In which cases, condolences. Nope, I really think it's for fear of someone writing a huge runaway SQL statement

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-17 Thread Doran, Michael D
/ From: Code for Libraries on behalf of Casey Durfee Sent: Wed 1/17/2007 8:06 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] Getting data from Voyager into XML? That's why you can set up different logins with different priorities so a runaway statement has zero effect

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-17 Thread Alexander Johannesen
On 1/18/07, Doran, Michael D [EMAIL PROTECTED] wrote: So you may find that there is a well-founded reluctance among Voyager systems people to get too carried away with the DBA 101 stuff. ;-) We're routing around the problem by creating a webservice that is Voyager specific and let other apps

Re: [CODE4LIB] Getting data from Voyager into XML?

2007-01-17 Thread Art Rhyno
Patrons definitly want to be able to limit on availability. And I don't think anyone's figured out a good way to do that in this generation of export and index search tools we are experimenting with. (Heck, I know a major commercial ILS that won't let you do it in the OPAC either!). I believe