Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-11 Thread Ethan Gruber
any problems or questions. Ralph -Original Message- From: LeVan,Ralph Sent: Thursday, December 10, 2009 11:12 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: RE: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service We've made some progress

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-11 Thread Ya'aqov Ziso
Ethan, so you will be dynamcally generating XForms for each term in the FAST index? and display what the user selects? how will you make them more relevant? Could you point us to any user interface where one can see some sample snippets? Kindest thanks, Ya¹aqov On 12/11/09 10:46 AM, Ethan

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-11 Thread Ya'aqov Ziso
Ethan, the dynamic terms, indicating their linking/relevancy also as main or cross references will be of interest also to the VUfind group. Kindest thanks, Ya¹aqov On 12/11/09 12:04 PM, Ethan Gruber ewg4x...@gmail.com wrote: Well, the way it works is that I put all of the LC subject

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-10 Thread LeVan,Ralph
We've made some progress on this topic. I have available a list of our FAST subject headings. They are derived from LCSH and may be of some use. The folks that produced this file are working on producing a similar file for LCSH. The file can be found at

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-10 Thread Ed Summers
On Thu, Dec 10, 2009 at 11:11 AM, LeVan,Ralph le...@oclc.org wrote: The file contains tab delimited records.  The first column is the ID number of the FAST record that the term comes from.  The second column is the MARC Authorities field that the term came from.  The third column is the term

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-10 Thread LeVan,Ralph
Subject: RE: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service We've made some progress on this topic. I have available a list of our FAST subject headings. They are derived from LCSH and may be of some use. The folks that produced this file are working on producing a similar file

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-10 Thread Ethan Gruber
Subject: RE: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service We've made some progress on this topic. I have available a list of our FAST subject headings. They are derived from LCSH and may be of some use. The folks that produced this file are working on producing a similar

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-10 Thread LeVan,Ralph
: Thursday, December 10, 2009 4:35 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service Nice work, Ralph. That's really slick. I have all the subject terms in the solr index, but I would like to eventually integrate the Worldcat data

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-10 Thread Ya'aqov Ziso
/FAST/AutoSuggestFAST.zip Let me know if you have any problems or questions. Ralph -Original Message- From: LeVan,Ralph Sent: Thursday, December 10, 2009 11:12 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: RE: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service We've

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-10 Thread LeVan,Ralph
[mailto:code4...@listserv.nd.edu] On Behalf Of Ya'aqov Ziso Sent: Thursday, December 10, 2009 4:49 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service O Holy Night, O HOCLC-ly Joy, thanks for the gifts Ralph! at http://orlabs.oclc.org/FAST

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-08 Thread Keith Jenkins
On Mon, Dec 7, 2009 at 5:56 PM, Ed Summers e...@pobox.com wrote: It would be great to have some external dataset to use in ranking LCSH suggestions at id.loc.gov. But at the moment it's a simple mysql db loaded up with some MARC LCSH data. I guess it could do something smart with PageRank-like

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-08 Thread Karen Coyle
Quoting Keith Jenkins k...@cornell.edu: The frequency of an LCSH term within the LC catalog could also be useful for ranking, although I'm not sure if such data would be readily available. Couple of things: first, what we have at id.loc.gov is NOT LCSH, but a copy of the LC subject

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-08 Thread Ethan Gruber
If that isn't LCSH, then is the entirety of LCSH available electronically in some capacity (at least available in some easily accessible file or files that can be processed)? Ethan On Tue, Dec 8, 2009 at 10:16 AM, Karen Coyle li...@kcoyle.net wrote: Quoting Keith Jenkins k...@cornell.edu:

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-08 Thread Ed Summers
On Tue, Dec 8, 2009 at 10:16 AM, Karen Coyle li...@kcoyle.net wrote: Couple of things: first, what we have at id.loc.gov is NOT LCSH, but a copy of the LC subject authority file. The entries in this file form the basis for subject headings, most of which add facets to the authority entry when

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-08 Thread Ross Singer
I suppose it would be helpful to actually know the problem that is trying to be solved here (I mean, a lot of people, including myself, are throwing out solutions to a problem that's never been actually defined). Ethan, what, exactly, are you trying to do? Do you want authorized headings? Or do

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-08 Thread Ethan Gruber
I am going to integrate subject headings into an XForms application. I can work with the authorized headings. Before taking the XML file that LC provides and doing my own thing with Solr, I wanted to see if anyone had used the headings to do their own type of autosuggest. I was especially

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-08 Thread Ed Summers
On Tue, Dec 8, 2009 at 11:08 AM, Ethan Gruber ewg4x...@gmail.com wrote: my interest is how I (or other people developing their own autosuggest systems based on the subject headings) can pull updates of the master authority XML file into my index of terms. Take a look at the Atom feed for

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-08 Thread Ethan Gruber
Thanks a lot, Ed! I think that could work. On Tue, Dec 8, 2009 at 11:23 AM, Ed Summers e...@pobox.com wrote: On Tue, Dec 8, 2009 at 11:08 AM, Ethan Gruber ewg4x...@gmail.com wrote: my interest is how I (or other people developing their own autosuggest systems based on the subject headings)

[CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-07 Thread Ethan Gruber
Hi all, I have a need to integrate the LCSH terms into a web form that uses auto-suggest to control the vocabulary. Is this technically possible with the id.loc.gov service? I can curl a specific id to view the rdf, but I would need to know the specifics of the search index on the site to feed

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-07 Thread Houghton,Andrew
From: Code for Libraries [mailto:code4...@listserv.nd.edu] On Behalf Of Winona Salesky Sent: Monday, December 07, 2009 11:00 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service Quoting Ethan Gruber ewg4x...@gmail.com: I have a need

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-07 Thread Winona Salesky
We are also very interested in doing this at UVM. We have been storing the files locally as well, and it pretty cumbersome. -Winona Quoting Ethan Gruber ewg4x...@gmail.com: Hi all, I have a need to integrate the LCSH terms into a web form that uses auto-suggest to control the vocabulary.

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-07 Thread Doug Chestnut
and the id.loc.gov LCSH web service Quoting Ethan Gruber ewg4x...@gmail.com: I have a need to integrate the LCSH terms into a web form that uses auto-suggest to control the vocabulary.  Is this technically possible with the id.loc.gov service? Why can't you just add a * to the end

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-07 Thread LeVan,Ralph
Of Winona Salesky Sent: Monday, December 07, 2009 11:00 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service Quoting Ethan Gruber ewg4x...@gmail.com: I have a need to integrate the LCSH terms into a web form that uses

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-07 Thread Benjamin Florin
, 2009 at 11:05 AM, Houghton,Andrew hough...@oclc.org wrote: From: Code for Libraries [mailto:code4...@listserv.nd.edu] On Behalf Of Winona Salesky Sent: Monday, December 07, 2009 11:00 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-07 Thread Ethan Gruber
...@listserv.nd.edu] On Behalf Of Ethan Gruber Sent: Monday, December 07, 2009 11:14 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service It doesn't seem very efficient. It is taking me at least 30 seconds to load a page

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-07 Thread Ross Singer
It has an OpenSearch interface: http://id.loc.gov/authorities/opensearch But I don't think there's a way to explicitly limit to, say, the beginning of a label. lcsubjects.org has a sparql interface where you could use a regex filter on the labels:

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-07 Thread Karen Coombs
database is relatively static. Ralph -Original Message- From: Code for Libraries [mailto:code4...@listserv.nd.edu] On Behalf Of Ethan Gruber Sent: Monday, December 07, 2009 11:14 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-07 Thread Ed Summers
In the interests of all-that-is-agile, and the HolidaySeason™ I took a quick (imperfect) stab at providing some basic suggest functionality at id.loc.gov which you can find documented in the OpenSearch Description: http://id.loc.gov/authorities/opensearch/ I used the OpenSearch Suggestions

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-07 Thread Ed Summers
On Mon, Dec 7, 2009 at 11:48 AM, Ethan Gruber ewg4x...@gmail.com wrote: Ben, another problem with digestibility of the search results is that it's not XHTML, and therefore not well-formed XML, making it impossible to process with XPath. What page did you find that wasn't valid XHTML? The JSON

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-07 Thread LeVan,Ralph
and the id.loc.gov LCSH web service In the interests of all-that-is-agile, and the HolidaySeason™ I took a quick (imperfect) stab at providing some basic suggest functionality at id.loc.gov which you can find documented in the OpenSearch Description: http://id.loc.gov/authorities/opensearch

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-07 Thread Ed Summers
On Mon, Dec 7, 2009 at 3:18 PM, LeVan,Ralph le...@oclc.org wrote: That looks more like an old-style index browse than what I'd think of as a suggestion.  You've returned nothing until the user has typed enough characters to restrict the number of index terms to be returned to a rational

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-07 Thread LeVan,Ralph
-Original Message- From: Code for Libraries [mailto:code4...@listserv.nd.edu] On Behalf Of Ed Summers Sent: Monday, December 07, 2009 3:39 PM What are you using for relevancy ranking in the VIAF AutoSuggester? For VIAF, rankings are calculated based on the number of institutions

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-07 Thread Ed Summers
On Mon, Dec 7, 2009 at 3:43 PM, LeVan,Ralph le...@oclc.org wrote: For VIAF, rankings are calculated based on the number of institutions that have controlled that name and the amount of attention the institutions have given to that name (e.g. size of their respective name authority records).

Re: [CODE4LIB] Auto-suggest and the id.loc.gov LCSH web service

2009-12-07 Thread [Your Name]
How about feeding back from web request stats? Things that get pulled more often are probably more popular. It's admittedly not very clever, but it would be easy to implement... --- A. Soroka Digital Research and Scholarship R D the University of Virginia Library On Dec 7, 2009, at 5:56