Re: [CODE4LIB] LOC Subject Headings API

[Ross Singer]

Do FAST headings match anything?

I guess what I mean is, do you have data that uses FAST headings?  If not,
what is it matching?

-Ross.

On Thursday, June 6, 2013, Joshua Welker wrote:

> I finished the project. Thanks to everyone for the suggestions!
>
> I ended up using the OCLC Fast API (fast.oclc.org/searchfast/fastsuggest)
> rather than saving everything locally. Tracking down the entire LCSH
> authority listing and parsing it into a simple data format was just
> unwieldy.
>
> The search box I built suggests the LCSH terms from OCLC as well as
> LibGuides and LibraryH3lp FAQ links. jQuery UI Autocomplete is used for the
> suggestion functionality. The search box send actual searches to EBSCO
> Discovery Service. You can see it below on our homepage:
>
> https://library.sbuniv.edu
>
>
> Josh Welker
>

Re: [CODE4LIB] LOC Subject Headings API

[Joshua Welker]

I finished the project. Thanks to everyone for the suggestions!

I ended up using the OCLC Fast API (fast.oclc.org/searchfast/fastsuggest) 
rather than saving everything locally. Tracking down the entire LCSH authority 
listing and parsing it into a simple data format was just unwieldy. 

The search box I built suggests the LCSH terms from OCLC as well as LibGuides 
and LibraryH3lp FAQ links. jQuery UI Autocomplete is used for the suggestion 
functionality. The search box send actual searches to EBSCO Discovery Service. 
You can see it below on our homepage: 

https://library.sbuniv.edu


Josh Welker

Re: [CODE4LIB] LOC Subject Headings API

[Karen Coyle]

Great, Ralph, thanks. I think that the 'pre-coordinated' aspect of LCSH 
makes it very unwieldy for auto-suggest. FAST has some great untapped 
potential.


kc

On Thu Jun  6 08:00:25 2013, LeVan,Ralph wrote:

There's also an autosuggester for FAST.

http://oclc.org/developer/services/assignfast

Ralph

-Original Message-
From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Karen 
Coyle
Sent: Wednesday, June 05, 2013 4:23 PM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: LOC Subject Headings API

If you don't have to use LCSH... the Agrovoc thesaurus has a term suggester API:

try http://foris.fao.org/agrovoc/

It's actually easier to use than LCSH because the terms are not pre-coordinated.

kc

On 6/5/13 9:58 AM, Joshua Welker wrote:

Hmm, that is pretty smart. I am actually hoping to roll this whole thing into a 
plugin for Wordpress/Drupal, so if possible I want to avoid using anything that 
is going to require server configuration (ie setting up Solr). But I bet I 
could just roll all the LCSH data into an SQLite file and then search it with 
PHP on the server.

This might work. Thanks!

Josh Welker


-Original Message-
From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf
Of Ethan Gruber
Sent: Wednesday, June 05, 2013 11:51 AM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: [CODE4LIB] LOC Subject Headings API

I once put all of the LCSH headings into a local Solr index and used 
TermsComponent to power autosuggest.  It was really fast.

Ethan


On Wed, Jun 5, 2013 at 12:47 PM, Joshua Welker  wrote:


I realized since I made that comment that the API is designed to give
the top 10 subject heading suggestions rather than all of them.

So that part is fine. But I am once again unsure if the API will work
for me. I am creating a mashup of several data sources for my
auto-suggest feature, and I am having a hard time dynamically adding
the results from the LOC Suggest API to the existing collection of
data that is used to populate my jQuery UI Autocomplete field.
Ideally, I'd like to be able to have all the LC Subject Heading data
cached on my server so that I can build my autocomplete data source
one time rather than having to deal with dynamically adding, sorting,
etc. But then the problem I run into is that the LCSH master file is so big 
that it basically crashes the server.

That's why I'm thinking I might have to give up on this project.

Josh Welker


-Original Message-
From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf
Of Michael J. Giarlo
Sent: Wednesday, June 05, 2013 9:59 AM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: [CODE4LIB] LOC Subject Headings API

Josh,

Can you say more about how the API isn't behaving as you expected it to?

-Mike



On Wed, Jun 5, 2013 at 10:37 AM, Joshua Welker  wrote:


I went with this method and made some good progress, but the results
the API was returning were not what I expected. I might have to give
up on this project.

Josh Welker


-Original Message-
From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf
Of Ethan Gruber
Sent: Wednesday, June 05, 2013 8:22 AM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: [CODE4LIB] LOC Subject Headings API

You'd write some javascript to query the service with every
keystroke,

e.g.

http://id.loc.gov/authorities/suggest/?q=Hi replies with subjects
beginning with "hi*"  It looks like covo.js supports LCSH, so you
could look into that.

Ethan


On Wed, Jun 5, 2013 at 9:13 AM, Joshua Welker 

wrote:

This would work, except I would need a way to get all the subjects
rather than just biology. Any idea how to do that? I tried removing
the querystring from the URL and changing "Biology" in the URL to ""
with no success.

Josh Welker


-Original Message-
From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On
Behalf Of Michael J. Giarlo
Sent: Tuesday, June 04, 2013 7:05 PM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: [CODE4LIB] LOC Subject Headings API

How about id.loc.gov's OpenSearch-powered autosuggest feature?

mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology
["Biology",["Biology","Biology Colloquium","Biology Curators'
Group","Biology Databook Editorial Board (U.S.)","Biology and Earth
Sciences Teaching Institute","Biology and Management of True Fir in
the Pacific Northwest Symposium (1981 : Seattle, Wash.)","Biology
and Resource Management Program (Alaska Cooperative Park Studies
Unit)","Biology and behavior series","Biology and environment
(Macmillan Press)","Biology and management of old-growth
forests"],["1
result","1 result","1 result","1
result","1 result","1 result","1 result","1 result","1 result","1
result"],[&

Re: [CODE4LIB] LOC Subject Headings API

[Joshua Welker]

I think I prefer the FAST auto-suggest results to the LOC one. Thanks!

Josh Welker


-Original Message-
From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of 
LeVan,Ralph
Sent: Thursday, June 06, 2013 10:00 AM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: [CODE4LIB] LOC Subject Headings API

There's also an autosuggester for FAST.

http://oclc.org/developer/services/assignfast

Ralph

-Original Message-
From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Karen 
Coyle
Sent: Wednesday, June 05, 2013 4:23 PM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: LOC Subject Headings API

If you don't have to use LCSH... the Agrovoc thesaurus has a term suggester API:

try http://foris.fao.org/agrovoc/

It's actually easier to use than LCSH because the terms are not pre-coordinated.

kc

On 6/5/13 9:58 AM, Joshua Welker wrote:
> Hmm, that is pretty smart. I am actually hoping to roll this whole thing into 
> a plugin for Wordpress/Drupal, so if possible I want to avoid using anything 
> that is going to require server configuration (ie setting up Solr). But I bet 
> I could just roll all the LCSH data into an SQLite file and then search it 
> with PHP on the server.
>
> This might work. Thanks!
>
> Josh Welker
>
>
> -Original Message-
> From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf 
> Of Ethan Gruber
> Sent: Wednesday, June 05, 2013 11:51 AM
> To: CODE4LIB@LISTSERV.ND.EDU
> Subject: Re: [CODE4LIB] LOC Subject Headings API
>
> I once put all of the LCSH headings into a local Solr index and used 
> TermsComponent to power autosuggest.  It was really fast.
>
> Ethan
>
>
> On Wed, Jun 5, 2013 at 12:47 PM, Joshua Welker  wrote:
>
>> I realized since I made that comment that the API is designed to give 
>> the top 10 subject heading suggestions rather than all of them.
>>
>> So that part is fine. But I am once again unsure if the API will work 
>> for me. I am creating a mashup of several data sources for my 
>> auto-suggest feature, and I am having a hard time dynamically adding 
>> the results from the LOC Suggest API to the existing collection of 
>> data that is used to populate my jQuery UI Autocomplete field.
>> Ideally, I'd like to be able to have all the LC Subject Heading data 
>> cached on my server so that I can build my autocomplete data source 
>> one time rather than having to deal with dynamically adding, sorting, 
>> etc. But then the problem I run into is that the LCSH master file is so big 
>> that it basically crashes the server.
>>
>> That's why I'm thinking I might have to give up on this project.
>>
>> Josh Welker
>>
>>
>> -Original Message-
>> From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf 
>> Of Michael J. Giarlo
>> Sent: Wednesday, June 05, 2013 9:59 AM
>> To: CODE4LIB@LISTSERV.ND.EDU
>> Subject: Re: [CODE4LIB] LOC Subject Headings API
>>
>> Josh,
>>
>> Can you say more about how the API isn't behaving as you expected it to?
>>
>> -Mike
>>
>>
>>
>> On Wed, Jun 5, 2013 at 10:37 AM, Joshua Welker  wrote:
>>
>>> I went with this method and made some good progress, but the results 
>>> the API was returning were not what I expected. I might have to give 
>>> up on this project.
>>>
>>> Josh Welker
>>>
>>>
>>> -Original Message-
>>> From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf 
>>> Of Ethan Gruber
>>> Sent: Wednesday, June 05, 2013 8:22 AM
>>> To: CODE4LIB@LISTSERV.ND.EDU
>>> Subject: Re: [CODE4LIB] LOC Subject Headings API
>>>
>>> You'd write some javascript to query the service with every 
>>> keystroke,
>> e.g.
>>> http://id.loc.gov/authorities/suggest/?q=Hi replies with subjects 
>>> beginning with "hi*"  It looks like covo.js supports LCSH, so you 
>>> could look into that.
>>>
>>> Ethan
>>>
>>>
>>> On Wed, Jun 5, 2013 at 9:13 AM, Joshua Welker 
>> wrote:
>>>> This would work, except I would need a way to get all the subjects 
>>>> rather than just biology. Any idea how to do that? I tried removing 
>>>> the querystring from the URL and changing "Biology" in the URL to ""
>>>> with no success.
>>>>
>>>> Josh Welker
>>>>
>>>>
>>>> -Original Message-
>>>> From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On 
>>>> Behalf Of Michael J. Gia

Re: [CODE4LIB] LOC Subject Headings API

[LeVan,Ralph]

There's also an autosuggester for FAST.

http://oclc.org/developer/services/assignfast

Ralph

-Original Message-
From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Karen 
Coyle
Sent: Wednesday, June 05, 2013 4:23 PM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: LOC Subject Headings API

If you don't have to use LCSH... the Agrovoc thesaurus has a term suggester API:

try http://foris.fao.org/agrovoc/

It's actually easier to use than LCSH because the terms are not pre-coordinated.

kc

On 6/5/13 9:58 AM, Joshua Welker wrote:
> Hmm, that is pretty smart. I am actually hoping to roll this whole thing into 
> a plugin for Wordpress/Drupal, so if possible I want to avoid using anything 
> that is going to require server configuration (ie setting up Solr). But I bet 
> I could just roll all the LCSH data into an SQLite file and then search it 
> with PHP on the server.
>
> This might work. Thanks!
>
> Josh Welker
>
>
> -Original Message-
> From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf 
> Of Ethan Gruber
> Sent: Wednesday, June 05, 2013 11:51 AM
> To: CODE4LIB@LISTSERV.ND.EDU
> Subject: Re: [CODE4LIB] LOC Subject Headings API
>
> I once put all of the LCSH headings into a local Solr index and used 
> TermsComponent to power autosuggest.  It was really fast.
>
> Ethan
>
>
> On Wed, Jun 5, 2013 at 12:47 PM, Joshua Welker  wrote:
>
>> I realized since I made that comment that the API is designed to give 
>> the top 10 subject heading suggestions rather than all of them.
>>
>> So that part is fine. But I am once again unsure if the API will work 
>> for me. I am creating a mashup of several data sources for my 
>> auto-suggest feature, and I am having a hard time dynamically adding 
>> the results from the LOC Suggest API to the existing collection of 
>> data that is used to populate my jQuery UI Autocomplete field.
>> Ideally, I'd like to be able to have all the LC Subject Heading data 
>> cached on my server so that I can build my autocomplete data source 
>> one time rather than having to deal with dynamically adding, sorting, 
>> etc. But then the problem I run into is that the LCSH master file is so big 
>> that it basically crashes the server.
>>
>> That's why I'm thinking I might have to give up on this project.
>>
>> Josh Welker
>>
>>
>> -Original Message-
>> From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf 
>> Of Michael J. Giarlo
>> Sent: Wednesday, June 05, 2013 9:59 AM
>> To: CODE4LIB@LISTSERV.ND.EDU
>> Subject: Re: [CODE4LIB] LOC Subject Headings API
>>
>> Josh,
>>
>> Can you say more about how the API isn't behaving as you expected it to?
>>
>> -Mike
>>
>>
>>
>> On Wed, Jun 5, 2013 at 10:37 AM, Joshua Welker  wrote:
>>
>>> I went with this method and made some good progress, but the results 
>>> the API was returning were not what I expected. I might have to give 
>>> up on this project.
>>>
>>> Josh Welker
>>>
>>>
>>> -Original Message-
>>> From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf 
>>> Of Ethan Gruber
>>> Sent: Wednesday, June 05, 2013 8:22 AM
>>> To: CODE4LIB@LISTSERV.ND.EDU
>>> Subject: Re: [CODE4LIB] LOC Subject Headings API
>>>
>>> You'd write some javascript to query the service with every 
>>> keystroke,
>> e.g.
>>> http://id.loc.gov/authorities/suggest/?q=Hi replies with subjects 
>>> beginning with "hi*"  It looks like covo.js supports LCSH, so you 
>>> could look into that.
>>>
>>> Ethan
>>>
>>>
>>> On Wed, Jun 5, 2013 at 9:13 AM, Joshua Welker 
>> wrote:
>>>> This would work, except I would need a way to get all the subjects 
>>>> rather than just biology. Any idea how to do that? I tried removing 
>>>> the querystring from the URL and changing "Biology" in the URL to ""
>>>> with no success.
>>>>
>>>> Josh Welker
>>>>
>>>>
>>>> -Original Message-
>>>> From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On 
>>>> Behalf Of Michael J. Giarlo
>>>> Sent: Tuesday, June 04, 2013 7:05 PM
>>>> To: CODE4LIB@LISTSERV.ND.EDU
>>>> Subject: Re: [CODE4LIB] LOC Subject Headings API
>>>>
>>>> How about id.loc.gov's OpenSearch-powered autosuggest feature?
>>>>
>>>> mjg@

Re: [CODE4LIB] LOC Subject Headings API

[Karen Coyle]

If you don't have to use LCSH... the Agrovoc thesaurus has a term 
suggester API:


try http://foris.fao.org/agrovoc/

It's actually easier to use than LCSH because the terms are not 
pre-coordinated.


kc

On 6/5/13 9:58 AM, Joshua Welker wrote:

Hmm, that is pretty smart. I am actually hoping to roll this whole thing into a 
plugin for Wordpress/Drupal, so if possible I want to avoid using anything that 
is going to require server configuration (ie setting up Solr). But I bet I 
could just roll all the LCSH data into an SQLite file and then search it with 
PHP on the server.

This might work. Thanks!

Josh Welker


-Original Message-
From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Ethan 
Gruber
Sent: Wednesday, June 05, 2013 11:51 AM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: [CODE4LIB] LOC Subject Headings API

I once put all of the LCSH headings into a local Solr index and used 
TermsComponent to power autosuggest.  It was really fast.

Ethan


On Wed, Jun 5, 2013 at 12:47 PM, Joshua Welker  wrote:


I realized since I made that comment that the API is designed to give
the top 10 subject heading suggestions rather than all of them.

So that part is fine. But I am once again unsure if the API will work
for me. I am creating a mashup of several data sources for my
auto-suggest feature, and I am having a hard time dynamically adding
the results from the LOC Suggest API to the existing collection of
data that is used to populate my jQuery UI Autocomplete field.
Ideally, I'd like to be able to have all the LC Subject Heading data
cached on my server so that I can build my autocomplete data source
one time rather than having to deal with dynamically adding, sorting,
etc. But then the problem I run into is that the LCSH master file is so big 
that it basically crashes the server.

That's why I'm thinking I might have to give up on this project.

Josh Welker


-Original Message-
From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf
Of Michael J. Giarlo
Sent: Wednesday, June 05, 2013 9:59 AM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: [CODE4LIB] LOC Subject Headings API

Josh,

Can you say more about how the API isn't behaving as you expected it to?

-Mike



On Wed, Jun 5, 2013 at 10:37 AM, Joshua Welker  wrote:


I went with this method and made some good progress, but the results
the API was returning were not what I expected. I might have to give
up on this project.

Josh Welker


-Original Message-
From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf
Of Ethan Gruber
Sent: Wednesday, June 05, 2013 8:22 AM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: [CODE4LIB] LOC Subject Headings API

You'd write some javascript to query the service with every
keystroke,

e.g.

http://id.loc.gov/authorities/suggest/?q=Hi replies with subjects
beginning with "hi*"  It looks like covo.js supports LCSH, so you
could look into that.

Ethan


On Wed, Jun 5, 2013 at 9:13 AM, Joshua Welker 

wrote:

This would work, except I would need a way to get all the subjects
rather than just biology. Any idea how to do that? I tried
removing the querystring from the URL and changing "Biology" in the URL to ""
with no success.

Josh Welker


-Original Message-
From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On
Behalf Of Michael J. Giarlo
Sent: Tuesday, June 04, 2013 7:05 PM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: [CODE4LIB] LOC Subject Headings API

How about id.loc.gov's OpenSearch-powered autosuggest feature?

mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology
["Biology",["Biology","Biology Colloquium","Biology Curators'
Group","Biology Databook Editorial Board (U.S.)","Biology and
Earth Sciences Teaching Institute","Biology and Management of True
Fir in the Pacific Northwest Symposium (1981 : Seattle,
Wash.)","Biology and Resource Management Program (Alaska
Cooperative Park Studies Unit)","Biology and behavior
series","Biology and environment (Macmillan Press)","Biology and
management of old-growth
forests"],["1
result","1 result","1 result","1
result","1 result","1 result","1 result","1 result","1 result","1
result"],["http://id.loc.gov/authorities/subjects/sh85014203",";
http://id.loc.gov/authorities/names/n79006962",";
http://id.loc.gov/authorities/names/n90639795",";
http://id.loc.gov/authorities/names/n85100466",";
http://id.loc.gov/authorities/names/nr97041787",";
http://id.loc.gov/authorities/names/n85276541",";
http://id.loc.gov/authorities/names/n82057525",";
http://id.loc.gov/authorities/names/n90605518",";
http://id.loc.gov/authorities/names/nr2001011

Re: [CODE4LIB] LOC Subject Headings API

[Joshua Welker]

That's a good point, but this is a discovery search box (EDS) that will be 
searching a lot of database content as well as local holdings, so I would 
rather have too many search terms than just the ones in our catalog to the 
exclusion of online content.

Josh Welker


-Original Message-
From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Keith 
Jenkins
Sent: Wednesday, June 05, 2013 2:14 PM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: [CODE4LIB] LOC Subject Headings API

> the LCSH master file is so big that it basically crashes the server.

Do you really want to use the full LCSH, or just the subset that exists in your 
local catalog?

Or, to put it another way: do you really want to provide the user with search 
suggestions that will result in zero hits?

Keith

Re: [CODE4LIB] LOC Subject Headings API

[Keith Jenkins]

> the LCSH master file is so big that it basically crashes the server.

Do you really want to use the full LCSH, or just the subset that
exists in your local catalog?

Or, to put it another way: do you really want to provide the user with
search suggestions that will result in zero hits?

Keith

Re: [CODE4LIB] LOC Subject Headings API

[Joshua Welker]

Hmm, that is pretty smart. I am actually hoping to roll this whole thing into a 
plugin for Wordpress/Drupal, so if possible I want to avoid using anything that 
is going to require server configuration (ie setting up Solr). But I bet I 
could just roll all the LCSH data into an SQLite file and then search it with 
PHP on the server. 

This might work. Thanks!

Josh Welker


-Original Message-
From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Ethan 
Gruber
Sent: Wednesday, June 05, 2013 11:51 AM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: [CODE4LIB] LOC Subject Headings API

I once put all of the LCSH headings into a local Solr index and used 
TermsComponent to power autosuggest.  It was really fast.

Ethan


On Wed, Jun 5, 2013 at 12:47 PM, Joshua Welker  wrote:

> I realized since I made that comment that the API is designed to give 
> the top 10 subject heading suggestions rather than all of them.
>
> So that part is fine. But I am once again unsure if the API will work 
> for me. I am creating a mashup of several data sources for my 
> auto-suggest feature, and I am having a hard time dynamically adding 
> the results from the LOC Suggest API to the existing collection of 
> data that is used to populate my jQuery UI Autocomplete field. 
> Ideally, I'd like to be able to have all the LC Subject Heading data 
> cached on my server so that I can build my autocomplete data source 
> one time rather than having to deal with dynamically adding, sorting, 
> etc. But then the problem I run into is that the LCSH master file is so big 
> that it basically crashes the server.
>
> That's why I'm thinking I might have to give up on this project.
>
> Josh Welker
>
>
> -Original Message-
> From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf 
> Of Michael J. Giarlo
> Sent: Wednesday, June 05, 2013 9:59 AM
> To: CODE4LIB@LISTSERV.ND.EDU
> Subject: Re: [CODE4LIB] LOC Subject Headings API
>
> Josh,
>
> Can you say more about how the API isn't behaving as you expected it to?
>
> -Mike
>
>
>
> On Wed, Jun 5, 2013 at 10:37 AM, Joshua Welker  wrote:
>
> > I went with this method and made some good progress, but the results 
> > the API was returning were not what I expected. I might have to give 
> > up on this project.
> >
> > Josh Welker
> >
> >
> > -Original Message-
> > From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf 
> > Of Ethan Gruber
> > Sent: Wednesday, June 05, 2013 8:22 AM
> > To: CODE4LIB@LISTSERV.ND.EDU
> > Subject: Re: [CODE4LIB] LOC Subject Headings API
> >
> > You'd write some javascript to query the service with every 
> > keystroke,
> e.g.
> > http://id.loc.gov/authorities/suggest/?q=Hi replies with subjects 
> > beginning with "hi*"  It looks like covo.js supports LCSH, so you 
> > could look into that.
> >
> > Ethan
> >
> >
> > On Wed, Jun 5, 2013 at 9:13 AM, Joshua Welker 
> wrote:
> >
> > > This would work, except I would need a way to get all the subjects 
> > > rather than just biology. Any idea how to do that? I tried 
> > > removing the querystring from the URL and changing "Biology" in the URL 
> > > to ""
> > > with no success.
> > >
> > > Josh Welker
> > >
> > >
> > > -Original Message-
> > > From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On 
> > > Behalf Of Michael J. Giarlo
> > > Sent: Tuesday, June 04, 2013 7:05 PM
> > > To: CODE4LIB@LISTSERV.ND.EDU
> > > Subject: Re: [CODE4LIB] LOC Subject Headings API
> > >
> > > How about id.loc.gov's OpenSearch-powered autosuggest feature?
> > >
> > > mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology
> > > ["Biology",["Biology","Biology Colloquium","Biology Curators'
> > > Group","Biology Databook Editorial Board (U.S.)","Biology and 
> > > Earth Sciences Teaching Institute","Biology and Management of True 
> > > Fir in the Pacific Northwest Symposium (1981 : Seattle, 
> > > Wash.)","Biology and Resource Management Program (Alaska 
> > > Cooperative Park Studies Unit)","Biology and behavior 
> > > series","Biology and environment (Macmillan Press)","Biology and 
> > > management of old-growth
> > > forests"],["1
> > > result","1 result","1 result","1
> > > result","1 result","1 result&quo

Re: [CODE4LIB] LOC Subject Headings API

[Aaron Coburn]

As a somewhat different approach to this, you may wish to consider using Apache 
Stanbol [1].

Briefly, Stanbol is a system for building semantic web applications. Among 
other things, it allows you to import the LOC data as n-triples (either in SKOS 
or MADS/RDF format) [2]. The data is stored in a Solr index and you can query 
it over HTTP, so it ends up being really, really fast. Plus, all of the RDF 
relationships are stored in the index, so you can query the API in a lot of 
different ways. The iks-project has a demo version of stanbol [3] with a 
variety of "locally managed entity hubs" -- they don't have LC subject 
headings, but they do include a lot of other data collections.

I use Stanbol fairly extensively for a number of these types of applications, 
though I don't expose the API directly to the web. In our system, we have the 
LOC subject headings, LOC name authority records and the full geonames 
database. If you do run this, you will want to put it on a system with a good 
amount of memory.

Regards,
Aaron


[1] http://stanbol.apache.org
[2] https://stanbol.apache.org/docs/trunk/customvocabulary.html
[3] http://dev.iks-project.eu:8081/entityhub




--
Aaron Coburn
Systems Administrator and Programmer
Academic Technology Services, Amherst College
acob...@amherst.edu






On Jun 4, 2013, at 7:31 PM, Joshua Welker 
mailto:jwel...@sbuniv.edu>> wrote:

I am building an auto-suggest feature into our library's search box, and I am 
wanting to include LOC subject headings in my suggestions list. Does anyone 
know of any web service that allows for automated harvesting of LOC Subject 
Headings? I am also looking for name authorities, for that matter. Any format 
will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have spent a while 
Googling with no luck, but this seems like the sort of general-purpose thing 
that a lot of people would be interested in. I feel like I must be missing 
something. Any help is appreciated.

Josh Welker
Electronic/Media Services Librarian
College Liaison
University Libraries
Southwest Baptist University
417.328.1624

Re: [CODE4LIB] LOC Subject Headings API

[Ethan Gruber]

I once put all of the LCSH headings into a local Solr index and used
TermsComponent to power autosuggest.  It was really fast.

Ethan


On Wed, Jun 5, 2013 at 12:47 PM, Joshua Welker  wrote:

> I realized since I made that comment that the API is designed to give the
> top 10 subject heading suggestions rather than all of them.
>
> So that part is fine. But I am once again unsure if the API will work for
> me. I am creating a mashup of several data sources for my auto-suggest
> feature, and I am having a hard time dynamically adding the results from
> the LOC Suggest API to the existing collection of data that is used to
> populate my jQuery UI Autocomplete field. Ideally, I'd like to be able to
> have all the LC Subject Heading data cached on my server so that I can
> build my autocomplete data source one time rather than having to deal with
> dynamically adding, sorting, etc. But then the problem I run into is that
> the LCSH master file is so big that it basically crashes the server.
>
> That's why I'm thinking I might have to give up on this project.
>
> Josh Welker
>
>
> -Original Message-
> From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of
> Michael J. Giarlo
> Sent: Wednesday, June 05, 2013 9:59 AM
> To: CODE4LIB@LISTSERV.ND.EDU
> Subject: Re: [CODE4LIB] LOC Subject Headings API
>
> Josh,
>
> Can you say more about how the API isn't behaving as you expected it to?
>
> -Mike
>
>
>
> On Wed, Jun 5, 2013 at 10:37 AM, Joshua Welker  wrote:
>
> > I went with this method and made some good progress, but the results
> > the API was returning were not what I expected. I might have to give
> > up on this project.
> >
> > Josh Welker
> >
> >
> > -Original Message-
> > From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf
> > Of Ethan Gruber
> > Sent: Wednesday, June 05, 2013 8:22 AM
> > To: CODE4LIB@LISTSERV.ND.EDU
> > Subject: Re: [CODE4LIB] LOC Subject Headings API
> >
> > You'd write some javascript to query the service with every keystroke,
> e.g.
> > http://id.loc.gov/authorities/suggest/?q=Hi replies with subjects
> > beginning with "hi*"  It looks like covo.js supports LCSH, so you
> > could look into that.
> >
> > Ethan
> >
> >
> > On Wed, Jun 5, 2013 at 9:13 AM, Joshua Welker 
> wrote:
> >
> > > This would work, except I would need a way to get all the subjects
> > > rather than just biology. Any idea how to do that? I tried removing
> > > the querystring from the URL and changing "Biology" in the URL to ""
> > > with no success.
> > >
> > > Josh Welker
> > >
> > >
> > > -Original Message-
> > > From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf
> > > Of Michael J. Giarlo
> > > Sent: Tuesday, June 04, 2013 7:05 PM
> > > To: CODE4LIB@LISTSERV.ND.EDU
> > > Subject: Re: [CODE4LIB] LOC Subject Headings API
> > >
> > > How about id.loc.gov's OpenSearch-powered autosuggest feature?
> > >
> > > mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology
> > > ["Biology",["Biology","Biology Colloquium","Biology Curators'
> > > Group","Biology Databook Editorial Board (U.S.)","Biology and Earth
> > > Sciences Teaching Institute","Biology and Management of True Fir in
> > > the Pacific Northwest Symposium (1981 : Seattle, Wash.)","Biology
> > > and Resource Management Program (Alaska Cooperative Park Studies
> > > Unit)","Biology and behavior series","Biology and environment
> > > (Macmillan Press)","Biology and management of old-growth
> > > forests"],["1
> > > result","1 result","1 result","1
> > > result","1 result","1 result","1 result","1 result","1 result","1
> > > result"],["http://id.loc.gov/authorities/subjects/sh85014203",";
> > > http://id.loc.gov/authorities/names/n79006962",";
> > > http://id.loc.gov/authorities/names/n90639795",";
> > > http://id.loc.gov/authorities/names/n85100466",";
> > > http://id.loc.gov/authorities/names/nr97041787",";
> > > http://id.loc.gov/authorities/names/n85276541",";
> > > http://id.loc.gov/authorities/names/n82057525",";
> > > http://id.loc.gov/authorities/names/n90605

Re: [CODE4LIB] LOC Subject Headings API

[Joshua Welker]

I realized since I made that comment that the API is designed to give the top 
10 subject heading suggestions rather than all of them. 

So that part is fine. But I am once again unsure if the API will work for me. I 
am creating a mashup of several data sources for my auto-suggest feature, and I 
am having a hard time dynamically adding the results from the LOC Suggest API 
to the existing collection of data that is used to populate my jQuery UI 
Autocomplete field. Ideally, I'd like to be able to have all the LC Subject 
Heading data cached on my server so that I can build my autocomplete data 
source one time rather than having to deal with dynamically adding, sorting, 
etc. But then the problem I run into is that the LCSH master file is so big 
that it basically crashes the server.

That's why I'm thinking I might have to give up on this project.

Josh Welker


-Original Message-
From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Michael 
J. Giarlo
Sent: Wednesday, June 05, 2013 9:59 AM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: [CODE4LIB] LOC Subject Headings API

Josh,

Can you say more about how the API isn't behaving as you expected it to?

-Mike



On Wed, Jun 5, 2013 at 10:37 AM, Joshua Welker  wrote:

> I went with this method and made some good progress, but the results 
> the API was returning were not what I expected. I might have to give 
> up on this project.
>
> Josh Welker
>
>
> -Original Message-
> From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf 
> Of Ethan Gruber
> Sent: Wednesday, June 05, 2013 8:22 AM
> To: CODE4LIB@LISTSERV.ND.EDU
> Subject: Re: [CODE4LIB] LOC Subject Headings API
>
> You'd write some javascript to query the service with every keystroke, e.g.
> http://id.loc.gov/authorities/suggest/?q=Hi replies with subjects 
> beginning with "hi*"  It looks like covo.js supports LCSH, so you 
> could look into that.
>
> Ethan
>
>
> On Wed, Jun 5, 2013 at 9:13 AM, Joshua Welker  wrote:
>
> > This would work, except I would need a way to get all the subjects 
> > rather than just biology. Any idea how to do that? I tried removing 
> > the querystring from the URL and changing "Biology" in the URL to ""
> > with no success.
> >
> > Josh Welker
> >
> >
> > -Original Message-
> > From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf 
> > Of Michael J. Giarlo
> > Sent: Tuesday, June 04, 2013 7:05 PM
> > To: CODE4LIB@LISTSERV.ND.EDU
> > Subject: Re: [CODE4LIB] LOC Subject Headings API
> >
> > How about id.loc.gov's OpenSearch-powered autosuggest feature?
> >
> > mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology
> > ["Biology",["Biology","Biology Colloquium","Biology Curators'
> > Group","Biology Databook Editorial Board (U.S.)","Biology and Earth 
> > Sciences Teaching Institute","Biology and Management of True Fir in 
> > the Pacific Northwest Symposium (1981 : Seattle, Wash.)","Biology 
> > and Resource Management Program (Alaska Cooperative Park Studies 
> > Unit)","Biology and behavior series","Biology and environment 
> > (Macmillan Press)","Biology and management of old-growth 
> > forests"],["1
> > result","1 result","1 result","1
> > result","1 result","1 result","1 result","1 result","1 result","1 
> > result"],["http://id.loc.gov/authorities/subjects/sh85014203",";
> > http://id.loc.gov/authorities/names/n79006962",";
> > http://id.loc.gov/authorities/names/n90639795",";
> > http://id.loc.gov/authorities/names/n85100466",";
> > http://id.loc.gov/authorities/names/nr97041787",";
> > http://id.loc.gov/authorities/names/n85276541",";
> > http://id.loc.gov/authorities/names/n82057525",";
> > http://id.loc.gov/authorities/names/n90605518",";
> > http://id.loc.gov/authorities/names/nr2001011448",";
> > http://id.loc.gov/authorities/names/no94028058";]]
> >
> > -Mike
> >
> >
> >
> > On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker 
> wrote:
> >
> > > I did see that, and it will work in a pinch. But the authority 
> > > file is pretty massive--almost 1GB-- and would be difficult to 
> > > handle in an automated way and without completely killing my web 
> > > app due to memory constraints while searching the file. Thanks, though.
> > >

Re: [CODE4LIB] LOC Subject Headings API

[Amanda French]

Hi Josh,

You might ask on the Omeka developers' list about how the Omeka 
development team created their "LC Suggest" plugin -- they could 
probably give you tips. Here's the listserv: 
https://groups.google.com/forum/?fromgroups#!forum/omeka-dev and here's 
a description of the plugin: 
http://omeka.org/codex/Plugins/Library_of_Congress_Suggest


Amanda

Amanda L. French, Ph.D.
http://amandafrench.net

Email: ama...@amandafrench.net
Cell: 720-530-7515
Twitter: @amandafrench
Skype: amandafrenchphd
AIM: habitrailgirl

On 6/4/13 11:00 PM, CODE4LIB automatic digest system wrote:

--

Date:Tue, 4 Jun 2013 23:31:18 +
From:Joshua Welker
Subject: LOC Subject Headings API

I am building an auto-suggest feature into our library's search box, and I am 
wanting to include LOC subject headings in my suggestions list. Does anyone 
know of any web service that allows for automated harvesting of LOC Subject 
Headings? I am also looking for name authorities, for that matter. Any format 
will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have spent a while 
Googling with no luck, but this seems like the sort of general-purpose thing 
that a lot of people would be interested in. I feel like I must be missing 
something. Any help is appreciated.

Josh Welker
Electronic/Media Services Librarian
College Liaison
University Libraries
Southwest Baptist University
417.328.1624

Re: [CODE4LIB] LOC Subject Headings API

[Michael J. Giarlo]

Josh,

Can you say more about how the API isn't behaving as you expected it to?

-Mike



On Wed, Jun 5, 2013 at 10:37 AM, Joshua Welker  wrote:

> I went with this method and made some good progress, but the results the
> API was returning were not what I expected. I might have to give up on this
> project.
>
> Josh Welker
>
>
> -Original Message-
> From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of
> Ethan Gruber
> Sent: Wednesday, June 05, 2013 8:22 AM
> To: CODE4LIB@LISTSERV.ND.EDU
> Subject: Re: [CODE4LIB] LOC Subject Headings API
>
> You'd write some javascript to query the service with every keystroke, e.g.
> http://id.loc.gov/authorities/suggest/?q=Hi replies with subjects
> beginning with "hi*"  It looks like covo.js supports LCSH, so you could
> look into that.
>
> Ethan
>
>
> On Wed, Jun 5, 2013 at 9:13 AM, Joshua Welker  wrote:
>
> > This would work, except I would need a way to get all the subjects
> > rather than just biology. Any idea how to do that? I tried removing
> > the querystring from the URL and changing "Biology" in the URL to ""
> > with no success.
> >
> > Josh Welker
> >
> >
> > -Original Message-
> > From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf
> > Of Michael J. Giarlo
> > Sent: Tuesday, June 04, 2013 7:05 PM
> > To: CODE4LIB@LISTSERV.ND.EDU
> > Subject: Re: [CODE4LIB] LOC Subject Headings API
> >
> > How about id.loc.gov's OpenSearch-powered autosuggest feature?
> >
> > mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology
> > ["Biology",["Biology","Biology Colloquium","Biology Curators'
> > Group","Biology Databook Editorial Board (U.S.)","Biology and Earth
> > Sciences Teaching Institute","Biology and Management of True Fir in
> > the Pacific Northwest Symposium (1981 : Seattle, Wash.)","Biology and
> > Resource Management Program (Alaska Cooperative Park Studies
> > Unit)","Biology and behavior series","Biology and environment
> > (Macmillan Press)","Biology and management of old-growth forests"],["1
> > result","1 result","1 result","1
> > result","1 result","1 result","1 result","1 result","1 result","1
> > result"],["http://id.loc.gov/authorities/subjects/sh85014203",";
> > http://id.loc.gov/authorities/names/n79006962",";
> > http://id.loc.gov/authorities/names/n90639795",";
> > http://id.loc.gov/authorities/names/n85100466",";
> > http://id.loc.gov/authorities/names/nr97041787",";
> > http://id.loc.gov/authorities/names/n85276541",";
> > http://id.loc.gov/authorities/names/n82057525",";
> > http://id.loc.gov/authorities/names/n90605518",";
> > http://id.loc.gov/authorities/names/nr2001011448",";
> > http://id.loc.gov/authorities/names/no94028058";]]
> >
> > -Mike
> >
> >
> >
> > On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker 
> wrote:
> >
> > > I did see that, and it will work in a pinch. But the authority file
> > > is pretty massive--almost 1GB-- and would be difficult to handle in
> > > an automated way and without completely killing my web app due to
> > > memory constraints while searching the file. Thanks, though.
> > >
> > > Josh Welker
> > >
> > >
> > > -Original Message-
> > > From: Bryan Baldus [mailto:bryan.bal...@quality-books.com]
> > > Sent: Tuesday, June 04, 2013 6:39 PM
> > > To: Code for Libraries; Joshua Welker
> > > Subject: RE: LOC Subject Headings API
> > >
> > > On Tuesday, June 04, 2013 6:31 PM, Joshua Welker
> > > [jwel...@sbuniv.edu]
> > > wrote:
> > > >I am building an auto-suggest feature into our library's search
> > > >box, and
> > > I am wanting to include LOC subject headings in my suggestions list.
> > > Does anyone know of any web service that allows for automated
> > > harvesting of LOC Subject Headings? I am also looking for name
> > authorities, for that matter.
> > > Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I
> > > have spent a while Googling with no luck, but this seems like the
> > > sort of general-purpose thing that a lot of people would be interested
> in.
> > > I feel like I must be missing something. Any help is appreciated.
> > >
> > > Have you seen http://id.loc.gov/ with bulk downloads in various
> > > formats at http://id.loc.gov/download/
> > >
> > > I hope this helps,
> > >
> > > Bryan Baldus
> > > Senior Cataloger
> > > Quality Books Inc.
> > > The Best of America's Independent Presses
> > > 1-800-323-4241x402
> > > bryan.bal...@quality-books.com
> > > eij...@cpan.org
> > > http://home.comcast.net/~eijabb/
> > >
> >
>

Re: [CODE4LIB] LOC Subject Headings API

[Ford, Kevin]

> it looks like LCSH
> is moving past this string-based hierarchy in favor of one expressed in
> terms of linked data.
-- Oh, I've never received that impression.  Pre-coordination - which you 
referred to as "hierarchical sets of terms" - is alive and well.  A number of 
studies were done in the second half of the 2000s that looked at the creation 
of LCSH headings.  Pre-coordination received significant attention in these 
studies and was ultimately confirmed as a good thing.  

Who knows why the precoordinated heading that was once used for "Mexican War, 
1846-1848" was replaced, but that probably happened in 1986 (or 1991) based on 
the creation and most-resent modification times on that record.  In other 
words, at a time when the notion of Linked Data was non-existent.

Yours,
Kevin





> -Original Message-
> From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of
> Ethan Gruber
> Sent: Wednesday, June 05, 2013 9:41 AM
> To: CODE4LIB@LISTSERV.ND.EDU
> Subject: Re: [CODE4LIB] LOC Subject Headings API
> 
> Are you referring to hierarchical sets of terms, like "United States--
> History--War with Mexico, 1845-1848"?  This is an "earlier established
> term" of http://id.loc.gov/authorities/subjects/sh85140201 (now labeled
> "Mexican War, 1846-1848").  Ed Summers or Kevin Ford are in a better
> position to discuss the change of terminology, but it looks like LCSH
> is moving past this string-based hierarchy in favor of one expressed in
> terms of linked data.
> 
> Ethan
> 
> 
> On Wed, Jun 5, 2013 at 9:32 AM, Joshua Welker 
> wrote:
> 
> > I've seen those, but I can't figure out where on the id.loc.gov site
> > there is actually a URL that provides a list of authority terms. All
> > the links on the site seem to link to other pages within the site.
> >
> > Josh Welker
> >
> >
> > -Original Message-
> > From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf
> > Of Dana Pearson
> > Sent: Tuesday, June 04, 2013 6:42 PM
> > To: CODE4LIB@LISTSERV.ND.EDU
> > Subject: Re: [CODE4LIB] LOC Subject Headings API
> >
> > Joshua,
> >
> > There are different formats at LOC:
> >
> > http://id.loc.gov/authorities/subjects.html
> >
> > dana
> >
> >
> > On Tue, Jun 4, 2013 at 6:31 PM, Joshua Welker 
> wrote:
> >
> > > I am building an auto-suggest feature into our library's search box,
> > > and I am wanting to include LOC subject headings in my suggestions
> > > list. Does anyone know of any web service that allows for automated
> > > harvesting of LOC Subject Headings? I am also looking for name
> > authorities, for that matter.
> > > Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I
> > > have spent a while Googling with no luck, but this seems like the
> > > sort of general-purpose thing that a lot of people would be
> interested in.
> > > I feel like I must be missing something. Any help is appreciated.
> > >
> > > Josh Welker
> > > Electronic/Media Services Librarian
> > > College Liaison
> > > University Libraries
> > > Southwest Baptist University
> > > 417.328.1624
> > >
> >
> >
> >
> > --
> > Dana Pearson
> > dbpearsonmlis.com
> >

Re: [CODE4LIB] LOC Subject Headings API

[Joshua Welker]

I see. I was afraid that I was going to have to dive into linked data, which I 
have avoided up to this point. I will have to go that route if the suggest api 
doesn't work for me.

Josh Welker


-Original Message-
From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Ethan 
Gruber
Sent: Wednesday, June 05, 2013 8:41 AM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: [CODE4LIB] LOC Subject Headings API

Are you referring to hierarchical sets of terms, like "United 
States--History--War with Mexico, 1845-1848"?  This is an "earlier established 
term" of http://id.loc.gov/authorities/subjects/sh85140201 (now labeled 
"Mexican War, 1846-1848").  Ed Summers or Kevin Ford are in a better position 
to discuss the change of terminology, but it looks like LCSH is moving past 
this string-based hierarchy in favor of one expressed in terms of linked data.

Ethan


On Wed, Jun 5, 2013 at 9:32 AM, Joshua Welker  wrote:

> I've seen those, but I can't figure out where on the id.loc.gov site 
> there is actually a URL that provides a list of authority terms. All 
> the links on the site seem to link to other pages within the site.
>
> Josh Welker
>
>
> -Original Message-
> From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf 
> Of Dana Pearson
> Sent: Tuesday, June 04, 2013 6:42 PM
> To: CODE4LIB@LISTSERV.ND.EDU
> Subject: Re: [CODE4LIB] LOC Subject Headings API
>
> Joshua,
>
> There are different formats at LOC:
>
> http://id.loc.gov/authorities/subjects.html
>
> dana
>
>
> On Tue, Jun 4, 2013 at 6:31 PM, Joshua Welker  wrote:
>
> > I am building an auto-suggest feature into our library's search box, 
> > and I am wanting to include LOC subject headings in my suggestions 
> > list. Does anyone know of any web service that allows for automated 
> > harvesting of LOC Subject Headings? I am also looking for name
> authorities, for that matter.
> > Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I 
> > have spent a while Googling with no luck, but this seems like the 
> > sort of general-purpose thing that a lot of people would be interested in.
> > I feel like I must be missing something. Any help is appreciated.
> >
> > Josh Welker
> > Electronic/Media Services Librarian
> > College Liaison
> > University Libraries
> > Southwest Baptist University
> > 417.328.1624
> >
>
>
>
> --
> Dana Pearson
> dbpearsonmlis.com
>

Re: [CODE4LIB] LOC Subject Headings API

[Joshua Welker]

I went with this method and made some good progress, but the results the API 
was returning were not what I expected. I might have to give up on this project.

Josh Welker


-Original Message-
From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Ethan 
Gruber
Sent: Wednesday, June 05, 2013 8:22 AM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: [CODE4LIB] LOC Subject Headings API

You'd write some javascript to query the service with every keystroke, e.g.
http://id.loc.gov/authorities/suggest/?q=Hi replies with subjects beginning 
with "hi*"  It looks like covo.js supports LCSH, so you could look into that.

Ethan


On Wed, Jun 5, 2013 at 9:13 AM, Joshua Welker  wrote:

> This would work, except I would need a way to get all the subjects 
> rather than just biology. Any idea how to do that? I tried removing 
> the querystring from the URL and changing "Biology" in the URL to "" 
> with no success.
>
> Josh Welker
>
>
> -Original Message-
> From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf 
> Of Michael J. Giarlo
> Sent: Tuesday, June 04, 2013 7:05 PM
> To: CODE4LIB@LISTSERV.ND.EDU
> Subject: Re: [CODE4LIB] LOC Subject Headings API
>
> How about id.loc.gov's OpenSearch-powered autosuggest feature?
>
> mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology
> ["Biology",["Biology","Biology Colloquium","Biology Curators'
> Group","Biology Databook Editorial Board (U.S.)","Biology and Earth 
> Sciences Teaching Institute","Biology and Management of True Fir in 
> the Pacific Northwest Symposium (1981 : Seattle, Wash.)","Biology and 
> Resource Management Program (Alaska Cooperative Park Studies 
> Unit)","Biology and behavior series","Biology and environment 
> (Macmillan Press)","Biology and management of old-growth forests"],["1 
> result","1 result","1 result","1
> result","1 result","1 result","1 result","1 result","1 result","1 
> result"],["http://id.loc.gov/authorities/subjects/sh85014203",";
> http://id.loc.gov/authorities/names/n79006962",";
> http://id.loc.gov/authorities/names/n90639795",";
> http://id.loc.gov/authorities/names/n85100466",";
> http://id.loc.gov/authorities/names/nr97041787",";
> http://id.loc.gov/authorities/names/n85276541",";
> http://id.loc.gov/authorities/names/n82057525",";
> http://id.loc.gov/authorities/names/n90605518",";
> http://id.loc.gov/authorities/names/nr2001011448",";
> http://id.loc.gov/authorities/names/no94028058";]]
>
> -Mike
>
>
>
> On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker  wrote:
>
> > I did see that, and it will work in a pinch. But the authority file 
> > is pretty massive--almost 1GB-- and would be difficult to handle in 
> > an automated way and without completely killing my web app due to 
> > memory constraints while searching the file. Thanks, though.
> >
> > Josh Welker
> >
> >
> > -Original Message-
> > From: Bryan Baldus [mailto:bryan.bal...@quality-books.com]
> > Sent: Tuesday, June 04, 2013 6:39 PM
> > To: Code for Libraries; Joshua Welker
> > Subject: RE: LOC Subject Headings API
> >
> > On Tuesday, June 04, 2013 6:31 PM, Joshua Welker 
> > [jwel...@sbuniv.edu]
> > wrote:
> > >I am building an auto-suggest feature into our library's search 
> > >box, and
> > I am wanting to include LOC subject headings in my suggestions list.
> > Does anyone know of any web service that allows for automated 
> > harvesting of LOC Subject Headings? I am also looking for name
> authorities, for that matter.
> > Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I 
> > have spent a while Googling with no luck, but this seems like the 
> > sort of general-purpose thing that a lot of people would be interested in.
> > I feel like I must be missing something. Any help is appreciated.
> >
> > Have you seen http://id.loc.gov/ with bulk downloads in various 
> > formats at http://id.loc.gov/download/
> >
> > I hope this helps,
> >
> > Bryan Baldus
> > Senior Cataloger
> > Quality Books Inc.
> > The Best of America's Independent Presses
> > 1-800-323-4241x402
> > bryan.bal...@quality-books.com
> > eij...@cpan.org
> > http://home.comcast.net/~eijabb/
> >
>

Re: [CODE4LIB] LOC Subject Headings API

[Ford, Kevin]

> This would work, except I would need a way to get all the subjects
> rather than just biology.
-- If you want "all the subjects. [period]", take a look at the download page:

http://id.loc.gov/download/

There are bulk downloads for LCSH and the LC/NACO file of Names.

The suggest service (described in a separate email) is designed to give you the 
top 10 "best" matches based on a left-anchored search, so that it may function 
as a real-time type-ahead service.

Yours,
Kevin

--
Kevin Ford
Network Development and MARC Standards Office
Library of Congress
Washington, DC




> -Original Message-
> From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of
> Joshua Welker
> Sent: Wednesday, June 05, 2013 9:14 AM
> To: CODE4LIB@LISTSERV.ND.EDU
> Subject: Re: [CODE4LIB] LOC Subject Headings API
> 
> This would work, except I would need a way to get all the subjects
> rather than just biology. Any idea how to do that? I tried removing the
> querystring from the URL and changing "Biology" in the URL to "" with
> no success.
> 
> Josh Welker
> 
> 
> -Original Message-
> From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of
> Michael J. Giarlo
> Sent: Tuesday, June 04, 2013 7:05 PM
> To: CODE4LIB@LISTSERV.ND.EDU
> Subject: Re: [CODE4LIB] LOC Subject Headings API
> 
> How about id.loc.gov's OpenSearch-powered autosuggest feature?
> 
> mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology
> ["Biology",["Biology","Biology Colloquium","Biology Curators'
> Group","Biology Databook Editorial Board (U.S.)","Biology and Earth
> Sciences Teaching Institute","Biology and Management of True Fir in the
> Pacific Northwest Symposium (1981 : Seattle, Wash.)","Biology and
> Resource Management Program (Alaska Cooperative Park Studies
> Unit)","Biology and behavior series","Biology and environment
> (Macmillan Press)","Biology and management of old-growth forests"],["1
> result","1 result","1 result","1
> result","1 result","1 result","1 result","1 result","1 result","1
> result"],["http://id.loc.gov/authorities/subjects/sh85014203",";
> http://id.loc.gov/authorities/names/n79006962",";
> http://id.loc.gov/authorities/names/n90639795",";
> http://id.loc.gov/authorities/names/n85100466",";
> http://id.loc.gov/authorities/names/nr97041787",";
> http://id.loc.gov/authorities/names/n85276541",";
> http://id.loc.gov/authorities/names/n82057525",";
> http://id.loc.gov/authorities/names/n90605518",";
> http://id.loc.gov/authorities/names/nr2001011448",";
> http://id.loc.gov/authorities/names/no94028058";]]
> 
> -Mike
> 
> 
> 
> On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker 
> wrote:
> 
> > I did see that, and it will work in a pinch. But the authority file
> is
> > pretty massive--almost 1GB-- and would be difficult to handle in an
> > automated way and without completely killing my web app due to memory
> > constraints while searching the file. Thanks, though.
> >
> > Josh Welker
> >
> >
> > -Original Message-
> > From: Bryan Baldus [mailto:bryan.bal...@quality-books.com]
> > Sent: Tuesday, June 04, 2013 6:39 PM
> > To: Code for Libraries; Joshua Welker
> > Subject: RE: LOC Subject Headings API
> >
> > On Tuesday, June 04, 2013 6:31 PM, Joshua Welker [jwel...@sbuniv.edu]
> > wrote:
> > >I am building an auto-suggest feature into our library's search box,
> > >and
> > I am wanting to include LOC subject headings in my suggestions list.
> > Does anyone know of any web service that allows for automated
> > harvesting of LOC Subject Headings? I am also looking for name
> authorities, for that matter.
> > Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I
> > have spent a while Googling with no luck, but this seems like the
> sort
> > of general-purpose thing that a lot of people would be interested in.
> > I feel like I must be missing something. Any help is appreciated.
> >
> > Have you seen http://id.loc.gov/ with bulk downloads in various
> > formats at http://id.loc.gov/download/
> >
> > I hope this helps,
> >
> > Bryan Baldus
> > Senior Cataloger
> > Quality Books Inc.
> > The Best of America's Independent Presses
> > 1-800-323-4241x402
> > bryan.bal...@quality-books.com
> > eij...@cpan.org
> > http://home.comcast.net/~eijabb/
> >

Re: [CODE4LIB] LOC Subject Headings API

[Ford, Kevin]

Dear Josh,

Take a look at Mike's email below, which may have quickly fell down the inbox, 
helped along by an unhelpful reply.  It has the suggest pattern, but to repeat 
the general pattern:

This will provide auto-suggestions for Subjects, ChildrensSubjects, GenreForms, 
and Names:
http://id.loc.gov/authorities/suggest/?q=Hounds

This will provide auto-suggestions for Subjects only (replace "subjects" 
with "names" for only names and so on):
http://id.loc.gov/authorities/subjects/suggest/?q=Hounds

Yours,
Kevin

--
Kevin Ford
Network Development and MARC Standards Office
Library of Congress
Washington, DC



> -Original Message-
> From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of
> Michael J. Giarlo
> Sent: Tuesday, June 04, 2013 8:05 PM
> To: CODE4LIB@LISTSERV.ND.EDU
> Subject: Re: [CODE4LIB] LOC Subject Headings API
> 
> How about id.loc.gov's OpenSearch-powered autosuggest feature?
> 
> mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology
> ["Biology",["Biology","Biology Colloquium","Biology Curators'
> Group","Biology Databook Editorial Board (U.S.)","Biology and Earth
> Sciences Teaching Institute","Biology and Management of True Fir in the
> Pacific Northwest Symposium (1981 : Seattle, Wash.)","Biology and
> Resource Management Program (Alaska Cooperative Park Studies
> Unit)","Biology and behavior series","Biology and environment
> (Macmillan Press)","Biology and management of old-growth forests"],["1
> result","1 result","1 result","1
> result","1 result","1 result","1 result","1 result","1 result","1
> result"],["http://id.loc.gov/authorities/subjects/sh85014203",";
> http://id.loc.gov/authorities/names/n79006962",";
> http://id.loc.gov/authorities/names/n90639795",";
> http://id.loc.gov/authorities/names/n85100466",";
> http://id.loc.gov/authorities/names/nr97041787",";
> http://id.loc.gov/authorities/names/n85276541",";
> http://id.loc.gov/authorities/names/n82057525",";
> http://id.loc.gov/authorities/names/n90605518",";
> http://id.loc.gov/authorities/names/nr2001011448",";
> http://id.loc.gov/authorities/names/no94028058";]]
> 
> -Mike
> 
> 
> 
> On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker 
> wrote:
> 
> > I did see that, and it will work in a pinch. But the authority file
> is
> > pretty massive--almost 1GB-- and would be difficult to handle in an
> > automated way and without completely killing my web app due to memory
> > constraints while searching the file. Thanks, though.
> >
> > Josh Welker
> >
> >
> > -Original Message-
> > From: Bryan Baldus [mailto:bryan.bal...@quality-books.com]
> > Sent: Tuesday, June 04, 2013 6:39 PM
> > To: Code for Libraries; Joshua Welker
> > Subject: RE: LOC Subject Headings API
> >
> > On Tuesday, June 04, 2013 6:31 PM, Joshua Welker [jwel...@sbuniv.edu]
> > wrote:
> > >I am building an auto-suggest feature into our library's search box,
> > >and
> > I am wanting to include LOC subject headings in my suggestions list.
> > Does anyone know of any web service that allows for automated
> > harvesting of LOC Subject Headings? I am also looking for name
> authorities, for that matter.
> > Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I
> > have spent a while Googling with no luck, but this seems like the
> sort
> > of general-purpose thing that a lot of people would be interested in.
> > I feel like I must be missing something. Any help is appreciated.
> >
> > Have you seen http://id.loc.gov/ with bulk downloads in various
> > formats at http://id.loc.gov/download/
> >
> > I hope this helps,
> >
> > Bryan Baldus
> > Senior Cataloger
> > Quality Books Inc.
> > The Best of America's Independent Presses
> > 1-800-323-4241x402
> > bryan.bal...@quality-books.com
> > eij...@cpan.org
> > http://home.comcast.net/~eijabb/
> >

Re: [CODE4LIB] LOC Subject Headings API

[Kaile Zhu]

Interesting project.  Sounds like AJAX technique is used to capture and 
transmit every keystroke.   I expect the result (automatic suggested words)  to 
be shown down the search box while you are typing.  I tested your link, but 
only got a download.  Do I miss something? 

Kelly Zhu

-Original Message-
From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Ethan 
Gruber
Sent: 2013年6月5日 8:22
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: [CODE4LIB] LOC Subject Headings API

You'd write some javascript to query the service with every keystroke, e.g.
http://id.loc.gov/authorities/suggest/?q=Hi replies with subjects beginning 
with "hi*"  It looks like covo.js supports LCSH, so you could look into that.

Ethan


On Wed, Jun 5, 2013 at 9:13 AM, Joshua Welker  wrote:

> This would work, except I would need a way to get all the subjects 
> rather than just biology. Any idea how to do that? I tried removing 
> the querystring from the URL and changing "Biology" in the URL to "" 
> with no success.
>
> Josh Welker
>
>
> -Original Message-
> From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf 
> Of Michael J. Giarlo
> Sent: Tuesday, June 04, 2013 7:05 PM
> To: CODE4LIB@LISTSERV.ND.EDU
> Subject: Re: [CODE4LIB] LOC Subject Headings API
>
> How about id.loc.gov's OpenSearch-powered autosuggest feature?
>
> mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology
> ["Biology",["Biology","Biology Colloquium","Biology Curators'
> Group","Biology Databook Editorial Board (U.S.)","Biology and Earth 
> Sciences Teaching Institute","Biology and Management of True Fir in 
> the Pacific Northwest Symposium (1981 : Seattle, Wash.)","Biology and 
> Resource Management Program (Alaska Cooperative Park Studies 
> Unit)","Biology and behavior series","Biology and environment 
> (Macmillan Press)","Biology and management of old-growth forests"],["1 
> result","1 result","1 result","1
> result","1 result","1 result","1 result","1 result","1 result","1 
> result"],["http://id.loc.gov/authorities/subjects/sh85014203",";
> http://id.loc.gov/authorities/names/n79006962",";
> http://id.loc.gov/authorities/names/n90639795",";
> http://id.loc.gov/authorities/names/n85100466",";
> http://id.loc.gov/authorities/names/nr97041787",";
> http://id.loc.gov/authorities/names/n85276541",";
> http://id.loc.gov/authorities/names/n82057525",";
> http://id.loc.gov/authorities/names/n90605518",";
> http://id.loc.gov/authorities/names/nr2001011448",";
> http://id.loc.gov/authorities/names/no94028058";]]
>
> -Mike
>
>
>
> On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker  wrote:
>
> > I did see that, and it will work in a pinch. But the authority file 
> > is pretty massive--almost 1GB-- and would be difficult to handle in 
> > an automated way and without completely killing my web app due to 
> > memory constraints while searching the file. Thanks, though.
> >
> > Josh Welker
> >
> >
> > -Original Message-
> > From: Bryan Baldus [mailto:bryan.bal...@quality-books.com]
> > Sent: Tuesday, June 04, 2013 6:39 PM
> > To: Code for Libraries; Joshua Welker
> > Subject: RE: LOC Subject Headings API
> >
> > On Tuesday, June 04, 2013 6:31 PM, Joshua Welker 
> > [jwel...@sbuniv.edu]
> > wrote:
> > >I am building an auto-suggest feature into our library's search 
> > >box, and
> > I am wanting to include LOC subject headings in my suggestions list.
> > Does anyone know of any web service that allows for automated 
> > harvesting of LOC Subject Headings? I am also looking for name
> authorities, for that matter.
> > Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I 
> > have spent a while Googling with no luck, but this seems like the 
> > sort of general-purpose thing that a lot of people would be interested in.
> > I feel like I must be missing something. Any help is appreciated.
> >
> > Have you seen http://id.loc.gov/ with bulk downloads in various 
> > formats at http://id.loc.gov/download/
> >
> > I hope this helps,
> >
> > Bryan Baldus
> > Senior Cataloger
> > Quality Books Inc.
> > The Best of America's Independent Presses
> > 1-800-323-4241x402
> > bryan.bal...@quality-books.com
> > eij...@cpan.org
> > http://home.comcast.net/~eijabb/
> >
>

Re: [CODE4LIB] LOC Subject Headings API

[Ethan Gruber]

Are you referring to hierarchical sets of terms, like "United
States--History--War with Mexico, 1845-1848"?  This is an "earlier
established term" of http://id.loc.gov/authorities/subjects/sh85140201 (now
labeled "Mexican War, 1846-1848").  Ed Summers or Kevin Ford are in a
better position to discuss the change of terminology, but it looks like
LCSH is moving past this string-based hierarchy in favor of one expressed
in terms of linked data.

Ethan


On Wed, Jun 5, 2013 at 9:32 AM, Joshua Welker  wrote:

> I've seen those, but I can't figure out where on the id.loc.gov site
> there is actually a URL that provides a list of authority terms. All the
> links on the site seem to link to other pages within the site.
>
> Josh Welker
>
>
> -Original Message-
> From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of
> Dana Pearson
> Sent: Tuesday, June 04, 2013 6:42 PM
> To: CODE4LIB@LISTSERV.ND.EDU
> Subject: Re: [CODE4LIB] LOC Subject Headings API
>
> Joshua,
>
> There are different formats at LOC:
>
> http://id.loc.gov/authorities/subjects.html
>
> dana
>
>
> On Tue, Jun 4, 2013 at 6:31 PM, Joshua Welker  wrote:
>
> > I am building an auto-suggest feature into our library's search box,
> > and I am wanting to include LOC subject headings in my suggestions
> > list. Does anyone know of any web service that allows for automated
> > harvesting of LOC Subject Headings? I am also looking for name
> authorities, for that matter.
> > Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I
> > have spent a while Googling with no luck, but this seems like the sort
> > of general-purpose thing that a lot of people would be interested in.
> > I feel like I must be missing something. Any help is appreciated.
> >
> > Josh Welker
> > Electronic/Media Services Librarian
> > College Liaison
> > University Libraries
> > Southwest Baptist University
> > 417.328.1624
> >
>
>
>
> --
> Dana Pearson
> dbpearsonmlis.com
>

Re: [CODE4LIB] LOC Subject Headings API

[Joshua Welker]

I've seen those, but I can't figure out where on the id.loc.gov site there is 
actually a URL that provides a list of authority terms. All the links on the 
site seem to link to other pages within the site. 

Josh Welker


-Original Message-
From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Dana 
Pearson
Sent: Tuesday, June 04, 2013 6:42 PM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: [CODE4LIB] LOC Subject Headings API

Joshua,

There are different formats at LOC:

http://id.loc.gov/authorities/subjects.html

dana


On Tue, Jun 4, 2013 at 6:31 PM, Joshua Welker  wrote:

> I am building an auto-suggest feature into our library's search box, 
> and I am wanting to include LOC subject headings in my suggestions 
> list. Does anyone know of any web service that allows for automated 
> harvesting of LOC Subject Headings? I am also looking for name authorities, 
> for that matter.
> Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I 
> have spent a while Googling with no luck, but this seems like the sort 
> of general-purpose thing that a lot of people would be interested in. 
> I feel like I must be missing something. Any help is appreciated.
>
> Josh Welker
> Electronic/Media Services Librarian
> College Liaison
> University Libraries
> Southwest Baptist University
> 417.328.1624
>



--
Dana Pearson
dbpearsonmlis.com

Re: [CODE4LIB] LOC Subject Headings API

[Joshua Welker]

Covo.js looks useful, but the sample proxy and example materials still leave me 
with the same problem I have right now: I'm not sure what URL to point my 
requests at to retrieve data. Covo.js is good inspiration for me, but I don't 
think I can use it because my autosuggest box is actually a mashup of several 
different sources (LibraryH3lp FAQs, LibGuides guide names and tags, custom 
autosuggest terms, website pages, and finally the LOC authority stuff I am 
asking about now).

Josh Welker


-Original Message-
From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of diego 
ferreyra
Sent: Wednesday, June 05, 2013 7:03 AM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: [CODE4LIB] LOC Subject Headings API

May be covo.js can help you: http://journal.code4lib.org/articles/5994
https://github.com/haseharu/covojs



2013/6/4 Andreas Orphanides 

> Something something Simon Spero something something OWL something LOC 
> hierarchy?
>
> On Tue, Jun 4, 2013 at 8:04 PM, Michael J. Giarlo < 
> leftw...@alumni.rutgers.edu> wrote:
>
> > How about id.loc.gov's OpenSearch-powered autosuggest feature?
> >
> > mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology
> > ["Biology",["Biology","Biology Colloquium","Biology Curators'
> > Group","Biology Databook Editorial Board (U.S.)","Biology and Earth 
> > Sciences Teaching Institute","Biology and Management of True Fir in 
> > the Pacific Northwest Symposium (1981 : Seattle, Wash.)","Biology 
> > and
> Resource
> > Management Program (Alaska Cooperative Park Studies Unit)","Biology 
> > and behavior series","Biology and environment (Macmillan 
> > Press)","Biology and management of old-growth forests"],["1 
> > result","1 result","1 result","1
> > result","1 result","1 result","1 result","1 result","1 result","1 
> > result"],["http://id.loc.gov/authorities/subjects/sh85014203",";
> > http://id.loc.gov/authorities/names/n79006962",";
> > http://id.loc.gov/authorities/names/n90639795",";
> > http://id.loc.gov/authorities/names/n85100466",";
> > http://id.loc.gov/authorities/names/nr97041787",";
> > http://id.loc.gov/authorities/names/n85276541",";
> > http://id.loc.gov/authorities/names/n82057525",";
> > http://id.loc.gov/authorities/names/n90605518",";
> > http://id.loc.gov/authorities/names/nr2001011448",";
> > http://id.loc.gov/authorities/names/no94028058";]]
> >
> > -Mike
> >
> >
> >
> > On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker 
> wrote:
> >
> > > I did see that, and it will work in a pinch. But the authority 
> > > file is pretty massive--almost 1GB-- and would be difficult to 
> > > handle in an automated way and without completely killing my web 
> > > app due to memory constraints while searching the file. Thanks, though.
> > >
> > > Josh Welker
> > >
> > >
> > > -Original Message-
> > > From: Bryan Baldus [mailto:bryan.bal...@quality-books.com]
> > > Sent: Tuesday, June 04, 2013 6:39 PM
> > > To: Code for Libraries; Joshua Welker
> > > Subject: RE: LOC Subject Headings API
> > >
> > > On Tuesday, June 04, 2013 6:31 PM, Joshua Welker 
> > > [jwel...@sbuniv.edu]
> > > wrote:
> > > >I am building an auto-suggest feature into our library's search 
> > > >box,
> and
> > > I am wanting to include LOC subject headings in my suggestions list.
> Does
> > > anyone know of any web service that allows for automated 
> > > harvesting of
> > LOC
> > > Subject Headings? I am also looking for name authorities, for that
> > matter.
> > > Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... 
> > > I
> have
> > > spent a while Googling with no luck, but this seems like the sort 
> > > of general-purpose thing that a lot of people would be interested 
> > > in. I
> feel
> > > like I must be missing something. Any help is appreciated.
> > >
> > > Have you seen http://id.loc.gov/ with bulk downloads in various
> formats
> > > at http://id.loc.gov/download/
> > >
> > > I hope this helps,
> > >
> > > Bryan Baldus
> > > Senior Cataloger
> > > Quality Books Inc.
> > > The Best of America's Independent Presses
> > > 1-800-323-4241x402
> > > bryan.bal...@quality-books.com
> > > eij...@cpan.org
> > > http://home.comcast.net/~eijabb/
> > >
> >
>



--
Diego Ferreyra

Re: [CODE4LIB] LOC Subject Headings API

[Ethan Gruber]

You'd write some javascript to query the service with every keystroke, e.g.
http://id.loc.gov/authorities/suggest/?q=Hi replies with subjects beginning
with "hi*"  It looks like covo.js supports LCSH, so you could look into
that.

Ethan


On Wed, Jun 5, 2013 at 9:13 AM, Joshua Welker  wrote:

> This would work, except I would need a way to get all the subjects rather
> than just biology. Any idea how to do that? I tried removing the
> querystring from the URL and changing "Biology" in the URL to "" with no
> success.
>
> Josh Welker
>
>
> -Original Message-
> From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of
> Michael J. Giarlo
> Sent: Tuesday, June 04, 2013 7:05 PM
> To: CODE4LIB@LISTSERV.ND.EDU
> Subject: Re: [CODE4LIB] LOC Subject Headings API
>
> How about id.loc.gov's OpenSearch-powered autosuggest feature?
>
> mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology
> ["Biology",["Biology","Biology Colloquium","Biology Curators'
> Group","Biology Databook Editorial Board (U.S.)","Biology and Earth
> Sciences Teaching Institute","Biology and Management of True Fir in the
> Pacific Northwest Symposium (1981 : Seattle, Wash.)","Biology and Resource
> Management Program (Alaska Cooperative Park Studies Unit)","Biology and
> behavior series","Biology and environment (Macmillan Press)","Biology and
> management of old-growth forests"],["1 result","1 result","1 result","1
> result","1 result","1 result","1 result","1 result","1 result","1
> result"],["http://id.loc.gov/authorities/subjects/sh85014203",";
> http://id.loc.gov/authorities/names/n79006962",";
> http://id.loc.gov/authorities/names/n90639795",";
> http://id.loc.gov/authorities/names/n85100466",";
> http://id.loc.gov/authorities/names/nr97041787",";
> http://id.loc.gov/authorities/names/n85276541",";
> http://id.loc.gov/authorities/names/n82057525",";
> http://id.loc.gov/authorities/names/n90605518",";
> http://id.loc.gov/authorities/names/nr2001011448",";
> http://id.loc.gov/authorities/names/no94028058";]]
>
> -Mike
>
>
>
> On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker  wrote:
>
> > I did see that, and it will work in a pinch. But the authority file is
> > pretty massive--almost 1GB-- and would be difficult to handle in an
> > automated way and without completely killing my web app due to memory
> > constraints while searching the file. Thanks, though.
> >
> > Josh Welker
> >
> >
> > -Original Message-
> > From: Bryan Baldus [mailto:bryan.bal...@quality-books.com]
> > Sent: Tuesday, June 04, 2013 6:39 PM
> > To: Code for Libraries; Joshua Welker
> > Subject: RE: LOC Subject Headings API
> >
> > On Tuesday, June 04, 2013 6:31 PM, Joshua Welker [jwel...@sbuniv.edu]
> > wrote:
> > >I am building an auto-suggest feature into our library's search box,
> > >and
> > I am wanting to include LOC subject headings in my suggestions list.
> > Does anyone know of any web service that allows for automated
> > harvesting of LOC Subject Headings? I am also looking for name
> authorities, for that matter.
> > Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I
> > have spent a while Googling with no luck, but this seems like the sort
> > of general-purpose thing that a lot of people would be interested in.
> > I feel like I must be missing something. Any help is appreciated.
> >
> > Have you seen http://id.loc.gov/ with bulk downloads in various
> > formats at http://id.loc.gov/download/
> >
> > I hope this helps,
> >
> > Bryan Baldus
> > Senior Cataloger
> > Quality Books Inc.
> > The Best of America's Independent Presses
> > 1-800-323-4241x402
> > bryan.bal...@quality-books.com
> > eij...@cpan.org
> > http://home.comcast.net/~eijabb/
> >
>

Re: [CODE4LIB] LOC Subject Headings API

[Joshua Welker]

This would work, except I would need a way to get all the subjects rather than 
just biology. Any idea how to do that? I tried removing the querystring from 
the URL and changing "Biology" in the URL to "" with no success.

Josh Welker


-Original Message-
From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Michael 
J. Giarlo
Sent: Tuesday, June 04, 2013 7:05 PM
To: CODE4LIB@LISTSERV.ND.EDU
Subject: Re: [CODE4LIB] LOC Subject Headings API

How about id.loc.gov's OpenSearch-powered autosuggest feature?

mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology
["Biology",["Biology","Biology Colloquium","Biology Curators'
Group","Biology Databook Editorial Board (U.S.)","Biology and Earth Sciences 
Teaching Institute","Biology and Management of True Fir in the Pacific 
Northwest Symposium (1981 : Seattle, Wash.)","Biology and Resource Management 
Program (Alaska Cooperative Park Studies Unit)","Biology and behavior 
series","Biology and environment (Macmillan Press)","Biology and management of 
old-growth forests"],["1 result","1 result","1 result","1
result","1 result","1 result","1 result","1 result","1 result","1 
result"],["http://id.loc.gov/authorities/subjects/sh85014203",";
http://id.loc.gov/authorities/names/n79006962",";
http://id.loc.gov/authorities/names/n90639795",";
http://id.loc.gov/authorities/names/n85100466",";
http://id.loc.gov/authorities/names/nr97041787",";
http://id.loc.gov/authorities/names/n85276541",";
http://id.loc.gov/authorities/names/n82057525",";
http://id.loc.gov/authorities/names/n90605518",";
http://id.loc.gov/authorities/names/nr2001011448",";
http://id.loc.gov/authorities/names/no94028058";]]

-Mike



On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker  wrote:

> I did see that, and it will work in a pinch. But the authority file is 
> pretty massive--almost 1GB-- and would be difficult to handle in an 
> automated way and without completely killing my web app due to memory 
> constraints while searching the file. Thanks, though.
>
> Josh Welker
>
>
> -Original Message-
> From: Bryan Baldus [mailto:bryan.bal...@quality-books.com]
> Sent: Tuesday, June 04, 2013 6:39 PM
> To: Code for Libraries; Joshua Welker
> Subject: RE: LOC Subject Headings API
>
> On Tuesday, June 04, 2013 6:31 PM, Joshua Welker [jwel...@sbuniv.edu]
> wrote:
> >I am building an auto-suggest feature into our library's search box, 
> >and
> I am wanting to include LOC subject headings in my suggestions list. 
> Does anyone know of any web service that allows for automated 
> harvesting of LOC Subject Headings? I am also looking for name authorities, 
> for that matter.
> Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I 
> have spent a while Googling with no luck, but this seems like the sort 
> of general-purpose thing that a lot of people would be interested in. 
> I feel like I must be missing something. Any help is appreciated.
>
> Have you seen http://id.loc.gov/ with bulk downloads in various 
> formats at http://id.loc.gov/download/
>
> I hope this helps,
>
> Bryan Baldus
> Senior Cataloger
> Quality Books Inc.
> The Best of America's Independent Presses
> 1-800-323-4241x402
> bryan.bal...@quality-books.com
> eij...@cpan.org
> http://home.comcast.net/~eijabb/
>

Re: [CODE4LIB] LOC Subject Headings API

[diego ferreyra]

May be covo.js can help you: http://journal.code4lib.org/articles/5994
https://github.com/haseharu/covojs



2013/6/4 Andreas Orphanides 

> Something something Simon Spero something something OWL something LOC
> hierarchy?
>
> On Tue, Jun 4, 2013 at 8:04 PM, Michael J. Giarlo <
> leftw...@alumni.rutgers.edu> wrote:
>
> > How about id.loc.gov's OpenSearch-powered autosuggest feature?
> >
> > mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology
> > ["Biology",["Biology","Biology Colloquium","Biology Curators'
> > Group","Biology Databook Editorial Board (U.S.)","Biology and Earth
> > Sciences Teaching Institute","Biology and Management of True Fir in the
> > Pacific Northwest Symposium (1981 : Seattle, Wash.)","Biology and
> Resource
> > Management Program (Alaska Cooperative Park Studies Unit)","Biology and
> > behavior series","Biology and environment (Macmillan Press)","Biology and
> > management of old-growth forests"],["1 result","1 result","1 result","1
> > result","1 result","1 result","1 result","1 result","1 result","1
> > result"],["http://id.loc.gov/authorities/subjects/sh85014203",";
> > http://id.loc.gov/authorities/names/n79006962",";
> > http://id.loc.gov/authorities/names/n90639795",";
> > http://id.loc.gov/authorities/names/n85100466",";
> > http://id.loc.gov/authorities/names/nr97041787",";
> > http://id.loc.gov/authorities/names/n85276541",";
> > http://id.loc.gov/authorities/names/n82057525",";
> > http://id.loc.gov/authorities/names/n90605518",";
> > http://id.loc.gov/authorities/names/nr2001011448",";
> > http://id.loc.gov/authorities/names/no94028058";]]
> >
> > -Mike
> >
> >
> >
> > On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker 
> wrote:
> >
> > > I did see that, and it will work in a pinch. But the authority file is
> > > pretty massive--almost 1GB-- and would be difficult to handle in an
> > > automated way and without completely killing my web app due to memory
> > > constraints while searching the file. Thanks, though.
> > >
> > > Josh Welker
> > >
> > >
> > > -Original Message-
> > > From: Bryan Baldus [mailto:bryan.bal...@quality-books.com]
> > > Sent: Tuesday, June 04, 2013 6:39 PM
> > > To: Code for Libraries; Joshua Welker
> > > Subject: RE: LOC Subject Headings API
> > >
> > > On Tuesday, June 04, 2013 6:31 PM, Joshua Welker [jwel...@sbuniv.edu]
> > > wrote:
> > > >I am building an auto-suggest feature into our library's search box,
> and
> > > I am wanting to include LOC subject headings in my suggestions list.
> Does
> > > anyone know of any web service that allows for automated harvesting of
> > LOC
> > > Subject Headings? I am also looking for name authorities, for that
> > matter.
> > > Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I
> have
> > > spent a while Googling with no luck, but this seems like the sort of
> > > general-purpose thing that a lot of people would be interested in. I
> feel
> > > like I must be missing something. Any help is appreciated.
> > >
> > > Have you seen http://id.loc.gov/ with bulk downloads in various
> formats
> > > at http://id.loc.gov/download/
> > >
> > > I hope this helps,
> > >
> > > Bryan Baldus
> > > Senior Cataloger
> > > Quality Books Inc.
> > > The Best of America's Independent Presses
> > > 1-800-323-4241x402
> > > bryan.bal...@quality-books.com
> > > eij...@cpan.org
> > > http://home.comcast.net/~eijabb/
> > >
> >
>



-- 
Diego Ferreyra

Re: [CODE4LIB] LOC Subject Headings API

[Andreas Orphanides]

Something something Simon Spero something something OWL something LOC
hierarchy?

On Tue, Jun 4, 2013 at 8:04 PM, Michael J. Giarlo <
leftw...@alumni.rutgers.edu> wrote:

> How about id.loc.gov's OpenSearch-powered autosuggest feature?
>
> mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology
> ["Biology",["Biology","Biology Colloquium","Biology Curators'
> Group","Biology Databook Editorial Board (U.S.)","Biology and Earth
> Sciences Teaching Institute","Biology and Management of True Fir in the
> Pacific Northwest Symposium (1981 : Seattle, Wash.)","Biology and Resource
> Management Program (Alaska Cooperative Park Studies Unit)","Biology and
> behavior series","Biology and environment (Macmillan Press)","Biology and
> management of old-growth forests"],["1 result","1 result","1 result","1
> result","1 result","1 result","1 result","1 result","1 result","1
> result"],["http://id.loc.gov/authorities/subjects/sh85014203",";
> http://id.loc.gov/authorities/names/n79006962",";
> http://id.loc.gov/authorities/names/n90639795",";
> http://id.loc.gov/authorities/names/n85100466",";
> http://id.loc.gov/authorities/names/nr97041787",";
> http://id.loc.gov/authorities/names/n85276541",";
> http://id.loc.gov/authorities/names/n82057525",";
> http://id.loc.gov/authorities/names/n90605518",";
> http://id.loc.gov/authorities/names/nr2001011448",";
> http://id.loc.gov/authorities/names/no94028058";]]
>
> -Mike
>
>
>
> On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker  wrote:
>
> > I did see that, and it will work in a pinch. But the authority file is
> > pretty massive--almost 1GB-- and would be difficult to handle in an
> > automated way and without completely killing my web app due to memory
> > constraints while searching the file. Thanks, though.
> >
> > Josh Welker
> >
> >
> > -Original Message-
> > From: Bryan Baldus [mailto:bryan.bal...@quality-books.com]
> > Sent: Tuesday, June 04, 2013 6:39 PM
> > To: Code for Libraries; Joshua Welker
> > Subject: RE: LOC Subject Headings API
> >
> > On Tuesday, June 04, 2013 6:31 PM, Joshua Welker [jwel...@sbuniv.edu]
> > wrote:
> > >I am building an auto-suggest feature into our library's search box, and
> > I am wanting to include LOC subject headings in my suggestions list. Does
> > anyone know of any web service that allows for automated harvesting of
> LOC
> > Subject Headings? I am also looking for name authorities, for that
> matter.
> > Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have
> > spent a while Googling with no luck, but this seems like the sort of
> > general-purpose thing that a lot of people would be interested in. I feel
> > like I must be missing something. Any help is appreciated.
> >
> > Have you seen http://id.loc.gov/ with bulk downloads in various formats
> > at http://id.loc.gov/download/
> >
> > I hope this helps,
> >
> > Bryan Baldus
> > Senior Cataloger
> > Quality Books Inc.
> > The Best of America's Independent Presses
> > 1-800-323-4241x402
> > bryan.bal...@quality-books.com
> > eij...@cpan.org
> > http://home.comcast.net/~eijabb/
> >
>

Re: [CODE4LIB] LOC Subject Headings API

[Michael J. Giarlo]

How about id.loc.gov's OpenSearch-powered autosuggest feature?

mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology
["Biology",["Biology","Biology Colloquium","Biology Curators'
Group","Biology Databook Editorial Board (U.S.)","Biology and Earth
Sciences Teaching Institute","Biology and Management of True Fir in the
Pacific Northwest Symposium (1981 : Seattle, Wash.)","Biology and Resource
Management Program (Alaska Cooperative Park Studies Unit)","Biology and
behavior series","Biology and environment (Macmillan Press)","Biology and
management of old-growth forests"],["1 result","1 result","1 result","1
result","1 result","1 result","1 result","1 result","1 result","1
result"],["http://id.loc.gov/authorities/subjects/sh85014203",";
http://id.loc.gov/authorities/names/n79006962",";
http://id.loc.gov/authorities/names/n90639795",";
http://id.loc.gov/authorities/names/n85100466",";
http://id.loc.gov/authorities/names/nr97041787",";
http://id.loc.gov/authorities/names/n85276541",";
http://id.loc.gov/authorities/names/n82057525",";
http://id.loc.gov/authorities/names/n90605518",";
http://id.loc.gov/authorities/names/nr2001011448",";
http://id.loc.gov/authorities/names/no94028058";]]

-Mike



On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker  wrote:

> I did see that, and it will work in a pinch. But the authority file is
> pretty massive--almost 1GB-- and would be difficult to handle in an
> automated way and without completely killing my web app due to memory
> constraints while searching the file. Thanks, though.
>
> Josh Welker
>
>
> -Original Message-
> From: Bryan Baldus [mailto:bryan.bal...@quality-books.com]
> Sent: Tuesday, June 04, 2013 6:39 PM
> To: Code for Libraries; Joshua Welker
> Subject: RE: LOC Subject Headings API
>
> On Tuesday, June 04, 2013 6:31 PM, Joshua Welker [jwel...@sbuniv.edu]
> wrote:
> >I am building an auto-suggest feature into our library's search box, and
> I am wanting to include LOC subject headings in my suggestions list. Does
> anyone know of any web service that allows for automated harvesting of LOC
> Subject Headings? I am also looking for name authorities, for that matter.
> Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have
> spent a while Googling with no luck, but this seems like the sort of
> general-purpose thing that a lot of people would be interested in. I feel
> like I must be missing something. Any help is appreciated.
>
> Have you seen http://id.loc.gov/ with bulk downloads in various formats
> at http://id.loc.gov/download/
>
> I hope this helps,
>
> Bryan Baldus
> Senior Cataloger
> Quality Books Inc.
> The Best of America's Independent Presses
> 1-800-323-4241x402
> bryan.bal...@quality-books.com
> eij...@cpan.org
> http://home.comcast.net/~eijabb/
>

Re: [CODE4LIB] LOC Subject Headings API

[Joshua Welker]

I did see that, and it will work in a pinch. But the authority file is pretty 
massive--almost 1GB-- and would be difficult to handle in an automated way and 
without completely killing my web app due to memory constraints while searching 
the file. Thanks, though.

Josh Welker


-Original Message-
From: Bryan Baldus [mailto:bryan.bal...@quality-books.com] 
Sent: Tuesday, June 04, 2013 6:39 PM
To: Code for Libraries; Joshua Welker
Subject: RE: LOC Subject Headings API

On Tuesday, June 04, 2013 6:31 PM, Joshua Welker [jwel...@sbuniv.edu] wrote:
>I am building an auto-suggest feature into our library's search box, and I am 
>wanting to include LOC subject headings in my suggestions list. Does anyone 
>know of any web service that allows for automated harvesting of LOC Subject 
>Headings? I am also looking for name authorities, for that matter. Any format 
>will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have spent a while 
>Googling with no luck, but this seems like the sort of general-purpose thing 
>that a lot of people would be interested in. I feel like I must be missing 
>something. Any help is appreciated.

Have you seen http://id.loc.gov/ with bulk downloads in various formats at 
http://id.loc.gov/download/

I hope this helps,

Bryan Baldus
Senior Cataloger
Quality Books Inc.
The Best of America's Independent Presses
1-800-323-4241x402
bryan.bal...@quality-books.com
eij...@cpan.org
http://home.comcast.net/~eijabb/

Re: [CODE4LIB] LOC Subject Headings API

[Bryan Baldus]

On Tuesday, June 04, 2013 6:31 PM, Joshua Welker [jwel...@sbuniv.edu] wrote:
>I am building an auto-suggest feature into our library's search box, and I am 
>wanting to include LOC subject headings in my suggestions list. Does anyone 
>know of any web service that allows for automated harvesting of LOC Subject 
>Headings? I am also looking for name authorities, for that matter. Any format 
>will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have spent a while 
>Googling with no luck, but this seems like the sort of general-purpose thing 
>that a lot of people would be interested in. I feel like I must be missing 
>something. Any help is appreciated.

Have you seen http://id.loc.gov/ with bulk downloads in various formats at 
http://id.loc.gov/download/

I hope this helps,

Bryan Baldus
Senior Cataloger
Quality Books Inc.
The Best of America's Independent Presses
1-800-323-4241x402
bryan.bal...@quality-books.com
eij...@cpan.org
http://home.comcast.net/~eijabb/

Re: [CODE4LIB] LOC Subject Headings API

[Dana Pearson]

Joshua,

There are different formats at LOC:

http://id.loc.gov/authorities/subjects.html

dana


On Tue, Jun 4, 2013 at 6:31 PM, Joshua Welker  wrote:

> I am building an auto-suggest feature into our library's search box, and I
> am wanting to include LOC subject headings in my suggestions list. Does
> anyone know of any web service that allows for automated harvesting of LOC
> Subject Headings? I am also looking for name authorities, for that matter.
> Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have
> spent a while Googling with no luck, but this seems like the sort of
> general-purpose thing that a lot of people would be interested in. I feel
> like I must be missing something. Any help is appreciated.
>
> Josh Welker
> Electronic/Media Services Librarian
> College Liaison
> University Libraries
> Southwest Baptist University
> 417.328.1624
>



-- 
Dana Pearson
dbpearsonmlis.com

[CODE4LIB] LOC Subject Headings API

[Joshua Welker]

I am building an auto-suggest feature into our library's search box, and I am 
wanting to include LOC subject headings in my suggestions list. Does anyone 
know of any web service that allows for automated harvesting of LOC Subject 
Headings? I am also looking for name authorities, for that matter. Any format 
will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have spent a while 
Googling with no luck, but this seems like the sort of general-purpose thing 
that a lot of people would be interested in. I feel like I must be missing 
something. Any help is appreciated.

Josh Welker
Electronic/Media Services Librarian
College Liaison
University Libraries
Southwest Baptist University
417.328.1624