Re: [CODE4LIB] LOC Subject Headings API
There's also an autosuggester for FAST. http://oclc.org/developer/services/assignfast Ralph -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Karen Coyle Sent: Wednesday, June 05, 2013 4:23 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: LOC Subject Headings API If you don't have to use LCSH... the Agrovoc thesaurus has a term suggester API: try http://foris.fao.org/agrovoc/ It's actually easier to use than LCSH because the terms are not pre-coordinated. kc On 6/5/13 9:58 AM, Joshua Welker wrote: Hmm, that is pretty smart. I am actually hoping to roll this whole thing into a plugin for Wordpress/Drupal, so if possible I want to avoid using anything that is going to require server configuration (ie setting up Solr). But I bet I could just roll all the LCSH data into an SQLite file and then search it with PHP on the server. This might work. Thanks! Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Ethan Gruber Sent: Wednesday, June 05, 2013 11:51 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API I once put all of the LCSH headings into a local Solr index and used TermsComponent to power autosuggest. It was really fast. Ethan On Wed, Jun 5, 2013 at 12:47 PM, Joshua Welker jwel...@sbuniv.edu wrote: I realized since I made that comment that the API is designed to give the top 10 subject heading suggestions rather than all of them. So that part is fine. But I am once again unsure if the API will work for me. I am creating a mashup of several data sources for my auto-suggest feature, and I am having a hard time dynamically adding the results from the LOC Suggest API to the existing collection of data that is used to populate my jQuery UI Autocomplete field. Ideally, I'd like to be able to have all the LC Subject Heading data cached on my server so that I can build my autocomplete data source one time rather than having to deal with dynamically adding, sorting, etc. But then the problem I run into is that the LCSH master file is so big that it basically crashes the server. That's why I'm thinking I might have to give up on this project. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Michael J. Giarlo Sent: Wednesday, June 05, 2013 9:59 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API Josh, Can you say more about how the API isn't behaving as you expected it to? -Mike On Wed, Jun 5, 2013 at 10:37 AM, Joshua Welker jwel...@sbuniv.edu wrote: I went with this method and made some good progress, but the results the API was returning were not what I expected. I might have to give up on this project. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Ethan Gruber Sent: Wednesday, June 05, 2013 8:22 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API You'd write some javascript to query the service with every keystroke, e.g. http://id.loc.gov/authorities/suggest/?q=Hi replies with subjects beginning with hi* It looks like covo.js supports LCSH, so you could look into that. Ethan On Wed, Jun 5, 2013 at 9:13 AM, Joshua Welker jwel...@sbuniv.edu wrote: This would work, except I would need a way to get all the subjects rather than just biology. Any idea how to do that? I tried removing the querystring from the URL and changing Biology in the URL to with no success. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Michael J. Giarlo Sent: Tuesday, June 04, 2013 7:05 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API How about id.loc.gov's OpenSearch-powered autosuggest feature? mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology [Biology,[Biology,Biology Colloquium,Biology Curators' Group,Biology Databook Editorial Board (U.S.),Biology and Earth Sciences Teaching Institute,Biology and Management of True Fir in the Pacific Northwest Symposium (1981 : Seattle, Wash.),Biology and Resource Management Program (Alaska Cooperative Park Studies Unit),Biology and behavior series,Biology and environment (Macmillan Press),Biology and management of old-growth forests],[1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result],[http://id.loc.gov/authorities/subjects/sh85014203,; http://id.loc.gov/authorities/names/n79006962,; http://id.loc.gov/authorities/names/n90639795,; http://id.loc.gov/authorities/names/n85100466,; http://id.loc.gov/authorities/names/nr97041787,; http://id.loc.gov/authorities/names/n85276541,; http://id.loc.gov/authorities/names/n82057525,; http://id.loc.gov/authorities/names/n90605518,; http
Re: [CODE4LIB] LOC Subject Headings API
I think I prefer the FAST auto-suggest results to the LOC one. Thanks! Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of LeVan,Ralph Sent: Thursday, June 06, 2013 10:00 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API There's also an autosuggester for FAST. http://oclc.org/developer/services/assignfast Ralph -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Karen Coyle Sent: Wednesday, June 05, 2013 4:23 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: LOC Subject Headings API If you don't have to use LCSH... the Agrovoc thesaurus has a term suggester API: try http://foris.fao.org/agrovoc/ It's actually easier to use than LCSH because the terms are not pre-coordinated. kc On 6/5/13 9:58 AM, Joshua Welker wrote: Hmm, that is pretty smart. I am actually hoping to roll this whole thing into a plugin for Wordpress/Drupal, so if possible I want to avoid using anything that is going to require server configuration (ie setting up Solr). But I bet I could just roll all the LCSH data into an SQLite file and then search it with PHP on the server. This might work. Thanks! Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Ethan Gruber Sent: Wednesday, June 05, 2013 11:51 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API I once put all of the LCSH headings into a local Solr index and used TermsComponent to power autosuggest. It was really fast. Ethan On Wed, Jun 5, 2013 at 12:47 PM, Joshua Welker jwel...@sbuniv.edu wrote: I realized since I made that comment that the API is designed to give the top 10 subject heading suggestions rather than all of them. So that part is fine. But I am once again unsure if the API will work for me. I am creating a mashup of several data sources for my auto-suggest feature, and I am having a hard time dynamically adding the results from the LOC Suggest API to the existing collection of data that is used to populate my jQuery UI Autocomplete field. Ideally, I'd like to be able to have all the LC Subject Heading data cached on my server so that I can build my autocomplete data source one time rather than having to deal with dynamically adding, sorting, etc. But then the problem I run into is that the LCSH master file is so big that it basically crashes the server. That's why I'm thinking I might have to give up on this project. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Michael J. Giarlo Sent: Wednesday, June 05, 2013 9:59 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API Josh, Can you say more about how the API isn't behaving as you expected it to? -Mike On Wed, Jun 5, 2013 at 10:37 AM, Joshua Welker jwel...@sbuniv.edu wrote: I went with this method and made some good progress, but the results the API was returning were not what I expected. I might have to give up on this project. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Ethan Gruber Sent: Wednesday, June 05, 2013 8:22 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API You'd write some javascript to query the service with every keystroke, e.g. http://id.loc.gov/authorities/suggest/?q=Hi replies with subjects beginning with hi* It looks like covo.js supports LCSH, so you could look into that. Ethan On Wed, Jun 5, 2013 at 9:13 AM, Joshua Welker jwel...@sbuniv.edu wrote: This would work, except I would need a way to get all the subjects rather than just biology. Any idea how to do that? I tried removing the querystring from the URL and changing Biology in the URL to with no success. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Michael J. Giarlo Sent: Tuesday, June 04, 2013 7:05 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API How about id.loc.gov's OpenSearch-powered autosuggest feature? mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology [Biology,[Biology,Biology Colloquium,Biology Curators' Group,Biology Databook Editorial Board (U.S.),Biology and Earth Sciences Teaching Institute,Biology and Management of True Fir in the Pacific Northwest Symposium (1981 : Seattle, Wash.),Biology and Resource Management Program (Alaska Cooperative Park Studies Unit),Biology and behavior series,Biology and environment (Macmillan Press),Biology and management of old-growth forests],[1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result],[http://id.loc.gov/authorities/subjects/sh85014203,; http://id.loc.gov/authorities/names
Re: [CODE4LIB] LOC Subject Headings API
Great, Ralph, thanks. I think that the 'pre-coordinated' aspect of LCSH makes it very unwieldy for auto-suggest. FAST has some great untapped potential. kc On Thu Jun 6 08:00:25 2013, LeVan,Ralph wrote: There's also an autosuggester for FAST. http://oclc.org/developer/services/assignfast Ralph -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Karen Coyle Sent: Wednesday, June 05, 2013 4:23 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: LOC Subject Headings API If you don't have to use LCSH... the Agrovoc thesaurus has a term suggester API: try http://foris.fao.org/agrovoc/ It's actually easier to use than LCSH because the terms are not pre-coordinated. kc On 6/5/13 9:58 AM, Joshua Welker wrote: Hmm, that is pretty smart. I am actually hoping to roll this whole thing into a plugin for Wordpress/Drupal, so if possible I want to avoid using anything that is going to require server configuration (ie setting up Solr). But I bet I could just roll all the LCSH data into an SQLite file and then search it with PHP on the server. This might work. Thanks! Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Ethan Gruber Sent: Wednesday, June 05, 2013 11:51 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API I once put all of the LCSH headings into a local Solr index and used TermsComponent to power autosuggest. It was really fast. Ethan On Wed, Jun 5, 2013 at 12:47 PM, Joshua Welker jwel...@sbuniv.edu wrote: I realized since I made that comment that the API is designed to give the top 10 subject heading suggestions rather than all of them. So that part is fine. But I am once again unsure if the API will work for me. I am creating a mashup of several data sources for my auto-suggest feature, and I am having a hard time dynamically adding the results from the LOC Suggest API to the existing collection of data that is used to populate my jQuery UI Autocomplete field. Ideally, I'd like to be able to have all the LC Subject Heading data cached on my server so that I can build my autocomplete data source one time rather than having to deal with dynamically adding, sorting, etc. But then the problem I run into is that the LCSH master file is so big that it basically crashes the server. That's why I'm thinking I might have to give up on this project. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Michael J. Giarlo Sent: Wednesday, June 05, 2013 9:59 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API Josh, Can you say more about how the API isn't behaving as you expected it to? -Mike On Wed, Jun 5, 2013 at 10:37 AM, Joshua Welker jwel...@sbuniv.edu wrote: I went with this method and made some good progress, but the results the API was returning were not what I expected. I might have to give up on this project. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Ethan Gruber Sent: Wednesday, June 05, 2013 8:22 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API You'd write some javascript to query the service with every keystroke, e.g. http://id.loc.gov/authorities/suggest/?q=Hi replies with subjects beginning with hi* It looks like covo.js supports LCSH, so you could look into that. Ethan On Wed, Jun 5, 2013 at 9:13 AM, Joshua Welker jwel...@sbuniv.edu wrote: This would work, except I would need a way to get all the subjects rather than just biology. Any idea how to do that? I tried removing the querystring from the URL and changing Biology in the URL to with no success. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Michael J. Giarlo Sent: Tuesday, June 04, 2013 7:05 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API How about id.loc.gov's OpenSearch-powered autosuggest feature? mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology [Biology,[Biology,Biology Colloquium,Biology Curators' Group,Biology Databook Editorial Board (U.S.),Biology and Earth Sciences Teaching Institute,Biology and Management of True Fir in the Pacific Northwest Symposium (1981 : Seattle, Wash.),Biology and Resource Management Program (Alaska Cooperative Park Studies Unit),Biology and behavior series,Biology and environment (Macmillan Press),Biology and management of old-growth forests],[1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result],[http://id.loc.gov/authorities/subjects/sh85014203,; http://id.loc.gov/authorities/names/n79006962,; http://id.loc.gov/authorities/names/n90639795,; http://id.loc.gov/authorities/names/n85100466,; http://id.loc.gov/authorities/names/nr97041787,; http://id.loc.gov/authorities/names/n85276541,; http
Re: [CODE4LIB] LOC Subject Headings API
I finished the project. Thanks to everyone for the suggestions! I ended up using the OCLC Fast API (fast.oclc.org/searchfast/fastsuggest) rather than saving everything locally. Tracking down the entire LCSH authority listing and parsing it into a simple data format was just unwieldy. The search box I built suggests the LCSH terms from OCLC as well as LibGuides and LibraryH3lp FAQ links. jQuery UI Autocomplete is used for the suggestion functionality. The search box send actual searches to EBSCO Discovery Service. You can see it below on our homepage: https://library.sbuniv.edu Josh Welker
Re: [CODE4LIB] LOC Subject Headings API
Do FAST headings match anything? I guess what I mean is, do you have data that uses FAST headings? If not, what is it matching? -Ross. On Thursday, June 6, 2013, Joshua Welker wrote: I finished the project. Thanks to everyone for the suggestions! I ended up using the OCLC Fast API (fast.oclc.org/searchfast/fastsuggest) rather than saving everything locally. Tracking down the entire LCSH authority listing and parsing it into a simple data format was just unwieldy. The search box I built suggests the LCSH terms from OCLC as well as LibGuides and LibraryH3lp FAQ links. jQuery UI Autocomplete is used for the suggestion functionality. The search box send actual searches to EBSCO Discovery Service. You can see it below on our homepage: https://library.sbuniv.edu Josh Welker
Re: [CODE4LIB] LOC Subject Headings API
May be covo.js can help you: http://journal.code4lib.org/articles/5994 https://github.com/haseharu/covojs 2013/6/4 Andreas Orphanides akorp...@ncsu.edu Something something Simon Spero something something OWL something LOC hierarchy? On Tue, Jun 4, 2013 at 8:04 PM, Michael J. Giarlo leftw...@alumni.rutgers.edu wrote: How about id.loc.gov's OpenSearch-powered autosuggest feature? mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology [Biology,[Biology,Biology Colloquium,Biology Curators' Group,Biology Databook Editorial Board (U.S.),Biology and Earth Sciences Teaching Institute,Biology and Management of True Fir in the Pacific Northwest Symposium (1981 : Seattle, Wash.),Biology and Resource Management Program (Alaska Cooperative Park Studies Unit),Biology and behavior series,Biology and environment (Macmillan Press),Biology and management of old-growth forests],[1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result],[http://id.loc.gov/authorities/subjects/sh85014203,; http://id.loc.gov/authorities/names/n79006962,; http://id.loc.gov/authorities/names/n90639795,; http://id.loc.gov/authorities/names/n85100466,; http://id.loc.gov/authorities/names/nr97041787,; http://id.loc.gov/authorities/names/n85276541,; http://id.loc.gov/authorities/names/n82057525,; http://id.loc.gov/authorities/names/n90605518,; http://id.loc.gov/authorities/names/nr2001011448,; http://id.loc.gov/authorities/names/no94028058;]] -Mike On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker jwel...@sbuniv.edu wrote: I did see that, and it will work in a pinch. But the authority file is pretty massive--almost 1GB-- and would be difficult to handle in an automated way and without completely killing my web app due to memory constraints while searching the file. Thanks, though. Josh Welker -Original Message- From: Bryan Baldus [mailto:bryan.bal...@quality-books.com] Sent: Tuesday, June 04, 2013 6:39 PM To: Code for Libraries; Joshua Welker Subject: RE: LOC Subject Headings API On Tuesday, June 04, 2013 6:31 PM, Joshua Welker [jwel...@sbuniv.edu] wrote: I am building an auto-suggest feature into our library's search box, and I am wanting to include LOC subject headings in my suggestions list. Does anyone know of any web service that allows for automated harvesting of LOC Subject Headings? I am also looking for name authorities, for that matter. Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have spent a while Googling with no luck, but this seems like the sort of general-purpose thing that a lot of people would be interested in. I feel like I must be missing something. Any help is appreciated. Have you seen http://id.loc.gov/ with bulk downloads in various formats at http://id.loc.gov/download/ I hope this helps, Bryan Baldus Senior Cataloger Quality Books Inc. The Best of America's Independent Presses 1-800-323-4241x402 bryan.bal...@quality-books.com eij...@cpan.org http://home.comcast.net/~eijabb/ -- Diego Ferreyra
Re: [CODE4LIB] LOC Subject Headings API
This would work, except I would need a way to get all the subjects rather than just biology. Any idea how to do that? I tried removing the querystring from the URL and changing Biology in the URL to with no success. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Michael J. Giarlo Sent: Tuesday, June 04, 2013 7:05 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API How about id.loc.gov's OpenSearch-powered autosuggest feature? mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology [Biology,[Biology,Biology Colloquium,Biology Curators' Group,Biology Databook Editorial Board (U.S.),Biology and Earth Sciences Teaching Institute,Biology and Management of True Fir in the Pacific Northwest Symposium (1981 : Seattle, Wash.),Biology and Resource Management Program (Alaska Cooperative Park Studies Unit),Biology and behavior series,Biology and environment (Macmillan Press),Biology and management of old-growth forests],[1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result],[http://id.loc.gov/authorities/subjects/sh85014203,; http://id.loc.gov/authorities/names/n79006962,; http://id.loc.gov/authorities/names/n90639795,; http://id.loc.gov/authorities/names/n85100466,; http://id.loc.gov/authorities/names/nr97041787,; http://id.loc.gov/authorities/names/n85276541,; http://id.loc.gov/authorities/names/n82057525,; http://id.loc.gov/authorities/names/n90605518,; http://id.loc.gov/authorities/names/nr2001011448,; http://id.loc.gov/authorities/names/no94028058;]] -Mike On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker jwel...@sbuniv.edu wrote: I did see that, and it will work in a pinch. But the authority file is pretty massive--almost 1GB-- and would be difficult to handle in an automated way and without completely killing my web app due to memory constraints while searching the file. Thanks, though. Josh Welker -Original Message- From: Bryan Baldus [mailto:bryan.bal...@quality-books.com] Sent: Tuesday, June 04, 2013 6:39 PM To: Code for Libraries; Joshua Welker Subject: RE: LOC Subject Headings API On Tuesday, June 04, 2013 6:31 PM, Joshua Welker [jwel...@sbuniv.edu] wrote: I am building an auto-suggest feature into our library's search box, and I am wanting to include LOC subject headings in my suggestions list. Does anyone know of any web service that allows for automated harvesting of LOC Subject Headings? I am also looking for name authorities, for that matter. Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have spent a while Googling with no luck, but this seems like the sort of general-purpose thing that a lot of people would be interested in. I feel like I must be missing something. Any help is appreciated. Have you seen http://id.loc.gov/ with bulk downloads in various formats at http://id.loc.gov/download/ I hope this helps, Bryan Baldus Senior Cataloger Quality Books Inc. The Best of America's Independent Presses 1-800-323-4241x402 bryan.bal...@quality-books.com eij...@cpan.org http://home.comcast.net/~eijabb/
Re: [CODE4LIB] LOC Subject Headings API
You'd write some javascript to query the service with every keystroke, e.g. http://id.loc.gov/authorities/suggest/?q=Hi replies with subjects beginning with hi* It looks like covo.js supports LCSH, so you could look into that. Ethan On Wed, Jun 5, 2013 at 9:13 AM, Joshua Welker jwel...@sbuniv.edu wrote: This would work, except I would need a way to get all the subjects rather than just biology. Any idea how to do that? I tried removing the querystring from the URL and changing Biology in the URL to with no success. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Michael J. Giarlo Sent: Tuesday, June 04, 2013 7:05 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API How about id.loc.gov's OpenSearch-powered autosuggest feature? mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology [Biology,[Biology,Biology Colloquium,Biology Curators' Group,Biology Databook Editorial Board (U.S.),Biology and Earth Sciences Teaching Institute,Biology and Management of True Fir in the Pacific Northwest Symposium (1981 : Seattle, Wash.),Biology and Resource Management Program (Alaska Cooperative Park Studies Unit),Biology and behavior series,Biology and environment (Macmillan Press),Biology and management of old-growth forests],[1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result],[http://id.loc.gov/authorities/subjects/sh85014203,; http://id.loc.gov/authorities/names/n79006962,; http://id.loc.gov/authorities/names/n90639795,; http://id.loc.gov/authorities/names/n85100466,; http://id.loc.gov/authorities/names/nr97041787,; http://id.loc.gov/authorities/names/n85276541,; http://id.loc.gov/authorities/names/n82057525,; http://id.loc.gov/authorities/names/n90605518,; http://id.loc.gov/authorities/names/nr2001011448,; http://id.loc.gov/authorities/names/no94028058;]] -Mike On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker jwel...@sbuniv.edu wrote: I did see that, and it will work in a pinch. But the authority file is pretty massive--almost 1GB-- and would be difficult to handle in an automated way and without completely killing my web app due to memory constraints while searching the file. Thanks, though. Josh Welker -Original Message- From: Bryan Baldus [mailto:bryan.bal...@quality-books.com] Sent: Tuesday, June 04, 2013 6:39 PM To: Code for Libraries; Joshua Welker Subject: RE: LOC Subject Headings API On Tuesday, June 04, 2013 6:31 PM, Joshua Welker [jwel...@sbuniv.edu] wrote: I am building an auto-suggest feature into our library's search box, and I am wanting to include LOC subject headings in my suggestions list. Does anyone know of any web service that allows for automated harvesting of LOC Subject Headings? I am also looking for name authorities, for that matter. Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have spent a while Googling with no luck, but this seems like the sort of general-purpose thing that a lot of people would be interested in. I feel like I must be missing something. Any help is appreciated. Have you seen http://id.loc.gov/ with bulk downloads in various formats at http://id.loc.gov/download/ I hope this helps, Bryan Baldus Senior Cataloger Quality Books Inc. The Best of America's Independent Presses 1-800-323-4241x402 bryan.bal...@quality-books.com eij...@cpan.org http://home.comcast.net/~eijabb/
Re: [CODE4LIB] LOC Subject Headings API
Covo.js looks useful, but the sample proxy and example materials still leave me with the same problem I have right now: I'm not sure what URL to point my requests at to retrieve data. Covo.js is good inspiration for me, but I don't think I can use it because my autosuggest box is actually a mashup of several different sources (LibraryH3lp FAQs, LibGuides guide names and tags, custom autosuggest terms, website pages, and finally the LOC authority stuff I am asking about now). Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of diego ferreyra Sent: Wednesday, June 05, 2013 7:03 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API May be covo.js can help you: http://journal.code4lib.org/articles/5994 https://github.com/haseharu/covojs 2013/6/4 Andreas Orphanides akorp...@ncsu.edu Something something Simon Spero something something OWL something LOC hierarchy? On Tue, Jun 4, 2013 at 8:04 PM, Michael J. Giarlo leftw...@alumni.rutgers.edu wrote: How about id.loc.gov's OpenSearch-powered autosuggest feature? mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology [Biology,[Biology,Biology Colloquium,Biology Curators' Group,Biology Databook Editorial Board (U.S.),Biology and Earth Sciences Teaching Institute,Biology and Management of True Fir in the Pacific Northwest Symposium (1981 : Seattle, Wash.),Biology and Resource Management Program (Alaska Cooperative Park Studies Unit),Biology and behavior series,Biology and environment (Macmillan Press),Biology and management of old-growth forests],[1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result],[http://id.loc.gov/authorities/subjects/sh85014203,; http://id.loc.gov/authorities/names/n79006962,; http://id.loc.gov/authorities/names/n90639795,; http://id.loc.gov/authorities/names/n85100466,; http://id.loc.gov/authorities/names/nr97041787,; http://id.loc.gov/authorities/names/n85276541,; http://id.loc.gov/authorities/names/n82057525,; http://id.loc.gov/authorities/names/n90605518,; http://id.loc.gov/authorities/names/nr2001011448,; http://id.loc.gov/authorities/names/no94028058;]] -Mike On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker jwel...@sbuniv.edu wrote: I did see that, and it will work in a pinch. But the authority file is pretty massive--almost 1GB-- and would be difficult to handle in an automated way and without completely killing my web app due to memory constraints while searching the file. Thanks, though. Josh Welker -Original Message- From: Bryan Baldus [mailto:bryan.bal...@quality-books.com] Sent: Tuesday, June 04, 2013 6:39 PM To: Code for Libraries; Joshua Welker Subject: RE: LOC Subject Headings API On Tuesday, June 04, 2013 6:31 PM, Joshua Welker [jwel...@sbuniv.edu] wrote: I am building an auto-suggest feature into our library's search box, and I am wanting to include LOC subject headings in my suggestions list. Does anyone know of any web service that allows for automated harvesting of LOC Subject Headings? I am also looking for name authorities, for that matter. Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have spent a while Googling with no luck, but this seems like the sort of general-purpose thing that a lot of people would be interested in. I feel like I must be missing something. Any help is appreciated. Have you seen http://id.loc.gov/ with bulk downloads in various formats at http://id.loc.gov/download/ I hope this helps, Bryan Baldus Senior Cataloger Quality Books Inc. The Best of America's Independent Presses 1-800-323-4241x402 bryan.bal...@quality-books.com eij...@cpan.org http://home.comcast.net/~eijabb/ -- Diego Ferreyra
Re: [CODE4LIB] LOC Subject Headings API
I've seen those, but I can't figure out where on the id.loc.gov site there is actually a URL that provides a list of authority terms. All the links on the site seem to link to other pages within the site. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Dana Pearson Sent: Tuesday, June 04, 2013 6:42 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API Joshua, There are different formats at LOC: http://id.loc.gov/authorities/subjects.html dana On Tue, Jun 4, 2013 at 6:31 PM, Joshua Welker jwel...@sbuniv.edu wrote: I am building an auto-suggest feature into our library's search box, and I am wanting to include LOC subject headings in my suggestions list. Does anyone know of any web service that allows for automated harvesting of LOC Subject Headings? I am also looking for name authorities, for that matter. Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have spent a while Googling with no luck, but this seems like the sort of general-purpose thing that a lot of people would be interested in. I feel like I must be missing something. Any help is appreciated. Josh Welker Electronic/Media Services Librarian College Liaison University Libraries Southwest Baptist University 417.328.1624 -- Dana Pearson dbpearsonmlis.com
Re: [CODE4LIB] LOC Subject Headings API
Are you referring to hierarchical sets of terms, like United States--History--War with Mexico, 1845-1848? This is an earlier established term of http://id.loc.gov/authorities/subjects/sh85140201 (now labeled Mexican War, 1846-1848). Ed Summers or Kevin Ford are in a better position to discuss the change of terminology, but it looks like LCSH is moving past this string-based hierarchy in favor of one expressed in terms of linked data. Ethan On Wed, Jun 5, 2013 at 9:32 AM, Joshua Welker jwel...@sbuniv.edu wrote: I've seen those, but I can't figure out where on the id.loc.gov site there is actually a URL that provides a list of authority terms. All the links on the site seem to link to other pages within the site. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Dana Pearson Sent: Tuesday, June 04, 2013 6:42 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API Joshua, There are different formats at LOC: http://id.loc.gov/authorities/subjects.html dana On Tue, Jun 4, 2013 at 6:31 PM, Joshua Welker jwel...@sbuniv.edu wrote: I am building an auto-suggest feature into our library's search box, and I am wanting to include LOC subject headings in my suggestions list. Does anyone know of any web service that allows for automated harvesting of LOC Subject Headings? I am also looking for name authorities, for that matter. Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have spent a while Googling with no luck, but this seems like the sort of general-purpose thing that a lot of people would be interested in. I feel like I must be missing something. Any help is appreciated. Josh Welker Electronic/Media Services Librarian College Liaison University Libraries Southwest Baptist University 417.328.1624 -- Dana Pearson dbpearsonmlis.com
Re: [CODE4LIB] LOC Subject Headings API
Interesting project. Sounds like AJAX technique is used to capture and transmit every keystroke. I expect the result (automatic suggested words) to be shown down the search box while you are typing. I tested your link, but only got a download. Do I miss something? Kelly Zhu -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Ethan Gruber Sent: 2013年6月5日 8:22 To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API You'd write some javascript to query the service with every keystroke, e.g. http://id.loc.gov/authorities/suggest/?q=Hi replies with subjects beginning with hi* It looks like covo.js supports LCSH, so you could look into that. Ethan On Wed, Jun 5, 2013 at 9:13 AM, Joshua Welker jwel...@sbuniv.edu wrote: This would work, except I would need a way to get all the subjects rather than just biology. Any idea how to do that? I tried removing the querystring from the URL and changing Biology in the URL to with no success. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Michael J. Giarlo Sent: Tuesday, June 04, 2013 7:05 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API How about id.loc.gov's OpenSearch-powered autosuggest feature? mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology [Biology,[Biology,Biology Colloquium,Biology Curators' Group,Biology Databook Editorial Board (U.S.),Biology and Earth Sciences Teaching Institute,Biology and Management of True Fir in the Pacific Northwest Symposium (1981 : Seattle, Wash.),Biology and Resource Management Program (Alaska Cooperative Park Studies Unit),Biology and behavior series,Biology and environment (Macmillan Press),Biology and management of old-growth forests],[1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result],[http://id.loc.gov/authorities/subjects/sh85014203,; http://id.loc.gov/authorities/names/n79006962,; http://id.loc.gov/authorities/names/n90639795,; http://id.loc.gov/authorities/names/n85100466,; http://id.loc.gov/authorities/names/nr97041787,; http://id.loc.gov/authorities/names/n85276541,; http://id.loc.gov/authorities/names/n82057525,; http://id.loc.gov/authorities/names/n90605518,; http://id.loc.gov/authorities/names/nr2001011448,; http://id.loc.gov/authorities/names/no94028058;]] -Mike On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker jwel...@sbuniv.edu wrote: I did see that, and it will work in a pinch. But the authority file is pretty massive--almost 1GB-- and would be difficult to handle in an automated way and without completely killing my web app due to memory constraints while searching the file. Thanks, though. Josh Welker -Original Message- From: Bryan Baldus [mailto:bryan.bal...@quality-books.com] Sent: Tuesday, June 04, 2013 6:39 PM To: Code for Libraries; Joshua Welker Subject: RE: LOC Subject Headings API On Tuesday, June 04, 2013 6:31 PM, Joshua Welker [jwel...@sbuniv.edu] wrote: I am building an auto-suggest feature into our library's search box, and I am wanting to include LOC subject headings in my suggestions list. Does anyone know of any web service that allows for automated harvesting of LOC Subject Headings? I am also looking for name authorities, for that matter. Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have spent a while Googling with no luck, but this seems like the sort of general-purpose thing that a lot of people would be interested in. I feel like I must be missing something. Any help is appreciated. Have you seen http://id.loc.gov/ with bulk downloads in various formats at http://id.loc.gov/download/ I hope this helps, Bryan Baldus Senior Cataloger Quality Books Inc. The Best of America's Independent Presses 1-800-323-4241x402 bryan.bal...@quality-books.com eij...@cpan.org http://home.comcast.net/~eijabb/
Re: [CODE4LIB] LOC Subject Headings API
Dear Josh, Take a look at Mike's email below, which may have quickly fell down the inbox, helped along by an unhelpful reply. It has the suggest pattern, but to repeat the general pattern: This will provide auto-suggestions for Subjects, ChildrensSubjects, GenreForms, and Names: http://id.loc.gov/authorities/suggest/?q=Hounds This will provide auto-suggestions for Subjects only (replace subjects with names for only names and so on): http://id.loc.gov/authorities/subjects/suggest/?q=Hounds Yours, Kevin -- Kevin Ford Network Development and MARC Standards Office Library of Congress Washington, DC -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Michael J. Giarlo Sent: Tuesday, June 04, 2013 8:05 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API How about id.loc.gov's OpenSearch-powered autosuggest feature? mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology [Biology,[Biology,Biology Colloquium,Biology Curators' Group,Biology Databook Editorial Board (U.S.),Biology and Earth Sciences Teaching Institute,Biology and Management of True Fir in the Pacific Northwest Symposium (1981 : Seattle, Wash.),Biology and Resource Management Program (Alaska Cooperative Park Studies Unit),Biology and behavior series,Biology and environment (Macmillan Press),Biology and management of old-growth forests],[1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result],[http://id.loc.gov/authorities/subjects/sh85014203,; http://id.loc.gov/authorities/names/n79006962,; http://id.loc.gov/authorities/names/n90639795,; http://id.loc.gov/authorities/names/n85100466,; http://id.loc.gov/authorities/names/nr97041787,; http://id.loc.gov/authorities/names/n85276541,; http://id.loc.gov/authorities/names/n82057525,; http://id.loc.gov/authorities/names/n90605518,; http://id.loc.gov/authorities/names/nr2001011448,; http://id.loc.gov/authorities/names/no94028058;]] -Mike On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker jwel...@sbuniv.edu wrote: I did see that, and it will work in a pinch. But the authority file is pretty massive--almost 1GB-- and would be difficult to handle in an automated way and without completely killing my web app due to memory constraints while searching the file. Thanks, though. Josh Welker -Original Message- From: Bryan Baldus [mailto:bryan.bal...@quality-books.com] Sent: Tuesday, June 04, 2013 6:39 PM To: Code for Libraries; Joshua Welker Subject: RE: LOC Subject Headings API On Tuesday, June 04, 2013 6:31 PM, Joshua Welker [jwel...@sbuniv.edu] wrote: I am building an auto-suggest feature into our library's search box, and I am wanting to include LOC subject headings in my suggestions list. Does anyone know of any web service that allows for automated harvesting of LOC Subject Headings? I am also looking for name authorities, for that matter. Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have spent a while Googling with no luck, but this seems like the sort of general-purpose thing that a lot of people would be interested in. I feel like I must be missing something. Any help is appreciated. Have you seen http://id.loc.gov/ with bulk downloads in various formats at http://id.loc.gov/download/ I hope this helps, Bryan Baldus Senior Cataloger Quality Books Inc. The Best of America's Independent Presses 1-800-323-4241x402 bryan.bal...@quality-books.com eij...@cpan.org http://home.comcast.net/~eijabb/
Re: [CODE4LIB] LOC Subject Headings API
This would work, except I would need a way to get all the subjects rather than just biology. -- If you want all the subjects. [period], take a look at the download page: http://id.loc.gov/download/ There are bulk downloads for LCSH and the LC/NACO file of Names. The suggest service (described in a separate email) is designed to give you the top 10 best matches based on a left-anchored search, so that it may function as a real-time type-ahead service. Yours, Kevin -- Kevin Ford Network Development and MARC Standards Office Library of Congress Washington, DC -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Joshua Welker Sent: Wednesday, June 05, 2013 9:14 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API This would work, except I would need a way to get all the subjects rather than just biology. Any idea how to do that? I tried removing the querystring from the URL and changing Biology in the URL to with no success. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Michael J. Giarlo Sent: Tuesday, June 04, 2013 7:05 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API How about id.loc.gov's OpenSearch-powered autosuggest feature? mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology [Biology,[Biology,Biology Colloquium,Biology Curators' Group,Biology Databook Editorial Board (U.S.),Biology and Earth Sciences Teaching Institute,Biology and Management of True Fir in the Pacific Northwest Symposium (1981 : Seattle, Wash.),Biology and Resource Management Program (Alaska Cooperative Park Studies Unit),Biology and behavior series,Biology and environment (Macmillan Press),Biology and management of old-growth forests],[1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result],[http://id.loc.gov/authorities/subjects/sh85014203,; http://id.loc.gov/authorities/names/n79006962,; http://id.loc.gov/authorities/names/n90639795,; http://id.loc.gov/authorities/names/n85100466,; http://id.loc.gov/authorities/names/nr97041787,; http://id.loc.gov/authorities/names/n85276541,; http://id.loc.gov/authorities/names/n82057525,; http://id.loc.gov/authorities/names/n90605518,; http://id.loc.gov/authorities/names/nr2001011448,; http://id.loc.gov/authorities/names/no94028058;]] -Mike On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker jwel...@sbuniv.edu wrote: I did see that, and it will work in a pinch. But the authority file is pretty massive--almost 1GB-- and would be difficult to handle in an automated way and without completely killing my web app due to memory constraints while searching the file. Thanks, though. Josh Welker -Original Message- From: Bryan Baldus [mailto:bryan.bal...@quality-books.com] Sent: Tuesday, June 04, 2013 6:39 PM To: Code for Libraries; Joshua Welker Subject: RE: LOC Subject Headings API On Tuesday, June 04, 2013 6:31 PM, Joshua Welker [jwel...@sbuniv.edu] wrote: I am building an auto-suggest feature into our library's search box, and I am wanting to include LOC subject headings in my suggestions list. Does anyone know of any web service that allows for automated harvesting of LOC Subject Headings? I am also looking for name authorities, for that matter. Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have spent a while Googling with no luck, but this seems like the sort of general-purpose thing that a lot of people would be interested in. I feel like I must be missing something. Any help is appreciated. Have you seen http://id.loc.gov/ with bulk downloads in various formats at http://id.loc.gov/download/ I hope this helps, Bryan Baldus Senior Cataloger Quality Books Inc. The Best of America's Independent Presses 1-800-323-4241x402 bryan.bal...@quality-books.com eij...@cpan.org http://home.comcast.net/~eijabb/
Re: [CODE4LIB] LOC Subject Headings API
it looks like LCSH is moving past this string-based hierarchy in favor of one expressed in terms of linked data. -- Oh, I've never received that impression. Pre-coordination - which you referred to as hierarchical sets of terms - is alive and well. A number of studies were done in the second half of the 2000s that looked at the creation of LCSH headings. Pre-coordination received significant attention in these studies and was ultimately confirmed as a good thing. Who knows why the precoordinated heading that was once used for Mexican War, 1846-1848 was replaced, but that probably happened in 1986 (or 1991) based on the creation and most-resent modification times on that record. In other words, at a time when the notion of Linked Data was non-existent. Yours, Kevin -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Ethan Gruber Sent: Wednesday, June 05, 2013 9:41 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API Are you referring to hierarchical sets of terms, like United States-- History--War with Mexico, 1845-1848? This is an earlier established term of http://id.loc.gov/authorities/subjects/sh85140201 (now labeled Mexican War, 1846-1848). Ed Summers or Kevin Ford are in a better position to discuss the change of terminology, but it looks like LCSH is moving past this string-based hierarchy in favor of one expressed in terms of linked data. Ethan On Wed, Jun 5, 2013 at 9:32 AM, Joshua Welker jwel...@sbuniv.edu wrote: I've seen those, but I can't figure out where on the id.loc.gov site there is actually a URL that provides a list of authority terms. All the links on the site seem to link to other pages within the site. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Dana Pearson Sent: Tuesday, June 04, 2013 6:42 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API Joshua, There are different formats at LOC: http://id.loc.gov/authorities/subjects.html dana On Tue, Jun 4, 2013 at 6:31 PM, Joshua Welker jwel...@sbuniv.edu wrote: I am building an auto-suggest feature into our library's search box, and I am wanting to include LOC subject headings in my suggestions list. Does anyone know of any web service that allows for automated harvesting of LOC Subject Headings? I am also looking for name authorities, for that matter. Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have spent a while Googling with no luck, but this seems like the sort of general-purpose thing that a lot of people would be interested in. I feel like I must be missing something. Any help is appreciated. Josh Welker Electronic/Media Services Librarian College Liaison University Libraries Southwest Baptist University 417.328.1624 -- Dana Pearson dbpearsonmlis.com
Re: [CODE4LIB] LOC Subject Headings API
Josh, Can you say more about how the API isn't behaving as you expected it to? -Mike On Wed, Jun 5, 2013 at 10:37 AM, Joshua Welker jwel...@sbuniv.edu wrote: I went with this method and made some good progress, but the results the API was returning were not what I expected. I might have to give up on this project. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Ethan Gruber Sent: Wednesday, June 05, 2013 8:22 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API You'd write some javascript to query the service with every keystroke, e.g. http://id.loc.gov/authorities/suggest/?q=Hi replies with subjects beginning with hi* It looks like covo.js supports LCSH, so you could look into that. Ethan On Wed, Jun 5, 2013 at 9:13 AM, Joshua Welker jwel...@sbuniv.edu wrote: This would work, except I would need a way to get all the subjects rather than just biology. Any idea how to do that? I tried removing the querystring from the URL and changing Biology in the URL to with no success. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Michael J. Giarlo Sent: Tuesday, June 04, 2013 7:05 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API How about id.loc.gov's OpenSearch-powered autosuggest feature? mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology [Biology,[Biology,Biology Colloquium,Biology Curators' Group,Biology Databook Editorial Board (U.S.),Biology and Earth Sciences Teaching Institute,Biology and Management of True Fir in the Pacific Northwest Symposium (1981 : Seattle, Wash.),Biology and Resource Management Program (Alaska Cooperative Park Studies Unit),Biology and behavior series,Biology and environment (Macmillan Press),Biology and management of old-growth forests],[1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result],[http://id.loc.gov/authorities/subjects/sh85014203,; http://id.loc.gov/authorities/names/n79006962,; http://id.loc.gov/authorities/names/n90639795,; http://id.loc.gov/authorities/names/n85100466,; http://id.loc.gov/authorities/names/nr97041787,; http://id.loc.gov/authorities/names/n85276541,; http://id.loc.gov/authorities/names/n82057525,; http://id.loc.gov/authorities/names/n90605518,; http://id.loc.gov/authorities/names/nr2001011448,; http://id.loc.gov/authorities/names/no94028058;]] -Mike On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker jwel...@sbuniv.edu wrote: I did see that, and it will work in a pinch. But the authority file is pretty massive--almost 1GB-- and would be difficult to handle in an automated way and without completely killing my web app due to memory constraints while searching the file. Thanks, though. Josh Welker -Original Message- From: Bryan Baldus [mailto:bryan.bal...@quality-books.com] Sent: Tuesday, June 04, 2013 6:39 PM To: Code for Libraries; Joshua Welker Subject: RE: LOC Subject Headings API On Tuesday, June 04, 2013 6:31 PM, Joshua Welker [jwel...@sbuniv.edu] wrote: I am building an auto-suggest feature into our library's search box, and I am wanting to include LOC subject headings in my suggestions list. Does anyone know of any web service that allows for automated harvesting of LOC Subject Headings? I am also looking for name authorities, for that matter. Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have spent a while Googling with no luck, but this seems like the sort of general-purpose thing that a lot of people would be interested in. I feel like I must be missing something. Any help is appreciated. Have you seen http://id.loc.gov/ with bulk downloads in various formats at http://id.loc.gov/download/ I hope this helps, Bryan Baldus Senior Cataloger Quality Books Inc. The Best of America's Independent Presses 1-800-323-4241x402 bryan.bal...@quality-books.com eij...@cpan.org http://home.comcast.net/~eijabb/
Re: [CODE4LIB] LOC Subject Headings API
Hi Josh, You might ask on the Omeka developers' list about how the Omeka development team created their LC Suggest plugin -- they could probably give you tips. Here's the listserv: https://groups.google.com/forum/?fromgroups#!forum/omeka-dev and here's a description of the plugin: http://omeka.org/codex/Plugins/Library_of_Congress_Suggest Amanda Amanda L. French, Ph.D. http://amandafrench.net Email: ama...@amandafrench.net Cell: 720-530-7515 Twitter: @amandafrench Skype: amandafrenchphd AIM: habitrailgirl On 6/4/13 11:00 PM, CODE4LIB automatic digest system wrote: -- Date:Tue, 4 Jun 2013 23:31:18 + From:Joshua Welkerjwel...@sbuniv.edu Subject: LOC Subject Headings API I am building an auto-suggest feature into our library's search box, and I am wanting to include LOC subject headings in my suggestions list. Does anyone know of any web service that allows for automated harvesting of LOC Subject Headings? I am also looking for name authorities, for that matter. Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have spent a while Googling with no luck, but this seems like the sort of general-purpose thing that a lot of people would be interested in. I feel like I must be missing something. Any help is appreciated. Josh Welker Electronic/Media Services Librarian College Liaison University Libraries Southwest Baptist University 417.328.1624
Re: [CODE4LIB] LOC Subject Headings API
I realized since I made that comment that the API is designed to give the top 10 subject heading suggestions rather than all of them. So that part is fine. But I am once again unsure if the API will work for me. I am creating a mashup of several data sources for my auto-suggest feature, and I am having a hard time dynamically adding the results from the LOC Suggest API to the existing collection of data that is used to populate my jQuery UI Autocomplete field. Ideally, I'd like to be able to have all the LC Subject Heading data cached on my server so that I can build my autocomplete data source one time rather than having to deal with dynamically adding, sorting, etc. But then the problem I run into is that the LCSH master file is so big that it basically crashes the server. That's why I'm thinking I might have to give up on this project. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Michael J. Giarlo Sent: Wednesday, June 05, 2013 9:59 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API Josh, Can you say more about how the API isn't behaving as you expected it to? -Mike On Wed, Jun 5, 2013 at 10:37 AM, Joshua Welker jwel...@sbuniv.edu wrote: I went with this method and made some good progress, but the results the API was returning were not what I expected. I might have to give up on this project. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Ethan Gruber Sent: Wednesday, June 05, 2013 8:22 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API You'd write some javascript to query the service with every keystroke, e.g. http://id.loc.gov/authorities/suggest/?q=Hi replies with subjects beginning with hi* It looks like covo.js supports LCSH, so you could look into that. Ethan On Wed, Jun 5, 2013 at 9:13 AM, Joshua Welker jwel...@sbuniv.edu wrote: This would work, except I would need a way to get all the subjects rather than just biology. Any idea how to do that? I tried removing the querystring from the URL and changing Biology in the URL to with no success. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Michael J. Giarlo Sent: Tuesday, June 04, 2013 7:05 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API How about id.loc.gov's OpenSearch-powered autosuggest feature? mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology [Biology,[Biology,Biology Colloquium,Biology Curators' Group,Biology Databook Editorial Board (U.S.),Biology and Earth Sciences Teaching Institute,Biology and Management of True Fir in the Pacific Northwest Symposium (1981 : Seattle, Wash.),Biology and Resource Management Program (Alaska Cooperative Park Studies Unit),Biology and behavior series,Biology and environment (Macmillan Press),Biology and management of old-growth forests],[1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result],[http://id.loc.gov/authorities/subjects/sh85014203,; http://id.loc.gov/authorities/names/n79006962,; http://id.loc.gov/authorities/names/n90639795,; http://id.loc.gov/authorities/names/n85100466,; http://id.loc.gov/authorities/names/nr97041787,; http://id.loc.gov/authorities/names/n85276541,; http://id.loc.gov/authorities/names/n82057525,; http://id.loc.gov/authorities/names/n90605518,; http://id.loc.gov/authorities/names/nr2001011448,; http://id.loc.gov/authorities/names/no94028058;]] -Mike On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker jwel...@sbuniv.edu wrote: I did see that, and it will work in a pinch. But the authority file is pretty massive--almost 1GB-- and would be difficult to handle in an automated way and without completely killing my web app due to memory constraints while searching the file. Thanks, though. Josh Welker -Original Message- From: Bryan Baldus [mailto:bryan.bal...@quality-books.com] Sent: Tuesday, June 04, 2013 6:39 PM To: Code for Libraries; Joshua Welker Subject: RE: LOC Subject Headings API On Tuesday, June 04, 2013 6:31 PM, Joshua Welker [jwel...@sbuniv.edu] wrote: I am building an auto-suggest feature into our library's search box, and I am wanting to include LOC subject headings in my suggestions list. Does anyone know of any web service that allows for automated harvesting of LOC Subject Headings? I am also looking for name authorities, for that matter. Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have spent a while Googling with no luck, but this seems like the sort of general-purpose thing that a lot of people would be interested in. I feel like I must be missing something. Any
Re: [CODE4LIB] LOC Subject Headings API
I once put all of the LCSH headings into a local Solr index and used TermsComponent to power autosuggest. It was really fast. Ethan On Wed, Jun 5, 2013 at 12:47 PM, Joshua Welker jwel...@sbuniv.edu wrote: I realized since I made that comment that the API is designed to give the top 10 subject heading suggestions rather than all of them. So that part is fine. But I am once again unsure if the API will work for me. I am creating a mashup of several data sources for my auto-suggest feature, and I am having a hard time dynamically adding the results from the LOC Suggest API to the existing collection of data that is used to populate my jQuery UI Autocomplete field. Ideally, I'd like to be able to have all the LC Subject Heading data cached on my server so that I can build my autocomplete data source one time rather than having to deal with dynamically adding, sorting, etc. But then the problem I run into is that the LCSH master file is so big that it basically crashes the server. That's why I'm thinking I might have to give up on this project. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Michael J. Giarlo Sent: Wednesday, June 05, 2013 9:59 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API Josh, Can you say more about how the API isn't behaving as you expected it to? -Mike On Wed, Jun 5, 2013 at 10:37 AM, Joshua Welker jwel...@sbuniv.edu wrote: I went with this method and made some good progress, but the results the API was returning were not what I expected. I might have to give up on this project. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Ethan Gruber Sent: Wednesday, June 05, 2013 8:22 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API You'd write some javascript to query the service with every keystroke, e.g. http://id.loc.gov/authorities/suggest/?q=Hi replies with subjects beginning with hi* It looks like covo.js supports LCSH, so you could look into that. Ethan On Wed, Jun 5, 2013 at 9:13 AM, Joshua Welker jwel...@sbuniv.edu wrote: This would work, except I would need a way to get all the subjects rather than just biology. Any idea how to do that? I tried removing the querystring from the URL and changing Biology in the URL to with no success. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Michael J. Giarlo Sent: Tuesday, June 04, 2013 7:05 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API How about id.loc.gov's OpenSearch-powered autosuggest feature? mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology [Biology,[Biology,Biology Colloquium,Biology Curators' Group,Biology Databook Editorial Board (U.S.),Biology and Earth Sciences Teaching Institute,Biology and Management of True Fir in the Pacific Northwest Symposium (1981 : Seattle, Wash.),Biology and Resource Management Program (Alaska Cooperative Park Studies Unit),Biology and behavior series,Biology and environment (Macmillan Press),Biology and management of old-growth forests],[1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result],[http://id.loc.gov/authorities/subjects/sh85014203,; http://id.loc.gov/authorities/names/n79006962,; http://id.loc.gov/authorities/names/n90639795,; http://id.loc.gov/authorities/names/n85100466,; http://id.loc.gov/authorities/names/nr97041787,; http://id.loc.gov/authorities/names/n85276541,; http://id.loc.gov/authorities/names/n82057525,; http://id.loc.gov/authorities/names/n90605518,; http://id.loc.gov/authorities/names/nr2001011448,; http://id.loc.gov/authorities/names/no94028058;]] -Mike On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker jwel...@sbuniv.edu wrote: I did see that, and it will work in a pinch. But the authority file is pretty massive--almost 1GB-- and would be difficult to handle in an automated way and without completely killing my web app due to memory constraints while searching the file. Thanks, though. Josh Welker -Original Message- From: Bryan Baldus [mailto:bryan.bal...@quality-books.com] Sent: Tuesday, June 04, 2013 6:39 PM To: Code for Libraries; Joshua Welker Subject: RE: LOC Subject Headings API On Tuesday, June 04, 2013 6:31 PM, Joshua Welker [jwel...@sbuniv.edu] wrote: I am building an auto-suggest feature into our library's search box, and I am wanting to include LOC subject headings in my suggestions list. Does anyone know of any web service that allows for automated harvesting of LOC Subject Headings? I am also looking for name
Re: [CODE4LIB] LOC Subject Headings API
As a somewhat different approach to this, you may wish to consider using Apache Stanbol [1]. Briefly, Stanbol is a system for building semantic web applications. Among other things, it allows you to import the LOC data as n-triples (either in SKOS or MADS/RDF format) [2]. The data is stored in a Solr index and you can query it over HTTP, so it ends up being really, really fast. Plus, all of the RDF relationships are stored in the index, so you can query the API in a lot of different ways. The iks-project has a demo version of stanbol [3] with a variety of locally managed entity hubs -- they don't have LC subject headings, but they do include a lot of other data collections. I use Stanbol fairly extensively for a number of these types of applications, though I don't expose the API directly to the web. In our system, we have the LOC subject headings, LOC name authority records and the full geonames database. If you do run this, you will want to put it on a system with a good amount of memory. Regards, Aaron [1] http://stanbol.apache.org [2] https://stanbol.apache.org/docs/trunk/customvocabulary.html [3] http://dev.iks-project.eu:8081/entityhub -- Aaron Coburn Systems Administrator and Programmer Academic Technology Services, Amherst College acob...@amherst.edumailto:acob...@amherst.edu On Jun 4, 2013, at 7:31 PM, Joshua Welker jwel...@sbuniv.edumailto:jwel...@sbuniv.edu wrote: I am building an auto-suggest feature into our library's search box, and I am wanting to include LOC subject headings in my suggestions list. Does anyone know of any web service that allows for automated harvesting of LOC Subject Headings? I am also looking for name authorities, for that matter. Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have spent a while Googling with no luck, but this seems like the sort of general-purpose thing that a lot of people would be interested in. I feel like I must be missing something. Any help is appreciated. Josh Welker Electronic/Media Services Librarian College Liaison University Libraries Southwest Baptist University 417.328.1624
Re: [CODE4LIB] LOC Subject Headings API
Hmm, that is pretty smart. I am actually hoping to roll this whole thing into a plugin for Wordpress/Drupal, so if possible I want to avoid using anything that is going to require server configuration (ie setting up Solr). But I bet I could just roll all the LCSH data into an SQLite file and then search it with PHP on the server. This might work. Thanks! Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Ethan Gruber Sent: Wednesday, June 05, 2013 11:51 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API I once put all of the LCSH headings into a local Solr index and used TermsComponent to power autosuggest. It was really fast. Ethan On Wed, Jun 5, 2013 at 12:47 PM, Joshua Welker jwel...@sbuniv.edu wrote: I realized since I made that comment that the API is designed to give the top 10 subject heading suggestions rather than all of them. So that part is fine. But I am once again unsure if the API will work for me. I am creating a mashup of several data sources for my auto-suggest feature, and I am having a hard time dynamically adding the results from the LOC Suggest API to the existing collection of data that is used to populate my jQuery UI Autocomplete field. Ideally, I'd like to be able to have all the LC Subject Heading data cached on my server so that I can build my autocomplete data source one time rather than having to deal with dynamically adding, sorting, etc. But then the problem I run into is that the LCSH master file is so big that it basically crashes the server. That's why I'm thinking I might have to give up on this project. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Michael J. Giarlo Sent: Wednesday, June 05, 2013 9:59 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API Josh, Can you say more about how the API isn't behaving as you expected it to? -Mike On Wed, Jun 5, 2013 at 10:37 AM, Joshua Welker jwel...@sbuniv.edu wrote: I went with this method and made some good progress, but the results the API was returning were not what I expected. I might have to give up on this project. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Ethan Gruber Sent: Wednesday, June 05, 2013 8:22 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API You'd write some javascript to query the service with every keystroke, e.g. http://id.loc.gov/authorities/suggest/?q=Hi replies with subjects beginning with hi* It looks like covo.js supports LCSH, so you could look into that. Ethan On Wed, Jun 5, 2013 at 9:13 AM, Joshua Welker jwel...@sbuniv.edu wrote: This would work, except I would need a way to get all the subjects rather than just biology. Any idea how to do that? I tried removing the querystring from the URL and changing Biology in the URL to with no success. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Michael J. Giarlo Sent: Tuesday, June 04, 2013 7:05 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API How about id.loc.gov's OpenSearch-powered autosuggest feature? mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology [Biology,[Biology,Biology Colloquium,Biology Curators' Group,Biology Databook Editorial Board (U.S.),Biology and Earth Sciences Teaching Institute,Biology and Management of True Fir in the Pacific Northwest Symposium (1981 : Seattle, Wash.),Biology and Resource Management Program (Alaska Cooperative Park Studies Unit),Biology and behavior series,Biology and environment (Macmillan Press),Biology and management of old-growth forests],[1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result],[http://id.loc.gov/authorities/subjects/sh85014203,; http://id.loc.gov/authorities/names/n79006962,; http://id.loc.gov/authorities/names/n90639795,; http://id.loc.gov/authorities/names/n85100466,; http://id.loc.gov/authorities/names/nr97041787,; http://id.loc.gov/authorities/names/n85276541,; http://id.loc.gov/authorities/names/n82057525,; http://id.loc.gov/authorities/names/n90605518,; http://id.loc.gov/authorities/names/nr2001011448,; http://id.loc.gov/authorities/names/no94028058;]] -Mike On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker jwel...@sbuniv.edu wrote: I did see that, and it will work in a pinch. But the authority file is pretty massive--almost 1GB-- and would be difficult to handle in an automated way and without completely killing my web app due to memory constraints while searching the file
Re: [CODE4LIB] LOC Subject Headings API
the LCSH master file is so big that it basically crashes the server. Do you really want to use the full LCSH, or just the subset that exists in your local catalog? Or, to put it another way: do you really want to provide the user with search suggestions that will result in zero hits? Keith
Re: [CODE4LIB] LOC Subject Headings API
If you don't have to use LCSH... the Agrovoc thesaurus has a term suggester API: try http://foris.fao.org/agrovoc/ It's actually easier to use than LCSH because the terms are not pre-coordinated. kc On 6/5/13 9:58 AM, Joshua Welker wrote: Hmm, that is pretty smart. I am actually hoping to roll this whole thing into a plugin for Wordpress/Drupal, so if possible I want to avoid using anything that is going to require server configuration (ie setting up Solr). But I bet I could just roll all the LCSH data into an SQLite file and then search it with PHP on the server. This might work. Thanks! Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Ethan Gruber Sent: Wednesday, June 05, 2013 11:51 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API I once put all of the LCSH headings into a local Solr index and used TermsComponent to power autosuggest. It was really fast. Ethan On Wed, Jun 5, 2013 at 12:47 PM, Joshua Welker jwel...@sbuniv.edu wrote: I realized since I made that comment that the API is designed to give the top 10 subject heading suggestions rather than all of them. So that part is fine. But I am once again unsure if the API will work for me. I am creating a mashup of several data sources for my auto-suggest feature, and I am having a hard time dynamically adding the results from the LOC Suggest API to the existing collection of data that is used to populate my jQuery UI Autocomplete field. Ideally, I'd like to be able to have all the LC Subject Heading data cached on my server so that I can build my autocomplete data source one time rather than having to deal with dynamically adding, sorting, etc. But then the problem I run into is that the LCSH master file is so big that it basically crashes the server. That's why I'm thinking I might have to give up on this project. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Michael J. Giarlo Sent: Wednesday, June 05, 2013 9:59 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API Josh, Can you say more about how the API isn't behaving as you expected it to? -Mike On Wed, Jun 5, 2013 at 10:37 AM, Joshua Welker jwel...@sbuniv.edu wrote: I went with this method and made some good progress, but the results the API was returning were not what I expected. I might have to give up on this project. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Ethan Gruber Sent: Wednesday, June 05, 2013 8:22 AM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API You'd write some javascript to query the service with every keystroke, e.g. http://id.loc.gov/authorities/suggest/?q=Hi replies with subjects beginning with hi* It looks like covo.js supports LCSH, so you could look into that. Ethan On Wed, Jun 5, 2013 at 9:13 AM, Joshua Welker jwel...@sbuniv.edu wrote: This would work, except I would need a way to get all the subjects rather than just biology. Any idea how to do that? I tried removing the querystring from the URL and changing Biology in the URL to with no success. Josh Welker -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Michael J. Giarlo Sent: Tuesday, June 04, 2013 7:05 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] LOC Subject Headings API How about id.loc.gov's OpenSearch-powered autosuggest feature? mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology [Biology,[Biology,Biology Colloquium,Biology Curators' Group,Biology Databook Editorial Board (U.S.),Biology and Earth Sciences Teaching Institute,Biology and Management of True Fir in the Pacific Northwest Symposium (1981 : Seattle, Wash.),Biology and Resource Management Program (Alaska Cooperative Park Studies Unit),Biology and behavior series,Biology and environment (Macmillan Press),Biology and management of old-growth forests],[1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result],[http://id.loc.gov/authorities/subjects/sh85014203,; http://id.loc.gov/authorities/names/n79006962,; http://id.loc.gov/authorities/names/n90639795,; http://id.loc.gov/authorities/names/n85100466,; http://id.loc.gov/authorities/names/nr97041787,; http://id.loc.gov/authorities/names/n85276541,; http://id.loc.gov/authorities/names/n82057525,; http://id.loc.gov/authorities/names/n90605518,; http://id.loc.gov/authorities/names/nr2001011448,; http://id.loc.gov/authorities/names/no94028058;]] -Mike On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker jwel...@sbuniv.edu wrote: I did see that, and it will work in a pinch. But the authority file is pretty massive--almost 1GB-- and would be difficult to handle in an automated way and without completely killing my web app due to memory constraints while searching the file
[CODE4LIB] LOC Subject Headings API
I am building an auto-suggest feature into our library's search box, and I am wanting to include LOC subject headings in my suggestions list. Does anyone know of any web service that allows for automated harvesting of LOC Subject Headings? I am also looking for name authorities, for that matter. Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have spent a while Googling with no luck, but this seems like the sort of general-purpose thing that a lot of people would be interested in. I feel like I must be missing something. Any help is appreciated. Josh Welker Electronic/Media Services Librarian College Liaison University Libraries Southwest Baptist University 417.328.1624
Re: [CODE4LIB] LOC Subject Headings API
Joshua, There are different formats at LOC: http://id.loc.gov/authorities/subjects.html dana On Tue, Jun 4, 2013 at 6:31 PM, Joshua Welker jwel...@sbuniv.edu wrote: I am building an auto-suggest feature into our library's search box, and I am wanting to include LOC subject headings in my suggestions list. Does anyone know of any web service that allows for automated harvesting of LOC Subject Headings? I am also looking for name authorities, for that matter. Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have spent a while Googling with no luck, but this seems like the sort of general-purpose thing that a lot of people would be interested in. I feel like I must be missing something. Any help is appreciated. Josh Welker Electronic/Media Services Librarian College Liaison University Libraries Southwest Baptist University 417.328.1624 -- Dana Pearson dbpearsonmlis.com
Re: [CODE4LIB] LOC Subject Headings API
On Tuesday, June 04, 2013 6:31 PM, Joshua Welker [jwel...@sbuniv.edu] wrote: I am building an auto-suggest feature into our library's search box, and I am wanting to include LOC subject headings in my suggestions list. Does anyone know of any web service that allows for automated harvesting of LOC Subject Headings? I am also looking for name authorities, for that matter. Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have spent a while Googling with no luck, but this seems like the sort of general-purpose thing that a lot of people would be interested in. I feel like I must be missing something. Any help is appreciated. Have you seen http://id.loc.gov/ with bulk downloads in various formats at http://id.loc.gov/download/ I hope this helps, Bryan Baldus Senior Cataloger Quality Books Inc. The Best of America's Independent Presses 1-800-323-4241x402 bryan.bal...@quality-books.com eij...@cpan.org http://home.comcast.net/~eijabb/
Re: [CODE4LIB] LOC Subject Headings API
I did see that, and it will work in a pinch. But the authority file is pretty massive--almost 1GB-- and would be difficult to handle in an automated way and without completely killing my web app due to memory constraints while searching the file. Thanks, though. Josh Welker -Original Message- From: Bryan Baldus [mailto:bryan.bal...@quality-books.com] Sent: Tuesday, June 04, 2013 6:39 PM To: Code for Libraries; Joshua Welker Subject: RE: LOC Subject Headings API On Tuesday, June 04, 2013 6:31 PM, Joshua Welker [jwel...@sbuniv.edu] wrote: I am building an auto-suggest feature into our library's search box, and I am wanting to include LOC subject headings in my suggestions list. Does anyone know of any web service that allows for automated harvesting of LOC Subject Headings? I am also looking for name authorities, for that matter. Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have spent a while Googling with no luck, but this seems like the sort of general-purpose thing that a lot of people would be interested in. I feel like I must be missing something. Any help is appreciated. Have you seen http://id.loc.gov/ with bulk downloads in various formats at http://id.loc.gov/download/ I hope this helps, Bryan Baldus Senior Cataloger Quality Books Inc. The Best of America's Independent Presses 1-800-323-4241x402 bryan.bal...@quality-books.com eij...@cpan.org http://home.comcast.net/~eijabb/
Re: [CODE4LIB] LOC Subject Headings API
How about id.loc.gov's OpenSearch-powered autosuggest feature? mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology [Biology,[Biology,Biology Colloquium,Biology Curators' Group,Biology Databook Editorial Board (U.S.),Biology and Earth Sciences Teaching Institute,Biology and Management of True Fir in the Pacific Northwest Symposium (1981 : Seattle, Wash.),Biology and Resource Management Program (Alaska Cooperative Park Studies Unit),Biology and behavior series,Biology and environment (Macmillan Press),Biology and management of old-growth forests],[1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result],[http://id.loc.gov/authorities/subjects/sh85014203,; http://id.loc.gov/authorities/names/n79006962,; http://id.loc.gov/authorities/names/n90639795,; http://id.loc.gov/authorities/names/n85100466,; http://id.loc.gov/authorities/names/nr97041787,; http://id.loc.gov/authorities/names/n85276541,; http://id.loc.gov/authorities/names/n82057525,; http://id.loc.gov/authorities/names/n90605518,; http://id.loc.gov/authorities/names/nr2001011448,; http://id.loc.gov/authorities/names/no94028058;]] -Mike On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker jwel...@sbuniv.edu wrote: I did see that, and it will work in a pinch. But the authority file is pretty massive--almost 1GB-- and would be difficult to handle in an automated way and without completely killing my web app due to memory constraints while searching the file. Thanks, though. Josh Welker -Original Message- From: Bryan Baldus [mailto:bryan.bal...@quality-books.com] Sent: Tuesday, June 04, 2013 6:39 PM To: Code for Libraries; Joshua Welker Subject: RE: LOC Subject Headings API On Tuesday, June 04, 2013 6:31 PM, Joshua Welker [jwel...@sbuniv.edu] wrote: I am building an auto-suggest feature into our library's search box, and I am wanting to include LOC subject headings in my suggestions list. Does anyone know of any web service that allows for automated harvesting of LOC Subject Headings? I am also looking for name authorities, for that matter. Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have spent a while Googling with no luck, but this seems like the sort of general-purpose thing that a lot of people would be interested in. I feel like I must be missing something. Any help is appreciated. Have you seen http://id.loc.gov/ with bulk downloads in various formats at http://id.loc.gov/download/ I hope this helps, Bryan Baldus Senior Cataloger Quality Books Inc. The Best of America's Independent Presses 1-800-323-4241x402 bryan.bal...@quality-books.com eij...@cpan.org http://home.comcast.net/~eijabb/
Re: [CODE4LIB] LOC Subject Headings API
Something something Simon Spero something something OWL something LOC hierarchy? On Tue, Jun 4, 2013 at 8:04 PM, Michael J. Giarlo leftw...@alumni.rutgers.edu wrote: How about id.loc.gov's OpenSearch-powered autosuggest feature? mjg@moby:~$ curl http://id.loc.gov/authorities/suggest/?q=Biology [Biology,[Biology,Biology Colloquium,Biology Curators' Group,Biology Databook Editorial Board (U.S.),Biology and Earth Sciences Teaching Institute,Biology and Management of True Fir in the Pacific Northwest Symposium (1981 : Seattle, Wash.),Biology and Resource Management Program (Alaska Cooperative Park Studies Unit),Biology and behavior series,Biology and environment (Macmillan Press),Biology and management of old-growth forests],[1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result,1 result],[http://id.loc.gov/authorities/subjects/sh85014203,; http://id.loc.gov/authorities/names/n79006962,; http://id.loc.gov/authorities/names/n90639795,; http://id.loc.gov/authorities/names/n85100466,; http://id.loc.gov/authorities/names/nr97041787,; http://id.loc.gov/authorities/names/n85276541,; http://id.loc.gov/authorities/names/n82057525,; http://id.loc.gov/authorities/names/n90605518,; http://id.loc.gov/authorities/names/nr2001011448,; http://id.loc.gov/authorities/names/no94028058;]] -Mike On Tue, Jun 4, 2013 at 7:51 PM, Joshua Welker jwel...@sbuniv.edu wrote: I did see that, and it will work in a pinch. But the authority file is pretty massive--almost 1GB-- and would be difficult to handle in an automated way and without completely killing my web app due to memory constraints while searching the file. Thanks, though. Josh Welker -Original Message- From: Bryan Baldus [mailto:bryan.bal...@quality-books.com] Sent: Tuesday, June 04, 2013 6:39 PM To: Code for Libraries; Joshua Welker Subject: RE: LOC Subject Headings API On Tuesday, June 04, 2013 6:31 PM, Joshua Welker [jwel...@sbuniv.edu] wrote: I am building an auto-suggest feature into our library's search box, and I am wanting to include LOC subject headings in my suggestions list. Does anyone know of any web service that allows for automated harvesting of LOC Subject Headings? I am also looking for name authorities, for that matter. Any format will be acceptable to me: RDF, XML, JSON, HTML, CSV... I have spent a while Googling with no luck, but this seems like the sort of general-purpose thing that a lot of people would be interested in. I feel like I must be missing something. Any help is appreciated. Have you seen http://id.loc.gov/ with bulk downloads in various formats at http://id.loc.gov/download/ I hope this helps, Bryan Baldus Senior Cataloger Quality Books Inc. The Best of America's Independent Presses 1-800-323-4241x402 bryan.bal...@quality-books.com eij...@cpan.org http://home.comcast.net/~eijabb/
