[CODE4LIB] elasticsearch Implementation
Greetings, i would appreciate if you could provide us with feedback regarding the way you have adopted elasticsearch, and how you have used it with MARC records. I have already read all previous answers, if someone has something in more detail (technically) it would be very helpful. I have seen a project in Github, in Perl, but i wonder if someone has done something in Ruby. Thank you in advance
Re: [CODE4LIB] ElasticSearch
I haven't personally used it but one of my colleagues used it to build something called VivoSearchLight. It's a browser bookmarklet that uses node.js that searches an elasticsearch index produced from a harvest of the triple stores from instances of 7 (I think) instances of a semantic web application (VIVO). He recently refactored the server side code such that it uses Solr. I'm currently working on a project based on blacklight and am going to be looking at the searchlight code to see if I can build a CatalogSearchLight application that will provide a bookmarket such that one can view any page on the web and execute a search of holdings in our catalog based on the text of a web page. In any case, here's the vivosearchlight page: http://vivosearchlight.org/ -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Cary Gordon Sent: Thursday, March 14, 2013 2:47 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: [CODE4LIB] ElasticSearch Anyone using it? Thanks, Cary -- Cary Gordon The Cherry Hill Company http://chillco.com
[CODE4LIB] ElasticSearch
Anyone using it? Thanks, Cary -- Cary Gordon The Cherry Hill Company http://chillco.com
Re: [CODE4LIB] ElasticSearch
That's something pretty pricy. Kun -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Cary Gordon Sent: Thursday, March 14, 2013 2:47 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: [CODE4LIB] ElasticSearch Anyone using it? Thanks, Cary -- Cary Gordon The Cherry Hill Company http://chillco.com
Re: [CODE4LIB] ElasticSearch
In context of logstash, more or less from source but not in production. That's mostly a +1 to the idea though. Interested to hear thoughts. -- Al Matthews Software Developer, Digital Services Unit Atlanta University Center, Robert W. Woodruff Library email: amatth...@auctr.edu; office: 1 404 978 2057 On 3/14/13 2:46 PM, Cary Gordon listu...@chillco.com wrote: Anyone using it? Thanks, Cary -- Cary Gordon The Cherry Hill Company http://chillco.com - ** The contents of this email and any attachments are confidential. They are intended for the named recipient(s) only. If you have received this email in error please notify the system manager or the sender immediately and do not disclose the contents to anyone or make copies. ** IronMail scanned this email for viruses, vandals and malicious content. ** **
Re: [CODE4LIB] ElasticSearch
On Mar 14, 2013, at 2:46 PM, Cary Gordon listu...@chillco.com wrote: Anyone using it? We do, what are you looking to know? -Ross. Thanks, Cary -- Cary Gordon The Cherry Hill Company http://chillco.com
Re: [CODE4LIB] ElasticSearch
Likewise, I've been using it since mid-2010 (0.6.0). What do you want to know about it? MJ
Re: [CODE4LIB] ElasticSearch
I am trying to decide whether we should evaluate it and possibly do a Drupal integration. I know that this is not a trivial question, but, being lazy, I would like to know in what ways it provides services that I can't get from Solr. I have looked at the comparo cheatsheet — http://solr-vs-elasticsearch.com Cary On Thu, Mar 14, 2013 at 11:59 AM, MJ Suhonos m...@suhonos.ca wrote: Likewise, I've been using it since mid-2010 (0.6.0). What do you want to know about it? MJ -- Cary Gordon The Cherry Hill Company http://chillco.com
Re: [CODE4LIB] ElasticSearch
On Thu, Mar 14, 2013 at 06:49:28PM +, Lin, Kun wrote: That's something pretty pricy. Are you joking? It's free and open-source software: https://github.com/elasticsearch/elasticsearch Some of my colleagues at Bielefeld University Library's LibTec department are using it with LibreCat http://librecat.org/ to power our university's central publication data service PUB http://pub.uni-bielefeld.de/. They seem to be happy with it. In other projects, we stick to SOLR or even pure old Lucence. What are you looking to use ES for? Cheers, Christian -- Christian Pietsch · http://purl.org/net/pietsch LibTec · Library Technology and Knowledge Management Bielefeld University Library, Bielefeld, Germany
Re: [CODE4LIB] ElasticSearch
So the main advantages to ES over Solr that I can think of offhand are the fact that you can store and search on complex JSON documents (that is, documents with nested objects, etc.) making it an effective standalone document database and the fact that it will automatically replicate and shard to other instances using zeroconf. -Ross. On Mar 14, 2013, at 3:10 PM, Cary Gordon listu...@chillco.com wrote: I am trying to decide whether we should evaluate it and possibly do a Drupal integration. I know that this is not a trivial question, but, being lazy, I would like to know in what ways it provides services that I can't get from Solr. I have looked at the comparo cheatsheet — http://solr-vs-elasticsearch.com Cary On Thu, Mar 14, 2013 at 11:59 AM, MJ Suhonos m...@suhonos.ca wrote: Likewise, I've been using it since mid-2010 (0.6.0). What do you want to know about it? MJ -- Cary Gordon The Cherry Hill Company http://chillco.com
Re: [CODE4LIB] ElasticSearch
I would add that it generally does better for realtime applications. If your index is updated often, ES *might* perform much better than Solr. http://blog.socialcast.com/realtime-search-solr-vs-elasticsearch/ On Thu, Mar 14, 2013 at 12:18 PM, Ross Singer rossfsin...@gmail.com wrote: So the main advantages to ES over Solr that I can think of offhand are the fact that you can store and search on complex JSON documents (that is, documents with nested objects, etc.) making it an effective standalone document database and the fact that it will automatically replicate and shard to other instances using zeroconf. -Ross. On Mar 14, 2013, at 3:10 PM, Cary Gordon listu...@chillco.com wrote: I am trying to decide whether we should evaluate it and possibly do a Drupal integration. I know that this is not a trivial question, but, being lazy, I would like to know in what ways it provides services that I can't get from Solr. I have looked at the comparo cheatsheet — http://solr-vs-elasticsearch.com Cary On Thu, Mar 14, 2013 at 11:59 AM, MJ Suhonos m...@suhonos.ca wrote: Likewise, I've been using it since mid-2010 (0.6.0). What do you want to know about it? MJ -- Cary Gordon The Cherry Hill Company http://chillco.com
Re: [CODE4LIB] ElasticSearch
This is good info. I guess I will build out a test Drupal integration, unless I can talk someone else into doing it. Cary On Thu, Mar 14, 2013 at 12:19 PM, Tom Johnson johnson.tom+code4...@gmail.com wrote: I would add that it generally does better for realtime applications. If your index is updated often, ES *might* perform much better than Solr. http://blog.socialcast.com/realtime-search-solr-vs-elasticsearch/ On Thu, Mar 14, 2013 at 12:18 PM, Ross Singer rossfsin...@gmail.com wrote: So the main advantages to ES over Solr that I can think of offhand are the fact that you can store and search on complex JSON documents (that is, documents with nested objects, etc.) making it an effective standalone document database and the fact that it will automatically replicate and shard to other instances using zeroconf. -Ross. On Mar 14, 2013, at 3:10 PM, Cary Gordon listu...@chillco.com wrote: I am trying to decide whether we should evaluate it and possibly do a Drupal integration. I know that this is not a trivial question, but, being lazy, I would like to know in what ways it provides services that I can't get from Solr. I have looked at the comparo cheatsheet — http://solr-vs-elasticsearch.com Cary On Thu, Mar 14, 2013 at 11:59 AM, MJ Suhonos m...@suhonos.ca wrote: Likewise, I've been using it since mid-2010 (0.6.0). What do you want to know about it? MJ -- Cary Gordon The Cherry Hill Company http://chillco.com -- Cary Gordon The Cherry Hill Company http://chillco.com
Re: [CODE4LIB] ElasticSearch
Oh, I though he/she is talking about Amazon Search service(part of amazon cloud). I think it is the same or similar name. Kun -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Christian Pietsch Sent: Thursday, March 14, 2013 3:13 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] ElasticSearch On Thu, Mar 14, 2013 at 06:49:28PM +, Lin, Kun wrote: That's something pretty pricy. Are you joking? It's free and open-source software: https://github.com/elasticsearch/elasticsearch Some of my colleagues at Bielefeld University Library's LibTec department are using it with LibreCat http://librecat.org/ to power our university's central publication data service PUB http://pub.uni-bielefeld.de/. They seem to be happy with it. In other projects, we stick to SOLR or even pure old Lucence. What are you looking to use ES for? Cheers, Christian -- Christian Pietsch · http://purl.org/net/pietsch LibTec · Library Technology and Knowledge Management Bielefeld University Library, Bielefeld, Germany
Re: [CODE4LIB] ElasticSearch
To these responses, I would also add: extremely easy to install and configure -- that is, NO configuration is required to get it running out-of-the-box (including schema definitions, servlet containers, etc.) This alone was what drew me to ES in lieu of Solr way back, though I don't know if it has changed in Solr 4.
Re: [CODE4LIB] ElasticSearch
We use ES for indexing and searchability of historical textcorpora (Structure presented in TEI XML) in our dedicated research data repository in the LAUDATIO project (http://www.laudatio-repository.org). In my opinion the main advantages from ES are: Schema-free, Real time and Data in JSON and the best you can ingest tree like data structure. Cheers, Dennis Am 14.03.2013 20:29, schrieb Cary Gordon: Lo and behold, there is a Drupal module for that, although it isn't quite ready for prime time… http://drupal.org/project/elasticsearch On Thu, Mar 14, 2013 at 12:25 PM, Cary Gordon listu...@chillco.com wrote: This is good info. I guess I will build out a test Drupal integration, unless I can talk someone else into doing it. Cary On Thu, Mar 14, 2013 at 12:19 PM, Tom Johnson johnson.tom+code4...@gmail.com wrote: I would add that it generally does better for realtime applications. If your index is updated often, ES *might* perform much better than Solr. http://blog.socialcast.com/realtime-search-solr-vs-elasticsearch/ On Thu, Mar 14, 2013 at 12:18 PM, Ross Singer rossfsin...@gmail.com wrote: So the main advantages to ES over Solr that I can think of offhand are the fact that you can store and search on complex JSON documents (that is, documents with nested objects, etc.) making it an effective standalone document database and the fact that it will automatically replicate and shard to other instances using zeroconf. -Ross. On Mar 14, 2013, at 3:10 PM, Cary Gordon listu...@chillco.com wrote: I am trying to decide whether we should evaluate it and possibly do a Drupal integration. I know that this is not a trivial question, but, being lazy, I would like to know in what ways it provides services that I can't get from Solr. I have looked at the comparo cheatsheet — http://solr-vs-elasticsearch.com Cary On Thu, Mar 14, 2013 at 11:59 AM, MJ Suhonos m...@suhonos.ca wrote: Likewise, I've been using it since mid-2010 (0.6.0). What do you want to know about it? MJ -- Cary Gordon The Cherry Hill Company http://chillco.com -- Cary Gordon The Cherry Hill Company http://chillco.com -- Dennis Zielke Humboldt-Universität zu Berlin Arbeitsgruppe Elektronisches Publizieren am Computer- und Medienservice (CMS) Rudower Chaussee 26 D - 12489 Berlin Postadresse: Unter den Linden 6 D-10099 Berlin Tel. +49(0)30 2093-70004 Projekt LAUDATIO: http://www.laudatio-repository.org/ Projekt CARPET: http://www.carpet-project.net/
Re: [CODE4LIB] ElasticSearch
That would be Amazon CloudSearch. It costs (roughly) from $75/mo (small instance, ~1MM documents) to $500/mo (xl instance, ~8MM docs). It isn't thrilling. Yet. Cary On Thu, Mar 14, 2013 at 12:47 PM, Lin, Kun l...@cua.edu wrote: Oh, I though he/she is talking about Amazon Search service(part of amazon cloud). I think it is the same or similar name. Kun -Original Message- From: Code for Libraries [mailto:CODE4LIB@LISTSERV.ND.EDU] On Behalf Of Christian Pietsch Sent: Thursday, March 14, 2013 3:13 PM To: CODE4LIB@LISTSERV.ND.EDU Subject: Re: [CODE4LIB] ElasticSearch On Thu, Mar 14, 2013 at 06:49:28PM +, Lin, Kun wrote: That's something pretty pricy. Are you joking? It's free and open-source software: https://github.com/elasticsearch/elasticsearch Some of my colleagues at Bielefeld University Library's LibTec department are using it with LibreCat http://librecat.org/ to power our university's central publication data service PUB http://pub.uni-bielefeld.de/. They seem to be happy with it. In other projects, we stick to SOLR or even pure old Lucence. What are you looking to use ES for? Cheers, Christian -- Christian Pietsch · http://purl.org/net/pietsch LibTec · Library Technology and Knowledge Management Bielefeld University Library, Bielefeld, Germany -- Cary Gordon The Cherry Hill Company http://chillco.com
