Re: [Koha] Solr
Viviane, Are you conscious of Solr is a not completely implemented in Koha? The current Koha code allows to configure your indexes/mappings and to launch a search on OPAC. The staff interface does not use the Solr search. Note there has been a discussion at the KohaCon about Solr, see the wiki page http://wiki.koha-community.org/wiki/KohaCon13_searchengine_plan Regards, Jonathan 2013/10/22 Viviane Ventura vaventu...@yahoo.com.br: Oh, thanks. Now the record looks like this: doc str name=idbiblio_1/str str name=recordid1/str str name=recordtypebiblio/str str name=srt_ste_titleCONJUNTURA ECONÔMICA/str str name=srt_str_author/ arr name=ste_titlestrCONJUNTURA ECONÔMICA/str/arr arr name=str_titlestrCONJUNTURA ECONÔMICA/str/arr /doc However, when i search for CONJUNTURA, i have: No results found No results match your search for 'kw,wrdl: conjuntura'. Is there another configuration I'm forgetting to set? 2013/10/22 Jonathan Druart jonathan.dru...@biblibre.com Viviane, Did you configure mappings ? Regards, Jonathan 2013/10/21 Viviane Ventura vaventu...@yahoo.com.br: Hi! Im using koha 3.12 e im trying to use solr instead of zebra as search engine. Everything seems fine except that solr is not indexing the records correctly. Each record looks like this: doc str name=idbiblio_1/str str name=recordid1/str str name=recordtypebiblio/str str name=srt_ste_title/ str name=srt_str_author/ /doc Any ideas? ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha
Re: [Koha] Solr
Viviane, Did you configure mappings ? Regards, Jonathan 2013/10/21 Viviane Ventura vaventu...@yahoo.com.br: Hi! Im using koha 3.12 e im trying to use solr instead of zebra as search engine. Everything seems fine except that solr is not indexing the records correctly. Each record looks like this: doc str name=idbiblio_1/str str name=recordid1/str str name=recordtypebiblio/str str name=srt_ste_title/ str name=srt_str_author/ /doc Any ideas? ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha
Re: [Koha] Solr
Oh, thanks. Now the record looks like this: doc str name=idbiblio_1/str str name=recordid1/str str name=recordtypebiblio/str str name=srt_ste_titleCONJUNTURA ECONÔMICA/str str name=srt_str_author/ arr name=ste_titlestrCONJUNTURA ECONÔMICA/str/arr arr name=str_titlestrCONJUNTURA ECONÔMICA/str/arr /doc However, when i search for CONJUNTURA, i have: No results found No results match your search for 'kw,wrdl: conjuntura'. Is there another configuration I'm forgetting to set? 2013/10/22 Jonathan Druart jonathan.dru...@biblibre.com Viviane, Did you configure mappings ? Regards, Jonathan 2013/10/21 Viviane Ventura vaventu...@yahoo.com.br: Hi! Im using koha 3.12 e im trying to use solr instead of zebra as search engine. Everything seems fine except that solr is not indexing the records correctly. Each record looks like this: doc str name=idbiblio_1/str str name=recordid1/str str name=recordtypebiblio/str str name=srt_ste_title/ str name=srt_str_author/ /doc Any ideas? ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha
[Koha] Solr
Hi! Im using koha 3.12 e im trying to use solr instead of zebra as search engine. Everything seems fine except that solr is not indexing the records correctly. Each record looks like this: doc str name=idbiblio_1/str str name=recordid1/str str name=recordtypebiblio/str str name=srt_ste_title/ str name=srt_str_author/ /doc Any ideas? ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha
[Koha] solr searchengine
Hi, I set up a solr searchengine according to http://wiki.koha-community.org/wiki/Solr_deployment;. It seems to work. koha@ubuntu:~$ /usr/share/koha/bin/migration_tools/rebuild_solr.pl -i SolrAPI = http://localhost:8983/solr/koha How many indexed documents = 2; koha@ubuntu:~$ /usr/share/koha/bin/migration_tools/rebuild_solr.pl -t biblio IndexRecord called with biblio 1 2 at /etc/perl/Koha/SearchEngine/Solr/Index.pm line 35. Indexing biblio 1 at /etc/perl/Koha/SearchEngine/Solr/Index.pm line 55. Indexing biblio 2 at /etc/perl/Koha/SearchEngine/Solr/Index.pm line 55. I also can search on http://localhost:8983/solr/koha/admin/;, and see the records. But when I search on OPAC, it is No results found! The Staff Client can not search too. Could I miss some steps? Could anyone know what is the reason? Thanks a lot. Peter Zhao ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha
[Koha] Solr
Does anyone know if switching from Zebra to Solr will let Koha libraries use a stopwords list? Also, will Solr have any effect on fuzzy searching defaults? Lastly, is there anyone sponsoring or working on a did you mean... opac response to zero retrieval searches? At our library, we'd probably choose a did you mean... spelling suggestion choice over the automatic fuzzy spelling assumptions that are currently in the system. I realize this would probably be listed in bugzilla, but I'm not sure exactly how to search for this. -- Stacy Pober Information Alchemist Manhattan College Library Riverdale, NY 10471 stacy.po...@manhattan.edu ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha
Re: [Koha] Solr
On 25 July 2012 08:15, Stacy Pober stacy.po...@manhattan.edu wrote: Does anyone know if switching from Zebra to Solr will let Koha libraries use a stopwords list? Also, will Solr have any effect on fuzzy searching defaults? Lastly, is there anyone sponsoring or working on a did you mean... opac response to zero retrieval searches? At our library, we'd probably choose a did you mean... spelling suggestion choice over the automatic fuzzy spelling assumptions that are currently in the system. I realize this would probably be listed in bugzilla, but I'm not sure exactly how to search for this. Stacy Koha is not switching to Solr, but now (in master) you can choose between using Solr or Zebra. (YMMV with other software based originally on Koha). This is already working in the master branch. Also, in Koha itself using zebra (I don't know what the forks are doing) you can now use DOM indexing which is much more powerful than the old indexing methods. But we want to do much more than that, if you look at the thread starting here http://lists.katipo.co.nz/pipermail/koha/2012-July/033634.html You will see what the future plans are. (This does include did you mean). Hope this helps Chris ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha
Re: [Koha] Solr
Stacy, I'll address the points that are not answered in the proposal that Brooke linked to. Does anyone know if switching from Zebra to Solr will let Koha libraries use a stopwords list? Solr allows the use of stopwords (as would a decent query parser such as the one I propose writing). However, the Solr code in Koha right now does not make use of the stopwords feature. To my mind, that is a good thing. If we used stopwords, the poetry journal The would be unfindable (and yes, there is such a journal: I had a nightmare and a half trying to find the record when I had an issue to catalog at the NYPL; thankfully their catalog doesn't throw away stopwords anymore). And things would be even worse when searching for French books. Consider the case of the À thé and Le thé. In the US we would probably search for a the and le the. If someone can Also, will Solr have any effect on fuzzy searching defaults? It will. Fuzzy searching has completely different semantics in Solr compared to Zebra. We briefly noted that fact in the proposal, along with a footnote identifying the algorithms that Solr uses for fuzzy searching (and, yes, I am aware that the second algorithm listed is generally used as an alternate name for the first... I have no explanation of why the Solr docs used the two names like they were different). Whether the fuzzy behavior is closer to what you want I could not say. My personal preference, like yours, is to not be fuzzy, and just suggest better searches. Lastly, is there anyone sponsoring or working on a did you mean... opac response to zero retrieval searches? At our library, we'd probably choose a did you mean... spelling suggestion choice over the automatic fuzzy spelling assumptions that are currently in the system. I realize this would probably be listed in bugzilla, but I'm not sure exactly how to search for this. We have not yet added bugs for the various parts of the search rewrite. Regards, Jared -- Jared Camins-Esakov Bibliographer, C P Bibliography Services, LLC (phone) +1 (917) 727-3445 (e-mail) jcam...@cpbibliography.com (web) http://www.cpbibliography.com/ ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha
Re: [Koha] Solr
Stacy, Solr allows the use of stopwords (as would a decent query parser such as the one I propose writing). However, the Solr code in Koha right now does not make use of the stopwords feature. To my mind, that is a good thing. If we used stopwords, the poetry journal The would be unfindable (and yes, there is such a journal: I had a nightmare and a half trying to find the record when I had an issue to catalog at the NYPL; thankfully their catalog doesn't throw away stopwords anymore). And things would be even worse when searching for French books. Consider the case of the À thé and Le thé. In the US we would probably search for a the and le the. If someone can Whoops, I accidentally deleted several sentences when I hit send. Picking up where I left off: If someone can make a compelling case for stopwords, we could, of course, add their use to the proposal as an optional feature. That said, it is my opinion that any catalog that requires stopwords in order to offer relevant results is broken. Relevance ranking should take into account that a given word in a query is statistically overrepresented in the results, and therefore should be considered less relevant than other words in the query. Regards, Jared -- Jared Camins-Esakov Bibliographer, C P Bibliography Services, LLC (phone) +1 (917) 727-3445 (e-mail) jcam...@cpbibliography.com (web) http://www.cpbibliography.com/ ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha
Re: [Koha] Solr and enhanced searching (WAS: Re: Koha Digest, Vol 80, Issue 40)
On 26 June 2012 19:12, Stacy Pober stacy.po...@manhattan.edu wrote: Jared, Thank you for the explanation. When I looked at the link you provided: http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8233 I was surprised to see the heading: *Bug 8233* http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=8233-New search engine layer - introduce solr without breaking anything else Isn't the without breaking anything else something that is assumed in the software development process? Yes it is, that's what we have unit testing and regression testing for. You can actually follow the continuous integration testing here http://jenkins.koha-community.org/ . Here is the master branch http://jenkins.koha-community.org/job/Koha_master/ (which what will be the 3.10.0 release). The other active branches are the 'oldstable' 3.6.x branch of which 3.6.6 has just been released. And the 3.8.x branch, of which 3.8.2 has just been released. This 'bot' jenkins builds and installs a Koha, and runs over 10,000 tests every time anything changes, trying to minimise what is unintentionally broken by any new feature. What this bug is actually referring to is the fact that Koha has been able to work with Solr for nearly 2 years now, but that implementation was a replacement of Zebra. IE removing zebra and adding Solr. This new implementation (which works very well so far) instead allows the Library to choose between Zebra or Solr. IE it is Solr added without removing Zebra support. What is even better is that it allows us to add any number of different indexing engines. A lot of our bugs have tongue and cheek, or ironic names. Some are just silly fun, this is one of my favourites http://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=5158. Sometimes some of us (well mainly me) go a little crazy http://blog.bigballofwax.co.nz/2010/12/14/what-happens-after-updating-the-status-of-300-bugs/ But like Tom Robbins said It is a grave and dangerous mistake to take oneself too seriously :) Chris ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha
Re: [Koha] Solr demo - current BibLibre solr and stetienne devs (updated)
The opac url is here: http://catalogue.solr-demo.biblibre.com/ Type *:* in search input to find all biblios! Claire; On 03/05/2012 14:16, Claire Hernandez wrote: Hi all, I updated the solr-demo install. We provided it for kohacon11 demo but it seems it could be usefull sometimes. This is the current stetienne version (solr devs + acquisitions and serials you can find here with STE library code https://docs.google.com/a/biblibre.com/spreadsheet/ccc?key=0AuZF5Y_c4pIxdHE3S0RXMjJqSzZ3d1BVUmxpRnRVUUE#gid=0 ) Professional interface is here: http://solr-demo.biblibre.com http://solr-demo.biblibre.com/ There is a demo account, you could see for example the current admin interface for indexes preferences http://solr-demo.biblibre.com/cgi-bin/koha/solr/indexes.pl We are re-doing work for the future abstract layer. I will setup a new install to show what we have. Stay tuned :) Claire; (other close subject: you can see the progress for april month for rebase work at BibLibre: https://docs.google.com/a/biblibre.com/spreadsheet/ccc?key=0AuZF5Y_c4pIxdHE3S0RXMjJqSzZ3d1BVUmxpRnRVUUE#gid=11) ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha
[Koha] Solr demo - current BibLibre solr and stetienne devs (updated)
Great Work! Thank you BibLibre. Thank you Claire. For people like us with a non-Latin native language, with stemming as a must to support like in Arabic, Solr FTE is the answer to few but major limitations we have encountered with Zebra. I just hope that BibLibre's work with Solr can be easily now extended to help in migrating Katipto Communications' Kete (the great community digital library piece of work I love) from Zebra to Solr. Thanks Massoud M. AlShareef, عالم الانجازات ينحاز دوماً مع المتفائلين The world of achievement has always belonged to the optimist! KnowledgeWare Technologies (P.O. Box 230-312) Riyadh 11321, Saudi Arabia Cel: +966 505 307 267 mass...@kwareict.com CONFIDENTIALITY NOTE: This communication and any attachments hereto contain information that may be privileged, confidential and exempt from disclosure, and may be covered by the Electronic Communications Privacy Act, as well as other applicable laws. The information is intended solely for the use of the individual or entity to which it is addressed. If you are not the intended recipient or the employee or agent entrusted with the responsibility of delivering the message to the intended recipient, be aware that any review, disclosure, copying or distribution of this transmission is strictly prohibited. If you have received this communication by mistake, please delete and notify the sender immediately. Thank your for your compliance. On Fri, May 4, 2012 at 3:00 AM, koha-requ...@lists.katipo.co.nz wrote: Send Koha mailing list submissions to koha@lists.katipo.co.nz To subscribe or unsubscribe via the World Wide Web, visit http://lists.katipo.co.nz/mailman/listinfo/koha or, via email, send a message with subject or body 'help' to koha-requ...@lists.katipo.co.nz You can reach the person managing the list at koha-ow...@lists.katipo.co.nz When replying, please edit your Subject line so it is more specific than Re: Contents of Koha digest... Today's Topics: 1. Re: Solr demo - current BibLibre solr and stetienne devs (updated) (Claire Hernandez) 2. Re: marc import (Marcel Sandow) 3. Issue with HOLDS (Steven Nickerson) 4. new fiscal year (Michael Little) 5. Re: Issue with HOLDS (James Ghiorzi) -- Message: 1 Date: Thu, 03 May 2012 15:34:15 +0200 From: Claire Hernandez claire.hernan...@biblibre.com To: koha@lists.katipo.co.nz, koha-de...@lists.koha-community.org Subject: Re: [Koha] Solr demo - current BibLibre solr and stetienne devs(updated) Message-ID: 4fa28957.2090...@biblibre.com Content-Type: text/plain; charset=ISO-8859-1; format=flowed The opac url is here: http://catalogue.solr-demo.biblibre.com/ Type *:* in search input to find all biblios! Claire; On 03/05/2012 14:16, Claire Hernandez wrote: Hi all, I updated the solr-demo install. We provided it for kohacon11 demo but it seems it could be usefull sometimes. This is the current stetienne version (solr devs + acquisitions and serials you can find here with STE library code https://docs.google.com/a/biblibre.com/spreadsheet/ccc?key=0AuZF5Y_c4pIxdHE3S0RXMjJqSzZ3d1BVUmxpRnRVUUE#gid=0 ) Professional interface is here: http://solr-demo.biblibre.com http://solr-demo.biblibre.com/ There is a demo account, you could see for example the current admin interface for indexes preferences http://solr-demo.biblibre.com/cgi-bin/koha/solr/indexes.pl We are re-doing work for the future abstract layer. I will setup a new install to show what we have. Stay tuned :) Claire; (other close subject: you can see the progress for april month for rebase work at BibLibre: https://docs.google.com/a/biblibre.com/spreadsheet/ccc?key=0AuZF5Y_c4pIxdHE3S0RXMjJqSzZ3d1BVUmxpRnRVUUE#gid=11 ) ___ Koha mailing list http://koha-community.org Koha@lists.katipo.co.nz http://lists.katipo.co.nz/mailman/listinfo/koha -- Message: 2 Date: Thu, 03 May 2012 22:18:20 +0200 From: Marcel Sandow marcelsan...@gmx.de To: Hugo Agud ha...@orex.es Cc: koha@lists.katipo.co.nz Subject: Re: [Koha] marc import Message-ID: 20120503201820.11...@gmx.net Content-Type: text/plain; charset=utf-8 Hi Koha List! with your help I have managed to solve the import. The mrc syntax: =952 \\$oFCN(Shelf)$pbarcode$abranchcode$branchcode$yitemtype and the join marcedit submenu hint was quite helpful. Thanks for your help. I'm not sure if it is the easiest way, I solved the multiple item import by spliting the dataset into a single item dataset and a dataset with the extra copies. The single item dataset is imported. The extra copies are imported by using a record matching rule, in my case using author and title, and setting the import for only importing items if a record is present. Marcel Hi
