[OPEN-ILS-GENERAL] Evergreen Reports Task Force Meeting: Friday, March 30 at 2:30 Eastern on IRC (#evergreen)
Please join the next Evergreen Reports Task Force meeting this Friday, March 30 at 2:30 Eastern on the #evergreen IRC channel (http://open-ils.org/irc.php). An agenda has been posted: http://open-ils.org/dokuwiki/doku.php?id=evergreen-reports:meetings:2012-03-30-agenda. Anyone interested in Reports in Evergreen is welcome to attend! Jennifer Turner | PALS, A Program of the Minnesota State Colleges and Universities | 507-389-2000
Re: [OPEN-ILS-GENERAL] GSOC[2012] Some quesion regarding C-bsed stored procedures
On Sun, Mar 25, 2012 at 11:01 PM, dsy ds...@sina.com wrote: Hi everyone, I’m a graduate student in Peking University, China. My research direction is Information Retrieve and Extraction and I have about 8 years programming experience in C. I intend to apply for this year’s GSOC on evergreen. The last two ideas interests me and I think it suits me most. To be honest, I have not used evergreen before I see GSOC pages. So I’m not quite sure about the idea. I’m looking for your help to clarify some details and understand the whole project. The first idea about translate certain serach-related SQL query components to C-based stored procedures. Does this means some of the components in full-text searching are working independently which leads to a query will be separated into many SQL query to the database? Not exactly. In order to adjust a baseline cover-density based ranking provided by the Postgres full text search engine, we check for several word order criteria. Specifically, we generate three CASE statements checking to see if the user's query word order matches the order of words in the indexed term, to see if the first word in the query is the first word in the indexed term, and finally to see if the entire query matches the entire indexed term as a phrase. Different indexed terms make use of different combinations of these, and they are implemented using ILIKE conditions. Each has to re-parse the indexed term and apply certain normalizations, so the cost is high simply from repeated evaluation, in addition to the fact that the Postgres executor has more work to do for each row. If a single stored procedure were created that could implement any combination of the possible checks, by taking a flag variable to decide which to apply, and perform all the work in a single go, this would speed execution of searches. The second idea about convert PL/Perl-based PostgreSQL stored procedures to PL/SQL or PL/C. As I see the problem statements, I think this idea relates to the first one. Is this implies we have implemented some PL/Perl based stored procedures to solve the first one and now we need to use some faster language to improve its performance? That is essentially it, yes. In particular, normalization functions such as naco_normalize[1] and search_normalize[2] are very heavily used and would benefit both indexing and search if reimplemented in a faster language, but there are many candidates -- simply search the source for 'language plperlu' (case-insensitively) to see more. As far as I see, the work I need to do is writing some C based string generator to generate SQL query to improve the query performance of the system. Is my understanding correct? I don’t quite sure about the bottleneck faced in the project, is there any reference for me to quickly understand the bottleneck and locate in the code? Or is there any test data shows where the bottleneck is and how bad it is? I don't have the timings handy currently, and of course they depend on both the data set and the server, but the relevance adjustment CASE statements I mention above account for an overwhelming amount of the query response time for small result sets (on the order of 80% of the query time), and can double the time of queries on larger result sets. I have subscribed to the mail list and downloaded the virtual image to build a dev environment quickly. And I’m reading the doc in evergreen pages and downloading the mail archives. Is there any place I need to see? Supplying a small fix or improvement is a required part of the application, as it helps familiarize you with the codebase. There is a list of bugs tagged with 'bitesize' on the Evergreen launchpad site[3] for some ideas. Also, if you've managed to get the Evergreen virtual image running, you can turn up query logging in Postgres to see where query pain points are. [1] http://git.evergreen-ils.org/?p=Evergreen.git;a=blob;f=Open-ILS/src/sql/Pg/002.functions.config.sql;h=3ea61ae289152f4f3e60f99a41aa676becd7dc9e;hb=HEAD#l638 [2] http://git.evergreen-ils.org/?p=Evergreen.git;a=blob;f=Open-ILS/src/sql/Pg/002.functions.config.sql;h=3ea61ae289152f4f3e60f99a41aa676becd7dc9e;hb=HEAD#l702 [3]
Re: [OPEN-ILS-GENERAL] Movies and Z39.5
Welcome Ohio! Lori I'm just the welcome wagon...can't help you with MARC records ;) =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-==-=-=-=-=-=-=-=-= Lori Bowen Ayre // Library Technology Consultant / The Galecia Group Oversight Board Communications Committee / Evergreen (707) 763-6869 // lori.a...@galecia.com Availability: http://tungle.me/lori.ayre lori.a...@galecia.comSpecializing in open source ILS solutions, RFID, filtering, workflow optimization, and materials handling =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= On Tue, Mar 27, 2012 at 8:48 AM, Chauncey Montgomery montg...@oplin.orgwrote: Hello all, I am from Community Library in Sunbury, Ohio, and we are new to Evergreen as of March 15 (I think we may be the first Ohio library to use Evergreen). In the past we paid for MARC records, but in the migration opted to drop the services and see what we could copy through Z39.5 sources. It has been OK for print titles, but difficult to find any sources for movies. Do you know of any good Z39.5 sources for movie records? Thanks for your time. Chauncey -- Chauncey G. Montgomery, MLIS Director/Fiscal Officer Community Library Sunbury, Ohio 740-965-3901 montg...@oplin.org
[OPEN-ILS-GENERAL] Movies and Z39.5
Hello all, I am from Community Library in Sunbury, Ohio, and we are new to Evergreen as of March 15 (I think we may be the first Ohio library to use Evergreen). In the past we paid for MARC records, but in the migration opted to drop the services and see what we could copy through Z39.5 sources. It has been OK for print titles, but difficult to find any sources for movies. Do you know of any good Z39.5 sources for movie records? Thanks for your time. Chauncey -- Chauncey G. Montgomery, MLIS Director/Fiscal Officer Community Library Sunbury, Ohio 740-965-3901 montg...@oplin.org
Re: [OPEN-ILS-GENERAL] Movies and Z39.5
Hi Chauncey, Yay, welcome aboard Ohio! I'm not sure what they have, but Evergreen Indiana made their Evergreen database available as a z39.50 source for other Evergreen libraries last year. You can check the original mailing list message http://markmail.org/message/ymyl7ln7bnkkyl2a for more details. Others may have other suggestions too. Regards, -- Ben On 03/27/2012 11:48 AM, Chauncey Montgomery wrote: Hello all, I am from Community Library in Sunbury, Ohio, and we are new to Evergreen as of March 15 (I think we may be the first Ohio library to use Evergreen). In the past we paid for MARC records, but in the migration opted to drop the services and see what we could copy through Z39.5 sources. It has been OK for print titles, but difficult to find any sources for movies. Do you know of any good Z39.5 sources for movie records? Thanks for your time. Chauncey -- Benjamin Shum Open Source Software Coordinator Bibliomation, Inc. 32 Crest Road Middlebury, CT 06762 203-577-4070, ext. 113
Re: [OPEN-ILS-GENERAL] adding a page to the wiki
Hi Gordana, Just to clarify, you and Lori are referring to the navigation menu options on the main Evergreen website? I think it's a great idea to modify those areas to include references to a User Group page including the one you've started up. Curious to hear feedback from others on this. -- Ben On 03/27/2012 04:25 PM, Gordana Vitez wrote: Hi there, The Evergreen libraries in Niagara have been hosting a number of user group meetings for Evergreen users in Southern Ontario. Of course, it's not limited to the geographic area...we'd love to see everyone from all over! Nevertheless, we'd like to add our info to the wiki and Lori Bowen Ayre suggested that we change the main menu from Communicate to Participate and add a User Group page off that dropdown. Does anyone mind that change? Thanks! Gordana Gordana Vitez Library Services Systems Coordinator NC Libraries and Learning Commons Niagara College 300 Woodlawn Rd Welland Ontario L3C 7L3 Phone: (905) 735 2211 ext 7404 Fax: (905) 736 6021 gvi...@niagaracollege.ca -- Benjamin Shum Open Source Software Coordinator Bibliomation, Inc. 32 Crest Road Middlebury, CT 06762 203-577-4070, ext. 113
Re: [OPEN-ILS-GENERAL] adding a page to the wiki
Yep, Ben. That's the idea. Some of the Web Team folks have also already +1'd the idea. Anyone object? Lori On Tue, Mar 27, 2012 at 1:54 PM, Ben Shum bs...@biblio.org wrote: Hi Gordana, Just to clarify, you and Lori are referring to the navigation menu options on the main Evergreen website? I think it's a great idea to modify those areas to include references to a User Group page including the one you've started up. Curious to hear feedback from others on this. -- Ben On 03/27/2012 04:25 PM, Gordana Vitez wrote: Hi there, The Evergreen libraries in Niagara have been hosting a number of user group meetings for Evergreen users in Southern Ontario. Of course, it's not limited to the geographic area...we'd love to see everyone from all over! Nevertheless, we'd like to add our info to the wiki and Lori Bowen Ayre suggested that we change the main menu from Communicate to Participate and add a User Group page off that dropdown. Does anyone mind that change? Thanks! Gordana Gordana Vitez Library Services Systems Coordinator NC Libraries and Learning Commons Niagara College 300 Woodlawn Rd Welland Ontario L3C 7L3 Phone: (905) 735 2211 ext 7404 Fax: (905) 736 6021 gvi...@niagaracollege.ca -- Benjamin Shum Open Source Software Coordinator Bibliomation, Inc. 32 Crest Road Middlebury, CT 06762203-577-4070, ext. 113
Re: [OPEN-ILS-GENERAL] adding a page to the wiki
I love the idea to have user group info in the wiki! I'm a little concerned about moving from Communicate to Participate, because the latter seems closer in meaning to Contribute and thus muddies the navigation a bit to my mind. But I guess one could argue that to communicate is to contribute, so things are already muddy. Has anyone checked what other projects (that we admire for their community support clarity of their web site) do? Drupal.org Fedoraproject.org have some interesting similarities in their navigation wording choices... Dan On Tue, Mar 27, 2012 at 5:04 PM, Lori Bowen Ayre lori.a...@galecia.com wrote: Yep, Ben. That's the idea. Some of the Web Team folks have also already +1'd the idea. Anyone object? Lori On Tue, Mar 27, 2012 at 1:54 PM, Ben Shum bs...@biblio.org wrote: Hi Gordana, Just to clarify, you and Lori are referring to the navigation menu options on the main Evergreen website? I think it's a great idea to modify those areas to include references to a User Group page including the one you've started up. Curious to hear feedback from others on this. -- Ben On 03/27/2012 04:25 PM, Gordana Vitez wrote: Hi there, The Evergreen libraries in Niagara have been hosting a number of user group meetings for Evergreen users in Southern Ontario. Of course, it's not limited to the geographic area...we'd love to see everyone from all over! Nevertheless, we'd like to add our info to the wiki and Lori Bowen Ayre suggested that we change the main menu from Communicate to Participate and add a User Group page off that dropdown. Does anyone mind that change? Thanks! Gordana Gordana Vitez Library Services Systems Coordinator NC Libraries and Learning Commons Niagara College 300 Woodlawn Rd Welland Ontario L3C 7L3 Phone: (905) 735 2211 ext 7404 Fax: (905) 736 6021 gvi...@niagaracollege.ca -- Benjamin Shum Open Source Software Coordinator Bibliomation, Inc. 32 Crest Road Middlebury, CT 06762 203-577-4070, ext. 113
