[CODE4LIB] Sneak previews, etc.
Sorry all, that was obviously meant for Roy. But...that said...when the prototype is ready for sneak previews I'll send the link around to the list. Cheers, --Colleen
Re: [CODE4LIB] Ruby in libraries
Cool features, I am really starting to like Ruby.
Bas
Ed Summers wrote:
On the subject of Ruby, I started out thinking I wanted to port
MARC::Record directly to Ruby but as I worked on it I found myself
using some Ruby idioms that I ended up really liking.
In particular the Enumerable mixin is really useful for where you want
to allow people to iterate through MARC::Field objects in a
MARC::Record:
for field in record
...
end
Likewise MARC::Subfield objects in a MARC::Field
for subfield in field
...
end
When you mixin Enumerable you also get find() and find_all()
automatically which means you can do this to pull out all the subject
fields for example:
subjects = record.find_all {|f| ('600'..'699' === f.tag)}
This block usage is a bit hard to get used to at first, but is an
extremely powerful tool (I believe borrowed from Smalltalk) once you
get used to it.
Another nice thing in Ruby is that you can define a method like =~
which allows you to implement your own pattern matching for a class.
if record =~ /Gravity's Rainbow/
print "Slothrop"
end
I guess what I'm really trying to say is that it's pretty interesting
porting APIs from one language to another since it highlights the
strenths of the source and target languages. The tighter you can melt
your libraries into the host language the better.
//Ed
Re: [CODE4LIB] Catalog Enhancements & Extensions (Re: mylibrary @ockham)
Roy, we're in the middle of re-indexing, and there's some broken code in the search that won't be fixed until after Martin returns from vacation. Plus, we're working on UI right now...it will be much more readable very soon. So I would suggest not sending him the link quite yet. Within 2 - 3 weeks I suspect we can start giving out sneak previews though. --C Roy Tennant wrote: Short answer now, longer/better answer next week when someone gets back in the office. We have 4.5 million records indexed at the moment, but have had up to 9 million indexed. Our dev system runs on a Unix server (specs to come) that runs other apps as well. I'm not sure if we can share the crude search interface so you can judge the response, but will try to find out. Roy On Dec 2, 2005, at 12:36 PM, Andrew Nagy wrote: Roy Tennant wrote: Andrew, just as an additional data point, we have millions of records indexed in our Lucene-based XTF system, and the response isn't too bad even on a development server. Can you and others on this list briefly describe your hardware platform for this? I am assuming this is not running on an old 486 that is lying around in your office :) Do you feel that the searching is processor intensive and may be best suited for a load balanced infrastructure? I am implementing my pilot using eXist which stores the XML Database in B Trees which from my knowledge is an in memory data structure so therefor the machine would need lots of ram however I am curious as to the processing requirements. Thanks, you guys rock! Andrew
Re: [CODE4LIB] Catalog Enhancements & Extensions (Re: mylibrary @ockham)
Short answer now, longer/better answer next week when someone gets back in the office. We have 4.5 million records indexed at the moment, but have had up to 9 million indexed. Our dev system runs on a Unix server (specs to come) that runs other apps as well. I'm not sure if we can share the crude search interface so you can judge the response, but will try to find out. Roy On Dec 2, 2005, at 12:36 PM, Andrew Nagy wrote: Roy Tennant wrote: Andrew, just as an additional data point, we have millions of records indexed in our Lucene-based XTF system, and the response isn't too bad even on a development server. Can you and others on this list briefly describe your hardware platform for this? I am assuming this is not running on an old 486 that is lying around in your office :) Do you feel that the searching is processor intensive and may be best suited for a load balanced infrastructure? I am implementing my pilot using eXist which stores the XML Database in B Trees which from my knowledge is an in memory data structure so therefor the machine would need lots of ram however I am curious as to the processing requirements. Thanks, you guys rock! Andrew
Re: [CODE4LIB] Catalog Enhancements & Extensions (Re: mylibrary @ockham)
Roy Tennant wrote: Andrew, just as an additional data point, we have millions of records indexed in our Lucene-based XTF system, and the response isn't too bad even on a development server. Can you and others on this list briefly describe your hardware platform for this? I am assuming this is not running on an old 486 that is lying around in your office :) Do you feel that the searching is processor intensive and may be best suited for a load balanced infrastructure? I am implementing my pilot using eXist which stores the XML Database in B Trees which from my knowledge is an in memory data structure so therefor the machine would need lots of ram however I am curious as to the processing requirements. Thanks, you guys rock! Andrew
Re: [CODE4LIB] Ruby in libraries
On the subject of Ruby, I started out thinking I wanted to port
MARC::Record directly to Ruby but as I worked on it I found myself
using some Ruby idioms that I ended up really liking.
In particular the Enumerable mixin is really useful for where you want
to allow people to iterate through MARC::Field objects in a
MARC::Record:
for field in record
...
end
Likewise MARC::Subfield objects in a MARC::Field
for subfield in field
...
end
When you mixin Enumerable you also get find() and find_all()
automatically which means you can do this to pull out all the subject
fields for example:
subjects = record.find_all {|f| ('600'..'699' === f.tag)}
This block usage is a bit hard to get used to at first, but is an
extremely powerful tool (I believe borrowed from Smalltalk) once you
get used to it.
Another nice thing in Ruby is that you can define a method like =~
which allows you to implement your own pattern matching for a class.
if record =~ /Gravity's Rainbow/
print "Slothrop"
end
I guess what I'm really trying to say is that it's pretty interesting
porting APIs from one language to another since it highlights the
strenths of the source and target languages. The tighter you can melt
your libraries into the host language the better.
//Ed
Re: [CODE4LIB] Ruby in libraries
I will install your gem and have a look at it. I started in september to
'port' MARC4J to Ruby. You can browse the code in RubyForge CVS, but I
haven't published anything yet. It is not yet packaged into modules and
there is no documentation.
Ed Summers wrote:
On 12/2/05, Bas Peters <[EMAIL PROTECTED]> wrote:
but I was just wondering how difficult it would
be to create a MARC parser in Ruby. Is there any interest in such a
library for Ruby?
I actually created a MARC parser in Ruby [1] a month or so ago which
is available on RubyForge [2]. I'm definitely open to ways of
improving it, or developers who want to help develop it.
Since it's available on rubyforge, if you have gem installed you can.
gem install marc
Once installed you can do stuff like:
require 'marc'
reader = MARC::Reader.new('batch.dat')
for record in reader
puts record['245']
end
The rdoc [3] is also available which hopefully shows common usage. One
thing that I haven't implemented yet is MARC-8 -> UTF-8 conversion for
going to XML...but that's in the works. I really like your marc4j
package by the way.
//Ed
[1] http://www.textualize.com/ruby_marc
[2] http://rubyforge.org/projects/marc/
[3] http://www.textualize.com/rdoc/ruby-marc/
Re: [CODE4LIB] Ruby in libraries
On 12/2/05, Kevin S. Clarke <[EMAIL PROTECTED]> wrote: > I don't know if it is getting mindshare, but you (and others) might > also be interested in Ed Summers work on this: Thanks Kevin :-) I hadn't seen your message before replying. For those that are interested in Ruby in libraries you might also be interested in ruby-zoom [1] for talking to z39.50 servers. [1] http://ruby-zoom.rubyforge.org/
Re: [CODE4LIB] Ruby in libraries
On 12/2/05, Bas Peters <[EMAIL PROTECTED]> wrote:
>but I was just wondering how difficult it would
> be to create a MARC parser in Ruby. Is there any interest in such a
> library for Ruby?
I actually created a MARC parser in Ruby [1] a month or so ago which
is available on RubyForge [2]. I'm definitely open to ways of
improving it, or developers who want to help develop it.
Since it's available on rubyforge, if you have gem installed you can.
gem install marc
Once installed you can do stuff like:
require 'marc'
reader = MARC::Reader.new('batch.dat')
for record in reader
puts record['245']
end
The rdoc [3] is also available which hopefully shows common usage. One
thing that I haven't implemented yet is MARC-8 -> UTF-8 conversion for
going to XML...but that's in the works. I really like your marc4j
package by the way.
//Ed
[1] http://www.textualize.com/ruby_marc
[2] http://rubyforge.org/projects/marc/
[3] http://www.textualize.com/rdoc/ruby-marc/
Re: [CODE4LIB] Ruby in libraries
I don't know if it is getting mindshare, but you (and others) might also be interested in Ed Summers work on this: http://rubyforge.org/projects/marc/ Kevin On 12/2/05, Bas Peters <[EMAIL PROTECTED]> wrote: > Is Ruby gaining popularity in the library world? A few months ago I > started developing a MARC4J implementation in Ruby. MARC4J is a library > for working with MARC and MARC XML data in Java. I do not have a direct > need for such a program, but I was just wondering how difficult it would > be to create a MARC parser in Ruby. Is there any interest in such a > library for Ruby? > > Check http://marc4j.tigris.org for more information about MARC4J. You > can find the Ruby project here: http://rubyforge.org/projects/rmarc/. > > Regards, > > Bas Peters >
[CODE4LIB] Ruby in libraries
Is Ruby gaining popularity in the library world? A few months ago I started developing a MARC4J implementation in Ruby. MARC4J is a library for working with MARC and MARC XML data in Java. I do not have a direct need for such a program, but I was just wondering how difficult it would be to create a MARC parser in Ruby. Is there any interest in such a library for Ruby? Check http://marc4j.tigris.org for more information about MARC4J. You can find the Ruby project here: http://rubyforge.org/projects/rmarc/. Regards, Bas Peters
