Re: [CODE4LIB] Indexing MARC(-JSON) with MongoDB?

2010-05-14 Thread Király Péter
. - I should learn more about the possibilities of MongoDB I can give you more technical details, if you interested. Péter eXtensible Catalog - Original Message - From: "Fernando Gómez" To: Sent: Thursday, May 13, 2010 2:59 PM Subject: [CODE4LIB] Indexing MARC(-JSON) with Mong

Re: [CODE4LIB] Indexing MARC(-JSON) with MongoDB?

2010-05-13 Thread Allen Jones
Please disregard last email. Allen Jones Director - Digital Library Programs The New School Libraries On May 13, 2010, at 2:00 PM, Jonathan Rochkind wrote: JSON and XML as structures have 'order' in exactly analagous ways. In the case of Json, if you want to encode order you should use an

Re: [CODE4LIB] Indexing MARC(-JSON) with MongoDB?

2010-05-13 Thread Allen Jones
Airtran???Newark not jfk. Allen Jones Director - Digital Library Programs The New School Libraries On May 13, 2010, at 2:00 PM, Jonathan Rochkind wrote: JSON and XML as structures have 'order' in exactly analagous ways. In the case of Json, if you want to encode order you should use an ar

Re: [CODE4LIB] Indexing MARC(-JSON) with MongoDB?

2010-05-13 Thread Jonathan Rochkind
JSON and XML as structures have 'order' in exactly analagous ways. In the case of Json, if you want to encode order you should use an array, not a dictionary, of course. Whether the particular software _parsing_ or _translating_ either Json or XML will go through it in order and preserve the or

Re: [CODE4LIB] Indexing MARC(-JSON) with MongoDB?

2010-05-13 Thread Kyle Banerjee
> > Huh? JSON arrays preserve element order just like XML preserves element > order. Combining JSON labeled arrays and objects provide you with the > same mechanisms available in markup languages such as XML. > Maybe I'm getting mixed up but is it not unsafe to assume that element order will be p

Re: [CODE4LIB] Indexing MARC(-JSON) with MongoDB?

2010-05-13 Thread Karen Coyle
Quoting MJ Suhonos : Not to start a flame war, but from my point of view, it seems rather strange for us to go through all this learning of new technology only to stuff MARC into it. That's not to say it can't be done, or there aren't valid use cases for doing such a thing, but just th

Re: [CODE4LIB] Indexing MARC(-JSON) with MongoDB?

2010-05-13 Thread Houghton,Andrew
> From: Code for Libraries [mailto:code4...@listserv.nd.edu] On Behalf Of > MJ Suhonos > Sent: Thursday, May 13, 2010 12:34 PM > To: CODE4LIB@LISTSERV.ND.EDU > Subject: Re: [CODE4LIB] Indexing MARC(-JSON) with MongoDB? > > PS. For those RDF-ites among us, I also happen to th

Re: [CODE4LIB] Indexing MARC(-JSON) with MongoDB?

2010-05-13 Thread MJ Suhonos
> In any case, the trick in my mind is how to represent MARC in JSON > (disclaimer: I haven't tried to do this yet). Breaking it into pieces that > index well but which also can be recombined without going through > contortions doesn't sound easy because the obvious solution of converting > each fi

Re: [CODE4LIB] Indexing MARC(-JSON) with MongoDB?

2010-05-13 Thread Houghton,Andrew
> From: Code for Libraries [mailto:code4...@listserv.nd.edu] On Behalf Of > Kyle Banerjee > Sent: Thursday, May 13, 2010 11:51 AM > To: CODE4LIB@LISTSERV.ND.EDU > Subject: Re: [CODE4LIB] Indexing MARC(-JSON) with MongoDB? > > JSON maybe a great data exchange format,

Re: [CODE4LIB] Indexing MARC(-JSON) with MongoDB?

2010-05-13 Thread Kyle Banerjee
Just out of curiosity, why are you focusing on a document store database? It seems that wide column store might also be appropriate for this type of application given the similarity in both structure and content of many fields. In any case, the trick in my mind is how to represent MARC in JSON (d

Re: [CODE4LIB] Indexing MARC(-JSON) with MongoDB?

2010-05-13 Thread MJ Suhonos
Sorry, meant to include this link, which compares Elastic Search and Solr: http://blog.sematext.com/2010/05/03/elastic-search-distributed-lucene/ MJ

Re: [CODE4LIB] Indexing MARC(-JSON) with MongoDB?

2010-05-13 Thread MJ Suhonos
>> First things first : it depends on what kind of "indexing" you're looking to >> do — I haven't worked with CouchDB (yet), but I have with MongoDB, and >> although it's a great (and fast) data store, it has a "basic" style of >> indexing as SQL databases. That is, you can do exact-match, some

Re: [CODE4LIB] Indexing MARC(-JSON) with MongoDB?

2010-05-13 Thread Thomas Dowling
On 05/13/2010 09:59 AM, MJ Suhonos wrote: > > First things first : it depends on what kind of "indexing" you're looking to > do — I haven't worked with CouchDB (yet), but I have with MongoDB, and > although it's a great (and fast) data store, it has a "basic" style of > indexing as SQL databas

Re: [CODE4LIB] Indexing MARC(-JSON) with MongoDB?

2010-05-13 Thread MJ Suhonos
> There's been some talk in code4lib about using MongoDB to store MARC > records in some kind of JSON format. I'd like to know if you have > experimented with indexing those documents in MongoDB. From my limited > exposure to MongoDB, it seems difficult, unless MongoDB supports some > kind of "cust

Re: [CODE4LIB] Indexing MARC(-JSON) with MongoDB?

2010-05-13 Thread Király Péter
ibility and speed known from Solr. I will let you know as soon I could insert first MARC records to Mongo. [1] http://www.mongodb.org/display/DOCS/Inserting regards, Péter eXtensible Catalog ----- Original Message - From: "Fernando Gómez" To: Sent: Thursday, May 13, 2010 2:59 PM Subje

Re: [CODE4LIB] Indexing MARC(-JSON) with MongoDB?

2010-05-13 Thread Benjamin Young
On 5/13/10 8:59 AM, Fernando Gómez wrote: Any suggestions? Do other document oriented databases offer a better solution for this? Hey Fernando, I'd suggest you checkout CouchDB. CouchDB uses JSON as it's document format, provides advanced indexing (anywhere in the JSON docs) via map/reduc

[CODE4LIB] Indexing MARC(-JSON) with MongoDB?

2010-05-13 Thread Fernando Gómez
There's been some talk in code4lib about using MongoDB to store MARC records in some kind of JSON format. I'd like to know if you have experimented with indexing those documents in MongoDB. From my limited exposure to MongoDB, it seems difficult, unless MongoDB supports some kind of "custom indexin