Mike,
our RecordManager (https://github.com/KDK-Alli/RecordManager) used in
conjunction with VuFind does deduplication with our own algorithm. This
might be of some interest to you. RecordManager works standalone, so no
VuFind installation needed. For some parts it's still in active
development, but the deduplication has been working pretty well so far.
A short description of the algorithm is available at
<https://github.com/KDK-Alli/RecordManager/wiki/Deduplication>, and the
actual PHP code is in
<https://github.com/KDK-Alli/RecordManager/blob/master/classes/RecordManager.php>
starting at the dedupRecord function.
--Ere
22.8.2013 18.07, Michael Beccaria kirjoitti:
Steve,
I don't think it's so much find a control field (however, the closest match I
can use is ISBN or eISBN which has its issues) but also normalizing the data in
the fields so that matches are produced. It will no doubt take some time to
figure out.
Mike Beccaria
Systems Librarian
Head of Digital Initiative
Paul Smith's College
518.327.6376
[email protected]
Become a friend of Paul Smith's Library on Facebook today!
-----Original Message-----
From: Code for Libraries [mailto:[email protected]] On Behalf Of
McDonald, Stephen
Sent: Friday, August 16, 2013 8:16 AM
To: [email protected]
Subject: Re: [CODE4LIB] De-dup MARC Ebook records
Michael Beccaria said:
Thanks for the replies. To clarify, I am working with 2 (or more in
the future) marc records outside of the ILS. I've tried using Marcedit
but my usage did vary...not much overlap with the control fields that
were available to me. I have a feeling they are a bit varied. I'm also
messing around with marcXimiL a little but I'm having trouble getting
it to output any records at all. I also was looking at the XC
aggregation module but I was having trouble getting that to work
properly as well and the listserv was unresponsive. It seemed like
good software but it required me to set up an OAI harvest source to
allow it to ingest the records and that...well...enough is enough... I
think I will probably need to write something, and at least that way I
know what it will be doing rather than plowing through software that
has little to no support. Please feel free to let me know of a particular
strategy you think might work best in this regard...
If you couldn't get adequate deduping from the control fields available in
MarcEdit deduping, what control fields do you think you need to dedup on? You
can actually specify any arbitrary field and subfield for deduping in MarcEdit.
Steve McDonald
[email protected]
--
Ere Maijala
Kansalliskirjasto / The National Library of Finland
