On 23.11.2013 17:06, Henning Hraban Ramm wrote:
Hi!
If it's only about serving the bibliographic data I'd go
for OAI-PMH as it makes a smaller footprint and scales
way better than dumping. Just set your master to expose
the collection as OAI-PMH and harvest it from your slave
periodically. Depending on the nature of your project
you'd most likely want to have the OAI-Server anyway for
visibility reasons.
Thank you for the idea, since I’m not familiar with OAI,
I didn’t give consideration to that possibility.
Usually, it should offer most flexibility as it works though
http-protocol and all the stuff is quite high-level. Say,
you move on and drop MySQL on the go to next-next, OAI
would still work. We even migrated one of our instances from
a proprietary solution to Marc using OAI exports.
Visibility is not one of our goals...
Well. If I ever find a setup where I know the goals in
advance ;)
- after that, I change the server URL in all records (like in
http://invenio-software.org/wiki/HowTo/HowToChangeSiteUrl)
This, however, would not be necessary if you harvest. Additionally,
harvesting has the charming aspect that you need to transfer only the
diff and not the whole bunch. (IMHO dbdumps are possible but not a real
solution. It could be that I differ here a bit from CERN usecases ;)
MySQL replication also just ‚diff’s, rsync the same.
Sounds interesting for a quite different usecase as well.
Isn’t it possible to save media files only with relative
paths (since those are the same on all servers)?
I don't get that. If they are all on the same network,
why the fuss with the laptop? However, you could just not
include the full texts and let the URI point to your
master. (However, then I still don't get the laptop.)
Ok, I must explain.
[...]
This is an interesting probject of yours. Try to make sure
that you could present it on the 3rd Invenio User Group
Workshop. :)
The „bus server“ is then sync’ed to the „web server“, as
soon as the bus has proper internet access (normally
probably only after each journey).
Sounds for me like a OAI-scenario. HTTP hookup is quite
general and you also avoid any security issues that might
arrise if you hook up to your db server right away. You'd
just need some post script that adds the necessary fft-tags
before ingestion of new records.
Maybe Invenio is overkill for the main use, since we don’t
need most(?) of the huge set of functions,
Actually, I don't think so.
but it seemed
the most flexible and sustainable solution
... simply cause of this. If you can run it, with Marc you
have a decent data model flexible enough to handle almost
everything. I'd not go for something "smaller" (Dublin
Coreish stuff) especially as you seem to cover quite a bit
of different materials. Also it seems you're on a limited
set of ressources. I'd argue that in this case one might do
well to make it right in the first place as you'll not have
a chance to correct later. Say, you add everything to a DC
set, work around it's many limitations and later on need to
convert that to something better (like Marc) you'll have to
invest quite a bunch of work (I could tell you, we had some
2500 records of this sort, that took longer than the frist
60.000 to finish...), while the initial ingest to Marc right
away isn't that difficult if you have only simple data.
Especially if you can set up decent websubmits. You might
probably want to have a look at the autosetup for websubmit
we did for our systems. (T. Pazeras talk at the recent
IUGW might give you a good idea) to ease this up.
--
Kind regards,
Alexander Wagner
Scientific Services / Scientific Publishing
Central Library
52425 Juelich
mail : [email protected]
phone: +49 2461 61-1586
Fax : +49 2461 61-6103
http://www.fz-juelich.de/zb/wp
------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
Forschungszentrum Juelich GmbH
52425 Juelich
Sitz der Gesellschaft: Juelich
Eingetragen im Handelsregister des Amtsgerichts Dueren Nr. HR B 3498
Vorsitzender des Aufsichtsrats: MinDir Dr. Karl Eugen Huthmacher
Geschaeftsfuehrung: Prof. Dr. Achim Bachem (Vorsitzender),
Karsten Beneke (stellv. Vorsitzender), Prof. Dr.-Ing. Harald Bolt,
Prof. Dr. Sebastian M. Schmidt
------------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------------
