(Following Sam's suggestion I'm re-sending this to the dev list.)
I'm currently experiencing VERY slow bibindex times (~2-3min/rec) for
itemcount and filetype indexes[1] and records that have many authors
(for example Atlas related experiments). I'm running the latest master.
Have you noticed it too at CERN?
I understand that -as Esteban mentioned- these indexes are very complex
and they are computed on-the-fly, but still the time spent on them makes
the re/indexing unusable.
I could always re-enable CFG_BIBUPLOAD_SERIALIZE_RECORD_STRUCTURE and
maybe speed things up a litte, but I was trying to save some space in
the DB :)
I don't want to delete the index, in order to be on par with other
installations and I only have ~200 such records, but as you understand
it takes several hours to index them! (If you experience this issue as
well, with all these experiments going on, it will take forever to
re/index INSPIRE regardless of all the computing power you put on it...).
Is there anything that I could do to make it run a bit faster?
I was also wondering... while you're optimizing the algorithms (and only
if bibfield is not used elsewhere) whether I could tweak (i.e. empy)
bibfield.cfg to speed things up.
Cheers,
Theodoros
[1] The itemcount index is bearable (maybe because I'm not using
circulation and hence I don't have items?), the filetype takes forever...