On 05/08/2015 17:45, Julian Sedding wrote: > ... > > My aim is to reduce the critical path for migrating one NodeStore > (incl JR2) to another. Indexing (especially async indexing) takes is a > big part of the time, so if I can move that out of the critical path, > it can save a lot of downtime.
Interesting. I know async index can be lengthy but it would be very interesting if we could measure what we have now and the improvements we're making. The slowest part of the async index is normally the full-text extraction as they run in a single thread. With https://issues.apache.org/jira/browse/OAK-2749 we provided a mechanism (not used yet AFAIK) to run different indexers on different threads. Maybe it's something you would like to experiment with as well to speed up the indexing. If you want ping me on chat tomorrow morning (CEST) so we can quickly see what we can do here. But I think we should start measuring it first :) Cheers Davide
