[ 
https://issues.apache.org/jira/browse/SOLR-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198128#comment-15198128
 ] 

James Dyer commented on SOLR-2613:
----------------------------------

bq. I wonder if maybe we could implement enough of an API layer that a user 
could provide the jar themselves, tell Solr what class will be needed, and be 
in business. Is this what the patch on this issue does?

This patch is an implementation of the DIHCache interface.  If this is on the 
classpath, you can specify 'cacheImpl="BerkleyBackedCache" ' on any DIH Entity 
in data-config.xml, and it will cache to disk instead of memory.

I developed this years ago and still use it in production, with an *old* dih 
jar, 4.6-vintage, built with this and SOLR-2943 applied.  I believe there may 
have been changes to DIH since 4.6-ish that prevent this from working, but it 
would not take a lot of work to update this either.  My experience is bdb-je is 
much faster than any sql database, or anything ootb I've tried.  If you have a 
lot of records to join, this is much faster than the n+1 select approach, 
slower than in-memory, but then again, this scales.  

I also put a mapdb impl out there -- SOLR-6144 -- the license is friendlier, 
but the performance was not there.  Also, its just a quick impl, possibly full 
of bugs.

Of course, you could write a DIHCache implementation that does it any way you 
want.  Just this was fairly quick to develop and it works good for us.   And 
yes, you'd have to have your client download the bdb-je jar for themselves.  
I'm using this with je-6.2.31.jar .


> DIH Cache backed w/bdb-je
> -------------------------
>
>                 Key: SOLR-2613
>                 URL: https://issues.apache.org/jira/browse/SOLR-2613
>             Project: Solr
>          Issue Type: Improvement
>          Components: contrib - DataImportHandler
>    Affects Versions: 4.0-ALPHA
>            Reporter: James Dyer
>            Priority: Minor
>         Attachments: SOLR-2613.patch, SOLR-2613.patch, SOLR-2613.patch, 
> SOLR-2613.patch, SOLR-2613.patch, SOLR-2613.patch, SOLR-2613.patch
>
>
> This is spun out of SOLR-2382, which provides a framework for multiple 
> cacheing implementations with DIH.  This cache implementation is fast & 
> flexible, supporting persistence and delta updates.  However, it depends on 
> Berkley Database Java Edition so in order to evaluate this and use it you 
> must download bdb-je from Oracle and accept the license requirements.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to