Re: Using Solr as a Database?

2019-06-05 Thread Ralph Soika
Hello Christopher, On 03.06.19 23:13, Christopher Schultz wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Ralph, On 6/2/19 16:32, Ralph Soika wrote: The whole system is highly transactional as it runs on Java EE with JPA and Session EJBs. And you write-through from your application

Re: Using Solr as a Database?

2019-06-03 Thread Christopher Schultz
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Daniel, On 6/3/19 16:26, Davis, Daniel (NIH/NLM) [C] wrote: > I think the sweet spot of Cassandra and Solr should be mentioned > in this discussion. Cassandra is more scalable/clusterable than > an RDBMS, without losing all of the structure that

Re: Using Solr as a Database?

2019-06-03 Thread Christopher Schultz
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Ralph, On 6/2/19 16:32, Ralph Soika wrote: > The whole system is highly transactional as it runs on Java EE with > JPA and Session EJBs. And you write-through from your application -> RDBMS -> Lucene/Solr? How are you handling commits (both soft

RE: Using Solr as a Database?

2019-06-03 Thread Davis, Daniel (NIH/NLM) [C]
I think the sweet spot of Cassandra and Solr should be mentioned in this discussion. Cassandra is more scalable/clusterable than an RDBMS, without losing all of the structure that is desirable in an RDBMS. In contrast, if you use a full document store such as MongoDB, you lose some of the

Re: Using Solr as a Database?

2019-06-03 Thread Shawn Heisey
On 6/2/2019 7:28 AM, Ralph Soika wrote: This is not intended to contradict the other replies you've gotten, only supplement them. Now as far as I understand is solr a cluster enabled datastore which can be used to store also all the data form our document. The problem with relational

Re: Using Solr as a Database?

2019-06-03 Thread Ralph Soika
Thanks a lot again for your answers. I do now better understand the operation purpose of Solar Thanks for your help === Ralph On 02.06.19 23:27, Erick Erickson wrote: Not exactly. If I’m reading this right, you do now, and will continue, to have all the data in the RDBMS, correct? That’s

Re: Using Solr as a Database?

2019-06-02 Thread Erick Erickson
Not exactly. If I’m reading this right, you do now, and will continue, to have all the data in the RDBMS, correct? That’s what I call the “system of record”. So you’re not talking about getting rid of the RDBMS, rather basically copying it all over in to Solr and periodically updating your Solr

Re: Using Solr as a Database?

2019-06-02 Thread Dave
You *can use solr as a database, in the same sense that you *can use a chainsaw to remodel your bathroom. Is it the right tool for the job? No. Can you make it work? Yes. As for HA and cluster rdbms gallera cluster works great for Maria db, and is acid compliant. I’m sure any other database

Re: Using Solr as a Database?

2019-06-02 Thread Walter Underwood
> On Jun 2, 2019, at 6:28 AM, Ralph Soika wrote: > > Now as far as I understand is solr a cluster enabled datastore which can be > used to store also all the data form our document. That understanding is incorrect. Solr is not a data store. Reasoning based on that false assumption leads to

Re: Using Solr as a Database?

2019-06-02 Thread Ralph Soika
Thanks Jörn and Erick for your explanations. What I do so far is the following:  * I have a RDBMS with one totally flatten table holding all the data and the id.  * The data is unstructured. Fields can vary from document to document. I have no fixed schema. A dataset is represented by a

Re: Using Solr as a Database?

2019-06-02 Thread Erick Erickson
You must be able to rebuild your index completely when, at some point, you change your schema in incompatible ways. For that reason, either you have to play tricks with Solr (i.e. store all fields or the original document or….) or somehow have access to the original document. Furthermore,

Re: Using Solr as a Database?

2019-06-02 Thread Jörn Franke
It depends what you want to do with it. You can store all fields in Solr and filter on them. However, as soon as it comes to Acid guarantees or if you need to join the data you will be probably needing something else than Solr (or have other workarounds eg flatten the table ). Maybe you can

Using Solr as a Database?

2019-06-02 Thread Ralph Soika
Inspired by an article in the last german JavaMagazin written by Uwe Schindler I wonder if Solr can also be used as a database? In our open source project Imixs-Workflow we use Lucene since several years with great success. We have unstructured