Re: How to create an additional cluster in Cassandra exclusively for Analytics Purpose

2016-03-07 Thread Bhuvan Rawal
Thanks for the correction Jon. (Atmost 2000 queries *per cluster* for serving 100 searches.) On Mon, Mar 7, 2016 at 11:47 PM, Jonathan Haddad wrote: > If you're doing 100 searches a second each machine will be serving at most > 100 requests per second, not 2000. > > On Mon,

Re: How to create an additional cluster in Cassandra exclusively for Analytics Purpose

2016-03-07 Thread Jonathan Haddad
If you're doing 100 searches a second each machine will be serving at most 100 requests per second, not 2000. On Mon, Mar 7, 2016 at 10:13 AM Bhuvan Rawal wrote: > Well thats certainly true, there are these points worth discussing here : > > 1. Scatter Gather queries -

Re: How to create an additional cluster in Cassandra exclusively for Analytics Purpose

2016-03-07 Thread Bhuvan Rawal
Well thats certainly true, there are these points worth discussing here : 1. Scatter Gather queries - Especially if the cluster size is large. Say we have a 20 node cluster, and we are searching 100 times a second. then effectively coordinator would be hitting each node 2000 times (20*100) That

Re: How to create an additional cluster in Cassandra exclusively for Analytics Purpose

2016-03-06 Thread Jack Krupansky
I don't have any direct personal experience with Stratio. It will all depend on your queries and your data cardinality - some queries are fine with secondary indexes while other are quite poor. Ditto for Lucene and Solr. It is also worth noting that the new SASI feature of Cassandra supports

Re: How to create an additional cluster in Cassandra exclusively for Analytics Purpose

2016-03-05 Thread Bhuvan Rawal
Yes Jack, we are rolling out with Stratio right now, we will assess the performance benefit it yields and can go for ElasticSearch/Solr later. As per your experience how does Stratio perform vis-a-vis Secondary Indexes? On Sun, Mar 6, 2016 at 11:15 AM, Jack Krupansky

Re: How to create an additional cluster in Cassandra exclusively for Analytics Purpose

2016-03-05 Thread Jack Krupansky
You haven't been clear about how you intend to add Solr. You can also use Stratio or Stargate for basic Lucene search if you don't want need full Solr support and want to stick to open source rather than go with DSE Search for Solr. -- Jack Krupansky On Sun, Mar 6, 2016 at 12:25 AM, Bhuvan Rawal

Re: How to create an additional cluster in Cassandra exclusively for Analytics Purpose

2016-03-05 Thread Bhuvan Rawal
Thanks Sean and Nirmallaya. @Jack, We are going with DSC right now and plan to use spark and later solr over the analytics DC. The use case is to have olap and oltp workloads separated and not intertwine them, whether it is achieved by creating a new DC or a new cluster altogether. From