Re: solr in spark

2015-04-29 Thread Costin Leau
On 4/29/15 6:02 PM, Jeetendra Gangele wrote: Thanks for detail explanation. My only worry is to search the all combinations of company names through ES looks hard. I'm not sure what makes you think "ES looks hard". Have you tried browsing the Elasticsearch reference or the definitive guide?

Re: Re: solr in spark

2015-04-29 Thread Jeetendra Gangele
Thanks for detail explanation. My only worry is to search the all combinations of company names through ES looks hard. in solr we define everything in xml files like all attributes in WordDocumentFilterFactory and shingles factory. how to do this in elastic search? On 29 April 2015 at 20:03, Co

Re: Re: solr in spark

2015-04-29 Thread Costin Leau
# disclaimer I'm an employee of Elastic (the company behind Elasticsearch) and lead of Elasticsearch Hadoop integration Some things to clarify on the Elasticsearch side: 1. Elasticsearch is a distributed, real-time search and analytics engine. Search is just one aspect of it and it can work wi

Re: solr in spark

2015-04-28 Thread Nick Pentreath
Depends on your use case and search volume. Typically you'd have a dedicated ES cluster if your app is doing a lot of real time indexing and search. If it's only for spark integration then you could colocate ES and spark — Sent from Mailbox On Tue, Apr 28, 2015 at 6:41 PM, Jeetendra Gangel

Re: solr in spark

2015-04-28 Thread Jeetendra Gangele
Thanks for reply. Elastic search index will be within my Cluster? or I need the separate host the elastic search? On 28 April 2015 at 22:03, Nick Pentreath wrote: > I haven't used Solr for a long time, and haven't used Solr in Spark. > > However, why do you say "Elasticsearch is not a good opt

Re: solr in spark

2015-04-28 Thread andy petrella
AFAIK Datastax is heavily looking at it. they have a good integration of Cassandra with it. the next was clearly to have a strong combination of the three in one of the coming releases Le mar. 28 avr. 2015 18:28, Jeetendra Gangele a écrit : > Does anyone tried using solr inside spark? > below is

Re: solr in spark

2015-04-28 Thread Nick Pentreath
I haven't used Solr for a long time, and haven't used Solr in Spark. However, why do you say "Elasticsearch is not a good option ..."? ES absolutely supports full-text search and not just filtering and grouping (in fact it's original purpose was and still is text search, though filtering, grouping