I haven't used Solr for a long time, and haven't used Solr in Spark. However, why do you say "Elasticsearch is not a good option ..."? ES absolutely supports full-text search and not just filtering and grouping (in fact it's original purpose was and still is text search, though filtering, grouping and aggregation are heavily used). http://www.elastic.co/guide/en/elasticsearch/guide/master/full-text-search.html
On Tue, Apr 28, 2015 at 6:27 PM, Jeetendra Gangele <gangele...@gmail.com> wrote: > Does anyone tried using solr inside spark? > below is the project describing it. > https://github.com/LucidWorks/spark-solr. > > I have a requirement in which I want to index 20 millions companies name > and then search as and when new data comes in. the output should be list of > companies matching the query. > > Spark has inbuilt elastic search but for this purpose Elastic search is > not a good option since this is totally text search problem? > > Elastic search is good for filtering and grouping. > > Does any body used solr inside spark? > > Regards > jeetendra > >