Is there fl.encoder just like hl.encoder

2018-12-10 Thread Arnold Bronley
hl.encoder escapes html characters in highlight text response except the highlight html characters that Solr uses. Is there something similar available for field text that we get back as response from Solr?

Re: Soft commit and new replica types

2018-12-10 Thread Tomás Fernández Löbbe
I think this is a good point. The tricky part is that if TLOG replicas don't replicate often, their transaction logs will get too big too, so you want the replication interval of TLOG replicas to be tied to the auto(hard)Commit interval (by default at least). If you are using them for search, you

Re: solr reads whole index on startup

2018-12-10 Thread lstusr 5u93n4
Hi Guys, > What OS is it on? CentOS 7 > With your indexes in HDFS, the HDFS software running > inside Solr also needs heap memory to operate, and is probably going to > set aside part of the heap for caching purposes. We still have the solr.hdfs.blockcache.slab.count parameter set to the

Re: solr 4.4 splitshard query

2018-12-10 Thread Shawn Heisey
On 12/5/2018 5:14 AM, ashoknix wrote: curl -v 'http://localhost:8980/solr/admin/collections?action=SPLITSHARD=billdocs=shard1=2000' 50039splitshard the collection time out:300sorg.apache.solr.common.SolrException: splitshard the collection time out:300s 1. Currently index size is around

Re: solr reads whole index on startup

2018-12-10 Thread Shawn Heisey
On 12/7/2018 8:54 AM, Erick Erickson wrote: Here's the trap:_Indexing_ doesn't take much memory. The memory is bounded by ramBufferSizeMB, which defaults to 100. This statement is completely true.  But it hides one detail:  A large amount of indexing will allocate this buffer repeatedly.  So

Re: Soft commit and new replica types

2018-12-10 Thread Erick Erickson
bq. but not every poll attempt they fetch new segment from the leader Ah, right. Ignore my comment. Commit will only occur on the followers when there are new segments to pull down, so your'e right, roughly every second poll would commit find things to bring down and open a new searcher.

Re: solr crashes

2018-12-10 Thread Shawn Heisey
On 12/3/2018 2:09 AM, Danilo Tomasoni wrote: Unfortunately in this scenario solr often crashes while performing a query, even with a single query and no other source of system load. What do you mean by "crashes"?  Because what I think of as a crash is exceedingly rare with Java programs.  I

Re: shingles + stop words

2018-12-10 Thread Emir Arnautović
Hi David, As you already observed shingles are concatenating tokens based on positions and in case of stopwords it results in empty string (you can configure it to be something else with fillerToken option). You can do the following: 1. if you do not have too many stopwords, you could use

Using streaming expressions with a pre-existing schema (aka migrating a standalone instance to SolrCloud)

2018-12-10 Thread Guillaume Rossolini
Hi there, This is about undocumented restrictions about using streaming expressions (in the sense that I haven't found the right documentation). ** Setup I just followed the documentation to start SolrCloud on my local machine, and I made it so it would replace the previous standalone server I