RE: Solr Size Limitation upto 32 kb limitation

2019-01-23 Thread Michelle Ngo
Thanks @Kranthi Kumar K for following up From: Kranthi Kumar K Sent: Thursday, 24 January 2019 4:51 PM To: d...@lucene.apache.org; solr-user@lucene.apache.org Cc: Ananda Babu medida ; Srinivasa Reddy Karri ; Michelle Ngo ; Ravi Vangala ; Suresh Malladi

RE: Solr Size Limitation upto 32 kb limitation

2019-01-23 Thread Kranthi Kumar K
Thank you Bernd Fehling for your suggested solution, I've tried the same by changing the type and added multivalued to true in Schema.xml file i.e, change from: Changed to: After changing it also still we are unable to import the files size > 32 kb. please find the solution suggested by

Frange Alternative in the filter query

2019-01-23 Thread Aman deep singh
Hi, I have created a value source parser ,to use the parser in the filter query i was using the frange function,But using the frange function is giving the really bad performance (4x of current),my value source parser performance is almost same when used in sort and fl ,Only performance

Re: Solr Size Limitation upto 32 kb limitation

2019-01-23 Thread Jörn Franke
I guess selfwritten loader means that you split up the file in 32 kB chunks or smaller and then posts each of those 32 kB chunks to the multi valued field. > Am 18.01.2019 um 11:51 schrieb Kranthi Kumar K > : > > Hi team, > > Thank you Erick Erickson ,Bernd Fehling , Jan Hoydahl for your

Per-field slop param in eDisMax

2019-01-23 Thread Yasufumi Mizoguchi
Hi, I am struggling to set per-field slop param in eDisMax query parser with Solr 6.0 and 7.6. What I want to do with eDixMax is similar to following in the default query parser. * Query string : "aaa bbb" * Target fields : fieldA(TextField), fieldB(TextField) q=fieldA:"aaa bbb"~2 OR

Re: Solr admin UI new features

2019-01-23 Thread Dwane Hall
Thanks Erick, very helpful as always ...we're up and going now. Before the install I spun up a stand alone instance to check comparability and the process did not shut down cleanly from the looks of things. I'm guessing solr was a little confused on which instance of zookeeper to use. (The

Re: Indexing in one collection affect index in another collection

2019-01-23 Thread Zheng Lin Edwin Yeo
Hi Shawn, Thanks for your reply. The log only shows a list the following and I don't see any other logs besides these. 2019-01-24 02:47:57.925 INFO (qtp2131952342-1330) [c:collectioin1 s:shard1 r:core_node4 x:policies_shard1_replica_n2] o.a.s.u.p.StatelessScriptUpdateProcessorFactory

Re: API to convert a SolrInputDocument to JSON

2019-01-23 Thread Erick Erickson
Walter: Don't know if it helps, but have you looked at: https://issues.apache.org/jira/browse/SOLR-445 I have _not_ worked with this personally in prod SolrCloud systems, so I can't say much more than it exists. It's only available in Solr 6.1+ Best, Erick On Wed, Jan 23, 2019 at 5:55 PM

Re: Solr admin UI new features

2019-01-23 Thread Erick Erickson
H, is there any chance you somehow have your Solr instances pulling some things, particularly browser-related from your old install? Or from some intermediate cache between your browser and the Solr instances? Or perhaps "something got copied somewhere" and is being picked up from the old

Re: API to convert a SolrInputDocument to JSON

2019-01-23 Thread Walter Underwood
Only use CloudSolrClient if you don’t care about the error return from updates. For us, that is a fatal flaw that makes CloudSolrClient unacceptable for prod use. We use HttpSolrClient directed at the load balancer for the cluster and I haven’t noticed any speed issues. I expect that

Re: API to convert a SolrInputDocument to JSON

2019-01-23 Thread Pushkar Raste
You mean I can use SolrJ 7.x for both indexing documents to both Solr 4 and Solr 7 as well as the SolrInputDocument class from Solrj 7.x Wouldn’t there be issues if there are any backwards incompatible changes. On Wed, Jan 23, 2019 at 8:09 PM Shawn Heisey wrote: > On 1/23/2019 5:49 PM, Pushkar

Re: API to convert a SolrInputDocument to JSON

2019-01-23 Thread Shawn Heisey
On 1/23/2019 5:49 PM, Pushkar Raste wrote: Thanks for the quick response Shawn. It is migrating ion from Solr 4.10 master/slave to Solr Cloud 7.x In that case, use SolrJ 7.x, with CloudSolrClient to talk to the new version and HttpSolrClient to talk to the old version. Use the same

Re: API to convert a SolrInputDocument to JSON

2019-01-23 Thread Pushkar Raste
Thanks for the quick response Shawn. It is migrating ion from Solr 4.10 master/slave to Solr Cloud 7.x On Wed, Jan 23, 2019 at 7:41 PM Shawn Heisey wrote: > On 1/23/2019 5:05 PM, Pushkar Raste wrote: > > We are setting up cluster with new version Solr and going to reindex > data. > > However,

Re: API to convert a SolrInputDocument to JSON

2019-01-23 Thread Shawn Heisey
On 1/23/2019 5:05 PM, Pushkar Raste wrote: We are setting up cluster with new version Solr and going to reindex data. However, until all the data is indexed I need keep indexing data in the old cluster as well. We are currently using the Solrj client and constructing SolrInputDocument objects to

Solr admin UI new features

2019-01-23 Thread Dwane Hall
Hi user community, I recently upgraded a single node solr cloud environment from 7.3.1 to 7.6. While traversing through the release notes for solr 7.5 to identify any important changes to consider for the upgrade I noticed two excellent additions to the Admin UI that took effect in solr 7.5

API to convert a SolrInputDocument to JSON

2019-01-23 Thread Pushkar Raste
Hi, We are setting up cluster with new version Solr and going to reindex data. However, until all the data is indexed I need keep indexing data in the old cluster as well. We are currently using the Solrj client and constructing SolrInputDocument objects to index data. To avoid conflicts with

Lucene Solr custom tokenizer - How to include delimiter special characters as tokens?

2019-01-23 Thread rina joseph
Hello Solr users, I have a need to write a tokenizer for source code files in Solr, but don't have the option of including custom JARs. So for ex: Input: foo.bar Tokens: 'foo', '.', 'bar' How can I have a custom tokenizer or filter in schema.xml that can split on some characters, but also not

How to clear old versions of a documents

2019-01-23 Thread Eyyub Çil
Hi All, I have nested document based solr schema. Solr keeps multiple _version_ of parent document when any update occurse solr keeps . I know that comes with NoSQL feature of Solr . My question is how I clean up older versions of documents ? and display last version of a document in search

Re: Indexing in one collection affect index in another collection

2019-01-23 Thread Shawn Heisey
On 1/23/2019 10:01 AM, Zheng Lin Edwin Yeo wrote: I am using Solr 7.5.0, and currently I am facing an issue of when I am indexing in collection2, the indexing affects the records in collection1. Although the records are still intact, it seems that the settings of the termVecotrs get wipe out,

Indexing in one collection affect index in another collection

2019-01-23 Thread Zheng Lin Edwin Yeo
Hi, I am using Solr 7.5.0, and currently I am facing an issue of when I am indexing in collection2, the indexing affects the records in collection1. Although the records are still intact, it seems that the settings of the termVecotrs get wipe out, and the index size of collection1 reduced from

Solr times out connecting to Zookeeper

2019-01-23 Thread marotosg
Hi, I am having some trouble trying to increase Zookeeper client timeout when Solr tries to connect to Zookeeper when starts the first time. Tried already with no luck updating the following properties : 1) Update the zkClientTimeout on solr.xml ${zkClientTimeout:9} 2) Uncomment

Solr indexing raises error while posting PDF

2019-01-23 Thread sonam mittal
I am using Solr-6.6.4 version and Ubuntu 16 version.I have created a collection in Solr using the configuration files of the Solr example *techproducts*. I am trying to post a PDF in Solr but it is raising some errors.I have also installed the apache tika through maven but still it is showing the

Re: _version_ field missing in schema?

2019-01-23 Thread Shawn Heisey
On 1/23/2019 3:49 AM, Aleksandar Dimitrov wrote: Hi Alex, thanks for you answer. I took the lines directly from the managed-schema, deleted the managed-schema, and pasted those lines into my schema.xml. Unless you have changed the solrconfig.xml to refer to the classic schema, the file named

Re: _version_ field missing in schema?

2019-01-23 Thread Alexandre Rafalovitch
If you do not use API or Admin to change schema, it will not get automatically rewritten. So you can just stay with managed-shema file and version that. You can even disable write changes in solrconfig.xml:

Re: Adding and deleting documents in the same update request

2019-01-23 Thread Shawn Heisey
On 1/23/2019 5:58 AM, Andreas Nilsson wrote: Related: in the case where I cannot rely on the operations order in a single update request, is there a recommended way to do these kinds of updates "atomically" in a single request? Ideally, I obviously don't want the collection to be left in a

Adding and deleting documents in the same update request

2019-01-23 Thread Andreas Nilsson
Hi all, I am updating a Solr Collection (Solr 7.3.1 in Cloud mode using SolrJ Java API) with requests that include both adding new documents as well as deleting existing ones (by query). The deletion part is meant to make sure any earlier revisions of the indexed source are deleted as part of

Re: The parent shard will never be delete/clean?

2019-01-23 Thread Andrzej Białecki
Solr 7.4.0 added a periodic maintenance task that cleans up old inactive parent shards left after the split. “Old” means 2 days by default. > On 22 Jan 2019, at 15:31, Jason Gerlowski wrote: > > Hi, > > You might want to check out the documentation, which goes over > split-shard in a bit more

Re: difference in behavior of term boosting between Solr 6 and Solr 7

2019-01-23 Thread Elaine Cario
I predicted some colleague would come to me 2 minutes after I sent this with some finding - I was wrong, it was a few hours! It seems there was a change in a custom similarity class (I think because of an API change in Solr), which caused the query boost to not be applied. We're looking at this

Re: _version_ field missing in schema?

2019-01-23 Thread Aleksandar Dimitrov
Hi Alex, thanks for you answer. I took the lines directly from the managed-schema, deleted the managed-schema, and pasted those lines into my schema.xml. If I have other errors in the schema.xml (such as a missing field type), solr complains about those until I fix them. So I would guess