Finding time of last commit to index from SolrJ?

The admin gui displays the time of last commit to a core but how can this be queried from within SolrJ? Notice: This email and any attachments are confidential and may not be used, published or redistributed without the prior written consent of the Institute of Geological and Nuclear Sciences

Re: Error with Streaming Expressions - shortestPath

This issue is caused by the same issue as the other thread, in which the solrconfig.xml was carried forward from the previous version, and is not updated correctly to reflect based on the latest Solr 6.4.2. Regards, Edwin On 14 March 2017 at 23:09, Joel Bernstein wrote: >

Re: Fetch Data from two collections and filter results

I'm currently looking at this as well, and from what I know, Solr Streaming Expressions might be able to achieve this. https://cwiki.apache.org/confluence/display/solr/Streaming+Expressions#StreamingExpressions-StreamEvaluators There are functions like innerJoin, leftOuterJoin, etc. But do note

getting "dedupe" management when updating index via tika and SolrJ

I have added a signature field to schema and setup dedupe handler in solrconfig.xml as per docs, however docs say: “Be sure to change your update handlers to use the defined chain, as below:” Umm, WHERE do you change the update handler to use the defined chain? Is this in one of config xmls or

HttpSolrServer default connection timeout and socket timeout

Hi devs, What are the default HttpSolrServer connection timeout and socket timeout used? And what are the recommended values we should use? My system is having some problems when the load is high, just trying to figure out what are the correct values should set Regards, Lasitha

Re: Solr 6.3 will not stay connected to zookeeper

I have a pretty good guess what happened. I requested a Zookeeper 3.4.6 cluster, but they built a 3.4.9 cluster. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Mar 15, 2017, at 4:38 PM, Walter Underwood wrote: > > This

Re: Solr 6.3 will not stay connected to zookeeper

This happens with the data_directed_schema_configs example, too. Could it be a file size issue? Small files are succeeding. For the data_driven example, stopwords_it.txt (4924 bytes) worked, but stoptags_ja.txt (16724 bytes) failed. For my tutors config, schema.xml (9974 bytes) failed. The

Solr 6.3 will not stay connected to zookeeper

Python kazoo can talk to zookeeper, uploading these same files. Solr fails. What is going on? $ bin/solr create -c tutors -d tutors Connecting to ZooKeeper at

Re: Get handler not working

Wait... Is iqdocid set to the in your schema? That might be the missing thing. On Wed, Mar 15, 2017 at 11:20 AM, Chris Ulicny wrote: > Unless the behavior's changed on the way to version 6.3.0, the get handler > used to use whatever field is set to be the uniqueKey. We have

Re: Data Import Handler on 6.4.1

Also, upgrade to 6.4.2. There are serious performance problems in 6.4.0 and 6.4.1. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Mar 15, 2017, at 12:05 PM, Liu, Daphne > wrote: > > For Solr 6.3, I have to move

RE: Data Import Handler on 6.4.1

For Solr 6.3, I have to move mine to ../solr-6.3.0/server/solr-webapp/webapp/WEB-INF/lib. If you are using jetty. Kind regards, Daphne Liu BI Architect - Matrix SCM CEVA Logistics / 10751 Deerwood Park Blvd, Suite 200, Jacksonville, FL 32256 USA / www.cevalogistics.com T 904.564.1192 / F

Data Import Handler on 6.4.1

I am sure I am missing something simple but I am running Solr 4.8.1 and trialling 6.4.1 on another computer. I have had to manually modify the automatic 6.4.1 scheme config as we use a set of specialised field types. They work fine. I am now trying to populate my core with data and having

Group by range results

Hi, Can we group by ranges? something like: facet=true stats=true stats.field={!tag=piv1 min=true max=true}price facet.range={!tag=r1}manufacturedate_dt facet.range.start=2006-01-01T00:00:00Z facet.range.end=NOW/YEAR facet.range.gap=+1YEAR facet.pivot={!stats=piv1}r1 Where I want the max

Re: Index and query

Thank you. I like both option XSLT and mapping rules. Would you please provide some pointers to it? so that I can use it. Thanks again. Regards, rn On Wed, Mar 15, 2017 at 1:37 PM, Alexandre Rafalovitch wrote: > Additionally, > > Solr can index arbitrary XML by applying an

Re: Index and query

Would you please elaborate the 1> I guess you are saying add an attribute in managed-schema that is stored only. i.e

Re: Index and query

Additionally, Solr can index arbitrary XML by applying an XSLT transform to it before indexing. But you still need to write the XSLT transform. Solr can also index arbitrary XML with DataImportHandler by pulling out specific fields. But you need to write mapping rules. I am not sure what

Re: Get handler not working

Unless the behavior's changed on the way to version 6.3.0, the get handler used to use whatever field is set to be the uniqueKey. We have successfully been using get on a 4.9.0 standalone core with no explicit "id" field defined by passing in the value for the uniqueKey field to the get handler.

Re: Index and query

bq: How original document X will be returned? Should I store location of X in Tx? I s there a generic way of doing it? A couple of choices here: 1> create a stored-only field (i.e. stored="true" indexed="false" docValues="false") and stuff the original in that. It'll chew up some disk space, but

Re: Index and query

Solr does not index XML. Period. Solr uses an XML protocol for indexing. It can also use JSON or binary protocols for indexing. You need to convert your XML document into fields, then send those fields to Solr using one of the indexing protocols. If you need an XML database and search engine,

Re: Index and query

Thank you Erick for such a prompt reply. I am bit confused. Suppose I have a document X, I transformed it document Tx. Tx matches the format that you have described. I post Tx and I asume it get indexed. Now I query. How original document X will be returned? Should I store location of X in Tx?

Re: Get handler not working

if im not mistaken, the real time get handler uses the "id" field exclusively. I have never seen examples that use a different field then that one. the idea behind it is its a solr given unique value, yonik kind of sheds light on it here: http://yonik.com/solr/realtime-get/ so why not use the

Re: Get handler not working

What type is your iqdocid? If totally stuck, I would take a non-SolrCloud basic example, index your single document into it and seeing if the problem still exist. Then try to find the mid-point between your config and this config and see if problem is still there. Regards, Alex.

Re: Get handler not working

from your previous email: "There is no "id" field defined in the schema." you need an id field to use the get handler On Wed, Mar 15, 2017 at 1:45 PM, Chris Ulicny wrote: > I thought that "id" and "ids" were fixed parameters for the get handler, > but I never remember, so

Re: Get handler not working

I thought that "id" and "ids" were fixed parameters for the get handler, but I never remember, so I've already tried both. Each time it comes back with the same response of no document. On Wed, Mar 15, 2017 at 1:31 PM Alexandre Rafalovitch wrote: > Actually. > > I think

Re: Get handler not working

Actually. I think Real Time Get handler has "id" as a magical parameter, not as a field name. It maps to the real id field via the uniqueKey definition: https://cwiki.apache.org/confluence/display/solr/RealTime+Get So, if you have not, could you try the way you originally wrote it. Regards,

Re: Get handler not working

Sorry, that is a typo. The get is using the iqdocid field. There is no "id" field defined in the schema. solr/TestCollection/get?iqdocid=2957-TV-201604141900 solr/TestCollection/select?q=*:*=iqdocid:2957-TV-201604141900 On Wed, Mar 15, 2017 at 1:15 PM Erick Erickson

Re: Get handler not working

Is this a typo or are you trying to use get with an "id" field and your filter query uses "iqdocid"? Best, Erick On Wed, Mar 15, 2017 at 8:31 AM, Chris Ulicny wrote: > Yes, we're using a fixed schema with the iqdocid field set as the uniqueKey. > > On Wed, Mar 15, 2017 at

Re: Index corruption with replication

You can specify your replication to include config files, but if the schema has changed you'll have to restart your Solr afterwards. How is it corrupt? what is the symptom? Any error messages in the solr log on the slave? What version of Solr? Details matter. Best, Erick On Wed, Mar 15, 2017 at

Re: Index and query

Solr does _not_ index arbitrary XML, it will index XML in a very specific format, i.e. value . . So if you're sending arbitrary XML to Solr I'm actually surprised it's indexing. You might be able to do something with sending docs through Tika

Re: Index corruption with replication

are you certain the schema is the same on both master and slave? I find that the schema file doesnt always go with the replication and if a field is different on the slave it will cause problems On Wed, Mar 15, 2017 at 12:08 PM, Santosh Sidnal wrote: > Hi all, > > I

Index and query

Good Afternoon, I am trying to index xml documents and query them. Once query successfully matches, I am hoping to download the uploaded and indexed xml document. Initially I thought solr supports xml. Thus I did not make any change to my default installation. However I was not able to query

Index corruption with replication

Hi all, I am facing issues of index corruption at regular intervals of the time on live server where i pull index data from one master server. Can anyone please give us some ppinters why we are facing issue on regular interval of time? I am aware of how can we correct corrupted index but i am

Re: Using fetch function with streaming expression

Great, I think I can achieve what I want by combining "select" and "cartersian" functions in my expression. Thanks a lot for help! Regards, Pratik On Wed, Mar 15, 2017 at 10:21 AM, Joel Bernstein wrote: > I haven't created the jira ticket for this yet. It's fairly quick to

Re: Get handler not working

Yes, we're using a fixed schema with the iqdocid field set as the uniqueKey. On Wed, Mar 15, 2017 at 11:28 AM Alexandre Rafalovitch wrote: > What is your uniqueKey? Is it iqdocid? > > Regards, >Alex. > > http://www.solr-start.com/ - Resources for Solr users, new and

Re: Get handler not working

What is your uniqueKey? Is it iqdocid? Regards, Alex. http://www.solr-start.com/ - Resources for Solr users, new and experienced On 15 March 2017 at 11:24, Chris Ulicny wrote: > Hi, > > I've been trying to use the get handler for a new solr cloud collection we > are

Re: Error for Graph Traversal using Streaming Expressions

Hi Joel, Thanks for your help. The problem is with the solrconfig.xml. I got the latest Solr 6.4.2 sample solrconfig.xml, and added in my custom handler, and it works now. Regards, Edwin On 15 March 2017 at 09:35, Zheng Lin Edwin Yeo wrote: > Ok, thanks for the heads

Get handler not working

Hi, I've been trying to use the get handler for a new solr cloud collection we are using, and something seems to be amiss. We are running 6.3.0, so we did not explicitly define the request handler in the solrconfig since it's supposed to be implicitly defined. We also have the update log enabled

Re: CDCR support with solr version 4.10.3

The first version of CDCR is Solr 6.0. CDCR over HDFS is also not supported currently, see SOLR-9861. Best, Erick On Wed, Mar 15, 2017 at 6:37 AM, Ganesh Kumar J wrote: > Hi Solr Team, > > > We are using apache solr 4.10.3 version along with CDH >

Re: Using fetch function with streaming expression

I haven't created the jira ticket for this yet. It's fairly quick to implement but the Solr 6.5 release is just around the corner. So most likely it would be in the Solr 6.6. It will be committed fairly soon though so if you want to use master, or branch_6x you can experiment with it earlier.

CDCR support with solr version 4.10.3

Hi Solr Team, We are using apache solr 4.10.3 version along with CDH 5.4.8. We like to know that the Cross Data Center Replication (CDCR) support with the solr version 4.10.3

Fetch Data from two collections and filter results

Hi, I am trying to solve a use case and not fully sure if can be achieved with new fancy Solr features. I have two collections People and Jobs. Job collection has the id of the person in the schema. 1) Is it possible to run a query against person collection and join data from the job

Re: managing active/passive cores in Solr and Haystack

Thanks Erick for the fast answer:) I knew about sharding, just as far as I know it will work on different servers. I wonder if it is possible to do sth like sharding as you mentioned but on a single standalone Solr? Can I use the implicit routing on standalone then? and I would appreciate if

Re: Suggestions from different dictionaries dynamically

Hi Mesenthil, Are you using the spellchecker for autocompletion purposes ? In case you do, I would recommend to use the suggester component, way more flexible and specifically designed for autocompletion [1] . Related your requirement to see different categories of spellcheck suggestions, I would

How to use facet pivoting with paging?

Hi all, I am performing a facet with pivot query. The result I get is correct, but when I use "facet.offset=1" in the query, the results I get differ, as in pivot removed. Instead of getting: "facet_pivot":{ "buyer.name,agreedPrice.hasCurrency.notation":[{

org.apache.solr.security.RuleBasedAuthorizationPlugin messages

Hi We have solr server 6.2.1 with basic auth (rule based). Clients are using solrj 6.2. During heavy workload we see that besides some timeouts, we also get the next messages: org.apache.solr.security.RuleBasedAuthorizationPlugin messages : request has come without principal. failed permission

Re: query the data contain key value

Solr doesn't know about "null" values. Using a schema which declares all those fields (id, eventA, eventB, eventC) and indexing those 2 documents 1,eventA=2,eventC=3 2,eventB=1,eventA=1 You already get a situation "similar" to what you want. I said "Similar" because you won't have any null

Re: query the data contain key value

Solr doesn't know about "null" values. Using a schema which declares all those fields (id, eventA, eventB, eventC) and indexing those 2 documents 1,eventA=2,eventC=3 2,eventB=1,eventA=1 You already get a situation "similar" to what you want. I said "Similar" because you won't have any null

Re: Indexing CPU performance

On Tue, 2017-03-14 at 16:47 +0200, Mahmoud Almokadem wrote: > After sorting with Self Time(CPU) I got that the > FSDirectory$FSIndexOutput$1.write() is taking much of CPU time, so > the bottleneck now is the IO of the hard drive? > > https://drive.google.com/open?id=0BwLcshoSCVcdb2I4U1RBNnI0OVU I

query the data contain key value

Hi, i have data sample to index it into solr. below is the format of my sample data : id,field1,field2 1,eventA=2,eventC=3 2,eventB=1,eventA=1 how can i query or indexing that data format in solr to get the result like this : id,eventA,eventB,eventC 1,2,null,3 2,1,1,null is there any way to

How to implement nested streaming expressions in Java using solrj

I am trying to write a streaming expression in solrj. Following is the query that I want to implement in Java. having( > gatherNodes(collection1, > search(collection1,q="*:*",fl="conceptid",sort="conceptid > asc",fq=storeid:"524efcfd505637004b1f6f24",fq=tags:"Company",fq=tags:"Prospects2", >

Re: Suggestions from different dictionaries dynamically

Yes we are using spellcheck dictionary. Our default search field is "text". Following is the solrconfig snippet. Please let us know if there is more information required. edismax true typeaheadspellcheck spellcheckresearcher