Re: Solr DIH using JDBC with TIKA

[ANNAMANENI RAVEENDRA]

Yes it can be local directory
File:///full path


On Tue, 4 Jul 2017 at 10:25 PM, d0ct0r4r6a  wrote:

> For the URL param in the "extract" entity, can it be a local directory? If
> yes, how do you specify the path?
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Solr-DIH-using-JDBC-with-TIKA-tp4180737p4344273.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

Re: setup solrcloud from scratch vie web-ui

[ANNAMANENI RAVEENDRA]

Hi ,

If there is a request handler configured in solrconfig.xml and update the
Conf in zookeeper it should show up

If already did it try reloading configuration

Thanks
Ravi


On Fri, 12 May 2017 at 9:46 AM, Thomas Porschberg 
wrote:

> > > This is another problem I see: With my non-cloud core I have a
> conf-directory where I have dataimport.xml, schema.xml and solrconfig.xml.
> > > I think these 3 files are enough to import my data from my relational
> database.
> > > Under example/cloud I could not find one of them. How to setup DIH for
> the solrcould?
> >
> > The entire configuration (what would normally be in the conf directory)
> > is in zookeeper when you're in cloud mode, not in the core directories.
> > You must upload a directory containing the same files that would
> > normally be in a conf directory as a named configset to zookeeper before
> > you try to create your collection.  This is something that the "bin/solr
> > create" command does for you in cloud mode, typically using one of the
> > configsets included on the disk as a source.
> >
> >
> https://cwiki.apache.org/confluence/display/solr/Using+ZooKeeper+to+Manage+Configuration+Files
> >
> Ok, thank you. I did the following steps.
>
> 1. Started an external zookeeper
> 2. Copied a conf-directory to zookeeper:
> bin/solr zk upconfig -n books -d $HOME/solr-6.5.1/server/solr/tommy/conf
> -z localhost:2181
> // This is a conf-directory from a standalone solr when dataimport was
> working!
> --> Connecting to ZooKeeper at localhost:2181 ...
> Uploading <> for config books to ZooKeeper at localhost:2181
> // I think no errors, but how can I check it in zookeeper? I found no
> files solrconfig.xml ...
> in the zookeeper directories (installation dir and data dir)
> 3. Started solr:
> bin/solr start -c
> 4. Created a books collection with 2 shards
> bin/solr create -c books -shards 2
>
> Result: I see in the web-ui my books collection with the 2 shards. No
> errors so far.
> However, the Dataimport-entry says:
> "Sorry, no dataimport-handler defined!"
>
> What could be the reason?
>
> Thomas
>

Re: Managed Synonyms query

[ANNAMANENI RAVEENDRA]

Hi,

Which version of solr is this on?
It will give a good idea if provided field definition like tokeniser
analyser used etc?
This is a case of multi word synonym which I think you should use
autopharing token filter

Thanks
Ravi

On Mon, 5 Jun 2017 at 11:20 AM, Sweta Parekh 
wrote:

> Hi All,
>
> We are using managed synonyms functionality at index time but one-way &
> replacement are not working as desired. Below are some examples that are
> not working
> Can anyone help to understand how the index time synonyms works in Solr .
> We are using edismax with mm=2>-1 5>100%, ps=5
>
> Below entries highlighted in yellow are not working. We need to search to
> return results of "From" word along with "To" term but not vice-versa
>
> rust-oleum ; rust-oleum, rust o leum-  this is not working
> rust-oleum  ; rust-oleum, rust oleum -  in the analyzer it is showing that
> rust oleum is replaced with rust-oleum and then it should show result .
> rust-oleum   ;rust-oleum, rust oleum Canada  this will work once above
> entry works
> rust-oleum; rust-oleum, rust-oleum Canada   this is working
> rust-oleum ;rust-oleum, rustoleum canada  this is working
>
> eye wash  ;   eye wash, douche occulaire  - this is not working
> eye wash  ;   eye wash, douche oculaire - this is working
>
>
> Gatorade; gatoraid - this is not working . We want to replace to term
> "gatoraid" with from term "Gatorade" but output is reversed. When we switch
> the entry, there is not impact of the rule
>
> Regards,
> Sweta Parekh
> Search / CRO - Associate Program Manager
> Digital Marketing Services
> sweta.par...@clerx.com
> Extn: 284887 | Mobile: +(91) 9004667625
> eClerx Services Limited [www.eClerx.com]
>
>

Re: Searching under multiple field

[ANNAMANENI RAVEENDRA]

Hi,

Use dismay or edismax query parser

Or

Use copy field concept

Thanks
Ravi

On Sun, 11 Jun 2017 at 9:32 PM, Zheng Lin Edwin Yeo 
wrote:

> Hi,
>
> Currently, I'm using the following query to search for the same word under
> different fields
>
> http://localhost:8983/solr/collection1/select?q=(field1_s:*test* OR
> field2_s:*test* OR field3_s:*test* OR field4_s:*test*) AND
> field1_tc:"Main"*
>
> Is there a way to better streamline the query, so that we will not have to
> use so many "OR" in the query?
>
> I'm using Solr 6.5.1.
>
> Regards,
> Edwin
>

Re: Phrase boosting on multiple fields

[ANNAMANENI RAVEENDRA]

Just pass qf=field1,field2,field3=field1,firld2,field3

Like that you can add as many field as you want


On Wed, 6 Sep 2017 at 2:41 AM, ritesh kumar 
wrote:

> I have a situation where I have to apply phrase boosting on multiple
> fields. I am using Edismax as query parser.
> For instance, I am accepting a keyword (phrase) from the user and I want
> the doc with the exact phrase to be on the top of the resultant list. The
> problem is, there are multiple fields to be queried upon.
> I could find some assistance from the code below but again it works on a
> single field only.
>
> q=java+design+patterns=edismax=name=name^30=0
>
> Any kind of suggestion would be helpful.
>
> Best,
>
> Ritesh Kumar
>
>
>

Re: count mismatch: number of records indexed

[ANNAMANENI RAVEENDRA]

Possible cases can be

If you don’t have unique key then there are high chances that you will see
less data
Try hard commit or check your commit times (hard/soft)


On Wed, May 2, 2018 at 9:30 AM Srinivas Kashyap <
srini...@tradestonesoftware.com> wrote:

> Hi,
>
> I have standalone solr index server 5.2.1 and have a core with 15
> fields(all indexed and stored).
>
> Through DIH I'm indexing the data (around 65million records). The index
> process took 6hours to complete. But after the completion when I checked
> through Solr admin query console(*:*), numfound is only 41 thousand
> records. Am I missing some configuration to index all records?
>
> Physical memory: 16GB
> JVM memory: 4GB
>
> Thanks,
> Srinivas
>

Re: Regarding multi keyword search

[ANNAMANENI RAVEENDRA]

You should use mm parameter and it should be set to 100 if you use dismax
or edismax


On Tue, Oct 23, 2018 at 11:18 AM Gauri Dhawan 
wrote:

> Hi!
> I have been facing an issue for quite some time and haven't been able to
> come to a solution as of yet. We are trying to implement search on our
> platform and all our data is stored in Solr.
>
> I have a field `description` which is the field where I have to search.
> It is of the field type `text_edit_suggest` and it looks something like
> this
>
> 
> >   
> > 
> > 
> > 
> >  > pattern="([\.,;:-_])" replacement=" " replace="all"/>
> >  > minGramSize="1"/>
> >  > pattern="([^\w\d\*æøåÆØÅ ])" replacement="" replace="all"/>
> >  > ignoreCase="true" expand="false"/>
> >   
> >   
> >   
> >   
> > 
> > 
> > 
> >  > pattern="([\.,;:-_])" replacement=" " replace="all"/>
> >  > pattern="([^\w\d\*æøåÆØÅ ])" replacement="" replace="all"/>
> >  > pattern="^(.{30})(.*)?" replacement="$1" replace="all"/>
> >  > ignoreCase="true" expand="false"/>
> >   
>
>
>
> When I search for multiple keywords, the results are unexpected.
> For example :
> I want to search for the words `first` and `post` and both these words
> should be present in the description field of the document else it
> shouldn't return the document.
> I've tried some 50+ queries for this. Used `edismax` parser as well but in
> vain.
>
> Tried boosting as well. But most queries result in weight given to either
> one of the keywords and results in documents that have that keyword but not
> the other. Can you guys help? Thanks in advance!
>
>
> Gauri Dhawan
> Associate Software Engineer
> SHEROES
>

Re: maxBooleanClauses change in solr.xml not reflecting in solr 8.4.1

[ANNAMANENI RAVEENDRA]

I experienced the same thing in solr-8.7 , it worked for me using system
property.

Set system property in solr.in.sh file


On Tue, Jan 5, 2021 at 8:58 PM dinesh naik 
wrote:

> Hi all,
> I want to update the maxBooleanClauses to 2048 (from default value 1024).
> Below are the steps tried:
> 1. updated solrconfig.xml :
> ${solr.max.booleanClauses:2048}
>
> 2. updated  solr.xml :
> ${solr.max.booleanClauses:2048}
>
> 3. Restarted the solr nodes.
>
> 4. Tried query with more than 2000 OR clauses and getting below waring
> message in solr logs:
>
> 2021-01-05 14:03:59.603 WARN  (qtp1545077099-27) x:col1_shard1_replica_n3
> o.a.s.c.SolrConfig solrconfig.xml:  of 2048 is greater
> than global limit of 1024 and will have no effect
>
> 2021-01-05 14:03:59.603 WARN  (qtp1545077099-27) x:col1_shard1_replica_n3
> o.a.s.c.SolrConfig set 'maxBooleanClauses' in solr.xml to increase global
> limit
>
> Note: In 7.6.1 version we just need to change the solrconfig.xml and it
> works.
>
> Kindly let me know if i am missing something for making it work in 8.4.1
> version.
> --
> Best Regards,
> Dinesh Naik
>