RE: Return specific field from child documents.

[Preeti Bhat]

Hi Mikhail,

I was trying to restrict the data from child documents due to one of the 
request of the client where they would need the specific fields as output. The 
below query gives me the firstName and Last Name as expected but not the email 
which is part of the child document.
http://localhost:8984/solr/Contact/select?fl=FirstName,LastName,email,%20[child%20parentFilter=content_type:parent%20]=on={!parent%20which=%22content_type:parent%22}%20email:%22tempe...@tempest.com%22=json

I did try the sub query, but its returning only the parent document. Not sure 
if I am missing something here.

http://localhost:8984/solr/Contact/select??fl=id,FirstName,email,emp:[subquery]=10=email={!term%20f=contact_id%20v=$row.id}=on=%7b!parent%20which=%22content_type:parent%22%7d%20email:%22tempe...@tempest.com%22=json=true

I am expecting the result to be something like this. Could you please advise.
{
"FirstName":"temptest",
"LastName":"temper",
"_childDocuments_":[
{ "email":["tempe...@tempest.com"]
},
{"email":["temper.tt...@tempt.com"]
}
]
}

Thanks and Regards,
Preeti Bhat

-Original Message-
From: Mikhail Khludnev [mailto:m...@apache.org]
Sent: Monday, January 30, 2017 5:49 PM
To: solr-user
Subject: Re: Return specific field from child documents.

Hello,

You hardly get any gain limiting child field output. You can do that with 
[subquery] result transformer.

On Mon, Jan 30, 2017 at 11:09 AM, Preeti Bhat 
wrote:

> Hi All,
>
> I am trying out the nested documents concept for SOLR. I am able to
> show the specific field for the parent document like
> "FirstName","LastName" but I am not able to show the specific field in fl for 
> child.
>
> I would like to retrieve the email from the _childDocuments. Could
> someone please advise.
>
> Q=+FirstName:"etr4tr" {!parent which="content_type:parent"}
> Fl=FirstName,LastName,email, [child parentFilter=content_type:parent ]
>
>   "response":{"numFound":1,"start":0,"docs":[
>   {
> "FirstName":"etr4tr",
> "LastName":"wrer6t",
> "_childDocuments_":[
> {
>   "id":"3556|12",
>   "company_id":["12"],
>   "email":["ehrijw.e...@b.com"],
>   "isPrimary":["true"]},
> {
>   "id":"3556|45",
>   "company_id":["45"],
>   "email":["ehrijw.eer54...@ccc.com"]}]}]
>   }}
>
>
> Thanks and Regards,
> Preeti Bhat
>
>
>
> NOTICE TO RECIPIENTS: This communication may contain confidential
> and/or privileged information. If you are not the intended recipient
> (or have received this communication in error) please notify the
> sender and it-supp...@shoregrp.com immediately, and destroy this
> communication. Any unauthorized copying, disclosure or distribution of
> the material in this communication is strictly forbidden. Any views or
> opinions presented in this email are solely those of the author and do
> not necessarily represent those of the company. Finally, the recipient
> should check this email and any attachments for the presence of
> viruses. The company accepts no liability for any damage caused by any virus 
> transmitted by this email.
>
>
>


--
Sincerely yours
Mikhail Khludnev

NOTICE TO RECIPIENTS: This communication may contain confidential and/or 
privileged information. If you are not the intended recipient (or have received 
this communication in error) please notify the sender and 
it-supp...@shoregrp.com immediately, and destroy this communication. Any 
unauthorized copying, disclosure or distribution of the material in this 
communication is strictly forbidden. Any views or opinions presented in this 
email are solely those of the author and do not necessarily represent those of 
the company. Finally, the recipient should check this email and any attachments 
for the presence of viruses. The company accepts no liability for any damage 
caused by any virus transmitted by this email.

RE: Best and efficient way to find out whether set of records available in Solr

[M, Arjun (Nokia - IN/Bangalore)]

Hi Erick,

Let me put it in other way. 

Id : 1,2,3 are present in solr db. 

I query with query param id with values 3,4,5,6, it should return 
4,5,6(records not present in solr)

Thanks & Regards,
   Arjun M

-Original Message-
From: Erick Erickson [mailto:erickerick...@gmail.com] 
Sent: Tuesday, January 31, 2017 11:18 AM
To: solr-user 
Subject: Re: Best and efficient way to find out whether set of records 
available in Solr

bq: if below are the records available in solr, I need to whether id
with values 3,4,5,6 are available in solr or not

This just doesn't make sense to me. _How_ do you decide you want to
know certain docs aren't available? What relation is there between the
presence of docs 1, 2 and 3 and the absence of 3, 4, 5, 6? And you've
said that doc 3 is available, but then asked to be informed that it's
_not_ available.

And what does "unavailable" mean? By what criteria?

Best,
Erick

On Mon, Jan 30, 2017 at 9:39 PM, M, Arjun (Nokia - IN/Bangalore)
 wrote:
> Hi,
>
> I have an use case where I need to find out whether a set of records 
> are available in Solr. Please suggest best and efficient way to achieve it. 
> Any suggestions are appreciated.
>
> For eg : if below are the records available in solr, I need to 
> whether id with values 3,4,5,6 are available in solr or not. I want the query 
> to return list of unavailable records.
>
> [{
>   "id":"1",
> "Name":Arjun
> },
> {
> "id":"2",
> "Name":Arun,
>  },
>  {
>   "id":"3",
> "Name":Arun
>  }]
>
> Thanks & Regards,
>Arjun M
>
>
>

Fwd: Arabic words search in solr

[mohan sundaram]

Hi,

 I went through the solr references document which you shared in the link.
Your shared references document pointing to solr version 6.4.0.

The implemented Solr version in my project is 4.9.0.


As I mentioned earlier In my solr schema.xml I defined product Arabic name
field as below:

/*--*/

























/*--*/



I am indexing the Arabic content using “text_ar” field type.




*Characters*

*ا*

*أ*

*إ*

*آ*

Shift key Considers for the above

Table 1


These are the example of characters where I’m facing the searching
difficulty.




*Example Indexed words*

*ابرا*

*أبرا*

*إبرا*

*آبرا*

Table 2

These an example of indexed words in Solr.



*Searching word*

*ابرا*

Table 3


Now my problem is, By searching for the above word(table 3) I should get
all indexed words in table 2 in the output.



Is Solr version 4.9.0 compatible with Arabic search or do I need to upgrade
to higher version?


Kindly, do let me know if I need to give an example of all characters since
I gave only for one character which is hamza with alef.


Thanks,

Mohan




On Mon, Jan 30, 2017 at 9:21 PM, Steve Rowe  wrote:

> Hi Mohan,
>
> I answered your question on the solr-user list.  Did you see my response?
>
> I CC’d you on this email, but you should know that Apache mailing lists
> won’t automatically send you email unless you have subscribed to the list.
> For more information, see  /community.html#mailing-lists-irc>.
>
> --
> Steve
> www.lucidworks.com
>
> > On Jan 29, 2017, at 2:16 PM, mohan sundaram 
> wrote:
> >
> > Hi,
> >
> > In solr search I want to search with product name using Arabic letters.
> > While searching, Arabic user can feel little default to search some
> product
> > name. Because some characters need to mention while searching.
> >
> > Ex: إ أ آ
> >
> >
> > In the above mentioned characters, user can get combination of shift key.
> > Usually if Arabic people will mention “ ا “  character and will get the
> > below combined words.
> >
> > Ex: إبرا
> >
> >
> > In my solr schema.xml I defined product arabic name field as below
> >
> >
> >  > stored="true"/>
> >
> >
> >   > positionIncrementGap="100">
> >
> >  
> >
> >
> >
> >
> >
> > > words="lang/stopwords_ar.txt" />
> >
> >
> >
> >
> >
> >  
> >
> >
> >
> >
> >
> > What changes I have do in schame.xml. Please help me on this.
> >
> >
> >
> > --
> > Regards,
> > Mohan.N
> > 096896429683
>
>

Re: How to alter the facet query limit default

[Erick Erickson]

Alexandre:

We recommend only using alphanum and underscore here:
https://cwiki.apache.org/confluence/display/solr/Defining+Fields. WDYT
about adding an explicit warning about this problem there? Or a JIRA
about "field names with periods cannot use field qualifiers like
f..facet.limit where  contains periods"?

Erick

On Mon, Jan 30, 2017 at 10:35 AM, KRIS MUSSHORN  wrote:
>
> Alexandre..
>
> Once i converted to fieldnames without dots it worked.. thank you
>
> Kris
> - Original Message -
>
> From: "Alexandre Rafalovitch" 
> To: "solr-user" 
> Sent: Thursday, January 26, 2017 11:40:49 AM
> Subject: Re: How to alter the facet query limit default
>
> facet.limit?
> f..facet.limit? (not sure how that would work with field
> name that contains dots)
>
> Docs are at: https://cwiki.apache.org/confluence/display/solr/Faceting
>
> Regards,
> Alex.
> 
> http://www.solr-start.com/ - Resources for Solr users, new and experienced
>
>
> On 26 January 2017 at 10:36, KRIS MUSSHORN  wrote:
>> SOLR 5.4.1 i am running a query with multiple facet fields.
>> _snip_ 
>> select?q=*%3A*=metatag.date.prefix4+DESC=7910=metatag.date.prefix7=json=true=true=metatag.date.prefix7
>>  =metatag.date.prefix4=metatag.doctype
>>
>> field metatag.date.prefix7 has way more facets than the default of 100.
>>
>> How would I set up solr, or modify my query, to ensure that the facets 
>> return all values.
>>
>> TIA,
>>
>> Kris
>>
>

Re: Arabic words search in solr

[mohanmca01]

Hi Steve,

Thanks for sharing the information. 

 I went through the solr references document which you shared in the link.
Your shared references document pointing to solr version 6.4.0.
The implemented Solr version in my project is 4.9.0.

As I mentioned earlier In my solr schema.xml I defined product Arabic name
field as below:

/*--*/
 
 









/*--*/


I am indexing the Arabic content using “text_ar” field type.

 
Characters
ا
أ
إ
آ
Shift key Considers for the above
Table 1

These are the example of characters where I’m facing the searching
difficulty.
 
Example Indexed words
ابرا
أبرا
إبرا
آبرا
Table 2

These an example of indexed words in Solr.
 
Searching word
ابرا
Table 3

Now my problem is, By searching for the above word(table 3) I should get all
indexed words in table 2 in the output.
 
Is Solr version 4.9.0 compatible with Arabic search or do I need to upgrade
to higher version?

Kindly, do let me know if I need to give an example of all characters since
I gave only for one character which is hamza with alef.

Thanks,
Mohan



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Arabic-words-search-in-solr-tp4317733p4317941.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: project related configsets need to be deployed in both data and solr install folders ?

[Erick Erickson]

Hmmm, did you try specifying the configSetBaseDir in solr.xml? See:
https://cwiki.apache.org/confluence/display/solr/Format+of+solr.xml


Best,
Erick

On Mon, Jan 30, 2017 at 3:54 PM, Renee Sun  wrote:
> Hi -
>
> We use separate solr install and data folders with a shared schema/config
> (configsets) in multi-cores setup, it seems the configsets need to be
> deployed in both places (we are running solr 6.4.0)?
>
> for example,
>
> solr is installed in /opt/solr, thus there is folder:
>
> /opt/solr/server/solr/configsets
>
> we separate the data into a different partition, thus there is:
>
> /mysolrdata/solr/data/configsets
>
> At first, I only deployed the project configsets to the solr install folder
> /opt/solr/server/solr/configsets :
>
> /opt/solr/server/solr/configsets/myproject_configs
>
> then when I create a core, solr complains it could not load config from
> /mysolrdata/solr/data/configsets/myproject_configs (the data folder):
>
> curl
> 'http://localhost:8983/solr/admin/cores?action=CREATE=abc=abc=myproject_configs'
> 
> 
> 400 name="QTime">14 name="error-class">org.apache.solr.common.SolrException name="root-error-class">org.apache.solr.common.SolrException name="msg">Error CREATEing SolrCore 'abc': Unable to create core [abc]
> Caused by: Could not load configuration from directory
> /mysolrdata/solr/data/configsets/myproject_configs name="code">400
> 
>
> So next, I moved the configs to /mysolrdata/solr/data/configsets, but it now
> complains it could not load config from the install folder
> /opt/solr/server/solr/configsets/myproject_configs with the same error.
>
> I had to copy the same config set to both folders ( I eventually did a
> symlink from the /opt/solr/server/solr/configsets/myproject_configs to
> /mysolrdata/solr/data/configsets), and it worked.
>
> I wonder if I have missed any settings to allow me only deploy the configset
> at one place: either my data folder or the install folder, I would assume
> the benefit is obvious.
>
> Thanks
> Renee
>
>
>
>
>
>
> --
> View this message in context: 
> http://lucene.472066.n3.nabble.com/project-related-configsets-need-to-be-deployed-in-both-data-and-solr-install-folders-tp4317897.html
> Sent from the Solr - User mailing list archive at Nabble.com.

Re: Upgrade SOLR version - facets perfomance regression

[SOLR4189]

But I can't run Json Facet API. I checked on SOLR-5.4.1.
If I write:
localhost:9001/solr/Test1_shard1_replica1/myHandler/q=*:*=5=*=json=true=someField
It works fine. But if I write:
localhost:9001/solr/Test1_shard1_replica1/myHandler/q=*:*=5=*=json={field:someField}
It doesn't work.
Are you sure that it is built-in? If it is built-in, why I can't find
explanation about it in reference guid?
Thank you for your help.



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Upgrade-SOLR-version-facets-perfomance-regression-tp4315027p4317931.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Best and efficient way to find out whether set of records available in Solr

[Erick Erickson]

bq: if below are the records available in solr, I need to whether id
with values 3,4,5,6 are available in solr or not

This just doesn't make sense to me. _How_ do you decide you want to
know certain docs aren't available? What relation is there between the
presence of docs 1, 2 and 3 and the absence of 3, 4, 5, 6? And you've
said that doc 3 is available, but then asked to be informed that it's
_not_ available.

And what does "unavailable" mean? By what criteria?

Best,
Erick

On Mon, Jan 30, 2017 at 9:39 PM, M, Arjun (Nokia - IN/Bangalore)
 wrote:
> Hi,
>
> I have an use case where I need to find out whether a set of records 
> are available in Solr. Please suggest best and efficient way to achieve it. 
> Any suggestions are appreciated.
>
> For eg : if below are the records available in solr, I need to 
> whether id with values 3,4,5,6 are available in solr or not. I want the query 
> to return list of unavailable records.
>
> [{
>   "id":"1",
> "Name":Arjun
> },
> {
> "id":"2",
> "Name":Arun,
>  },
>  {
>   "id":"3",
> "Name":Arun
>  }]
>
> Thanks & Regards,
>Arjun M
>
>
>

Best and efficient way to find out whether set of records available in Solr

[M, Arjun (Nokia - IN/Bangalore)]

Hi,

I have an use case where I need to find out whether a set of records 
are available in Solr. Please suggest best and efficient way to achieve it. Any 
suggestions are appreciated.

For eg : if below are the records available in solr, I need to whether 
id with values 3,4,5,6 are available in solr or not. I want the query to return 
list of unavailable records.

[{
  "id":"1",
"Name":Arjun
},
{
"id":"2",
"Name":Arun,
 },
 {
  "id":"3",
"Name":Arun
 }]

Thanks & Regards,
   Arjun M

Re: How to create solr custom filter

[Mugeesh Husain]

thank you Alessandro and Andrea for your help!



--
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-create-solr-custom-filter-tp4317767p4317928.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr Shard Splitting Issue

[Anshum Gupta]

I see a successful completion of the request in the logs here:

2017-01-18 14:43:55.439 INFO
(OverseerStateUpdate-97304349976428549-10.1.1.78:4983_solr-n_00)
[   ] o.a.s.c.o.SliceMutator Update shard state invoked for
collection: collection1 with message: {
  "shard1":"inactive",
  "collection":"collection1",
  "shard1_1":"active",
  "operation":"updateshardstate",
  "shard1_0":"active"}
2017-01-18 14:43:55.439 INFO
(OverseerStateUpdate-97304349976428549-10.1.1.78:4983_solr-n_00)
[   ] o.a.s.c.o.SliceMutator Update shard state shard1 to inactive
2017-01-18 14:43:55.439 INFO
(OverseerStateUpdate-97304349976428549-10.1.1.78:4983_solr-n_00)
[   ] o.a.s.c.o.SliceMutator Update shard state shard1_1 to active
2017-01-18 14:43:55.439 INFO
(OverseerStateUpdate-97304349976428549-10.1.1.78:4983_solr-n_00)
[   ] o.a.s.c.o.SliceMutator Update shard state shard1_0 to active


I think you might be looking at the admin UI to figure out the state
of the shards, and that might still be broken. Can you confirm the
state of the shard from the CLUSTERSTATUS API ?

Also, you shouldn't be invoking SPLITSHARD on the same shard multiple
times like you did when the non-async version failed.

-Anshum


On Thu, Jan 19, 2017 at 6:12 AM ekta  wrote:

> Hi Anshum,
>
> Thanks for the reply.
>
> I had the copy of data that i was experimenting on, and anyways i was doing
> it later too, after i posted the mail. Some points i want to let you know:-
>
> 1. This time i did not change the state of state.json.
> 2. Rest,I did the same steps as above and still the data got frozen to 24GB
> in both shards(my parent shard had -60GB).
> 3. Still, the state.json is showing
> 3.1 Parent -  Active
> 3.2 Child   - Construction
> 4.Yeah i do have logs , i am attaching the file with mail. Please check it
> out.
> 5. I did shard splitting by this command
>
> "
> http://10.1.1.78:4983/solr/admin/collections?action=SPLITSHARD=collection1=shard1
> "
> in browser, and i got Timeout Exception in browser. I am attaching the file
> which contains, what the browser displayed.
> 6. The Details of the system(Amazon EC2 Instances) for which i am doing
> above steps is:
>  6.1 30GB RAM
>  6.2 4 cores
>  6.3 250 GB drive
> 7. Lastly , i googled about the timeout exception that i got, i found some
> reply by you on the post about the same, where  you mentioned to issue the
> spilt shard command asynchronously , i tried with that too. As a result no
> doubt i did not got time out exception from browser but , rest all was same
> as mentioned above.
>
> Please tell me if any further details are required.  solr.log
> 
> Browser_result.txt
> 
>
>
>
>
>
>
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Solr-Shard-Splitting-Issue-tp4314145p4314813.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

project related configsets need to be deployed in both data and solr install folders ?

[Renee Sun]

Hi -

We use separate solr install and data folders with a shared schema/config
(configsets) in multi-cores setup, it seems the configsets need to be
deployed in both places (we are running solr 6.4.0)?

for example, 

solr is installed in /opt/solr, thus there is folder:

/opt/solr/server/solr/configsets

we separate the data into a different partition, thus there is:

/mysolrdata/solr/data/configsets

At first, I only deployed the project configsets to the solr install folder
/opt/solr/server/solr/configsets :

/opt/solr/server/solr/configsets/myproject_configs

then when I create a core, solr complains it could not load config from
/mysolrdata/solr/data/configsets/myproject_configs (the data folder):

curl
'http://localhost:8983/solr/admin/cores?action=CREATE=abc=abc=myproject_configs'


40014org.apache.solr.common.SolrExceptionorg.apache.solr.common.SolrExceptionError CREATEing SolrCore 'abc': Unable to create core [abc]
Caused by: Could not load configuration from directory
/mysolrdata/solr/data/configsets/myproject_configs400


So next, I moved the configs to /mysolrdata/solr/data/configsets, but it now
complains it could not load config from the install folder
/opt/solr/server/solr/configsets/myproject_configs with the same error.

I had to copy the same config set to both folders ( I eventually did a
symlink from the /opt/solr/server/solr/configsets/myproject_configs to
/mysolrdata/solr/data/configsets), and it worked.

I wonder if I have missed any settings to allow me only deploy the configset
at one place: either my data folder or the install folder, I would assume
the benefit is obvious.

Thanks
Renee






--
View this message in context: 
http://lucene.472066.n3.nabble.com/project-related-configsets-need-to-be-deployed-in-both-data-and-solr-install-folders-tp4317897.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr Partial Update query

[Alexandre Rafalovitch]

Would SOLR-9918's SkipExistingDocumentsProcessorFactory help?
https://issues.apache.org/jira/browse/SOLR-9918

It's been released with 6.4, just recently.

Regards,
   Alex.

http://www.solr-start.com/ - Resources for Solr users, new and experienced


On 30 January 2017 at 09:35, kshitij tyagi  wrote:
> Hi,
>
> I want to update document in solr partial. The issue I am facing is that I
> want to update only those documents in solr that are already present.
>
> I dont want to query solr to check if documnet is present or not, i just
> want to post updates to existing documents. How can I achieve this.
>
> Help appreciated.
>
> Regards,
> Kshitij

Re: How to alter the facet query limit default

[KRIS MUSSHORN]

Alexandre.. 

Once i converted to fieldnames without dots it worked.. thank you 

Kris 
- Original Message -

From: "Alexandre Rafalovitch"  
To: "solr-user"  
Sent: Thursday, January 26, 2017 11:40:49 AM 
Subject: Re: How to alter the facet query limit default 

facet.limit? 
f..facet.limit? (not sure how that would work with field 
name that contains dots) 

Docs are at: https://cwiki.apache.org/confluence/display/solr/Faceting 

Regards, 
Alex. 
 
http://www.solr-start.com/ - Resources for Solr users, new and experienced 


On 26 January 2017 at 10:36, KRIS MUSSHORN  wrote: 
> SOLR 5.4.1 i am running a query with multiple facet fields. 
> _snip_ 
> select?q=*%3A*=metatag.date.prefix4+DESC=7910=metatag.date.prefix7=json=true=true=metatag.date.prefix7
>  =metatag.date.prefix4=metatag.doctype 
> 
> field metatag.date.prefix7 has way more facets than the default of 100. 
> 
> How would I set up solr, or modify my query, to ensure that the facets return 
> all values. 
> 
> TIA, 
> 
> Kris 
> 

Re: SQL-like queries (with percent character) - matching an exact substring, with parts of words

[Erick Erickson]

Well, the usual Solr solution to leading and trailing wildcards is to
ngram the field. You can get the entire field (incuding spaces) to be
analyzed as a whole by using KeywordTokenizer. Sometimes you wind up
using a copyField to support this and search against one or the other
if necessary.

You can do this with KeywordTokenizer and '*a bcd ef*", but that'll be
slow for the exact same reason the SQL query is slow: It has to
examine every value in every document to find terms that match then
search on those.

There's some index size cost here so you'll have to test.

Really go back to your use-case to see if this is _really_ necessary
though. Often people think it is because that's the only way they've
been able to search at all in SQL and it can turn out that there are
other ways to solve it. IOW, this could be an XY problem.

Best,
Erick

On Mon, Jan 30, 2017 at 1:52 AM, Maciej Ł. PCSS  wrote:
> Hi All,
>
> What solution have you applied in your implementations?
>
> Regards
> Maciej
>
>
> W dniu 24.01.2017 o 14:10, Maciej Ł. PCSS pisze:
>>
>> Dear SOLR users,
>>
>> please point me to the right solution of my problem. I'm using SOLR to
>> implement a Google-like search in my application and this scenario is
>> working fine.
>>
>> However, in specific use-cases I need to filter documents that include a
>> specific substring in a given field. It's about an SQL-like query similar to
>> this:
>>
>> SELECT *  FROM table WHERE someField = '%c def g%'
>>
>> I expect to match documents having someField ='abc def ghi'. That means I
>> expect match parts of words.
>>
>> As I understand SOLR, as a reversed-index, does work with tokens rather
>> that character strings and thereby looks for whole words (not substrings).
>>
>> Is there any solution for such an issue?
>>
>> Regards
>> Maciej Łabędzki
>
>

Re: solr-user-unsubscribe

[Erick Erickson]

It's all an automated process,
Please follow the "unsubscribe" instructions here:
http://lucene.apache.org/solr/community.html#mailing-lists-irc

You must use the _exact_ e-mail address you used to subscribe with.
the "Problems" link provides additional information.

On Mon, Jan 30, 2017 at 4:55 AM, Syed Mudasseer  wrote:
>

Re: allograph matching

[Danilo Giacomi]

Hi again,
thanks for this information.

I've since run some tests and, of course, they reflect what you said, but
it's good to have a confirmation.

Grazie,
Danilo

On Mon, Jan 30, 2017 at 3:42 PM, alessandro.benedetti  wrote:

> You are welcome !
> Related your points :
>
> 1) until you replace chars in a 1 to 1 manner, you should see no problem.
> If your mappings become different, you can always use an highlighter that
> will take your analysis chain in consideration
>
> 2) term count would not be a problem as you will count the normalised
> version of your term ( tempus -> tempvs , so tempvs will be in the index) .
> Of course this means that you will treat effectively tempus and tempvs as
> the same thing.
>
> Cheers
>
>
>
> --
> View this message in context: http://lucene.472066.n3.
> nabble.com/allograph-matching-tp4317807p4317835.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

Re: allograph matching

[alessandro.benedetti]

You are welcome !
Related your points :

1) until you replace chars in a 1 to 1 manner, you should see no problem.
If your mappings become different, you can always use an highlighter that
will take your analysis chain in consideration

2) term count would not be a problem as you will count the normalised
version of your term ( tempus -> tempvs , so tempvs will be in the index) .
Of course this means that you will treat effectively tempus and tempvs as
the same thing.

Cheers



--
View this message in context: 
http://lucene.472066.n3.nabble.com/allograph-matching-tp4317807p4317835.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: How to create solr custom filter

[alessandro.benedetti]

Hi Mugeesh,
 you don't really need the main method in any java class as a requirement
for compilation !
Just take a look to building systems such as gradle[1] and maven[2].

Cheers

[1] https://gradle.org
[2]https://maven.apache.org



--
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-create-solr-custom-filter-tp4317767p4317834.html
Sent from the Solr - User mailing list archive at Nabble.com.

Solr Partial Update query

[kshitij tyagi]

Hi,

I want to update document in solr partial. The issue I am facing is that I
want to update only those documents in solr that are already present.

I dont want to query solr to check if documnet is present or not, i just
want to post updates to existing documents. How can I achieve this.

Help appreciated.

Regards,
Kshitij

Re: solr-user-unsubscribe

[Dorian Hoxha]

Come on dude. Just look at instructions. Have a little respect.

On Mon, Jan 30, 2017 at 1:55 PM, Rowe, William - 1180 - MITLL <
william.r...@ll.mit.edu> wrote:

> solr-user-unsubscribe
>
>
>

Re: Documents issue

[KRIS MUSSHORN]

Allesandro et al. 

I tried this with no change in the results. 
"Other" is still missing when doctype is empty.. 
No dynamicFields are involved. 

 
 

 

- Original Message -

From: "alessandro.benedetti"  
To: solr-user@lucene.apache.org 
Sent: Friday, January 27, 2017 4:07:19 AM 
Subject: Re: Documents issue 

I may be wrong and don't have time to check the code in details now, but I 
would say you need to define the default in the destination field as well. 

The copy field should take in input the plain content of the field ( which 
is null) and then pass that content to the destination field. 

Properties and attributes of the source field should not be considered at 
copy field time. 
So what it happens is simply you pass a null content to the destination 
field. 

If you define the default in the destination field, it should work as 
expected. 

N.B. it's a shot in the dark, not sure if you experienced a different 
behavior previously. 

Cheers 



-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-alter-the-facet-query-limit-default-tp4315939p4317514.html
 
Sent from the Solr - User mailing list archive at Nabble.com. 

solr-user-unsubscribe

[Syed Mudasseer]

RE: solr-user-unsubscribe

[Rowe, William - 1180 - MITLL]

solr-user-unsubscribe

 



smime.p7s
Description: S/MIME cryptographic signature

solr-user-unsubscribe

[Rowe, William - 1180 - MITLL]

 

 

Bill Rowe

Senior Software Developer

Technology Innovation & Integration, Information Services Department (ISD)

MIT Lincoln Laboratory

244 Wood Street

Lexington, MA 02420

Office: 781-981-4520

Mobile: 774-210-0853

william.r...@ll.mit.edu

 



smime.p7s
Description: S/MIME cryptographic signature

Re: How to create solr custom filter

[Mugeesh Husain]

Thank you so much Alessandro Benedetti, it really help me, that the things
which i was looking for, one more thing I need to know, how to compile the
class file without have main method.



--
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-create-solr-custom-filter-tp4317767p4317821.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: allograph matching

[Danilo Giacomi]

Thanks Alessandro,

I didn't know about that CharFilterFactory, and in a first quick test it
behaves well.
I have to check what happens with highlights, term count and the like, but
at least I have a trail :)

Cheers,
Danilo

Re: Return specific field from child documents.

[Mikhail Khludnev]

Hello,

You hardly get any gain limiting child field output. You can do that with
[subquery] result transformer.

On Mon, Jan 30, 2017 at 11:09 AM, Preeti Bhat 
wrote:

> Hi All,
>
> I am trying out the nested documents concept for SOLR. I am able to show
> the specific field for the parent document like "FirstName","LastName" but
> I am not able to show the specific field in fl for child.
>
> I would like to retrieve the email from the _childDocuments. Could someone
> please advise.
>
> Q=+FirstName:"etr4tr" {!parent which="content_type:parent"}
> Fl=FirstName,LastName,email, [child parentFilter=content_type:parent ]
>
>   "response":{"numFound":1,"start":0,"docs":[
>   {
> "FirstName":"etr4tr",
> "LastName":"wrer6t",
> "_childDocuments_":[
> {
>   "id":"3556|12",
>   "company_id":["12"],
>   "email":["ehrijw.e...@b.com"],
>   "isPrimary":["true"]},
> {
>   "id":"3556|45",
>   "company_id":["45"],
>   "email":["ehrijw.eer54...@ccc.com"]}]}]
>   }}
>
>
> Thanks and Regards,
> Preeti Bhat
>
>
>
> NOTICE TO RECIPIENTS: This communication may contain confidential and/or
> privileged information. If you are not the intended recipient (or have
> received this communication in error) please notify the sender and
> it-supp...@shoregrp.com immediately, and destroy this communication. Any
> unauthorized copying, disclosure or distribution of the material in this
> communication is strictly forbidden. Any views or opinions presented in
> this email are solely those of the author and do not necessarily represent
> those of the company. Finally, the recipient should check this email and
> any attachments for the presence of viruses. The company accepts no
> liability for any damage caused by any virus transmitted by this email.
>
>
>


-- 
Sincerely yours
Mikhail Khludnev

Re: Upgrade SOLR version - facets perfomance regression

[alessandro.benedetti]

You should not give up, starting from 5.5 uif should be there helping and
starting from 6.1 term enum is fixed as well.

There is still the logic of forcing a facet approach depending on your
config and request parameters [1].
It is not expected you don't solve your problem with docValues either ...

Using the json Faceting approach anyway will not imply any particular
configuration or jars.
it is in Solr out of the box, starting from 5.
It is experimental and you may check yourself this APIs changed and improved
a lot in late 5 and 6 :)

Cheers


[1] org/apache/solr/request/SimpleFacets.java:578 : selectFacetMethod



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Upgrade-SOLR-version-facets-perfomance-regression-tp4315027p4317815.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: DocValues and facet searches

[alessandro.benedetti]

It could be.
Which version of Solr are you using ?
Unfortunately I can not access your responses snippets, is it any exception
in the logs ?

Cheers



--
View this message in context: 
http://lucene.472066.n3.nabble.com/DocValues-and-facet-searches-tp4317763p4317814.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: allograph matching

[alessandro.benedetti]

Hi Danilo,
Have you tried using the CharFilter[1] concept in an analysis chain ? 
For example the MappingCharFilter.
You could map :
u -> v
j -> i
y -> i

It's a shot in the dark but should work!
You can do that both at index/query time.
I would need to refresh my latin to understand if my proposed solution make
sense ina  general sense.

Cheers
[1] https://cwiki.apache.org/confluence/display/solr/CharFilterFactories



--
View this message in context: 
http://lucene.472066.n3.nabble.com/allograph-matching-tp4317807p4317812.html
Sent from the Solr - User mailing list archive at Nabble.com.

allograph matching

[Danilo Giacomi]

Hi all,
we have some latin documents indexed in SOLR  which we'd like to search
through using allographs as well.

This means that, as there have been different ways to write the same
letters over the time, we can now have the same word written using
different letters.

This specifically resolves in our texts having the letter "u" and "v" used
both as the same letter (we can find "tempus" as well as "tempvs" in our
documents) and a similar thing with "y", "j" and "i" (so we can have
"fugit" or "fugjt" or "fvgit" or "fugjt" ecc.).

As we cannot provide a full list of synonyms (that would consist in the
entire latin dictionary...) is there a sensible way to realize what we're
after?

Thanks in advance,
Danilo

Re: Upgrade SOLR version - facets perfomance regression

[SOLR4189]

After failing with SOLR-5.4.1, we checked SOLR-5.5.2 also.
Most of our facet fields are multivalued.
I see that Json Facet API is experimental API and I can't find how to use it
(I am not speaking about syntax, I need to know how to use it from the point
of view of configurations and jars).
I came to the conclusion that inorder to upgrade SOLR, I need to give up
facets or to leave in SOLR-4.10.1. Is it right?



alessandro.benedetti wrote
> Hi,
> Reading in here : https://issues.apache.org/jira/browse/SOLR-8466
> It seems that uif has been introduced in Solr 5.5 ( you were using 5.4.1 ,
> were't you?)
> Furthermore, I would recommend to check if your field is/isn't
> multi-valued
> ( that could affect as well)
> It is weird you don't get any benefit from docValues though...
> 
> Cheers

Quoted from: 
http://lucene.472066.n3.nabble.com/Upgrade-SOLR-version-facets-perfomance-regression-tp4315027p4317781.html




--
View this message in context: 
http://lucene.472066.n3.nabble.com/Upgrade-SOLR-version-facets-perfomance-regression-tp4315027p4317806.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Upgrade SOLR version - facets perfomance regression

[SOLR4189]

After failining SOLR-5.4.1, we checked SOLR-5.5.2 also. 



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Upgrade-SOLR-version-facets-perfomance-regression-tp4315027p4317804.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: How to create solr custom filter

[Andrea Gazzarini]

On top of what Alessandro already told you, here's a brief post [1] that 
can be useful for setting up your dev environment.


HTH
Andrea

[1] 
http://andreagazzarini.blogspot.it/2016/11/quickly-debug-your-solr-add-on.html 



On 30/01/17 11:16, alessandro.benedetti wrote:

Generally speaking I assume you want to write a Solr plugin [1] ( or you are
forking Solr instead?)
So you need to package your jar.
You can setup your IDE as you usually do, and use a building framework such
as Maven/Gradle.
After you have your jar you can easily import it in Solr, specifying the
location in the solrconfig.xml.



[1] https://wiki.apache.org/solr/SolrPlugins,
http://shulhi.com/creating-solr-plugin/




--
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-create-solr-custom-filter-tp4317767p4317784.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Commit/callbacks doesn't happen on core close

[alessandro.benedetti]

Hi Saiks,
I am not following you.
According to the Solr documentation :
"transient=["true"|"false"]. Whether the core should be put in the LRU list
of cores that may be unloaded. NOTE: When a core is unloaded, any
outstanding operations (indexing or query) will be completed before the core
is closed.
old-style: this is an attribute of each individual  tag
new-style: this is an entry in the "core.properties" file for each core."

So if you index 2 cores, even if one of them is selected by the transient
cache to be dismissed, it should carry out all the pending operations (
indexing included).
Also each core is independent, and it has independent configuration (
solrconfig and schema).
So, indexing on both should produce effects on both.

probably I am missing the point, can you explain further ? Do you have any
exception/weird thing happening log side ?

Cheers



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Commit-callbacks-doesn-t-happen-on-core-close-tp4316015p4317795.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: How to create solr custom filter

[alessandro.benedetti]

Generally speaking I assume you want to write a Solr plugin [1] ( or you are
forking Solr instead?)
So you need to package your jar.
You can setup your IDE as you usually do, and use a building framework such
as Maven/Gradle.
After you have your jar you can easily import it in Solr, specifying the
location in the solrconfig.xml.



[1] https://wiki.apache.org/solr/SolrPlugins,
http://shulhi.com/creating-solr-plugin/




--
View this message in context: 
http://lucene.472066.n3.nabble.com/How-to-create-solr-custom-filter-tp4317767p4317784.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: SQL-like queries (with percent character) - matching an exact substring, with parts of words

[Maciej Ł. PCSS]

Hi All,

What solution have you applied in your implementations?

Regards
Maciej


W dniu 24.01.2017 o 14:10, Maciej Ł. PCSS pisze:

Dear SOLR users,

please point me to the right solution of my problem. I'm using SOLR to 
implement a Google-like search in my application and this scenario is 
working fine.


However, in specific use-cases I need to filter documents that include 
a specific substring in a given field. It's about an SQL-like query 
similar to this:


SELECT *  FROM table WHERE someField = '%c def g%'

I expect to match documents having someField ='abc def ghi'. That 
means I expect match parts of words.


As I understand SOLR, as a reversed-index, does work with tokens 
rather that character strings and thereby looks for whole words (not 
substrings).


Is there any solution for such an issue?

Regards
Maciej Łabędzki

Re: Upgrade SOLR version - facets perfomance regression

[alessandro.benedetti]

Hi,
Reading in here : https://issues.apache.org/jira/browse/SOLR-8466
It seems that uif has been introduced in Solr 5.5 ( you were using 5.4.1 ,
were't you?)
Furthermore, I would recommend to check if your field is/isn't multi-valued
( that could affect as well)
It is weird you don't get any benefit from docValues though...

Cheers



--
View this message in context: 
http://lucene.472066.n3.nabble.com/Upgrade-SOLR-version-facets-perfomance-regression-tp4315027p4317781.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: After migrating to SolrCloud

[Sergio García Maroto]

Thanks a lot guys. It was the F5 load balancer.

Regards,
Sergio

On 28 January 2017 at 01:50, Chris Hostetter 
wrote:

>
> That error means that some client talking to your server is attempting to
> use an antiquated HTTP protocol version, which was (evidently) supported
> by the jetty used in 3.6, but is no longer supported by the jetty used in
> 6.2.
>
> (some details: https://stackoverflow.com/a/32302263/689372 )
>
> If it's happening once a second, that sounds like perhaps some sort of
> monitoring agent? or perhaps you have a load balancer with an antiquated
> health check mechanism?
>
>
> NUANCE NOTE: even though the error specifically mentions "HTTP/0.9" it's
> possible that the problematic client is actually attempting to use
> HTTP/1.0, but for a vairety of esoteric reasons related to how broadly
> formatted HTTP/0.9 requests can be, some HTTP/1.0 requests will look like
> "valid" (but unsupported) HTTP/0.9 requests to the jetty server -- hence
> that error message...
>
> https://github.com/eclipse/jetty.project/issues/370
>
>
>
>
> : Date: Thu, 26 Jan 2017 08:49:06 -0700 (MST)
> : From: marotosg 
> : Reply-To: solr-user@lucene.apache.org
> : To: solr-user@lucene.apache.org
> : Subject: After migrating to SolrCloud
> :
> : Hi All,
> : I have migrated Solr from older versio 3.6 to SolrCloud 6.2 and all good
> but
> : there are almost every second some WARN messages in the logs.
> :
> : HttpParser
> : bad HTTP parsed: 400 HTTP/0.9 not supported for
> : HttpChannelOverHttp@16a84451{r=0,c=false,a=
> IDLE,uri=null}
> :
> : Anynone knows where are these coming from?
> :
> : Thanks
> :
> :
> :
> :
> : --
> : View this message in context: http://lucene.472066.n3.
> nabble.com/After-migrating-to-SolrCloud-tp4315943.html
> : Sent from the Solr - User mailing list archive at Nabble.com.
> :
>
> -Hoss
> http://www.lucidworks.com/
>

[Benchmark SOLR] JETTY VS TOMCAT - Jetty 15% slower - need advice to improve Jetty performance

[Gerald Reinhart]

Hello,

In addition to the following settings, we have tried to :
- force Jetty to use more threads
- put the same GC options as our Tomcat
- change nb of acceptors and selectors

   and every time Jetty is slower than Tomcat.

   Any advice is welcome

Thanks,

Gérald Reinhart




On 01/27/2017 11:22 AM, Gerald Reinhart wrote:

Hello,

 We are migrating our platform
 from
  - Solr 5.4.1 hosted by a Tomcat
 to
  - Solr 5.4.1 standalone (hosted by Jetty)

=> Jetty is 15% slower than Tomcat in the same conditions.


Here are details about the benchmarks :

Context :
 - Index with 9 000 000 documents
 - Gatling launch queries extracted from the real traffic
 - Server :  R410 with 16 virtual CPU and 96G mem

Results with 20 clients in // during 10 minutes:
 For Tomcat :
 - 165 Queries per seconds
 - 120ms mean response time

 For Jetty :
 - 139 Queries per seconds
 - 142ms mean response time

We have checked :
- the load of the server => same
- the io wait => same
- the memory used in the JVM => same
- JVM GC settings => same

   For us, it's a blocker for the migration.

   Is it a known issue ? (I found that :
http://www.asjava.com/jetty/jetty-vs-tomcat-performance-comparison/)

   How can we improve the performance of Jetty ? (We have already
followed
http://www.eclipse.org/jetty/documentation/9.2.21.v20170120/optimizing.html
recommendation)

  Many thanks,


Gérald Reinhart


Kelkoo SAS
Société par Actions Simplifiée
Au capital de € 4.168.964,30
Siège social : 158 Ter Rue du Temple 75003 Paris
425 093 069 RCS Paris

Ce message et les pièces jointes sont confidentiels et établis à l'attention 
exclusive de leurs destinataires. Si vous n'êtes pas le destinataire de ce 
message, merci de le détruire et d'en avertir l'expéditeur.



--

Gérald Reinhart
Software Engineer



*E*gerald.reinh...@kelkoo.com
*A*Parc Sud Galaxie, 6, rue des Méridiens, 38130 Echirolles, FR


Kelkoo SAS
Société par Actions Simplifiée
Au capital de € 4.168.964,30
Siège social : 158 Ter Rue du Temple 75003 Paris
425 093 069 RCS Paris

Ce message et les pièces jointes sont confidentiels et établis à l'attention 
exclusive de leurs destinataires. Si vous n'êtes pas le destinataire de ce 
message, merci de le détruire et d'en avertir l'expéditeur.

Return specific field from child documents.

[Preeti Bhat]

Hi All,

I am trying out the nested documents concept for SOLR. I am able to show the 
specific field for the parent document like "FirstName","LastName" but I am not 
able to show the specific field in fl for child.

I would like to retrieve the email from the _childDocuments. Could someone 
please advise.

Q=+FirstName:"etr4tr" {!parent which="content_type:parent"}
Fl=FirstName,LastName,email, [child parentFilter=content_type:parent ]

  "response":{"numFound":1,"start":0,"docs":[
  {
"FirstName":"etr4tr",
"LastName":"wrer6t",
"_childDocuments_":[
{
  "id":"3556|12",
  "company_id":["12"],
  "email":["ehrijw.e...@b.com"],
  "isPrimary":["true"]},
{
  "id":"3556|45",
  "company_id":["45"],
  "email":["ehrijw.eer54...@ccc.com"]}]}]
  }}


Thanks and Regards,
Preeti Bhat



NOTICE TO RECIPIENTS: This communication may contain confidential and/or 
privileged information. If you are not the intended recipient (or have received 
this communication in error) please notify the sender and 
it-supp...@shoregrp.com immediately, and destroy this communication. Any 
unauthorized copying, disclosure or distribution of the material in this 
communication is strictly forbidden. Any views or opinions presented in this 
email are solely those of the author and do not necessarily represent those of 
the company. Finally, the recipient should check this email and any attachments 
for the presence of viruses. The company accepts no liability for any damage 
caused by any virus transmitted by this email.

Solr Kafka DIH

[Mahmoud Almokadem]

Hello,

Is there a way to get SolrCloud to pull data from a topic in Kafak periodically 
using Dataimport Handler?

Thanks
Mahmoud