Re: SolrException undefined field *

2018-01-09 Thread Chris Hostetter

: Might be the case as you mentioned Shawn. But there are no search requests
: triggered and might be that somehow a search query is getting fired to Solr
: end while indexing. Given the complete log information(solr.log) while the
: indexing is triggered.

the search request is triggered by a "newSearcher" cache warming query -- 
solr explicitly adds an "event=newSearcher" param so it shows up right 
there in the log for the query that's failing...

: 
(searcherExecutor-46-thread-1-processing-x:master_backoffice_backoffice_product_default)
: [   x:master_backoffice_backoffice_product_default] o.a.s.c.S.Request
: [master_backoffice_backoffice_product_default]  webapp=null path=null
: 
params={q=*:*%26facet%3Dtrue%26facet.field%3DcatalogVersion%26facet.field%3DcatalogId%26facet.field%3DapprovalStatus_string%26facet.field%3Dcategory_string_mv=false=newSearcher}
: status=400 QTime=0

You probably have something like this in your solrconfig.xml...


  
   
 *:*facet=true...
  ...

When what you should have is sometihng like...


  
   
 *:*
 true
 ...

https://lucene.apache.org/solr/guide/7_2/query-settings-in-solrconfig.html#QuerySettingsinSolrConfig-Query-RelatedListeners



-Hoss
http://www.lucidworks.com/


Re: SolrException undefined field *

2018-01-09 Thread padmanabhan
Might be the case as you mentioned Shawn. But there are no search requests
triggered and might be that somehow a search query is getting fired to Solr
end while indexing. Given the complete log information(solr.log) while the
indexing is triggered.

2018-01-09 15:42:25.292 INFO  (qtp834133664-15) [   ] o.a.s.s.HttpSolrCall
[admin] webapp=null path=/admin/cores
params={core=master_backoffice_backoffice_product_default=STATUS=true=javabin=2}
status=0 QTime=0
2018-01-09 15:42:25.296 INFO  (qtp834133664-14) [  
x:master_backoffice_backoffice_product_default] o.a.s.r.RestManager Found
ManagedResource
[org.apache.solr.rest.schema.analysis.ManagedSynonymFilterFactory$SynonymManager@ab61d3a]
for /schema/analysis/synonyms/de
2018-01-09 15:42:25.297 INFO  (qtp834133664-14) [  
x:master_backoffice_backoffice_product_default] o.a.s.r.RestManager
[master_backoffice_backoffice_product_default]  webapp=/solr
path=/schema/analysis/synonyms/de params={} status=0 QTime=1
2018-01-09 15:42:25.307 INFO  (qtp834133664-18) [  
x:master_backoffice_backoffice_product_default] o.a.s.r.RestManager Found
ManagedResource
[org.apache.solr.rest.schema.analysis.ManagedSynonymFilterFactory$SynonymManager@ab61d3a]
for /schema/analysis/synonyms/de
2018-01-09 15:42:25.307 INFO  (qtp834133664-18) [  
x:master_backoffice_backoffice_product_default] o.a.s.r.ManagedResource
Processing update to /schema/analysis/synonyms/de: {} is a
java.util.LinkedHashMap
2018-01-09 15:42:25.308 INFO  (qtp834133664-18) [  
x:master_backoffice_backoffice_product_default] o.a.s.r.RestManager
[master_backoffice_backoffice_product_default]  webapp=/solr
path=/schema/analysis/synonyms/de params={} status=0 QTime=3
2018-01-09 15:42:25.312 INFO  (qtp834133664-19) [  
x:master_backoffice_backoffice_product_default] o.a.s.r.RestManager Found
ManagedResource
[org.apache.solr.rest.schema.analysis.ManagedSynonymFilterFactory$SynonymManager@214c1af1]
for /schema/analysis/synonyms/en
2018-01-09 15:42:25.312 INFO  (qtp834133664-19) [  
x:master_backoffice_backoffice_product_default] o.a.s.r.RestManager
[master_backoffice_backoffice_product_default]  webapp=/solr
path=/schema/analysis/synonyms/en params={} status=0 QTime=0
2018-01-09 15:42:25.316 INFO  (qtp834133664-11) [  
x:master_backoffice_backoffice_product_default] o.a.s.r.RestManager Found
ManagedResource
[org.apache.solr.rest.schema.analysis.ManagedSynonymFilterFactory$SynonymManager@214c1af1]
for /schema/analysis/synonyms/en
2018-01-09 15:42:25.316 INFO  (qtp834133664-11) [  
x:master_backoffice_backoffice_product_default] o.a.s.r.ManagedResource
Processing update to /schema/analysis/synonyms/en: {} is a
java.util.LinkedHashMap
2018-01-09 15:42:25.316 INFO  (qtp834133664-11) [  
x:master_backoffice_backoffice_product_default] o.a.s.r.RestManager
[master_backoffice_backoffice_product_default]  webapp=/solr
path=/schema/analysis/synonyms/en params={} status=0 QTime=0
2018-01-09 15:42:25.327 INFO  (qtp834133664-16) [  
x:master_backoffice_backoffice_product_default] o.a.s.r.RestManager Found
ManagedResource
[org.apache.solr.rest.schema.analysis.ManagedWordSetResource@182ac811] for
/schema/analysis/stopwords/de
2018-01-09 15:42:25.327 INFO  (qtp834133664-16) [  
x:master_backoffice_backoffice_product_default] o.a.s.r.RestManager
[master_backoffice_backoffice_product_default]  webapp=/solr
path=/schema/analysis/stopwords/de params={} status=0 QTime=0
2018-01-09 15:42:25.334 INFO  (qtp834133664-15) [  
x:master_backoffice_backoffice_product_default] o.a.s.r.RestManager Found
ManagedResource
[org.apache.solr.rest.schema.analysis.ManagedWordSetResource@182ac811] for
/schema/analysis/stopwords/de
2018-01-09 15:42:25.334 INFO  (qtp834133664-15) [  
x:master_backoffice_backoffice_product_default] o.a.s.r.ManagedResource
Processing update to /schema/analysis/stopwords/de: [] is a
java.util.ArrayList
2018-01-09 15:42:25.334 INFO  (qtp834133664-15) [  
x:master_backoffice_backoffice_product_default]
o.a.s.r.s.a.ManagedWordSetResource Applying updates: []
2018-01-09 15:42:25.334 INFO  (qtp834133664-15) [  
x:master_backoffice_backoffice_product_default] o.a.s.r.RestManager
[master_backoffice_backoffice_product_default]  webapp=/solr
path=/schema/analysis/stopwords/de params={} status=0 QTime=0
2018-01-09 15:42:25.338 INFO  (qtp834133664-13) [  
x:master_backoffice_backoffice_product_default] o.a.s.r.RestManager Found
ManagedResource
[org.apache.solr.rest.schema.analysis.ManagedWordSetResource@70f76fc2] for
/schema/analysis/stopwords/en
2018-01-09 15:42:25.338 INFO  (qtp834133664-13) [  
x:master_backoffice_backoffice_product_default] o.a.s.r.RestManager
[master_backoffice_backoffice_product_default]  webapp=/solr
path=/schema/analysis/stopwords/en params={} status=0 QTime=1
2018-01-09 15:42:25.342 INFO  (qtp834133664-20) [  
x:master_backoffice_backoffice_product_default] o.a.s.r.RestManager Found
ManagedResource
[org.apache.solr.rest.schema.analysis.ManagedWordSetResource@70f76fc2] for
/schema/analysis/stopwords/en
2018-01-09 

Re: SolrException undefined field *

2018-01-09 Thread Shawn Heisey
On 1/9/2018 8:31 AM, padmanabhan wrote:
> I get the below error whenever an indexing is executed.. I didn't find enough
> clue on to where this field is coming from and how could i debug on to it..
> any help would be appreciated



> 2018-01-09 16:03:11.705 INFO 
> (searcherExecutor-51-thread-1-processing-x:master_backoffice_backoffice_product_default)
> [   x:master_backoffice_backoffice_product_default] o.a.s.c.S.Request
> [master_backoffice_backoffice_product_default]  webapp=null path=null
> params={q=*:*%26facet%3Dtrue%26facet.field%3DcatalogVersion%26facet.field%3DcatalogId%26facet.field%3DapprovalStatus_string%26facet.field%3Dcategory_string_mv=false=newSearcher}
> status=400 QTime=0

As Michael told you, this is a query, not an indexing request.

The source of the problem here is aggressive URL encoding.  Because of
this, what you have is the following text as the query string -- looks
like 130 characters:

*:*=true=catalogVersion=catalogId=approvalStatus_string=category_string_mv

This is happening because ampersand characters separating the URL
parameters have been URL encoded as %26 in the HTTP request, so the
decoded ampersands and the parameters around them are part of the query
string and are not being interpreted by the web server as separate URL
parameters.  Other characters are also being encoded, such as the equal
sign as %3D.  Therefore the first asterisk is being interpreted as a
field name, instead of being part of the three-character special string
"*:*" which is shorthand for all documents.

You're going to need to change whatever code you have that is generating
this query so that it doesn't do this aggressive URL encoding.

Thanks,
Shawn



Re: SolrException undefined field *

2018-01-09 Thread Michael Kuhlmann
To correct myself, querying "*" is allowed in the sense that asking for
all fields is done by assigning "*" to the fl parameter.

So the problem is possibly not that "*" is requested, but that the star
is used somewhere else, probably in the q parameter.

We can help you better when you pass the full query string (if you're
able to fetch it).

-Michael


Am 09.01.2018 um 16:38 schrieb Michael Kuhlmann:
> First, you might want to index, but what Solr is executing here is a
> search request.
> 
> Second, you're querying for a dynamic field "*" which is not defined in
> your schema. This is quite obvious, the exception says right this.
> 
> So whatever is sending the query (some client, it seems) is doing the
> wrong thing. Or your schema definition is not matching what the client
> expects.
> 
> Since we don't know what client code you're using, we can't tell more.
> 
> -Michael
> 
> 
> Am 09.01.2018 um 16:31 schrieb padmanabhan:
>> I get the below error whenever an indexing is executed.. I didn't find enough
>> clue on to where this field is coming from and how could i debug on to it..
>> any help would be appreciated
>>
>> 2018-01-09 16:03:11.705 INFO 
>> (searcherExecutor-51-thread-1-processing-x:master_backoffice_backoffice_product_default)
>> [   x:master_backoffice_backoffice_product_default]
>> o.a.s.c.QuerySenderListener QuerySenderListener sending requests to
>> Searcher@232ae42b[master_backoffice_backoffice_product_default]
>> main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_1p(6.4.1):C56)))}
>> 2018-01-09 16:03:11.705 ERROR
>> (searcherExecutor-51-thread-1-processing-x:master_backoffice_backoffice_product_default)
>> [   x:master_backoffice_backoffice_product_default]
>> o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: undefined
>> field *
>>  at
>> org.apache.solr.schema.IndexSchema.getDynamicFieldType(IndexSchema.java:1308)
>>  at 
>> org.apache.solr.schema.IndexSchema.getFieldType(IndexSchema.java:1260)
>>  at
>> org.apache.solr.parser.SolrQueryParserBase.getWildcardQuery(SolrQueryParserBase.java:932)
>>  at
>> org.apache.solr.parser.SolrQueryParserBase.handleBareTokenQuery(SolrQueryParserBase.java:616)
>>  at org.apache.solr.parser.QueryParser.Term(QueryParser.java:312)
>>  at org.apache.solr.parser.QueryParser.Clause(QueryParser.java:182)
>>  at org.apache.solr.parser.QueryParser.Query(QueryParser.java:102)
>>  at org.apache.solr.parser.QueryParser.TopLevelQuery(QueryParser.java:91)
>>  at
>> org.apache.solr.parser.SolrQueryParserBase.parse(SolrQueryParserBase.java:194)
>>  at org.apache.solr.search.LuceneQParser.parse(LuceneQParser.java:50)
>>  at org.apache.solr.search.QParser.getQuery(QParser.java:168)
>>  at
>> org.apache.solr.handler.component.QueryComponent.prepare(QueryComponent.java:160)
>>  at
>> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:269)
>>  at
>> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:166)
>>  at org.apache.solr.core.SolrCore.execute(SolrCore.java:2306)
>>  at
>> org.apache.solr.core.QuerySenderListener.newSearcher(QuerySenderListener.java:72)
>>  at 
>> org.apache.solr.core.SolrCore.lambda$getSearcher$4(SolrCore.java:2094)
>>  at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>>  at
>> org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
>>  at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>  at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>  at java.lang.Thread.run(Thread.java:748)
>>
>> 2018-01-09 16:03:11.705 INFO 
>> (searcherExecutor-51-thread-1-processing-x:master_backoffice_backoffice_product_default)
>> [   x:master_backoffice_backoffice_product_default] o.a.s.c.S.Request
>> [master_backoffice_backoffice_product_default]  webapp=null path=null
>> params={q=*:*%26facet%3Dtrue%26facet.field%3DcatalogVersion%26facet.field%3DcatalogId%26facet.field%3DapprovalStatus_string%26facet.field%3Dcategory_string_mv=false=newSearcher}
>> status=400 QTime=0
>>
>>
>>
>>
>> --
>> Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html
>>
> 



Re: SolrException undefined field *

2018-01-09 Thread Michael Kuhlmann
First, you might want to index, but what Solr is executing here is a
search request.

Second, you're querying for a dynamic field "*" which is not defined in
your schema. This is quite obvious, the exception says right this.

So whatever is sending the query (some client, it seems) is doing the
wrong thing. Or your schema definition is not matching what the client
expects.

Since we don't know what client code you're using, we can't tell more.

-Michael


Am 09.01.2018 um 16:31 schrieb padmanabhan:
> I get the below error whenever an indexing is executed.. I didn't find enough
> clue on to where this field is coming from and how could i debug on to it..
> any help would be appreciated
> 
> 2018-01-09 16:03:11.705 INFO 
> (searcherExecutor-51-thread-1-processing-x:master_backoffice_backoffice_product_default)
> [   x:master_backoffice_backoffice_product_default]
> o.a.s.c.QuerySenderListener QuerySenderListener sending requests to
> Searcher@232ae42b[master_backoffice_backoffice_product_default]
> main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_1p(6.4.1):C56)))}
> 2018-01-09 16:03:11.705 ERROR
> (searcherExecutor-51-thread-1-processing-x:master_backoffice_backoffice_product_default)
> [   x:master_backoffice_backoffice_product_default]
> o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: undefined
> field *
>   at
> org.apache.solr.schema.IndexSchema.getDynamicFieldType(IndexSchema.java:1308)
>   at 
> org.apache.solr.schema.IndexSchema.getFieldType(IndexSchema.java:1260)
>   at
> org.apache.solr.parser.SolrQueryParserBase.getWildcardQuery(SolrQueryParserBase.java:932)
>   at
> org.apache.solr.parser.SolrQueryParserBase.handleBareTokenQuery(SolrQueryParserBase.java:616)
>   at org.apache.solr.parser.QueryParser.Term(QueryParser.java:312)
>   at org.apache.solr.parser.QueryParser.Clause(QueryParser.java:182)
>   at org.apache.solr.parser.QueryParser.Query(QueryParser.java:102)
>   at org.apache.solr.parser.QueryParser.TopLevelQuery(QueryParser.java:91)
>   at
> org.apache.solr.parser.SolrQueryParserBase.parse(SolrQueryParserBase.java:194)
>   at org.apache.solr.search.LuceneQParser.parse(LuceneQParser.java:50)
>   at org.apache.solr.search.QParser.getQuery(QParser.java:168)
>   at
> org.apache.solr.handler.component.QueryComponent.prepare(QueryComponent.java:160)
>   at
> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:269)
>   at
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:166)
>   at org.apache.solr.core.SolrCore.execute(SolrCore.java:2306)
>   at
> org.apache.solr.core.QuerySenderListener.newSearcher(QuerySenderListener.java:72)
>   at 
> org.apache.solr.core.SolrCore.lambda$getSearcher$4(SolrCore.java:2094)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>   at
> org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
>   at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>   at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>   at java.lang.Thread.run(Thread.java:748)
> 
> 2018-01-09 16:03:11.705 INFO 
> (searcherExecutor-51-thread-1-processing-x:master_backoffice_backoffice_product_default)
> [   x:master_backoffice_backoffice_product_default] o.a.s.c.S.Request
> [master_backoffice_backoffice_product_default]  webapp=null path=null
> params={q=*:*%26facet%3Dtrue%26facet.field%3DcatalogVersion%26facet.field%3DcatalogId%26facet.field%3DapprovalStatus_string%26facet.field%3Dcategory_string_mv=false=newSearcher}
> status=400 QTime=0
> 
> 
> 
> 
> --
> Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html
> 



SolrException undefined field *

2018-01-09 Thread padmanabhan
I get the below error whenever an indexing is executed.. I didn't find enough
clue on to where this field is coming from and how could i debug on to it..
any help would be appreciated

2018-01-09 16:03:11.705 INFO 
(searcherExecutor-51-thread-1-processing-x:master_backoffice_backoffice_product_default)
[   x:master_backoffice_backoffice_product_default]
o.a.s.c.QuerySenderListener QuerySenderListener sending requests to
Searcher@232ae42b[master_backoffice_backoffice_product_default]
main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_1p(6.4.1):C56)))}
2018-01-09 16:03:11.705 ERROR
(searcherExecutor-51-thread-1-processing-x:master_backoffice_backoffice_product_default)
[   x:master_backoffice_backoffice_product_default]
o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: undefined
field *
at
org.apache.solr.schema.IndexSchema.getDynamicFieldType(IndexSchema.java:1308)
at 
org.apache.solr.schema.IndexSchema.getFieldType(IndexSchema.java:1260)
at
org.apache.solr.parser.SolrQueryParserBase.getWildcardQuery(SolrQueryParserBase.java:932)
at
org.apache.solr.parser.SolrQueryParserBase.handleBareTokenQuery(SolrQueryParserBase.java:616)
at org.apache.solr.parser.QueryParser.Term(QueryParser.java:312)
at org.apache.solr.parser.QueryParser.Clause(QueryParser.java:182)
at org.apache.solr.parser.QueryParser.Query(QueryParser.java:102)
at org.apache.solr.parser.QueryParser.TopLevelQuery(QueryParser.java:91)
at
org.apache.solr.parser.SolrQueryParserBase.parse(SolrQueryParserBase.java:194)
at org.apache.solr.search.LuceneQParser.parse(LuceneQParser.java:50)
at org.apache.solr.search.QParser.getQuery(QParser.java:168)
at
org.apache.solr.handler.component.QueryComponent.prepare(QueryComponent.java:160)
at
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:269)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:166)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:2306)
at
org.apache.solr.core.QuerySenderListener.newSearcher(QuerySenderListener.java:72)
at 
org.apache.solr.core.SolrCore.lambda$getSearcher$4(SolrCore.java:2094)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:229)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)

2018-01-09 16:03:11.705 INFO 
(searcherExecutor-51-thread-1-processing-x:master_backoffice_backoffice_product_default)
[   x:master_backoffice_backoffice_product_default] o.a.s.c.S.Request
[master_backoffice_backoffice_product_default]  webapp=null path=null
params={q=*:*%26facet%3Dtrue%26facet.field%3DcatalogVersion%26facet.field%3DcatalogId%26facet.field%3DapprovalStatus_string%26facet.field%3Dcategory_string_mv=false=newSearcher}
status=400 QTime=0




--
Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html