hi
we have a small index . Whenever we commit new data we still see some old
data coming from SOLR.
( NOT A BROWSER CACHE ISSUE)
We do have autowarmcount set. As i read auto-warm count gets entries from
old cache to pre-populate filter cache. Can this cause such type of issue?
--
View this
Hi,
What Solr version? 4.0
How many docs? 700
What do you use as qutowarm count?700
If it's too high, it may take time.
Do you use spellcheck and buildOnCommit?No we dont use this
--
View this message in context:
hi
I m trying to add some weight for popularity in the score returned by solr
query.
http://localhost:10101/solr/syx/select?q={!boost%20b=product(popularity,score)}SIMrows=100fl=score,iddebug=true
I get error undefined field score
Any idea how to do this?
--
View this message in context:
i m using 4.0 from trunk.
--
View this message in context:
http://lucene.472066.n3.nabble.com/product-popularity-score-gives-error-undefined-field-score-tp3701734p3703647.html
Sent from the Solr - User mailing list archive at Nabble.com.
hi
at present we use carrot2 for clustering and doing analysis on customer
feedback data. Since its in memory and search time we are having issues with
performance and cluster size.
I was reading about generating clusters using mahout from solr index data.
But can we feed segmentation
I was looking at this
http://java.dzone.com/videos/configuring-mahout-clustering
seems like possible but can anyone shed more light, specially on the part of
mapping clusters to original docs
abhay
--
View this message in context:
hi
I am trying to use solr join in following way
q={!join+from=relatedVideoId+to=id}id:1234
This works fine but anyway for me to get the original document id:1234 along
with relatedVideoId's if exists?
--
View this message in context:
i already have multvalued relatedVideoId field which i m trying to join with
id
--
View this message in context:
http://lucene.472066.n3.nabble.com/solr-join-tp3881832p3882034.html
Sent from the Solr - User mailing list archive at Nabble.com.
hi
I am using solr.WordDelimiterFilterFactory for a text_en field during query
time.
my title for document is: blackberry torch 9810
My query : torch9810 works fine
It splits alpha numeric and gets me the document.
But when query is:blackberry9810 it splits to blackberry 9810 but I dont get
hi Erick,
autoGeneratePhraseQueries=false is set for field type. And it works fine
for standard query parser.
Problem seem to be when i start using dismax. As u suggested i checked
analysis tool and even after word delimiter is applied i see search term as
blackberry 9801 so i dont think it
hi jack erick,
Thanks
I do have qs set in solrconfig for query handler dismax settings.
str name=qs10/str
Still does not work
abhay
--
View this message in context:
http://lucene.472066.n3.nabble.com/solr-WordDelimiterFilterFactory-query-time-tp3950045p3951038.html
Sent from the Solr - User
hi jack,
tried qs=10 but unfortunately it does not seem to help.
Not sure what else could be wrong
abhay
--
View this message in context:
http://lucene.472066.n3.nabble.com/solr-WordDelimiterFilterFactory-query-time-tp3950045p3951082.html
Sent from the Solr - User mailing list archive at
hi jack,
tried qs=10 but unfortunately it does not seem to help.
Not sure what else could be wrong
abhay
--
View this message in context:
http://lucene.472066.n3.nabble.com/solr-WordDelimiterFilterFactory-query-time-tp3950045p3951083.html
Sent from the Solr - User mailing list archive at
hi jack,
thanks, i figured out the issue. It was settings during query and index time
--
View this message in context:
http://lucene.472066.n3.nabble.com/solr-WordDelimiterFilterFactory-query-time-tp3950045p3951811.html
Sent from the Solr - User mailing list archive at Nabble.com.
hi jack,
It worked with dismax. I was using a our search partner provided wrapper
around dismax and it seems like it has a bug.
I switched to dismax and all is working fine now.
Thanks for help
--
View this message in context:
hi
I am having some issues in using {!term} in fq with OR
Following query returns 6 results and it is working as expected
q=navigationfq={!term f=model}Vivid(PH39100)
And debug out put is also as expected
Debug:
QParser:LuceneQParser,
filter_queries:[{!term f=model}Vivid(PH39100)],
reformatted the same
hi
I am having some issues in using {!term} in fq with OR
Following query returns 6 results and it is working as expected
q=navigationfq={!term f=model}Vivid(PH39100)
And debug out put is also as expected
Debug:
QParser:LuceneQParser,
filter_queries:[{!term
hi jack,
Thanks that worked. Also another option that worked was nested queries.
It was nice to see u in Lucene Conference.
abhay
--
View this message in context:
http://lucene.472066.n3.nabble.com/term-f-xy-OR-device-0-in-fq-has-strange-results-tp3980152p3982663.html
Sent from the Solr -
hi
I am using highlighter component with
hl.frgmenter=regexhl.regex.pattern=[-\w ,/\n]\']{20,200}
Basically the configuration that comes with fragmenter in highlighting
component in solrconfig.xml file.
My snippets don't start with start of sentence.
I also tried boundary scanner
hi
Added hl.useFastVectorHighlighter=true to query. I was already doing term
vectors.
This worked like a charm.
--
View this message in context:
http://lucene.472066.n3.nabble.com/highlighter-not-respecting-sentence-boundry-tp3984327p3984416.html
Sent from the Solr - User mailing list archive at
hi
It did work in many cases but now is see many cases where it is not working.
Is this something to do with analysis. I m using word delimiter factory on
the field which is being used as hi.field.
Should this field be not tokenized? use one field for search and copy of it
for hl.field?
--
hi
I m looking into using single SolrCloud spanning multiple data centers. And
it would be mainly used as key, value store (NOSQL) type install.
We would like to have flexibility to take out the entire data center for
entire day or so. Also our app design is such that delay in soft commit of
thanks!! it worked.
I was just wondering if xpath can be used to use process default xml format
for solr index doc
--
View this message in context:
http://lucene.472066.n3.nabble.com/dih-fetching-but-not-adding-records-to-index-tp3189438p3198705.html
Sent from the Solr - User mailing list
hi erick,
I will be searching only on search_term.
I did exactly as u said in application layer,
I was not sure how multi-valued fields works in co-relation
--
View this message in context:
http://lucene.472066.n3.nabble.com/multivalue-or-denormalise-tp3197942p3198710.html
Sent from the
hi
I have a xml file which has url, category,subcategory, title kind of
details.
and we crawl the urls in xml using Nutch. Anyway for use to merge both?
like schema will look like
url
category
subcategory
title
crawl_data_summary_from_nutch
crawl_data_body_content_from_nutch
Any solution for
hi
I have never done this with xml files but u can have multiple data sources
in dih config
http://wiki.apache.org/solr/DataImportHandler#multipleds
abhay
--
View this message in context:
http://lucene.472066.n3.nabble.com/Combine-XML-data-with-DIH-tp3209413p3209933.html
Sent from the Solr
quick question
if i want to just load document with id=2 how would that work?
I tried xpath expression that works with xpath tools but not in solr. How
would i do this?
dataConfig
dataSource type=FileDataSource /
document
entity name=f processor=FileListEntityProcessor
hi
thanks, That's exactly what i want
as far as I know we can not update solr index with partial values it does
not update the index record, it gets recreated.
so I m not sure how solrindex command will work here
--
View this message in context:
hi
I have a xml doc whichi would like to index using xpath entity processor.
add
doc
id1/id
detailsxyz/details
/doc
doc
id2/id
detailsxyz2/details
/doc
/add
if i want to just load document with id=2 how would that work?
I tried xpath expression that works with xpath tools but not in solr.
hi
thanks for responding.
Do u have a sample which i can ref to?
abhay
--
View this message in context:
http://lucene.472066.n3.nabble.com/xpath-expression-not-working-tp3218133p3234537.html
Sent from the Solr - User mailing list archive at Nabble.com.
thanks Karsten
i was able to use ur suggestion
--
View this message in context:
http://lucene.472066.n3.nabble.com/xpath-expression-not-working-tp3218133p3251481.html
Sent from the Solr - User mailing list archive at Nabble.com.
hi
we have multiple environments where we run solr and use DIH to index
promotions.xml file.
here is snippet from dih config file
entity name=f processor=FileListEntityProcessor
baseDir=/sites/ fileName=promotions.xml
how do i set base dir to be solr.data.dir? on each server
hi
I have some issues with search result relevancy.
default query operator is OR
i search for iphone 4. I m not sure how would i get iphone 4 results to show
first.
I tried
?q=iphone+4start=0wt=jsonindent=onfl=displayName,scoreqt=dismaxfq=productType:Devicedebug=truepf=displayNameps=3
hi
i dont understand why though.
here is my displayName filed type text
fieldType name=text class=solr.TextField positionIncrementGap=100
analyzer type=index
tokenizer class=solr.WhitespaceTokenizerFactory/
filter class=solr.SynonymFilterFactory
hi erick,
thx,..
Any good doc on undestand debug/explain out put u would recommend? I tried
couple of places but doesnt seem to good enf
--
View this message in context:
http://lucene.472066.n3.nabble.com/word-proximity-and-queryoperator-OR-tp3299729p3308362.html
Sent from the Solr - User
hi
I have a requirement where i fetch some data from db , and based on db data
i pull details from XML file to index solr.
When i try to import it gives me following error.
--
SEVERE: Exception
hi gora,
Query works and if i remove xml data load indexing works fine too
Problem seem to be with this
entity name=f processor=FileListEntityProcessor
baseDir=${solr.solr.home} fileName=.xml
recursive=false rootEntity=true
dataSource=video_datasource
entity
hi
I have been following http://wiki.apache.org/solr/HierarchicalFaceting
We have hierarchical data which we want to use as facets and some of the
docs are part of multiple hierarchy. Reason we want to use this is because
we want to get entire facet tree in one query.
so for example
Doc#1:
Any help?
--
View this message in context:
http://lucene.472066.n3.nabble.com/DIH-error-when-nested-db-datasource-and-file-data-source-tp3345664p3360637.html
Sent from the Solr - User mailing list archive at Nabble.com.
hi
we already have autosuggest working using solr based on popular search
terms.
we use following approach..
http://www.lucidimagination.com/blog/2009/09/08/auto-suggest-from-popular-queries-using-edgengrams/
Now we want to use data indexed in solr also for autosuggest. with popular
search terms
not sure if u already seen this but may be useful
http://www.lucidimagination.com/blog/2009/09/08/auto-suggest-from-popular-queries-using-edgengrams/
--
View this message in context:
http://lucene.472066.n3.nabble.com/Autocomplete-terms-performance-problem-tp3351352p3360663.html
Sent from the
hi
I am not getting exception anymore.. I had issue with database
But now real problem i always have ...
Now that i can fetch ID's from database how would i fetch correcponding data
from ID in xm file
So after getting DB info from jdbcsource I use xpath processor like this,
but it does not
hi
My requirement is
i have a list of popular search terms in database
seachterm | count
---
mango | 100
Consider i have only oneterm in that table, mango. I use edgengram and put
that in auto_complete field in solr index with count.
If user starts typing m i wil show
yes it is possible
http://www.medihack.org/2011/03/01/autocompletion-autosuggestion-using-solr/
Since i m looking into autosuggest i came across that info while doing
research..
--
View this message in context:
hi
thanks for details. I will look into xsl suggestion.
Any idea how would i send parameter to script?
As i understand thats the syntax for script transformer
entity name=e pk=id transformer=script:f1 query=select * from
table1
--
View this message in context:
i found answer to my question ..
basically it works only with complete match..
--
View this message in context:
http://lucene.472066.n3.nabble.com/external-file-field-partial-data-match-in-key-field-tp3368547p3371328.html
Sent from the Solr - User mailing list archive at Nabble.com.
hi hoss,
This helps..
But as I understand TermsComponent does not allow sort on popularity..Just
coun|index. Or I m missing something?
If TermsComponent allows custom sorting i dont even have to use ngrams.
Any thoughts?
abhay
--
View this message in context:
hi Hoss,
This helps.
Only thing i am not sure is use of TermsComponent. As I understand
TermsComponent allows sorking only on count|index. So I m not sure how
popularity could be used for sort or boost.
Any thoughts around using TermsComponent with popularity? If this is
possible then i dont
hi
i m using solr from trunk 4.0
Also dismax is set as default qt with
str name=qf
text^2.5 features^1.1 displayName^15.0 mfg^4.0 description^3.0
/str
myquery is
=
q=+ab sx+OR+(mfg:abc+OR+sx)+OR+(displayName:abc+OR+sx)qt=dismax
It is not working as per my
anyone?
How to sort for termscomponent?
--
View this message in context:
http://lucene.472066.n3.nabble.com/autosuggest-combination-of-data-from-documents-and-popular-queries-tp3360657p3381201.html
Sent from the Solr - User mailing list archive at Nabble.com.
hi
i have a document like this
video_id,keyword:seq
for example
1,service:2 support:1
2,support:2
3,service:2
4,service:1
What i want is a query will send video_id and in response i want to see
video with that video_id and all other related videos with keyword in sorted
order by seq
say query is
hi
I am trying to sort results from solr using sum(count,score) function.
Basically its not adding things correctly.
For example here is partial sample response
Count:54,
UserQuery:how to,
score:1.2550932,
query({!dismax qf=UserQuery v='how'}):1.2550932,
any help?
--
View this message in context:
http://lucene.472066.n3.nabble.com/sorting-using-function-query-results-are-notin-order-tp3390926p3393781.html
Sent from the Solr - User mailing list archive at Nabble.com.
that was it..COunt was not indexed...works fine now
--
View this message in context:
http://lucene.472066.n3.nabble.com/sorting-using-function-query-results-are-notin-order-tp3390926p3394876.html
Sent from the Solr - User mailing list archive at Nabble.com.
hi
solr-spec-version
4.0.0.2011.07.19.16.15.08
solr-impl-version
4.0-SNAPSHOT ${svnversion} - ad895d - 2011-07-19 16:15:08
lucene-spec-version
4.0-SNAPSHOT
lucene-impl-version
4.0-SNAPSHOT ${svnversion} - ad895d - 2011-07-19 16:15:13
hi hoss,
I see this in change.txt
$Id: CHANGES.txt 1148494 2011-07-19 19:25:01Z hossman $
repository root: http://svn.apache.org/repos/asf/lucene/dev/trunk
Revision:1148519
If u let me know what/where to look for i can send details.
Here is field defination
field name=Count type=sint
hi
I have two questions
First on commit, external field file does not get loaded in index
===
http://localhost:8080/solr/core/update?stream.body=%3Ccommit/%3Ewt=json
Also it is not clear if external file can be incremental or every time we
hi
I am searching for blackberry for some reason parsedquery shows up as
blackberri.
I check synonyms but i don't see anywhere.
lst name=debug
str name=rawquerystringtext:blackberry/str
str name=querystringtext:blackberry/str
str name=parsedquerytext:blackberri/str
str
hi
I was looking into using solr suggester component as described in
http://wiki.apache.org/solr/Suggester
I have a file which has words, phrases in it.
I was wondering how to make following possible.
file has
-
rebate form
form
when i look for form or even for i would like to
hi erick,
Thanks for the link.
Problem is we dont want to have another solr core for implementing this, So
was trying suggester component as it allows file based auto suggest.
It works fine only issue is how to get prefix ignored . Any idea?
--
View this message in context:
hi erick,
I was able to implement this using link you posted.
I am using SOLR 1.3
I wanted to add spellcheck component to it so did this
requestHandler name=standard class=solr.SearchHandler default=true
!-- default values for query parameters --
lst name=defaults
str
I am using SOLR 1.3
I wanted to add spellcheck component to to standard request handler it so
did this
requestHandler name=standard class=solr.SearchHandler default=true
!-- default values for query parameters --
lst name=defaults
str name=echoParamsexplicit/str
arr
hi thanks.. It worked.!!
--
View this message in context:
http://lucene.472066.n3.nabble.com/spellcheck-component-does-not-work-with-request-handler-tp1786079p1789163.html
Sent from the Solr - User mailing list archive at Nabble.com.
hi
I added spellchecker to request handler. Spellchecker is indexed based.
Terms in index are like
iphone
iphone 4
iphone case
phone
gophoe
when i set q=iphole i get suggestions like
iphone
phone
gophone
ipad
Not sure how would i get iphone, iphone 4, iphone case, phone. Any thoughts?
At the
Thanks,
I was able to fix this issue with combination of EdgeNGrams and fuzzy query.
here are details
http://www.lucidimagination.com/blog/2009/09/08/auto-suggest-from-popular-queries-using-edgengrams/
I just added fuzzyquery operator and seems to be working so far
--
View this message in
thanks ..
i used
http://www.lucidimagination.com/blog/2009/09/08/auto-suggest-from-popular-queries-using-edgengrams/
with fuzzy operator..
--
View this message in context:
http://lucene.472066.n3.nabble.com/solr-1-4-suggester-component-tp1766915p2012946.html
Sent from the Solr - User mailing
hi
I was looking to boost certain docs based on some values in a indexed field.
e.g.
pType
-
post paid
go phone
Would like to have post paid docs first and then go phone.
I checked the functional query but could not figure out.
Any help?
--
View this message in context:
thanks!! that worked..
Can i enter the sequence too like postpaid,free,costly?
--
View this message in context:
http://lucene.472066.n3.nabble.com/boosting-certain-docs-based-on-a-filed-value-tp2012962p2013895.html
Sent from the Solr - User mailing list archive at Nabble.com.
great..
one last question
I am using dismax.
when i add this to bf in solrconfig.xml it give me errors when executing
requestHandler name=dismax class=solr.SearchHandler
lst name=defaults
str name=defTypedismax/str
str name=echoParamsexplicit/str
!-- float name=tie0.1/float
i have a field in xml file DeviceTypeAccessory Data / Memory/DeviceType
solr schema field declared as field name=deviceType type=text
indexed=true stored=true /
I am trying to eliminate results by using NOT. For example I want all
devices for a term except where DeviceType is not Accessory*
thanks that helps
--
View this message in context:
http://lucene.472066.n3.nabble.com/NOT-operator-not-working-tp2365831p2389803.html
Sent from the Solr - User mailing list archive at Nabble.com.
hi
We already have faceting on our site.
I am loading devices and accessories in solr index. deviceType indicates if
its a device or accessory
All other attributes are same for device and accessory. When query results
come back I would like to display someting like
Devices
+Manucaturer (100)
thanks this helped
--
View this message in context:
http://lucene.472066.n3.nabble.com/nested-faceting-tp2389841p2946515.html
Sent from the Solr - User mailing list archive at Nabble.com.
hi
I am not sure if SOLR has this feature so just wanted to confirm..
Basically what I want to do is for certain query terms I would like to query
real time web service which will return certain results and at the same time
search in solr index.
This can be implemented out side solr and I am
Any help? It can be done out side of solr application but just wanted to know
if solr has some features for supporting this
--
View this message in context:
http://lucene.472066.n3.nabble.com/adding-results-external-to-index-tp2946548p2983984.html
Sent from the Solr - User mailing list archive
hi
I am trying to configure suggester component. I downloaded solr from trunk
and did a build.
here is my config
requestHandler name=/suggest
class=org.apache.solr.handler.component.SearchHandler
lst name=defaults
str name=spellchecktrue/str
str
hi
I am having same issue, did you find the solution for this problem?
--
View this message in context:
http://lucene.472066.n3.nabble.com/Solr-suggester-and-spell-checker-tp2326907p3185680.html
Sent from the Solr - User mailing list archive at Nabble.com.
hi
I m trying to load data into solr index from a xml file using dih
my promotions.xml file
--
add
doc
field name=id3/field
/doc
doc
field name=id4/field
/doc
/add
-
schema.xml has
field
hi
thanks for the response
I am aware of post.sh but i wanted to make use of dih and scheduling. We can
not use cron due to some other issues.
So was thinking of using scheduling Data import
--
View this message in context:
hi
What i want to do is get title_1 if NOW is between st_date_1 and end_date_1
Also at the same time get title_2 if NOW is between st_date_2 and
end_date_2
and so on
at present i have a schema like this denorm'. I cant figure it out a
single solr query to do this.
field name=id
Any help on this one?
Seems like highlighting component does not always start the snippet from
starting of snippet. I tried several options.
Has anyone successfully got this working?
--
View this message in context:
hi
Here is how i get the snippet i phone is highlighted
==
, a car charger and a battery backup for iPods and iPhones.
I expect this to start from starting of sentence.
here is my solr config
hi
i m using edismax, synonym expansion=true, synonym processing index time
only. Solr is from trunk
synonyms.txt
---
setup, set up
backup, back up
Problem is when we search for set up we get documents which have backup and
back up along with docs that match setup and set up.
We are
hi
We would like to turn off TF for a field but we still want to use fast
vector highlighter.
How would we do that?
--
View this message in context:
http://lucene.472066.n3.nabble.com/termFrequncy-off-and-still-use-fastvector-highlighter-tp3998590.html
Sent from the Solr - User mailing list
So we have some content where document title is like this
Accessory for iphone, iphone4, iphone 4s
So these one come on top results for iphone. This could be content authoring
issue. But we are looking into avoiding such content to come on top.
--
View this message in context:
yes u r correct. But problem is u can not just turnOff term frequency. You
have to turn off termpositions with it. And once i do that phrase searches
dont work.
I want termPositions=false termPositions=true
How would i do that?
--
View this message in context:
that helps
--
View this message in context:
http://lucene.472066.n3.nabble.com/termFrequncy-off-and-still-use-fastvector-highlighter-tp3998590p4000575.html
Sent from the Solr - User mailing list archive at Nabble.com.
hi
I have documents like
iphone 4 - white
iphone 4s - black
ipone4 - black
when user searches for iphone 4 i would like to show iphone 4 docs first and
iphone 4s after that.
Similary when user is searching for iphone 4s i would like to show iphone 4s
docs first then iphone 4 docs.
At present i
hi
I m new to UIMA. Solr doea not have lemmatization component, i was thinking
of using UIMA for this.
Is this a correct choice and if so how i would go about it any idea?
I see couple of links for solr uima integration but dont know how that can
be used for lemmatization
Any thoughts?
--
hi
I am using edismax and boosting certain fields using bq during query time.
I would like to compare effect of boost side by side with original score
without boost. Is there anyway i can get original score without boosting?
thanks
abhay
--
View this message in context:
we do that now, but thats very time consuming.
Also we want our QA to have that info available on search result page in
debug mode.
--
View this message in context:
http://lucene.472066.n3.nabble.com/Score-after-boost-before-tp4054052p4054102.html
Sent from the Solr - User mailing list
hi
I am indexing a csv file using csv handler. I have two fields f1 and f2.
Based on value of f1 i want to set the value of f2. Like if(f1=='T') then
f2=True;
Is this something i can do during index time? I was reading about javascript
transformers but that only seem to work with DIH
Any help?
hi
I have dataset in solr like
id|time|price|
1|t0|100|
1|t1|10|
1|t2|20|
1|t3|30|
What i want is when i query solr for time t0 I want to return data like
t1, 100
rest,60 ( which is sum of price for t1,t2,t3)
Is that something can be done?
--
View this message in context:
hi All,
I am solr schema like
id | task
1|t1
1|t2
2|t2
2|t3
I would like to get all the id's where task t2 t1 are associated with same
id. Is there anyway we can do inner query or self join to get results?
--
View this message in context:
hi
I have field name GeoLocate with datatype as location. For some lat and long
it is giving me following error during indexing process
Can't parse point '139.9544301,35.4298081' because: Bad Y value 139.9544301
is not in boundary Rect(minX=-180.0,maxX=180.0,minY=-90.0,maxY=90.0)
Any idea
hi
I am using solr 4.10 in cloud mode. I am able to create collection using
./zkcli.sh -cmd upconfig -confdir $CONF_DIR -confname techproducts
-collection techproducts -z $ZOOKEEPER_URL && curl
"http://$SOLR_URL/solr/admin/collections?action=CREATE=techproducts=compositeId=1=1;
Instead of
hi
we are using solr 4.10. Jave version: Java(TM) SE Runtime Environment
(7.0_51-b13) (build 1.7.0_51-b13)
We have been running this setup for more than a year now. Suddenly we
started getting errors during startup
#
# A fatal error has been detected by the Java Runtime Environment:
#
#
Thanks.. I upgraded java to latest 1.7 version. Removed all docs from index
by deleting directory & re-indexed it again.
Solr is not crashing anymore.
--
View this message in context:
http://lucene.472066.n3.nabble.com/JVM-error-v-StubRoutines-jbyte-disjoint-arraycopy-tp4244603p4248152.html
98 matches
Mail list logo
