I would be interested in seeing it in action. Do you have any documentation
available on what it does and how?
Thanks
From: r b
Sent: Friday, October 2, 2015 3:09 PM
To: solr-user@lucene.apache.org
Subject: are there any SolrCloud supervisors?
I've been
Not sure if this will meet all your needs but you can probably do most of the
work using AWS lambda.
I haven't used it personally but it is supposed to launch custom code following
some events.
I guess you could create a small Java class to do the required work following
the birth of a new serv
Do you have any references to such integrations (Solr + Storm)?
Thanks
From: mike st. john
Sent: Monday, March 16, 2015 2:39 PM
To: solr-user@lucene.apache.org
Subject: Re: indexing db records via SolrJ
Take a look at some of the integrations people are
I prefer the second way. I find it more readable and shorter.
Thanks for making Solr even better ;)
From: Yonik Seeley
Sent: Friday, April 17, 2015 12:20 PM
To: solr-user@lucene.apache.org
Subject: Re: JSON Facet & Analytics API in Solr 5.1
Does anyone h
Hi All,
I`d like to know how (it is possible) to update a field`s value using SolrJ. I
looked at the API and could not figure it out so for now I'm using the
UpdateHandler by sending it a JSON formatted document illustrating the required
changes.
Is there a way to do the same through SolrJ?
> -Original Message-
> From: Shawn Heisey [mailto:s...@elyograg.org]
> Sent: March-28-14 3:21 PM
> To: solr-user@lucene.apache.org
> Subject: Re: Update single field through SolrJ
>
> On 3/28/2014 1:02 PM, Jean-Sebastien Vachon wrote:
> > I`d like to know how (
Hi All,
We just discovered that the response from Solr (4.7.1) when faceting on one of
our multi-valued fields has changed considerably.
In the past (4.6.1 and prior versions as well) we used to have something like
this: (there are 7 possible values for this attribute)
11454652
11387070
20
look at the index-time analysis
> chains in the two versions, I bet they're different and that accounts for your
> observations.
> 4> try 1-3, discover I'm totally off base and paste the schema.xml
> definitions for the field in question in both 4.6 and 4.7.1 to this threa
Here are the field definitions for both our old and new index... as you can see
that are identical. We've been using this chain and field type starting with
Solr 1.4 and never had any problem. As for the documents, both indexes are
using the same data source. They could be slightly out of sync f
> On 4/10/2014 9:14 AM, Jean-Sebastien Vachon wrote:
> > Here are the field definitions for both our old and new index... as you can
> see that are identical. We've been using this chain and field type starting
> with
> Solr 1.4 and never had any problem. As for the document
ify why the behavior has changed though, but my
> supposition is that it has nothing to do with Solr, and something about your
> SQL statement is different.
>
> Best,
> Erick
>
> On Thu, Apr 10, 2014 at 9:33 AM, Jean-Sebastien Vachon sebastien.vac...@want
Hi All,
I am looking for a way to index a numeric field and its value divided by 1 000
into another numeric field.
I thought about using a CopyField with a PatternReplaceFilterFactory to keep
only the first few digits (cutting the last three).
Solr complains that I can not have an analysis chai
ell.
>
> We could also write a generic script that takes a source and destination field
> name and then does a specified operation on it, like add an offset or multiple
> by a scale factor.
>
> -- Jack Krupansky
>
> -Original Message-
> From: Jean-Sebasti
Hi All,
I spent some time today playing around with subfacets and facets functions now
available in helios search 0.05 and I have some concerns... They look very
promising .
I indexed 10 000 documents and built some queries to look at each feature and
found some weird behaviour that I could no
gt;
> On Thu, May 15, 2014 at 3:44 PM, Jean-Sebastien Vachon sebastien.vac...@wantedanalytics.com> wrote:
> > I spent some time today playing around with subfacets and facets functions
> now available in helios search 0.05 and I have some concerns... They look
> very promisi
Hi All,
We have a 5 nodes setup running Solr 4.8.1 and we are trying to get the most
out of it by tuning Solr caches.
Following is the output of the script version.sh provided with Tomcat
Server version: Apache Tomcat/7.0.39
Server built: Mar 22 2013 12:37:24
Server number: 7.0.39.0
OS Name:
ct: Re: Strange behaviour when tuning the caches
>
> On 6/2/2014 8:24 AM, Jean-Sebastien Vachon wrote:
> > We have yet to determine where the exact breaking point is.
> >
> > The two patterns we are seeing are:
> >
> > - less cache (around 20-30% hit/rati
t;
> What are your queries like, can you share a few examples?
>
> Otis
> --
> Performance Monitoring * Log Analytics * Search Analytics Solr &
> Elasticsearch Support * http://sematext.com/
>
>
> On Mon, Jun 2, 2014 at 11:09 AM, Jean-Sebastien Vachon < jea
ttps://wiki.apache.org/solr/CollapsingQParserPlugin ? May
> help with the field collapsing queries.
>
> Otis
> --
> Performance Monitoring * Log Analytics * Search Analytics Solr &
> Elasticsearch Support * http://sematext.com/
>
>
> On Tue, Jun 3, 2014
I would try a thread dump and check the output to see what`s going on.
You could also strace the process if you`re running on Unix or changed the log
level in Solr to get more information logged
> -Original Message-
> From: S.L [mailto:simpleliving...@gmail.com]
> Sent: June-06-14 2:33 P
Hi Yonik,
Very impressive results. Looking forward to use this on our systems. Any idea
what`s the plan for this feature? Will it make its way into Solr 4.9? or do we
have to switch to HeliosSearch to be able to use it?
Thanks
> -Original Message-
> From: Yonik Seeley [mailto:ysee...@g
Bonjour Antoine,
Je ne vois que 2 solutions à ton problème.
1) utilisation de synonymes mais tu seras limités au cas connus d'avance
seulement alors c'est une solution qui ne scale pas à long terme.
2) sinon tu dois envisager d'avoir un deuxième champ (probablement en
CopyField) qui n'utiliser
Hi All,
Is there a way to delete a value from a Multi-value field without reindexing
anything?
Lets say I have three documents A,B and C with field XYZ set to "1,2,3",
"2,3,4" and "1". I'd like to remove anything that has the value '1' in the
field XYZ. That is I want to remove the value '1'
(atomic update) has been
added to 4.9.0 release. Haven't checked it though.
Thanks,
Lokesh
On Tue, Feb 3, 2015 at 7:26 AM, Jean-Sebastien Vachon <
jean-sebastien.vac...@wantedanalytics.com> wrote:
> Hi All,
>
>
> Is there a way to delete a value from a Multi-value field withou
Hi,
We just configured a new Solr cloud (5 nodes) running Solr 4.3, ran about 200
000 queries taken from our production environment and measured the performance
of the cloud over a collection of 14M documents with the default Solr settings.
We are now trying to tune the different caches and whe
Looks like the problem might not be related to Solr but to a proprietary system
we have on top of it.
I made some queries with facets and the cache was updated. We are looking into
this... I should not have assumed that the problem was coming from Solr ;)
I'll let you know if there is anything
06_4_id&group.field=position_id&group=true&group.ngroups=true&group.main=true&sort=score%20desc
it's quite long but this request uses both faceting and grouping. If I remove
the grouping then the cache is used. Is this a normal behavior or a bug?
Thanks
__
Also we do not have any useFilterForSortedQuery in our config. So we are
relying on the default which I guess is false.
From: Jean-Sebastien Vachon
Sent: Wednesday, July 31, 2013 3:44 PM
To: solr-user@lucene.apache.org
Subject: RE: queryResultCache
Hi All,
I am running some benchmarks to tune our Solr 4.3 cloud and noticed that while
the reported QTime is quite satisfactory (100 ms or so), the elapsed time is
quite large (around 5 seconds). The collection contains 12.8M documents and the
index size on disk is about 35 GB.. I have only on
On 8/14/2013 9:09 AM, Jean-Sebastien Vachon wrote:
> > I am running some benchmarks to tune our Solr 4.3 cloud and noticed
> > that while the reported QTime is quite satisfactory (100 ms or so),
> > the elapsed time is quite large (around 5 seconds). The collection
> > c
Hi All,
Is there a way to flush the cache of all nodes in a Solr Cloud (by reloading
all the cores, through the collection API, ...) without having to restart all
nodes?
Thanks
thing?
>
> Why? What are you trying to acheive with this? --wunder
>
> On Aug 20, 2013, at 11:04 AM, Jean-Sebastien Vachon wrote:
>
> > Hi All,
> >
> > Is there a way to flush the cache of all nodes in a Solr Cloud (by
> > reloading all
> the cores, throu
comparable to what is
> under real (=production) load?
>
> Dmitry
>
>
> On Tue, Aug 20, 2013 at 9:39 PM, Jean-Sebastien Vachon < jean-
> sebastien.vac...@wantedanalytics.com> wrote:
>
> > I just want to run benchmarks and want to have the same starting
&
> On Tue, 2013-08-20 at 20:04 +0200, Jean-Sebastien Vachon wrote:
> > Is there a way to flush the cache of all nodes in a Solr Cloud (by
> > reloading all the cores, through the collection API, ...) without
> > having to restart all nodes?
>
> As MMapDirectory shares da
Have you checked the hit ratio of the different caches? Try to tune them to get
rid of all evictions if possible.
Tuning the size of the caches and warming you searcher can give you a pretty
good improvement. You might want to check your analysis chain as well to see if
you`re not doing anythin
Hi All,
I just started indexing data in my brand new Solr Cloud running on 4.2.1.
Since I am a big user of the grouping feature, I need to route my documents on
the proper shard.
Following the instruction found here:
http://docs.lucidworks.com/display/solr/Shards+and+Indexing+Data+in+SolrCloud
I
Re: Problem with document routing with Solr 4.2.1
That's strange. The default value of "rows" param is 10 so you should be
getting 10 results back unless your StandardRequestHandler config in solrconfig
has set "rows" to 0 or if none of your fields are stored.
On Thu, May
If that can help.. adding distrib=false or shard.keys= is giving back
results.
-Original Message-
From: Jean-Sebastien Vachon [mailto:jean-sebastien.vac...@wantedanalytics.com]
Sent: May-23-13 10:39 AM
To: solr-user@lucene.apache.org
Subject: RE: Problem with document routing with
I must add the shard.keys= does not return anything on two on my nodes. But
that is to be expected since I'm using a replication factor of 3 on a cloud of
5 servers
-Original Message-
From: Jean-Sebastien Vachon [mailto:jean-sebastien.vac...@wantedanalytics.com]
Sent: May-23-
Since we are doing custom hashing and that the id field was tokenized, Solr
could not find back documents when collecting responses from each shards.
We changed back the id field to the 'string' type and it is now working
-----Original Message-
From: Jean-Sebastien Vachon [mailto:jean-s
Hi,
Can someone tell me why the two following queries do not return the same
results?
Is that a bug or a feature?
http://localhost:8983/jobs/select?fq=title:(NOT janitor)&fq=description:(NOT
janitor)&q=*:*
http://localhost:8983/jobs/select?q=title:(NOT janitor) AND description:(NOT
janitor)
can you tell us what are your current settings regarding the fieldCollapseCache?
I had similar issues with field collapsing and I found out that this cache was
responsible for
most of the OOM exceptions.
Reduce or even remove this cache from your configuration and it should help.
On 2010-09-0
You will also need to switch to a 64 bits JVM
You might have to add the `-d64` flag as well as the `-Xms` and `-Xmx`
- Original Message -
From: "Gora Mohanty"
To:
Sent: Thursday, October 21, 2010 2:34 AM
Subject: Re: RAM increase
On Thu, Oct 21, 2010 at 10:46 AM, satya swaroop
wro
Have you tried encoding it with %3F?
firstname:*%3F*
On 2010-11-04, at 1:44 AM, Stephen Powis wrote:
> I'm having difficulty properly escaping ? in my search queries. It seems as
> tho it matches any character.
>
> Some info, a simplified schema and query to explain the issue I'm having.
> I'm
Hi All,
I'm having some trouble with a query using some wildcard and I was wondering if
anyone could tell me why these two
similar queries do not return the same number of results. Basically, the query
I'm making should return all docs whose title starts
(or contain) the string "lowe'". I suspe
On 2010-11-11, at 3:45 PM, Ahmet Arslan wrote:
>> I'm having some trouble with a query using some wildcard
>> and I was wondering if anyone could tell me why these two
>> similar queries do not return the same number of results.
>> Basically, the query I'm making should return all docs whose
>> t
Hi,
If you're still looking for someone, I might be interested in getting more
information
about your project. From you initial message that does not seem to be a lot
of work
so I might be willing to give you some time.
I've been working with Solr for the last 7 months on my full-time job and
Sorry all, I obviously meant to send this to the original poster
- Original Message -
From: "Jean-Sebastien Vachon"
To:
Sent: Friday, November 12, 2010 10:09 PM
Subject: Re: Looking for help with Solr implementation
Hi,
If you're still looking for someone, I migh
ith you a document
that
he created that explains how things have been set-up which should help you
get
started.
Please let me know what you think.
Regards,
Abe
____
From: Jean-Sebastien Vachon
To: solr-user@lucene.apache.org
Sent: Fri, November 12, 2010 7:09
-- across multiple
shards, the count will not be what you expect. You'll need to ensure that each
document exists only on a single shard.
-Michael
-Original Message-
From: Jean-Sebastien Vachon [mailto:jean-sebastien.vac...@wantedanalytics.com]
Sent: Monday, January 14, 2013 9:59 AM
To:
W) is different than the slaves, there's the
polling interval to consider.
Best
Erick
On Mon, Jan 14, 2013 at 9:58 AM, Jean-Sebastien Vachon <
jean-sebastien.vac...@wantedanalytics.com> wrote:
> Hi,
>
> I`m setting up a small Sorl setup consisting of 1 master node and 4
ancer in front of your slaves and only send the request to one of
> them would be the place I'd start.
>
> Also, don't be at all surprised if the number of hits from the
> _master_ (which you shouldn't be searching, BTW) is different than the
> slaves, there's the
Erick
On Tue, Jan 15, 2013 at 10:18 AM, Jean-Sebastien Vachon
wrote:
> Ok I see what Erick`s meant now.. Thanks.
>
> The original index I`m working on contains about 120k documents. Since I have
> no access to the code that pushes documents into the index, I made four
> copies of
Hi All,
I'm in a situation where I need to perform a facet on a query with field
collapsing.
Let's say the main query is something like this
title:apple&fq={!tag=sources}source_id:(33 OR
44)&facet=on&facet.field={!ex=sources}source_id&facet.query=source_id:(33 OR
44)&collapse=on&collapse.fie
Try this...
http://localhost:8080/solr/select?wt=json&indent=true&q={!spatial%20lat=37.326375%20lng=-121.892639%20radius=3%20unit=km%20threadCount=3}title:Art%20Loft
- Original Message -
From: "Dennis Gearon"
To:
Sent: Wednesday, December 01, 2010 7:51 PM
Subject: spatial query parin
n mistakes. It is usually a
better
idea to learn from others’ mistakes, so you do not have to make them
yourself.
from 'http://blogs.techrepublic.com.com/security/?p=4501&tag=nl.e036'
EARTH has a Right To Life,
otherwise we all die.
- Original Message
From: Jean-Sebas
I'm curious to know why Solr is not respecting the phrase.
If it consider "manager" as a phrase... shouldn't it return only document
containing that phrase?
-Original Message-
From: Otis Gospodnetic [mailto:otis_gospodne...@yahoo.com]
Sent: April-11-11 3:42 PM
To: solr-user@lucene.apache
Thanks for the clarification. This make sense.
-Original Message-
From: Jonathan Rochkind [mailto:rochk...@jhu.edu]
Sent: April-11-11 7:54 PM
To: solr-user@lucene.apache.org
Subject: FW: Exact match on a field with stemming
> I'm curious to know why Solr is not respecting the phrase.
>
Hi All,
I am having some problems with the presence of unnecessary parenthesis in my
query.
A query such as:
title:software AND (title:engineer)
will return no results. Remove the parenthesis fix the issue but then since my
user can enter the parenthesis by himself I need to fin
.1 as far as I can tell. The
bug you're referencing is a peculiarity of the not (-) operator I think.
Best
Erick
On Thu, May 19, 2011 at 7:25 AM, Jean-Sebastien Vachon
wrote:
> Hi All,
>
> I am having some problems with the presence of unnecessary parenthesis in
my q
Hi All,
Since there is no way of controlling the size of Lucene's internal
FieldCache, how can we make sure that we are making good use of it? One of
my shard has close to 1.5M documents and the fieldCache only contains about
10 elements.
Is there anything we can do to control this?
Tha
10 unique terms on 1.5M documents each with 50+ fields? I don't think so ;)
What I mean is controlling its size like the other caches. There are
currently no options in solrconfig.xml to control this cache.
Is Solr/Lucene managing this all by itself?
It could be that my understanding of the Fiel
Hi All,
I'm currently looking on integrating Solr and I'd like to have some hints on
the size of the index (number of documents) I could possibly host on a server
running a Double-Quad server (16 cores) with 48Gb of RAM running Linux.
Basically, I need to determine how many of these servers wou
dex it,
> whether you compress it, how and how much you analyze the data, etc.
>
> Otis
>
> Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
> Hadoop ecosystem search :: http://search-hadoop.com/
>
>
>
> - Original Message
>> Fro
Hi,
I'm trying to identify the bottleneck to get acceptable performance of a single
shard containing 4.7 millions of documents using my own machine (Mac Pro - Quad
Core with 8Gb of RAM with 4Gb allocated to the JVM).
I tried using YourKit but I don't get anything about Solr classes. I'm new to
Hi All,
I'd like to know if it is possible to do the following on a multi-value field:
Given the following data:
document A: field1 = [ A B C D]
document B: field 1 = [A B]
document C: field 1 = [A]
Can I build a query such as :
-field: A
which will return all documents that d
Hi All,
I'm trying to figure out how to perform spatial searches using Solr 1.5 (from
the trunk).
Is the support for spatial search built-in? because none of the patches I tried
could be applied to the source tree.
If this is the case, can someone one tell me how to configure it?
I find the av
On 2010-03-18, at 1:03 PM, K Wong wrote:
> http://wiki.apache.org/solr/FAQ#What_are_the_Requirements_for_running_a_Solr_server.3F
>
> I have Solr running on CentOS 5.4. It runs fine on the OpenJDK 1.6.0
> and Tomcat 5. If I were to do it again, I'd probably just stick with
> Jetty.
Would you mi
Hi All,
I am using the package from JTeam to perform spatial searches on my index. I'd
like to know if it is possible
to build a query that uses multiple clauses. Here is an example:
q={!spatial lat=123 long=456 radius=10} OR {!spatial lat=111 long=222
radius=20}title:java
Basically that would
Hi,
Is there an easy way to prevent a field from being returned in the response?
we can use fl=field1, field2, field3, ...
but then our software has an option that must trigger the presence or not of a
field in the response.
So what I'd like to do is tell Solr to return all fields except one.
Hi,
why don't you use JMeter? It would give you greater control over the tests
you wish to make.
It has many different samplers that will let you run different scenarios
using your existing set of queries.
ab is great when you want to evaluate the performance of your server under
heavy load.
Hi All,
I'd like to know if anyone else is experiencing the same problem we are
facing
basically, we are running query with field collapsing (Solr 1.4 with patch
236). The responses tells us that there are about 2700 documents matching our
query.
However, I can not get passed the 431th do
I guess you can simply use a range query such as:
fq=createdDate:[ date1 TO date2 ]
On 2010-04-15, at 7:30 AM, Venkata Sai Krishna Vepakomma wrote:
> Hi,
>
> 1) How do I query for Data between 2 date ranges. I have specified the
> following field definition in Schema.xml.
>
>
>
> I have
Hi All,
I am using JTeam's Spatial Plugin RC3 to perform spatial searches on my index
and it works great. However, I can't seem to get it to return the computed
distances.
My query component is run before the geoDistanceComponent and the distanceField
is set to "distance"
Fields for lat/long a
ot;geo_distance" in the return fields.
>
> On Thu, Apr 29, 2010 at 9:26 AM, Jean-Sebastien Vachon
> wrote:
>> Hi All,
>>
>> I am using JTeam's Spatial Plugin RC3 to perform spatial searches on my
>> index and it works great. However, I can't seem to ge
Hi,
Try adding these options...
-Dcom.sun.management.jmxremote.ssl=false
-Dcom.sun.management.jmxremote.authenticate=false
On 2010-05-19, at 3:44 AM, Na_D wrote:
>
> Hi,
>
> I am trying to start solr with the following command :
>
> java -Dsolr.solr.home="./example-DIH/solr/" -Dcom.sun.man
Is the FacetComponent loaded at all?
query
facet
On 2010-05-25, at 3:32 AM, Sascha Szott wrote:
> Hi Birger,
>
> Birger Lie wrote:
>> I don't think the bolean fields is mapped to "on" and "off" :)
> You can use true and on interchangeably.
>
> -Sascha
>
>>
>>
>> -birg
Hi All,
I've been running some tests using 6 shards each one containing about 1
millions documents.
Each shard is running in its own virtual machine with 7 GB of ram (5GB
allocated to the JVM).
After about 1100 unique queries the shards start to struggle and run out of
memory. I've reduced all
n
>
> On 8 June 2010 19:05, Jean-Sebastien Vachon wrote:
>> Hi All,
>>
>> I've been running some tests using 6 shards each one containing about 1
>> millions documents.
>> Each shard is running in its own virtual machine with 7 GB of ram (5GB
>> all
Have you looked at the garbage collector statistics? I've experienced this kind
of issues in the past
and I was getting huge spikes when the GC was doing its job.
On 2010-06-09, at 10:52 AM, Paul wrote:
> Hi all,
>
> In my app, it seems like solr has become slower over time. The index
> has gro
I use the following article as a reference when dealing with GC related issues
http://www.petefreitag.com/articles/gctuning/
I suggest you activate the verbose option and send GC stats to a file. I don't
remember exactly what
was the option but you should find the information easily
Good luck
ried downloading solr 1.4.1 from the site. but it shows an empty
> directory. where did u get solr 1.4.1 from?
>
> Regards,
> Raakhi
>
> On Tue, Jun 8, 2010 at 10:35 PM, Jean-Sebastien Vachon <
> js.vac...@videotron.ca> wrote:
>
>> Hi All,
>>
>>
82 matches
Mail list logo
