Make In India : http://www.makeinindia.com/home
On Thu, May 10, 2018 at 10:50 PM, Shawn Heisey <apa...@elyograg.org> wrote:
> On 5/10/2018 10:58 AM, Deepak Goel wrote:
>
>> I wonder what does Solr stores in the document for fields which are not
>> being used. And if the qu
I wonder what does Solr stores in the document for fields which are not
being used. And if the queries have a performance difference
https://lucene.apache.org/solr/guide/6_6/defining-fields.html
(A default value that will be added automatically to any document that does
not have a value in this
Make In India : http://www.makeinindia.com/home
On Fri, May 11, 2018 at 8:15 PM, Shawn Heisey <apa...@elyograg.org> wrote:
> On 5/10/2018 2:22 PM, Deepak Goel wrote:
>
>> Are there any benchmarks for this approach? If not, I can give it a spin.
>> Also wondering if there
On Fri, 11 May 2018, 01:15 Shawn Heisey, <apa...@elyograg.org> wrote:
> On 5/10/2018 11:49 AM, Deepak Goel wrote:
> > Sorry but I am unclear about - "What if there is no default value and the
> > field does not contain anything"? What does Solr pass on to Luc
; wrote:
>
> Master/slave are working on single computer with Intel Core i5 3.2GHz (it
> is 4 cores).
>
> It is standard visualVm ui with CPU usage. I think that it show overall
> CPU usage (for all cores).
> >Среда, 16 мая 2018, 17:42 +03:00 от Deepak Goel <deic...@gm
How many CPU's do you have in master/slave?
The graphs shown by you are for 'a single CPU' or 'All the CPU'?
Deepak
"The greatness of a nation can be judged by the way its animals are
treated. Please stop cruelty to Animals, become a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook:
On Mon, May 21, 2018 at 7:55 PM, Kelly, Frank wrote:
> Using Solr 5.3.1 - index
>
> We have an indexing heavy workload (we do more indexing than searching)
> and for those searches we do perform we have very few cache hits (25% of
> our index is in memory and the hit rate
If you can find out how Solr evolved over the years, you can perhaps follow
that same path
On Mon, 21 May 2018, 18:35 Erick Erickson, wrote:
> Another useful trick is the class hierarchy displays most modern IDE's
> have available to get a sense of what class is where.
I wonder if in-memory-filesystem would help...
On Sat, 19 May 2018, 01:03 Erick Erickson, wrote:
> If you only return fields that are docValue=true that'll largely
> eliminate the disk seeks. 30 seconds does seem kind of excessive even
> with disk seeks though.
>
>
What does your base hardware configuration look like?
You could have several VM's on machines with higher configuration.
Deepak
"The greatness of a nation can be judged by the way its animals are
treated. Please consider stopping the cruelty by becoming a Vegan"
+91 73500 12833
Do these machines have a firewall in-between?
On Fri, 8 Jun 2018, 20:29 Markus Jelsma, wrote:
> Hello Shawn,
>
> The logs appear useless, they are littered with these:
>
> 2018-06-08 14:02:47.382 ERROR (qtp1458849419-1263) [ ]
> o.a.s.s.HttpSolrCall null:org.apache.solr.common.SolrException:
Is it possible to profile the code to find the exact points which are
taking more time comparatively?
On Sun, 27 May 2018, 06:02 Will Currie, wrote:
> I raised https://issues.apache.org/jira/browse/SOLR-12407. In case anybody
> else sees a similar slowdown with boosts.
>
> On
It would be a bit extensive, but would be interesting to know if a similar
error/situation occurs in Linux too (there are kernel level debugging tools
available for this open source OS)
On Wed, 6 Jun 2018, 10:59 Shawn Heisey, wrote:
> On 6/5/2018 10:26 PM, TK Solr wrote:
> > I visualized the GC
I had a similar problem some time back. Although it might not be the best
way, but I used cron to move data from a high-end-spec to a lower-end-spec.
It worked beautifully
Deepak
"The greatness of a nation can be judged by the way its animals are
treated. Please stop cruelty to Animals, become
Could you please also give the machine details of the two clouds you are
running?
Deepak
"The greatness of a nation can be judged by the way its animals are
treated. Please stop cruelty to Animals, become a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
Hello
*I am trying to search for documents in my collection (Shakespeare). The
code is as follows:*
SolrClient client = new HttpSolrClient.Builder("
http://localhost:8983/solr/shakespeare;).build();
SolrDocument doc = client.getById("2");
*However this does not return any document. What mistake
On Mon, Jan 8, 2018 at 10:55 PM, Alexandre Rafalovitch <arafa...@gmail.com>
wrote:
> I think you are missing /query handler endpoint in the URL. Plus actual
> search parameters.
>
> You may try using the admin UI to build your queries first.
>
> Regards,
> Alex
>
> On
Got it . Thank You for your help
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deicool
"Plant a Tree, Go Green"
On Mon, Jan 8, 2018 at 11:48 P
om/email-signature?utm_medium=email_source=link_campaign=sig-email_content=webmail>
Virus-free.
www.avg.com
<http://www.avg.com/email-signature?utm_medium=email_source=link_campaign=sig-email_content=webmail>
<#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>
Deepak
"Please sto
*Hello*
*In Solr Admin: I type the q parameter as - *
*text_entry:**
*It gives the following exception (In the schema I do see a field as
text_entry):*
{ "responseHeader":{ "zkConnected":true, "status":400, "QTime":2, "params":{
"q":"text_entry:*", "_":"1516190134181"}}, "error":{ "metadata":[
er":"13",
"line_number":"3.3.37",
"speaker":"HENRY BOLINGBROKE",
"text_entry":"Henry Bolingbroke",
"id":"9428c765-a4e8-4116-937a-9b70e8a8e2de",
"_version_":1588569205789163522,
"speaker_str&q
FYI. I recently did a study on 'Performance of Solr'
https://www.linkedin.com/pulse/performance-comparison-solr-elasticsearch-deepak-goel/?trackingId=N2j9xWvVEQQaZYa%2BoEsy%2Bw%3D%3D
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
I would suggest to keep the load same both for solr4 and solr6. And then
test. Also please post exact concurrent hits
On 12 Feb 2018 12:48, "~$alpha`" wrote:
When both solr4 and solr6 have concurrent hits:
1. 30 to 40 :
Avg response time 470ms vs 380ms
Load
This would then mean that solr6 is reaching some kind of saturation (number
of threads, etc) at about loads of 60 Hits which then drives the
performance of it to be very bad !
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook:
Please test for higher number of hits till cpu load reaches 100%
On 12 Feb 2018 19:44, "~$alpha`" wrote:
> Hits 41 :
> Avg response time470ms vs 380ms
> CPU Load reaches6 vs 10
>
> Hits 82:
> Avg response time 500ms vs 620ms
One more idea could be is to have multiple vm's (8 cpu each) on your server
and load balance them. That would help Solr6 scale nicely
On 12 Feb 2018 23:05, "Deepak Goel" <deic...@gmail.com> wrote:
> If the community cannot help, the only way i can think is either to
> pro
If the community cannot help, the only way i can think is either to profile
Solr (java) under a load test to find the problem. You could also use an
APM.
On 12 Feb 2018 23:00, "~$alpha`" wrote:
> Yes, but how to move ahead now.
> Its strange solr4 is better behaving
Two things trouble me:
1. It is a shared resource, so results are unreliable
2. Since cache results have increased, memory access will increase and it
will result in an increase in cpu usage. However response times will also
improve
To support more load you will have to increase server capacity
Can you please give the configuration of your server?
On 11 Feb 2018 19:17, "~$alpha`" wrote:
> I have upgraded Solr4.0 Beta to Solr6.6. The Cache results look Awesome but
> overall the CPU load on solr6.6 is double the load on solr4.0 and hence I
> am
> not able to roll
Also can you please post the throughputs for both of your tests
On 12 Feb 2018 00:35, "Deepak Goel" <deic...@gmail.com> wrote:
> Yup. Improvement of response time would hurt the cpu usage. The other
> thing is more memory usage (cache) which gets included into the cpu
Yup. Improvement of response time would hurt the cpu usage. The other thing
is more memory usage (cache) which gets included into the cpu usage.
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
Can you please post all the errors? The current error is only for the node
'solr-2d'
On 23 Feb 2018 09:42, "Tom Peters" wrote:
I'm trying to debug why indexing in SolrCloud 7.1 is having so many issues.
It will hang most of the time, and timeout the rest.
Here's an
79060
> On Feb 23, 2018, at 4:15 PM, Deepak Goel <deic...@gmail.com> wrote:
>
> Can you please post all the errors? The current error is only for the node
> 'solr-2d'
>
> On 23 Feb 2018 09:42, "Tom Peters" <tpet...@synacor.com> wrote:
>
> I'm tryin
To rephrase your Question
"Does Solr do well with Scale-up or Scale-out?"
Are there any Performance Benchmarks for the same out there supporting the
claim?
On 11 Mar 2018 23:05, "BlackIce" wrote:
> Hi,
>
> I have some questions regarding performance.
>
> Lets says I
On 12 Mar 2018 05:51, "Shawn Heisey" wrote:
On 3/11/2018 11:35 AM, BlackIce wrote:
> I have some questions regarding performance.
>
> Lets says I have a dual CPU with a total of 8 cores and 24 GB RAM for my
> Solr and some other stuff.
>
> Would it be more beneficial to
found this for running multiple apache servers on multiple VMs as
compared to a single instance (not Solr). But i am pretty sure it would be
same for Solr too
On 12 Mar 2018 12:42, "Shawn Heisey" <apa...@elyograg.org> wrote:
> On 3/11/2018 7:39 PM, Deepak Goel wrote:
>
>
much thought to Solr, asides shemal.xml and
> solrconfig.xml
> > and I'm just diving into a bit more deeper stuff!
> >
> > Greetz
> >
> > RRK
> >
> > On Sun, Mar 11, 2018 at 8:58 PM, Deepak Goel <deic...@gmail.com> wrote:
> >
> >> To
t;BlackIce" <blackice...@gmail.com> wrote:
>
> > OK, so we're gone nowhere, since I've already lost lots of time... A
> few
> > days more or less won't make a difference I'd be willing to
> benchmark
> > if some tells me how to.
> >
> >
&g
> for now.. collect some logs and then do some testing further down the
> road.
> > For now just get the sucker up and running.
> >
> > Thanks all
> >
> > On Mon, Mar 12, 2018 at 7:23 PM, Deepak Goel <deic...@gmail.com> wrote:
> >
> >
Please see inline...
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deicool
"Plant a Tree, Go Green"
On Thu, Mar 15, 2018 at 6:04 PM, BlackIce
Have you measured the overhead of VM anytime? Or have you read it somewhere?
On 14 Mar 2018 18:10, "BlackIce" <blackice...@gmail.com> wrote:
> but it should be possible, without the overhead of VM's
>
> On Wed, Mar 14, 2018 at 1:30 PM, Deepak Goel <deic...@gm
A few observations:
1. The Old Gen Heap on 9th April is about 6GB occupied which then runs up
to 9+GB on 10th April (It steadily increases throughout the day)
2. The Old Gen GC is never able to reclaim any free memory
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500
Please post the exact results. Many a times the high cpu utilisation may be
a boon as it improves query response times
On Tue, 17 Apr 2018, 13:55 mganeshs, wrote:
> Regarding query times, we couldn't see big improvements. Both are more or
> less same.
>
> Our main worry is
Do you see a performance improvement in your 'Query Times' (6.2.1
vis-a-vis 6.5.1)?
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deicool
"Plant a Tree, Go Green"
ce with
> 6.2.1
> and re-indexed all the data, and it is working very well, even with the
> settings I had initially used. /
>
> Is anyone else facing this issue or any fixes got released in future build
> for this ?
>
> Keep us posted
>
>
> Deepak Goel wrote
> >
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deicool
"Plant a Tree, Go Green"
On Sat, Mar 24, 2018 at 6:03 AM, Rick Leir wrote:
>
>
> Deep,
>
.org> wrote:
> On 3/23/2018 11:31 AM, Deepak Goel wrote:
> > Do you have any specific questions about the benchmark setup?
>
> How many docs are in the Solr index? How much disk space does it
> consume? How much total memory is in the machine? How much memory is
> alloca
.org> wrote:
> On 3/23/2018 1:13 PM, Deepak Goel wrote:
> > Yes I am now creating a client object only once. On Linux it has superb
> > results (performance improves by around two times). However on Windows it
> > has no improvement
> >
> > *SoftwareThroughput (/sec
.org> wrote:
> On 3/24/2018 1:25 PM, Deepak Goel wrote:
>
>> Please check the section *Questions from ‘Around the World’* in the
>> following doc for answers to your questions:
>>
>> *https://docs.google.com/document/d/1ZwyveG-Zjy7tbsvh9xjMug4
>> bnIMRqKn
On 25 Mar 2018 6:49 am, "Shawn Heisey" <apa...@elyograg.org> wrote:
On 3/24/2018 6:21 PM, Deepak Goel wrote:
> Do you have any documented proof of the same (1 to 5ms)? Or is it an
> educated guess
>
Just now, I did a test. I did a "*:*" query (all do
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deicool
"Plant a Tree, Go Green"
On Sun, Mar 25, 2018 at 2:24 PM, Shawn Heisey wrote:
> On
<apa...@elyograg.org> wrote:
> On 3/25/2018 7:15 AM, Deepak Goel wrote:
>
>> $ Why is the 'qps' not increasing with increase in threads? (If I
>> understand the qps parameter right?)
>>
>
> Likely because I sent all these queries to a single copy of the index. We
un...@wunderwood.org>
wrote:
> On Mar 16, 2018, at 6:38 AM, Deepak Goel <deic...@gmail.com> wrote:
> >
> > I did a performance study of Solr a while back. And I found that it does
> > not scale beyond a particular point on a single machine (could be due to
>
> On Mar 16, 2018, at 6:26 AM, Deepak Goel <deic...@gmail.com> wrote:
>
> I would try multiple Solr instances rather a single Solr instance (it
> definitely will give a performance boost)
> I would avoid multiple Solr instances on single machine. I can use all 36
cores on our
On Fri, Mar 16, 2018 at 6:03 PM, Shawn Heisey wrote:
> On 3/15/2018 6:34 AM, BlackIce wrote:
>
>> However the main app that will be
>> running is more or less a single threated app which takes advantage when
>> run under several instances, ie: parallelism, so I thought,
On Sat, Mar 17, 2018 at 1:06 AM, Shawn Heisey <apa...@elyograg.org> wrote:
> On 3/16/2018 7:38 AM, Deepak Goel wrote:
> > I did a performance study of Solr a while back. And I found that it does
> > not scale beyond a particular point on a single machine (could be due to
On Sat, Mar 17, 2018 at 3:11 AM, Walter Underwood <wun...@wunderwood.org>
wrote:
> > On Mar 16, 2018, at 1:21 PM, Deepak Goel <deic...@gmail.com> wrote:
> >
> > However a single client object with thousands of queries coming in would
> > surely become a bott
On Sat, Mar 17, 2018 at 2:56 AM, Shawn Heisey <apa...@elyograg.org> wrote:
> On 3/16/2018 2:21 PM, Deepak Goel wrote:
> > I wanted to test how many max connections can Solr handle concurrently.
> > Also I would have to implement an 'connection pooling' of the
> clien
.@wunderwood.org>
wrote:
> > On Mar 17, 2018, at 3:23 AM, Deepak Goel <deic...@gmail.com> wrote:
> >
> > Sorry for being rude. But the ' results ' please, not the ' road to the
> > results '
>
> We have 15 different search collections, all different sizes and all
.org> wrote:
> On 3/16/2018 2:21 PM, Deepak Goel wrote:
> > I wanted to test how many max connections can Solr handle concurrently.
> > Also I would have to implement an 'connection pooling' of the
> client-object
> > connections rather than a single connection thread
>
.org> wrote:
> On 3/23/2018 11:21 AM, Deepak Goel wrote:
> >> I tried the above suggestion. The throughput and utilisation remain the
> >> same (they dont increase even if I increase the load). The response time
> >> comes down.
> >>
>
> Are you still c
>I think there is no benefit in having multiple Solr instances on a single
>server, unless the heap memory required by the JVM is too big.
Deepak***
I would try multiple Solr instances rather a single Solr instance (it
definitely will give a performance boost)
Deepak***
>And remember that
On 17 Mar 2018 05:19, "Walter Underwood" <wun...@wunderwood.org> wrote:
> On Mar 16, 2018, at 3:26 PM, Deepak Goel <deic...@gmail.com> wrote:
>
> Can you please post results of your test?
>
> Please tell us the tps at 25%, 50%, 75%, 100% of your CPU reso
Deepak
"Please stop cruelty to Animals, help by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deicool
"Plant a Tree, Go Green"
On Thu, Mar 22, 2018 at 1:25 AM, Deepak Goel <deic...@gmail.com>
.org> wrote:
> On 3/16/2018 4:24 PM, Deepak Goel wrote:
> > It is taking less than 100ms to create a HttpSolrClient Object
>
> "Less than 100ms" is vague. Let's say by that you mean it takes at
> least 50 milliseconds. This is a lot slower than I expec
Are you getting errors in Jmeter?
On Wed, 24 Oct 2018, 21:49 Amjad Khan, wrote:
> Hi,
>
> We recently moved to Solr Cloud (Google) with 4 nodes and have very
> limited number of data.
>
> We are facing very weird issue here, solr cluster response time for query
> is high when we have less
What are your hardware utilisations (cpu, memory, disk, network)?
I think you might have to tune lucene too
On Wed, 26 Sep 2018, 14:33 Mugeesh Husain, wrote:
> Hi,
>
> We are running 3 node solr cloud(4.4) in our production infrastructure, We
> recently moved our SOLR server host softlayer to
ny kind of delay...
>
> **
Can you provide graphs for cpu iowait too? (For large timeframes)
**
> On 30.10.18 10:21, Deepak Goel wrote:
>
> Yes. Swapping from disk to memory & vice versa
>
>
> Deepak
> "The greatness of a nation can be judged by the way its
k to memory, or something else?
>
> On 29.10.18 17:20, Deepak Goel wrote:
>
> I would then suspect performance is choking in memory disk layer. can you
> please check the performance?
>
> On Mon, 29 Oct 2018, 20:30 Sofiya Strochyk, wrote:
>
>> Hi Deepak and thanks for your repl
On Fri, Oct 26, 2018 at 9:25 PM Sofiya Strochyk
wrote:
> Hi everyone,
>
> We have a SolrCloud setup with the following configuration:
>
>- 4 nodes (3x128GB RAM Intel Xeon E5-1650v2, 1x64GB RAM Intel Xeon
>E5-1650v2, 12 cores, with SSDs)
>- One collection, 4 shards, each has only a
Please see inline for my thoughts
Deepak
"The greatness of a nation can be judged by the way its animals are
treated. Please consider stopping the cruelty by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
LinkedIn: www.linkedin.com/in/deicool
I would start by monitoring the hardware (CPU, Memory, Disk) & software
(heap, threads) utilization's and seeing where the bottlenecks are. Or what
is getting utilized the most. And then tune that parameter.
I would also look at profiling the software.
Deepak
"The greatness of a nation can be
Please check if there is a deadlock happening by taking heap dumps
Deepak
"The greatness of a nation can be judged by the way its animals are
treated. Please consider stopping the cruelty by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook: https://www.facebook.com/deicool
I would then suspect performance is choking in memory disk layer. can you
please check the performance?
On Mon, 29 Oct 2018, 20:30 Sofiya Strochyk, wrote:
> Hi Deepak and thanks for your reply,
>
> On 27.10.18 10:35, Deepak Goel wrote:
>
>
> Last, what is the natu
You might have to use a APM tool (AppDynamics) to debug the busy solr
instance
Deepak
"The greatness of a nation can be judged by the way its animals are
treated. Please consider stopping the cruelty by becoming a Vegan"
+91 73500 12833
deic...@gmail.com
Facebook:
Document is not being passed. It has zero content.
It could be due to no memory in heap. For this please check GC logs
On Tue, 29 Jan 2019, 08:54 Schaum Mallik I am seeing this error in our logs. Our Solr heap is set to more than 10G.
> Any clues which anyone can provide will be very helpful.
>
eMillis=250
> -XX:InitiatingHeapOccupancyPercent=75
> -XX:+UseLargePages
> -XX:+AggressiveOpts
> -Xmx32G
> -Xms32G
> -Xss256k
>
>
> Thanks & Regards
> Yasufumi.
>
> 2019年9月30日(月) 16:12 Deepak Goel :
>
> > Hello
> >
> > Can you please
Hello
Can you please share the JVM heap settings in detail?
Deepak
On Mon, 30 Sep 2019, 11:15 Yasufumi Mizoguchi,
wrote:
> Hi,
>
> I am trying some tests to confirm if single Solr instance can perform over
> 1000 queries per second(!).
>
> But now, although CPU usage is 40% or so and iowait
78 matches
Mail list logo