Re: Indexing slower on a better system

Ok no problem. So you were saying that in your case, your indexing speed is also faster at your MacBook Pro, as compared to your Amazon EC2 servers which has better specifications? Regards, Edwin On 14 February 2017 at 14:17, Walter Underwood wrote: > Sorry. Haven’t

Re: Indexing slower on a better system

Sorry. Haven’t used Windows since seven years ago and haven’t run Windows as a server for more than a decade. I would not recommend using Windows as your Solr OS. Windows is just not designed for that. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) >

Re: Indexing slower on a better system

Hi Walter, For your suggestion to try out the time gunzip < solr-6.4.1.tgz > /dev/null, does it works on Windows system? I tried on Windows, and it give me the error "The syntax of the command is incorrect". In my current setup, if running on one trip, I can index about 16000 lines in a CSV file

Re: Division in JSON Facet

I found that we can't put div(4,2) directly, as it wouldn't work. It will work if I put something like max(div(4,2)). Regards, Edwin On 10 January 2017 at 19:59, Zheng Lin Edwin Yeo wrote: > Hi, > > I'm getting this error when I tried to do a division in JSON Facet. > >

Re: Continual garbage collection loop

Why is this a problem? Are you seeing unacceptable slowness? It's fairly common for Java to frequently do GC, the problem happens when it uses stop-the-world GC. So unless you're seeing visibly slow performance I'd say ignore it. Curiously, increasing the Java heap a little bit sometimes helps as

Re: Indexing slower on a better system

Thanks for the info. Yes, I'm running Solr 6.4.1 on both hosts. Regards, Edwin On 14 February 2017 at 13:21, Walter Underwood wrote: > It is worth doing a basic CPU speed test. Once you have enough RAM, > indexing is mostly CPU-bound. > > Try something like this. Run

Re: Indexing slower on a better system

It is worth doing a basic CPU speed test. Once you have enough RAM, indexing is mostly CPU-bound. Try something like this. Run it once to get the tgz file cached in OS file buffers, then once to time it. time gunzip < solr-6.4.1.tgz > /dev/null I get 1.3 seconds on an Amazon c4.8xlarge and

Re: Indexing slower on a better system

No, currently the server is slower, and my laptop is faster. But shouldn't the server be faster, since it has a much better specification, like more RAM, better processor and SSD drive. Regards, Edwin On 14 February 2017 at 12:26, Walter Underwood wrote: > Are you sure

Re: solrj5.50 query excepion

Spellcheck reponse format was changed since 5.0,not backward compatible alias <524839...@qq.com>于2017年2月13日 周一下午6:05写道： > hi I use solrj 5.5.0 to inquire solr3.6 reported the following error: > Java.lang.ClassCastException: java.lang.Boolean can not be cast to >

Re: Indexing slower on a better system

Are you sure the server is faster? My MacBook Pro is a lot faster than many of our Amazon EC2 servers. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Feb 13, 2017, at 8:12 PM, Zheng Lin Edwin Yeo wrote: > > Hi, > > I'm

Re: what is the bottleneck of solr

On 2/13/2017 8:27 PM, 跳舞的水滴 wrote: > I want to get some proposal about solr. How big is the size of solr > cluster when solr performance will meet bottleneck？ Or how can I to > estimate the suggested cluster size？ Could you give me some advice? It is not possible to provide general information

Indexing slower on a better system

Hi, I'm facing the issue of the indexing speed is slower is slower on a server with a much better specification with Solr running on SSD, as compared to a laptop with a normal hard disk. Both the system has the exact same configurations. The configurations are first setup on the laptop, before

what is the bottleneck of solr

Hi, I want to get some proposal about solr. How big is the size of solr cluster when solr performance will meet bottleneck?? Or how can I to estimate the suggested cluster size?? Could you give me some advice? Sincerely. Best Regards Daisy

solrj5.50 query excepion

hi I use solrj 5.5.0 to inquire solr3.6 reported the following error: Java.lang.ClassCastException: java.lang.Boolean can not be cast to org.apache.solr.common.util.NamedList At org.apache.solr.client.solrj.response.SpellCheckResponse. (SpellCheckResponse.java:47) At

Migrate Documents to Another Collection

hi I use solrj 5.5.0 to inquire solr3.6 reported the following error: Java.lang.ClassCastException: java.lang.Boolean can not be cast to org.apache.solr.common.util.NamedList At org.apache.solr.client.solrj.response.SpellCheckResponse. (SpellCheckResponse.java:47) At

Re: Heads up: SOLR-10130, Performance issue in Solr 6.4.1

> On 13 Feb 2017, at 13:46, Ere Maijala wrote: > > Hi all, > > this is just a quick heads-up that we've stumbled on serious performance > issues after upgrading to Solr 6.4.1 apparently due to the new metrics > collection causing a major slowdown. I've filed an issue

Re: Issues with Solr Morphline reading RFC822 files

Can't see what's color coded in the email. > On Feb 13, 2017, at 5:35 PM, Anatharaman, Srinatha (Contractor) > wrote: > > Hi, > > I am loading email files which are in RFC822 format into SolrCloud using Flume > But some meta data of the emails is not

Issues with Solr Morphline reading RFC822 files

Hi, I am loading email files which are in RFC822 format into SolrCloud using Flume But some meta data of the emails is not getting loaded to Solr. Please find below sample email, text which is colored in Bold Red is ignored by Solr I can read this files ONLY using

Re: Field collapsing, facets, and qtime: caching issue?

The additional work is done in the QueryComponent I believe. There is a flag that tells the QueryComponent if the DocSet is needed. If that's set to true and it's not available it will build the DocSet. We ran into the facet refinement issue I mentioned at Alfresco and I created this ticket:

Re: Unable to build Solr 5.5.3 from source

Sahil, Dependency versions are in lucene/ivy-versions.properties. When we upgrade, we change the version there instead of in each ivy.xml file with the dependency. -- Steve www.lucidworks.com > On Feb 13, 2017, at 11:00 AM, Sahil Agarwal wrote: > > The issue has

json facet API response size

I tried migrating our facet search from the old facet method to the new json facet API, but there is one problem in the size of the returned response. for example one query response size is around 1.2 MB while the same query using the old facet method produces a response of around 160 KB. Is

Re: Field collapsing, facets, and qtime: caching issue?

Thanks for the explanation, Joel. When you say the query/collapse needs to be re-run, is this the facet component that needs to do this? The confusing part is that the debug suggests the time is being spent in the query component when faceting is enabled. My naive reading of your response would

Get orphan documents

Hi, I want to check if I have orphan documents in my core. I found this utility *CheckJoinIndex* in Lucene, but I really don't know how to execute it in my Solr 5.5.3 core. Is there a query that can gave me the orphan documents in Solr? I have an schema like this: { "id": 1, "content_type":

Re: Upgrade SOLR version - facets perfomance regression

I finished to write FacetConverter, but I have a question: How do I config facet.threads parameter in Json Facet Api? I didn't find right syntax in the Confluence page. -- View this message in context:

Re: Upgrade SOLR version - facets perfomance regression

I finished to write FacetConverter, but I have some questions: 1) How do I config facet.threads parameter in Json Facet Api? 2) How do I add facet.pivot to query? For example, I need *q=*:*=true=A,B* and I tried to write something like this:

Continual garbage collection loop

Hi, I get an issue where, when I'm deleting and adding Solr cores, it appears to go into a loop increasing CPU load and continually (every 2 seconds) logging to the garbage collection log. I had this problem with 6.1.0 so we've just upgraded to 6.4.1 and the issue still occurs. The entries being

Re: ConcurrentUpdateSolrServer update response doesn't reflect correct response status

Hi Shawn, Thanks for the detailed explanation, really informative. However after further analyzing I found that I can use HttpSolrServer instead of ConcurrentUpdateSolrServer, I'm handling the concurrency by my self. But the issue with ConcurrentUpdateSolrServer is still there, seem like an

Re: Unable to build Solr 5.5.3 from source

Thanks Shawn, I have already come across the javadoc compiler problem after solving the dependency problem. I do have a workaround in mind for it, will try to apply it tomorrow and will update if it works. On 13 February 2017 at 21:30, Sahil Agarwal wrote: > The issue

Re: Unable to build Solr 5.5.3 from source

The issue has been fixed. Seems there is a problem in *solr/core/ivy.xml * In this line, I replaced the ${/commons-fileupload/commons-fileupload} with 1.3.2 as the variable seemed to be downloading version 1.3.1 of the commons-fileupload instead of the latest 1.3.2 version. Once this was done,

Re: Heads up: SOLR-10130, Performance issue in Solr 6.4.1

I’m seeing similar problems here. With 6.4.0, we were handling 6000 requests/minute. With 6.4.1 it is 1000 rpm with median response times around 2.5 seconds. I also switched to the G1 collector. I’m going to back that out and retest today to see if the performance comes back. wunder Walter

Re: Java version set to 1.8 for SOLR 6.4.0

Hi Shawn, I follwed following steps: Stopped the existing SOLR 5.1.0 by bin/solr stop -p 8983 I have copied solr-6.4.0.tgz file to the root directory -/opt/wml. Then I have extracted (installed) by  tarzxf solr-6.4.0.tgz Let me know what's wrong. Thanks. Regards, Uchit Patel From:

Re: how to get modified field data if it doesn't exist in meta

Hi, Who can compile me this to jar file? (I found something similar i need in google: ( http://stackoverflow.com/questions/20745935/set-last-modified-field-when-not-defined-in-document-in-solr )) package modifiedG4; import java.io.IOException; import org.apache.solr.common.SolrInputDocument;

Re: ConcurrentUpdateSolrServer update response doesn't reflect correct response status

On 2/12/2017 10:51 PM, Lasitha Wattaladeniya wrote: > Thanks for the reply. But even if I add a single document, the response > doesn't reflect the correct response status. From the given solr console > ui, it shows status 400 for the bad requests (when I try to index document > with no fields

Re: Java version set to 1.8 for SOLR 6.4.0

On 2/13/2017 3:13 AM, Uchit Patel wrote: > I have updated SOLR_JAVA_HOME in following file. > /opt/wml/solr-6.4.0/bin/solr.in.sh SOLR_JAVA_HOME = > "/opt/wml/jdk1.8.0_66/jre/bin/java" But it is not working. If you *installed* Solr using the service installer script, then that is not the correct

Re: Unable to build Solr 5.5.3 from source

On 2/12/2017 11:52 PM, Sahil Agarwal wrote: > I have not been able to build Solr 5.5.3 from the source. > Detected Java version: 1.8 in: /usr/lib/jvm/jdk1.8.0_121/jre The unresolved dependency error is unusual, I'm not really sure what's going on there. My best idea would be to delete the ivy

Re: bin/post and self-signed SSL

Thanks for your answers. I was also able to work around it using cURL, but we should obviously fix bin/post to be as smart as bin/solr in parsing env.variables related to SSL and auth. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com > 7. feb. 2017 kl. 01.23 skrev

Heads up: SOLR-10130, Performance issue in Solr 6.4.1

Hi all, this is just a quick heads-up that we've stumbled on serious performance issues after upgrading to Solr 6.4.1 apparently due to the new metrics collection causing a major slowdown. I've filed an issue (https://issues.apache.org/jira/browse/SOLR-10130) about it, but decided to post

Re: Unable to build Solr 5.5.3 from source

Hi Sahil, I downloaded the Solr 5.5.3 source, deleted my Ivy cache, and successfully ran “ant compile” from the solr/ directory. My Ant version is the same as yours. Do you have ivy-2.3.0.jar in your ~/.ant/lib/ directory? (I do.) Are you attempting to compile the unmodified released source,

Re: Java version set to 1.8 for SOLR 6.4.0

Hi, Maybe these links might be helpful to you. http://askubuntu.com/questions/740757/switch-between-multiple-java-versions http://lj4newbies.blogspot.in/2007/04/2-jvm-on-one-linux-box.html

Re: Java version set to 1.8 for SOLR 6.4.0

I have updated SOLR_JAVA_HOME in following file. /opt/wml/solr-6.4.0/bin/solr.in.sh SOLR_JAVA_HOME = "/opt/wml/jdk1.8.0_66/jre/bin/java"  But it is not working. Regards, Uchit Patel I have installed SOLR 6.4.0 on Linux box. I have Java 1.7.0 and 1.8.0 both on the box. By default it point to

Re: Java version set to 1.8 for SOLR 6.4.0

Hi , I tried SOLR_JAVA_HOME = "/opt/wml/jdk1.8.0_66/jre/bin/java" but it is not working. Regards, Uchit Patel I have installed SOLR 6.4.0 on Linux box. I have Java 1.7.0 and 1.8.0 both on the box. By default it point to 1.7.0. Some other applications using 1.7.0 Java. I want to set Java 1.8.0

RE: Simulating group.facet for JSON facets, high mem usage w/ sorting on aggregation...

Thanks for letting me know Yonik, I'll watch this issue with interest. BTW, I said Solr 4.6.1 in my original post - that should've been 6.4.1. Cheers, ~Mike From: Yonik Seeley [ysee...@gmail.com] Sent: 10 February 2017 21:44 To: