Re: More Like This Query problems

2018-10-18 Thread John Bickerstaff
Found it. My SOLR does NOT store fields and after some careful checking, it turns out we do NOT do term vectors either... So, according to the docs, MLT will not work. Thanks for the response David! On Thu, Oct 18, 2018 at 1:44 PM John Bickerstaff wrote: > Thanks. There are many d

Re: More Like This Query problems

2018-10-18 Thread John Bickerstaff
ur doc id” > Also be certain there are other documents that will meet your criteria for > a test case. Remember it’s unique words in your core/collection > > On Oct 18, 2018, at 2:43 PM, John Bickerstaff <mailto:j...@johnbickerstaff.com>> wrote: > > All, > >

More Like This Query problems

2018-10-18 Thread John Bickerstaff
All, I am having trouble with a “more like this” query in Solr. Here’s what I think should be happening: 1. Query contains Document ID (q=id:"942316176:9009:66

Re: Solr Developer needed urgently

2018-03-15 Thread John Bickerstaff
Hi - thanks for thinking of me! I'm currently lead on the Solr team for Ancestry - and having a good time. I might be interested, but moving to New York isn't going to work for me. If there is a good chance of working from home, then I might be interested... Let me know... On Wed, Mar 14, 2018

Re: SolrCloud: How best to do backups?

2018-02-08 Thread John Bickerstaff
that deep before... https://n2ws.com/how-to-guides/automate-amazon-ec2-instance-backup.html On Thu, Feb 8, 2018 at 2:00 PM, John Bickerstaff <j...@johnbickerstaff.com> wrote: > Hmmm... > > Can you (fairly quickly) reproduce this AWS environment (including the > indexes)? Or

Re: SolrCloud: How best to do backups?

2018-02-08 Thread John Bickerstaff
Hmmm... Can you (fairly quickly) reproduce this AWS environment (including the indexes)? Or does it require that several week process to provision new Solr boxes...? What happens now if one of those ec2 instances gets into trouble? Do you have autoscaling groups set up? On Thu, Feb 8, 2018 at

Re: Bitnami, or other Solr on AWS recommendations?

2018-01-26 Thread John Bickerstaff
I guess I'd say test with the image - especially if you're deploying a larger number of Solr boxes. We do a lot of them where I work and (unfortunately, for reasons I won't bother you with) can't use an image. The time it takes to install solr is noticeable when we deploy Solr on our 100 plus EC2

Re: Solr cloud planning

2017-10-03 Thread John Bickerstaff
Others will comment I'm sure, but I'm suspicious the answer is that you can only know by testing. The kind and quantity of data in your indexes - the type of queries you normally receive, etc, etc... All these things will have an affect on your speed. For sure you don't want 15 Zookeepers.

Re: Solrcloud configuration

2017-09-19 Thread John Bickerstaff
Addendum: It's not sql server, but I imagine the steps will be similar if not identical except for the details of the JDBC driver you need. On Tue, Sep 19, 2017 at 4:11 PM, John Bickerstaff <j...@johnbickerstaff.com> wrote: > This may also be of some assistance: > > https://

Re: Solrcloud configuration

2017-09-19 Thread John Bickerstaff
This may also be of some assistance: https://gist.github.com/maxivak/3e3ee1fca32f3949f052 I haven't tested, just found it. On Tue, Sep 19, 2017 at 4:10 PM, John Bickerstaff <j...@johnbickerstaff.com> wrote: > This may be of some assistance... > > http://lucene.apache.org

Re: Solrcloud configuration

2017-09-19 Thread John Bickerstaff
This may be of some assistance... http://lucene.apache.org/solr/guide/6_6/ There is a section discussing sharding and another section that includes the schema. On Tue, Sep 19, 2017 at 1:42 PM, Shashi Roushan wrote: > Hello David > > No, I didn't read any documentation

Re: solr-map-reduce:jar:6.6.0

2017-08-29 Thread John Bickerstaff
If we do need that functionality somehow, what is the recommended approach? Was it replaced by something? On Tue, Aug 29, 2017 at 4:27 PM, John Bickerstaff <j...@johnbickerstaff.com> wrote: > A quick search of the code's imports suggests we aren't actually using it. > H

Re: solr-map-reduce:jar:6.6.0

2017-08-29 Thread John Bickerstaff
contrib module is removed as part of SOLR-9221 > <https://issues.apache.org/jira/browse/SOLR-9221>. Are you using this > contrib module? > > Thanks > Hrishikesh > > > On Tue, Aug 29, 2017 at 2:39 PM, John Bickerstaff < > j...@johnbickerstaff.com> > wro

solr-map-reduce:jar:6.6.0

2017-08-29 Thread John Bickerstaff
All, I'm looking at upgrading some java projects to solr and lucene 6.6.0. I get an error when trying to "mvn package" one of them - it complained about the solr-map-reduce:jar:6.6.0 not being available. I went here: https://mvnrepository.com/artifact/org.apache.solr/solr-map-reduce And it

Solr Logs to ELK / AWS Firestream

2017-08-17 Thread John Bickerstaff
All, I'm trying to get Solr logs into AWS Firestream. Not having a lot of luck. Does anyone out there have any experience getting Solr logs into an ELK stack? Or, better yet, getting Solr Logs into AWS Firestream? We direct logs to SLF4J and use logback as our SLF4j implementation. I have a

Re: Comparison of Solr with Sharepoint Search

2017-08-14 Thread John Bickerstaff
Anything that Solr searches must exist in the Solr index. You could do it, but you'd need to get those documents into Solr "format" and indexed by Solr... Then you could return results that include a link to the actual doc in SharePoint. On Mon, Aug 14, 2017 at 11:08 AM, jmahuang

JSON Logs in SOLR 5.x

2017-08-08 Thread John Bickerstaff
I'm running Solr 5.x and have the need to push logs into AWS's kinesis firehose. As I understand it, I need the logs to be in JSON format. This page: https://cwiki.apache.org/confluence/display/solr/Configuring+Logging Tells me that SOLR is using Log4J version 1.2 I've played with Log4J

Re: Failure to load shards

2017-06-13 Thread John Bickerstaff
in 6 that the patch uses/depends on? Thanks... On Fri, Jun 9, 2017 at 12:03 PM, John Bickerstaff <j...@johnbickerstaff.com> wrote: > Hi all, > > Here's my situation... > > In AWS with zookeeper / solr. > > When trying to spin up additional Solr boxes from an &

Re: Failure to load shards

2017-06-09 Thread John Bickerstaff
sociated) or bringing up boxes more slowly are indicated. I > do know of installations with over 100K replicas, so Solr works at > your scale. > > Best, > Erick > > On Fri, Jun 9, 2017 at 11:03 AM, John Bickerstaff > <j...@johnbickerstaff.com> wrote: > > Hi all, >

Failure to load shards

2017-06-09 Thread John Bickerstaff
Hi all, Here's my situation... In AWS with zookeeper / solr. When trying to spin up additional Solr boxes from an "auto scaling group" I get this failure. The code used is exactly the same code that successfully spun up the first 3 or 4 solr boxes in each "auto scaling group" Below is a copy

Re: Solr performance on EC2 linux

2017-05-01 Thread John Bickerstaff
It's also very important to consider the type of EC2 instance you are using... We settled on the R4.2XL... The R series is labeled "High-Memory" Which instance type did you end up using? On Mon, May 1, 2017 at 8:22 AM, Shawn Heisey wrote: > On 4/28/2017 10:09 AM, Jeff

Re: Solr Kafka DIH

2017-01-31 Thread John Bickerstaff
I wrote a simple java microservice that did this about a year ago... It was pretty simple - and the kafka topic served as a way to re-create my collection from scratch without hitting the database again in the event of the Solr servers going down. The code just read from Kafka topic one by one

Re: How to combine third party search data as top results ?

2017-01-31 Thread John Bickerstaff
Some random thoughts... In case any of them are helpful... If the URLs are unique you might be able to elevate them "as is" with a boost or some other method... If the titles are unique, you might be able to do the same (this might require storing the EXACT title in another, non-indexed field)

Re: Is it possible to rewrite part of the solr response?

2016-12-21 Thread John Bickerstaff
Awesome explanation Eric, I'll be filing this away for future reference. On Dec 21, 2016 7:08 PM, "Erick Erickson" wrote: "grab the response" is a bit ambiguous here in Solr terms. Sure, a SearchComponent (you can write a plugin) gets the response, but it only sees the

Re: Is it possible to rewrite part of the solr response?

2016-12-21 Thread John Bickerstaff
It would be custom code and I have something along those lines, although it throws an error instead of changing the response... Rushing now and can't go into more detail right now. On Dec 21, 2016 6:57 PM, "Mike Thomsen" wrote: > We're trying out some ideas on locking

Re: solr audit logging

2016-12-06 Thread John Bickerstaff
us know what you find in the logs and if you want more "advice" -- which you should always take with a grain of salt... On Tue, Dec 6, 2016 at 3:56 PM, John Bickerstaff <j...@johnbickerstaff.com> wrote: > If you can identify currently-logged messages that give you what you

Re: solr audit logging

2016-12-06 Thread John Bickerstaff
If you can identify currently-logged messages that give you what you need (even if you have to modify or process them afterwards) you can easily make a custom log4j config that grabs ONLY what you want and dumps it into a separate file... I'm pretty sure I've seen all the request coming through

Re: boost solr results using users behavior

2016-11-29 Thread John Bickerstaff
This slideshow / presentation may give you some idea of the complexity involved... No, nothing like this in Solr itself. At least one approach is to mine your logs for user behavior and use that information as a starting point for either an external machine learning piece, or for just

Re: Highlighting, offsets -- external doc store

2016-11-29 Thread John Bickerstaff
ppear to have been used in any Solr > 4.10) > > -Simon > > On Tue, Nov 29, 2016 at 11:43 AM, John Bickerstaff < > j...@johnbickerstaff.com > > wrote: > > > All, > > > > One of the questions I've been asked to answer / prove out is around the > >

Re: Highlighting, offsets -- external doc store

2016-11-29 Thread John Bickerstaff
nalyzed text, > >> the only thing in the index is what's made it through the > >> analysis chains. So stopwords are missing. Stemming > >> has been done. You could even have put a phonetic filter > >> in there and have terms like ARDT KNTR which would > >> be

Re: Documentation of Zookeeper's specific roles and functions in Solr Cloud?

2016-11-29 Thread John Bickerstaff
ent, then a > request > >> gets sent to Zookeeper to determine the live nodes. If indexing, > >> CloudSolrClient can find the leader and send documents directly there. > The > >> client then uses that information to query the correct nodes directly. > >>

Documentation of Zookeeper's specific roles and functions in Solr Cloud?

2016-11-29 Thread John Bickerstaff
All, I've thought I understood that Solr search requests are made to the Solr servers and NOT Zookeeper directly. (I.E. Zookeeper doesn't decide which Solr server responds to requests and requests are made directly to Solr) My new place tells me they're sending requests to Zookeeper - and those

Highlighting, offsets -- external doc store

2016-11-29 Thread John Bickerstaff
All, One of the questions I've been asked to answer / prove out is around the question of highlighting query matches in responses. BTW - One assumption I'm making is that highlighting is basically a function of storing offsets for terms / tokens at index time. If that's not right, I'd be

Re: Editing schema and solrconfig files

2016-11-09 Thread John Bickerstaff
I never found a way to do it through the UI... and ended up using "nano" on linux for simple things. For more complex stuff, I scp'd the file (or the whole conf directory) up to my dev box (a Mac in my case) and edited in a decent UI tool, then scp'd the whole thing back... I wrote a simple bash

Re: load balancer for solr

2016-11-07 Thread John Bickerstaff
So from a "load balancing" perspective, you may want to consider using SolrCloud... It was designed (as I understand it) to be able to handle large loads, although to understand how it will work in your situation you will have to test. On Mon, Nov 7, 2016 at 6:29 AM, Mugeesh Husain

Re: Query formulation help

2016-10-26 Thread John Bickerstaff
For what it's worth- you can do some complex stuff - including using document fields as "variables" -- I did it on an Solr query endpoint (like /search) because I had stuff that was constant for every query. The syntax is challenging, but it can be done. I won't confuse the issue more unless you

Re: Query formulation help

2016-10-26 Thread John Bickerstaff
Ahh - I see what you're after (I think) This page should be helpful for you: https://cwiki.apache.org/confluence/display/solr/Function+Queries again, I'd try using the Admin UI as a test phase to get things right (and see the syntax in the URL that comes back on the response) Open the edismax

Re: Query formulation help

2016-10-26 Thread John Bickerstaff
It looks to me as if it's blowing up on syntax. I don't have access to the Admin UI right now, but I would suggest attempting to submit this query via the UI and examining the URL that comes back. That frequently solves my more frustrating syntax problems. I.E. try putting the cost:[...] in

Re: Load balancing with solr cloud

2016-10-20 Thread John Bickerstaff
Others on the list are more expert, but I think your #1 Zookeeper will not get hammered. As I understand it, Solr itself (the leader) will handle farming out the work to the other two Solr nodes. The amount of traffic on the Zookeeper instances should be minimal. Now - could your SolrCloud of 3

Re: (solrcloud) Importing documents into "implicit" router

2016-10-20 Thread John Bickerstaff
This may help? https://cwiki.apache.org/confluence/display/solr/Shards+and+Indexing+Data+in+SolrCloud On Thu, Oct 20, 2016 at 12:09 PM, Customer wrote: > Hey, > > I hope you all are doing well.. > > I got a router with "router.name=implicit" with couple of shards

Re: (solrcloud) Importing documents into "implicit" router

2016-10-20 Thread John Bickerstaff
e document belongs. If the field specified is missing in the document, however, the document will be rejected. You could also use the _route_ parameter to name a specific shard. On Thu, Oct 20, 2016 at 12:12 PM, John Bickerstaff <j...@johnbickerstaff.com > wrote: > This may help? https

Re: Result Grouping vs. Collapsing Query Parser -- Can one be deprecated?

2016-10-19 Thread John Bickerstaff
Thank you for posting that. I'll be saving it in my "important painful lessons learned by others" mail folder. On Oct 19, 2016 4:51 PM, "Mike Lissner" wrote: > Hi all, > > I've had a rotten day today because of Solr. I want to share my experience > and perhaps

Re: Public/Private data in Solr :: Metadata or ?

2016-10-19 Thread John Bickerstaff
almost always better to do > the work up-front during queries > > Best, > Erick > > On Wed, Oct 19, 2016 at 12:07 PM, John Bickerstaff > <j...@johnbickerstaff.com> wrote: > > Thank you both! Very helpful. > > > > On Wed, Oct 19, 2016 at 8:48 AM, Shawn H

Re: Public/Private data in Solr :: Metadata or ?

2016-10-19 Thread John Bickerstaff
Thank you both! Very helpful. On Wed, Oct 19, 2016 at 8:48 AM, Shawn Heisey <apa...@elyograg.org> wrote: > On 10/18/2016 3:00 PM, John Bickerstaff wrote: > > How (or is it even wise) to "segregate data" in Solr so that some data > > can be seen by some users and

Re: Public/Private data in Solr :: Metadata or ?

2016-10-18 Thread John Bickerstaff
3:32 PM, Jan Høydahl <jan@cominvent.com> wrote: > https://wiki.apache.org/solr/SolrSecurity#Document_Level_Security < > https://wiki.apache.org/solr/SolrSecurity#Document_Level_Security> > > -- > Jan Høydahl, search solution architect > Cominvent AS - www.comi

Re: Public/Private data in Solr :: Metadata or ?

2016-10-18 Thread John Bickerstaff
Thanks Markus, In your case that client's key is fairly static, yes? It doesn't change at any time, but tends to live on the data more or less permanently? On Tue, Oct 18, 2016 at 4:07 PM, Markus Jelsma wrote: > In case you're not up for Doug or Jan's anwers; we

Public/Private data in Solr :: Metadata or ?

2016-10-18 Thread John Bickerstaff
I have a question that I suspect I'll need to answer very soon in my current position. How (or is it even wise) to "segregate data" in Solr so that some data can be seen by some users and some data not be seen? Taking the case of "public / private" as a (hopefully) simple, binary example...

Re: Migration from Solr 4

2016-10-18 Thread John Bickerstaff
18, 2016 at 2:05 PM, Shawn Heisey <apa...@elyograg.org> wrote: > On 10/18/2016 12:28 PM, John Bickerstaff wrote: > > For what it's worth, (and it may not work for your situation) I > > decided not to upgrade, but to "upgrade by replacing". In other words, > >

Re: Migration from Solr 4

2016-10-18 Thread John Bickerstaff
ive scale (hundreds > of Solr instances and/or collections), and even in these cases it's > usually best to use Observers.... > > FWIW, > Erick > > On Tue, Oct 18, 2016 at 2:28 PM, John Bickerstaff > <j...@johnbickerstaff.com> wrote: > > For what it's worth, (and it

Re: Migration from Solr 4

2016-10-18 Thread John Bickerstaff
/www.linkedin.com/pulse/actual-solrcloud-vms-zookeeper-nodes-john-bickerstaff On Tue, Oct 18, 2016 at 11:28 AM, sputul <sputu...@gmail.com> wrote: > We are using Solr 4.3, sing Zoopeeker on development manage Solr Cloud > having > one or two nodes. Will it be easier to migrate t

Re: Query by distance

2016-10-18 Thread John Bickerstaff
Just in case it helps, I had good success on multi-word synonyms using this plugin... https://github.com/healthonnet/hon-lucene-synonyms IIRC, the instructions are clear and fairly easy to follow - especially for Solr 6.x Ping back if you run into any problems setting it up... On Tue, Oct

Re: Advice on implementing SOLR Cloud

2016-10-18 Thread John Bickerstaff
Excellent! Glad to know the efforts were useful to someone else. On Oct 17, 2016 11:20 PM, "Sadheera Vithanage" <sadhee...@gmail.com> wrote: Thank you very much John, I fixed it. Your steps helped big time.. Thanks again.. On Tue, Oct 18, 2016 at 10:17 AM, Joh

Re: Advice on implementing SOLR Cloud

2016-10-17 Thread John Bickerstaff
set called something like 6.1_final.txt and that will contain a step-by-step way to set up the Solr Cloud. You can modify for your situation. Hope this helps... https://www.linkedin.com/pulse/actual-solrcloud-vms-zookeeper-nodes-john-bickerstaff?trk=hp-feed-article-title-publish Oh, by the way, you

Re: PDF writer

2016-10-17 Thread John Bickerstaff
Awesome - I learned something - thanks! On Mon, Oct 17, 2016 at 3:06 PM, Markus Jelsma wrote: > Did someone miss https://pdfbox.apache.org/ ? It can write PDF documents, > is ASF and has a ton of examples to learn from. > M. > > > > -Original message- > >

Re: PDF writer

2016-10-17 Thread John Bickerstaff
It's not fun to build a .pdf this way, but this may help... http://itextpdf.com/ On Mon, Oct 17, 2016 at 12:15 PM, Matthew Roth wrote: > Thanks Erick. That is as anticipated. Scouring my other resources didn't > indicate the existence of a PDF writer. I thought I'd try

Re: solr 5 leaving tomcat, will I be the only one fearing about this?

2016-10-10 Thread John Bickerstaff
Renee - you have probably already thought of this, but just in case it helps... (It helped me a lot several years ago and I hadn't thought of it at the time...) If you end up needing to do a big re-index, Production doesn't have to be affected (assuming you have the hardware/cloud resources).

Re: solr 5 leaving tomcat, will I be the only one fearing about this?

2016-10-10 Thread John Bickerstaff
For what it's worth / in case it's helpful... I haven't dealt with JDBC in this context so I can't offer anything useful there... You can reference the data in Zookeeper when creating a new collection - so you don't need to put the configs anywhere on the Solr boxes themselves. It's not

Re: solr 5 leaving tomcat, will I be the only one fearing about this?

2016-10-07 Thread John Bickerstaff
Rajesh was right on Renee -- the only big concern might be if that other code is tightly-coupled to Tomcat or to other things which *must* have Tomcat. But it sounds to me as if your multi-lingual processors - if they just work with Solr/Tomcat - out to "just work" with Solr/Jetty - or work with

Re: solr 5 leaving tomcat, will I be the only one fearing about this?

2016-10-07 Thread John Bickerstaff
I won't speak for the committers, but I'm guessing you won't find a lot of support for the idea of continuing to provide a WAR file with the standard SOLR releases... I feel for you and your situation however - I've had to wrestle with a number of situations where a somewhat monolithic

Re: Writing Solr Custom Components

2016-10-06 Thread John Bickerstaff
t; https://github.com/sematext/solr-autocomplete > > I hope this helps. > > Otis > -- > Monitoring - Log Management - Alerting - Anomaly Detection > Solr & Elasticsearch Consulting Support Training - http://sematext.com/ > > > On Wed, Oct 5, 2016 at 9:34 AM,

Re: Average of Averages in Solr

2016-10-06 Thread John Bickerstaff
This may help? Note the "Bloomberg Analytics" at the bottom of the post... https://dzone.com/articles/solr-not-just-for-text-anymore Quote from article: - *Bloomberg Analytics Component for Solr*: Bloomberg Financial Services uses Solr extensively, and found the existing statistical

Re: running solr 6.x in Eclipse for debugging

2016-10-06 Thread John Bickerstaff
can set breakpoints in your initialization > (or anywhere else) in your plugin (or anywhere in Solr). > > HINT: If at all possible and you can write a Junit test, it's easier > to just debug _that_ than go all the stuff above, you can debug > individual junit tests.. > > FWIW, &g

Re: running solr 6.x in Eclipse for debugging

2016-10-05 Thread John Bickerstaff
...? On Wed, Oct 5, 2016 at 1:30 PM, John Bickerstaff <j...@johnbickerstaff.com> wrote: > OK - I'm running now in debug mode. My intent is to add and test a "hello &

Re: running solr 6.x in Eclipse for debugging

2016-10-05 Thread John Bickerstaff
re - My goal is: Add plugin source code, build, make config changes where needed, and see source when I put a breakpoint in code. On Wed, Oct 5, 2016 at 12:04 PM, John Bickerstaff <j...@johnbickerstaff.com> wrote: > Thanks Mikhail! > > On Wed, Oct 5, 2016 at 11:29 AM, Mikhail Khludn

Re: running solr 6.x in Eclipse for debugging

2016-10-05 Thread John Bickerstaff
master and branch_6x > > On Wed, Oct 5, 2016 at 5:51 PM, John Bickerstaff <j...@johnbickerstaff.com > > > wrote: > > > Mikhail -- which version of Solr are you using to do this [ant example > > -Dexample.debug=true] > > > > I may be wrong, but it seems

Re: running solr 6.x in Eclipse for debugging

2016-10-05 Thread John Bickerstaff
hat link suggests too. > > > > I also build 'ant server dist' from the install_dir/solr directory first. > > The 'ant eclipse' target just builds the project structure for Eclipse, > > it doesn't build Solr. > > > > YMMV of course since you're using a different I

Re: running solr 6.x in Eclipse for debugging

2016-10-05 Thread John Bickerstaff
. > > YMMV of course since you're using a different IDE. > > Best, > Erick > > > On Tue, Oct 4, 2016 at 5:27 PM, John Bickerstaff > <j...@johnbickerstaff.com> wrote: > > Thanks! > > > > This works... > > > > I'm getting a (

Re: Writing Solr Custom Components

2016-10-05 Thread John Bickerstaff
Thank you both! On Oct 5, 2016 2:32 AM, "Charlie Hull" <char...@flax.co.uk> wrote: > On 04/10/2016 17:23, John Bickerstaff wrote: > >> All, >> >> I'm looking for information on writing custom Solr components. A quick >> search showed nothing really

Re: running solr 6.x in Eclipse for debugging

2016-10-04 Thread John Bickerstaff
and 4.10.4. both works. > > bin/solr start -f -a "-Xdebug > -Xrunjdwp:transport=dt_socket,server=y,suspend=y,address=7666" > > On Tue, Oct 4, 2016 at 5:26 PM, John Bickerstaff <j...@johnbickerstaff.com > > > wrote: > > > All, > &

Re: running solr 6.x in Eclipse for debugging

2016-10-04 Thread John Bickerstaff
art -f -a "-Xdebug > -Xrunjdwp:transport=dt_socket,server=y,suspend=y,address=7666" > > On Tue, Oct 4, 2016 at 5:26 PM, John Bickerstaff <j...@johnbickerstaff.com > > > wrote: > > > All, > > > > I've found some hints, but can't get Solr running in de

running solr 6.x in Eclipse for debugging

2016-10-04 Thread John Bickerstaff
All, I've found some hints, but can't get Solr running in debug mode in eclipse with the instructions Here: http://opensourceconnections.com/blog/2013/04/13/how-to-debug-solr-with-eclipse/ or Here: http://wiki.apache.org/solr/HowToConfigureEclipse When I run this command from the wiki : java

Writing Solr Custom Components

2016-10-04 Thread John Bickerstaff
All, I'm looking for information on writing custom Solr components. A quick search showed nothing really recent and before I dig deeper, I thought I'd ask the community for anything you are aware of. Thanks

Re: Archiving documents

2016-09-29 Thread John Bickerstaff
I'm not the expert, but I'm thinking you would need an external process to handle this. SOLR itself doesn't seem built to use it's own collection data to act on collection data (I'd love to be wrong about that). So - barring any corrections from the committers, I'm imagining you'd need to write

Re: Whether SolrCloud can support 2 TB data?

2016-09-24 Thread John Bickerstaff
As an aside - I just spoke with somone the other day who is using Hadoop for re-index in order to save a lot of time. I don't know the details, but I assume they're using Hadoop to call Lucene code and index documents using the map-reduce approach... This was made in their own shop - I don't

Re: SolrJ App Engine Client

2016-09-22 Thread John Bickerstaff
Two possibilities from a quick search on the error message - both point to GAE NOT fully supporting Java 8 http://stackoverflow.com/questions/29528580/how-to-deal-with-app-engine-devserver-exception-due-to-formatstyle-restricted-cl

Re: SolrCloud setup

2016-09-21 Thread John Bickerstaff
I found it to be way less than intuitive when I first started to get going. I wished for an example or step by step (including zookeeper) Pulling it all together from the docs wasn't straightforward although I guess the info is still there. I'll send you my rough notes in case they're

Re: script to get core num docs

2016-09-19 Thread John Bickerstaff
I would imagine there's an http call that would get it and you could call cURL in your bash script... I don't know the URL parameters off hand however... On Mon, Sep 19, 2016 at 9:22 AM, KRIS MUSSHORN wrote: > How can i get the count of docs from a core with bash? >

Re: Miserable Experience Using Solr. Again.

2016-09-17 Thread John Bickerstaff
>> Good software doesn’t force users to learn how it works. It hides the inner workings under the interface, so that people never even have to worry about it at all. I agree - AND the fact is that the amount of effort involved in expressing (In a really well-made UI) every possible permutation of

Re: Solr Cloud Using Docker

2016-09-16 Thread John Bickerstaff
In case this is helpful - sponsored by Lucidworks https://hub.docker.com/_/solr/ I can't speak to the pros and cons of using it in production except to say that they are probably the same as the pros and cons of running Docker in production (as in nothing is perfect) HTH... On Fri, Sep 16,

Re: Tutorial not working for me

2016-09-16 Thread John Bickerstaff
e tutorial: > > > https://lucene.apache.org/solr/quickstart.html. Where it breaks down > is > > > this one: > > > > > > http://localhost:8983/solr/gettingstarted/select?wt=json; > > indent=true=name:foundation > > > > > > This ret

Re: Tutorial not working for me

2016-09-16 Thread John Bickerstaff
what happens if you issue this? Do you see the field in question in the results? http://localhost:8983/solr/gettingstarted/select?wt=json=true= *:* On Fri, Sep 16, 2016 at 9:43 AM, Alexandre Rafalovitch

Re: Tutorial not working for me

2016-09-16 Thread John Bickerstaff
Please share the exact query syntax? Are you using a collection you built or one of the examples? On Fri, Sep 16, 2016 at 9:06 AM, Pritchett, James < jpritch...@learningally.org> wrote: > I apologize if this is a really stupid question. I followed all > instructions on installing Tutorial, got

Re: (Survey/Experiment) Are you interested in a Solr example reading group?

2016-09-15 Thread John Bickerstaff
I'm in whether it's Slack or email or whatever. On Thu, Sep 15, 2016 at 2:45 PM, Erik Hatcher wrote: > Count me in to participate if it’s a Slack channel. (if it’s > e-mail-based, it won’t hit my radar and I wouldn’t tune in much) > > I’d love to chat up example/files*

Re: Miserable Experience Using Solr. Again.

2016-09-15 Thread John Bickerstaff
e too much, but that's what I've been wondering about for the last year or so... On Thu, Sep 15, 2016 at 9:09 AM, Alexandre Rafalovitch <arafa...@gmail.com> wrote: > On 15 September 2016 at 21:47, John Bickerstaff > <j...@johnbickerstaff.com> wrote: > > One thing I'd like to s

Re: Miserable Experience Using Solr. Again.

2016-09-15 Thread John Bickerstaff
YES, YES, YES!!! I think nearly everyone on this list will agree that getting started with almost any open-source project is agony - it's just that we've all gotten used to sucking it up and getting past it. Solr, given it's many moving parts and multiple ways of doing things is "worse" than

Re: How to enable JMX to monitor Jetty

2016-09-15 Thread John Bickerstaff
I'm very interested in Solr Docker images... Is this the "official" thing? I see it's supported by Lucidworks... On Thu, Sep 15, 2016 at 1:27 AM, Georg Sorst wrote: > If you are using the Solr's Docker images this is even easier: > > FROM solr:6.0.0 > > USER $SOLR_USER

Re: Miserable Experience Using Solr. Again.

2016-09-12 Thread John Bickerstaff
at 8:41 PM, <billnb...@gmail.com> wrote: > Interested for sure > > Bill Bell > Sent from mobile > > > > On Sep 12, 2016, at 4:05 PM, John Bickerstaff <j...@johnbickerstaff.com> > wrote: > > > > For what it's worth - I found enough frustration upgr

Re: Miserable Experience Using Solr. Again.

2016-09-12 Thread John Bickerstaff
entirely - although I also had to upgrade Java on my VMs... On Mon, Sep 12, 2016 at 4:05 PM, John Bickerstaff <j...@johnbickerstaff.com> wrote: > For what it's worth - I found enough frustration upgrading that I decided > to "upgrade by replacement" > > Now, I s

Re: Miserable Experience Using Solr. Again.

2016-09-12 Thread John Bickerstaff
For what it's worth - I found enough frustration upgrading that I decided to "upgrade by replacement" Now, I suppose if you've got a huge dataset to re-index that could be a problem, but just in case an option like that helps you, I'll suggest this. 1. Install 6.x on a new machine using the

Re: query formulation

2016-09-11 Thread John Bickerstaff
t me off the list and let's talk. > > Regards, > Alex. > > Newsletter and resources for Solr beginners and intermediates: > http://www.solr-start.com/ > > > On 11 September 2016 at 23:24, John Bickerstaff > <j...@johnbickerstaff.com> wrote: > > All, > > > &g

Re: query formulation

2016-09-11 Thread John Bickerstaff
All, I've found that figuring out the subtle nuances of the query language is a *daunting* task for someone unfamiliar with SOLR. I'm not aware of any comprehensive documentation (in the form of a tutorial or similar really useful tool) It seems the information is scattered all over the place

Re: Migrating: config found, but not mapped to collection

2016-09-09 Thread John Bickerstaff
Sure - and the apps may not have been pointed at the new ZK? If you want the new apps to use the latest Solr, then I would assume you want them on the new ZK, but I'll bet a dollar that there are some configurations, etc, that need to change in the applications before that will work right... On

Re: Migrating: config found, but not mapped to collection

2016-09-09 Thread John Bickerstaff
I'm not sure, but based on what I saw in the script command line, I would expect ONLY otac_en to show up - since that is the only one mentioned on the -confname flag... Glad you've made some progress - happy to try to assist in figuring out the larger problem if you want to. I have sweat a lot

Re: Migrating: config found, but not mapped to collection

2016-09-09 Thread John Bickerstaff
I'm afraid I'm pretty confused about what's going on... Naturally, because it's new to me and you've been staring at it for a long time... I'm afraid I'll have to ask some basic questions to get myself on the right page... When you say this: The scrtipt does the job: the config is visible at

Re: Migrating: config found, but not mapped to collection

2016-09-09 Thread John Bickerstaff
Specifically, how did you push the configuration to Zookeeper? Does the config exist in a separate "chroot" on Zookeeper? If so, do all the collection names exist inside there (On Zookeeper)? On Fri, Sep 9, 2016 at 2:01 PM, igiguere wrote: > Hi; > > I am migrating

Re: newbie question

2016-09-07 Thread John Bickerstaff
the /solr is a "chroot" -- if used, everything for solr goes into zookeeper's /solr "directory" It isn't required, but is very useful for keeping things separated. I use it to handle different Solr versions for upgrading (/solr5_4 or /solr6_2) If not used, everything you put into Zookeeper

Re: Can't create collection without plugin, can't load plugin without collection

2016-09-07 Thread John Bickerstaff
ng to help think around the corners of the box - feel free to ignore if I've missed something obvious. On Wed, Sep 7, 2016 at 10:44 AM, Erick Erickson <erickerick...@gmail.com> wrote: > Well, it was worth a try ;) > > On Wed, Sep 7, 2016 at 9:42 AM, John Bickerstaff > <

Re: Can't create collection without plugin, can't load plugin without collection

2016-09-07 Thread John Bickerstaff
Not sure if it's helpful, but I did solve a similar problem by scripting the placement of the plugin .jar file into the appropriate directories as part of the build process for my VMs I get that doing it through the BlobStore would be preferred, probably... But I couldn't get it to work and

Re: Apache SOLR Search Errors ?

2016-09-06 Thread John Bickerstaff
Sure - I'll contact you off this list. On Tue, Sep 6, 2016 at 11:13 AM, jake_4321 wrote: > Hi John / Charlie, > > Both - Thank you for your replies. > > John would you be able to have a chat with me on Skype about the upgrade? > > Also Charlie would you have Skype to

Re: Apache SOLR Search Errors ?

2016-09-06 Thread John Bickerstaff
I'll just add that upgrading need not be as frustrating / difficult as you might think given the following assumptions... 1. You have the resources to set up a new set of Servers or VM's with Solr 5 or 6 2. You have the data you need to re-index into the new servers. 3. You're running a load

  1   2   3   >