Re: solr training
> > How about in Denver? Nah dude. I'm in Jersey. Denver's like a half a country away! On Thu, Sep 17, 2015 at 12:18 AM, William Bell wrote: > How about in Denver? > > On Sun, Sep 13, 2015 at 7:53 PM, Otis Gospodnetić < > otis.gospodne...@gmail.com> wrote: > > > Hi Tim, > > > > A slightly delayed reply ;) > > We are running Solr training in NYC next month - > > http://sematext.com/training/solr-training.html - 2nd seat is 50% off. > > > > Otis > > -- > > Monitoring * Alerting * Anomaly Detection * Centralized Log Management > > Solr & Elasticsearch Support * http://sematext.com/ > > > > > > On Fri, May 1, 2015 at 2:18 PM, Tim Dunphy wrote: > > > > > Hey guys, > > > > > > My company has a training budget that it wants me to use. So what I'd > > like > > > to find out is if there is any instructor lead courses in the NY/NJ > area, > > > or courses online that are instructor lead that you could recommend? > > > > > > Thanks, > > > Tim > > > > > > -- > > > GPG me!! > > > > > > gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B > > > > > > > > > -- > Bill Bell > billnb...@gmail.com > cell 720-256-8076 > -- GPG me!! gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B
Re: solr training
Cool, I'll check it out. Thanks! On Sun, Sep 13, 2015 at 9:53 PM, Otis Gospodnetić < otis.gospodne...@gmail.com> wrote: > Hi Tim, > > A slightly delayed reply ;) > We are running Solr training in NYC next month - > http://sematext.com/training/solr-training.html - 2nd seat is 50% off. > > Otis > -- > Monitoring * Alerting * Anomaly Detection * Centralized Log Management > Solr & Elasticsearch Support * http://sematext.com/ > > > On Fri, May 1, 2015 at 2:18 PM, Tim Dunphy wrote: > > > Hey guys, > > > > My company has a training budget that it wants me to use. So what I'd > like > > to find out is if there is any instructor lead courses in the NY/NJ area, > > or courses online that are instructor lead that you could recommend? > > > > Thanks, > > Tim > > > > -- > > GPG me!! > > > > gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B > > > -- GPG me!! gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B
solr errors integrating with drupal
Hey guys, I've setup a slightly older version of solr (4.10) with apache tomcat 7.0.64. And set up some drupal configurations according to this guide: http://duntuk.com/how-install-apache-solr-46-apache-tomcat-7-use-drupal Everything seemed to work after I copied the log4j libraries to the correct location, which this tutorial leaves out. But I find that I am now getting these errors in the solr logs when I load up solr in the web browser: Time (Local)LevelLoggerMessage9/9/2015, 5:19:41 PMWARNSolrResourceLoaderCan't find (or read) directory to add to classloader: ../../../contrib/extraction/lib (resolved as: /usr/local/tomcat/solr/drupal/../../../contrib/extraction/lib).9/9/2015, 5:19:41 PMWARNSolrResourceLoaderCan't find (or read) directory to add to classloader: ../../../contrib/clustering/lib/ (resolved as: /usr/local/tomcat/solr/drupal/../../../contrib/clustering/lib).9/9/2015, 5:19:42 PMWARNSolrResourceLoaderSolr loaded a deprecated plugin/analysis class [solr.FloatField]. Please consult documentation how to replace it accordingly.9/9/2015, 5:19:42 PMWARNSolrResourceLoaderSolr loaded a deprecated plugin/analysis class [solr.DateField]. Please consult documentation how to replace it accordingly.9/9/2015, 5:19:42 PMWARNSolrCore[drupal] Solr index directory '/usr/local/apache-tomcat-7.0.64/solr/drupal/data/index' doesn't exist. Creating new index...9/9/2015, 5:19:42 PMWARNRequestHandlersMultiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler9/9/2015, 5:19:42 PMWARN RequestHandlersMultiple requestHandler registered to the same name: /update/csv ignoring: org.apache.solr.handler.UpdateRequestHandler9/9/2015, 5:19:42 PMWARNRequestHandlersMultiple requestHandler registered to the same name: /update/json ignoring: org.apache.solr.handler.UpdateRequestHandler How can I correct these errors? I'll be able to show you whatever config files you think may lead to a solution. I'll just need to know which ones to show you, as I am still new to solr. Thanks! Tim -- GPG me!! gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B
Re: solr 3.6.2 under tomcat 8 missing corename in path
Hi Shawn, > The URL must include the core name. Your defaultCoreName is > collection1, and I'm guessing you don't have a core named collection1. > Try browsing to just /solr instead of /solr/admin ... you should get a > list of links for valid cores, each of which will take you to the admin > page for that core. > Probably what you will find is that when you click on one of those > links, you will end up on /solr/corename/admin.jsp as the URL in your > browser. When I browse to /solr I see a link that points me to /solr/admin. And when I click on that link is when I see the error: *missing core name in path* I think what my problem is, is that I am not listing the cores correctly in the solr.xml file. This is what I have in my solr.xml file: So what I did was create a directory at solr/admin/cores and put collection1 there: [root@aoadbld00032la solr]# ls -ld admin/cores/collection1 drwxr-xr-x. 5 root root 4096 May 6 17:29 admin/cores/collection1 So, if I assume correctly, that the way I reference the collection1 directory is the problem, how can I express this differently in my solr.xml file so that it works? Thanks, Tim On Wed, May 6, 2015 at 8:00 PM, Shawn Heisey wrote: > On 5/6/2015 2:29 PM, Tim Dunphy wrote: > > I'm trying to setup an old version of Solr for one of our drupal > > developers. Apparently only versions 1.x or 3.x will work with the > current > > version of drupal. > > > > I'm setting up solr 3.4.2 under tomcat. > > > > And I'm getting this error when I start tomcat and surf to the > /solr/admin > > URL: > > > > HTTP Status 404 - missing core name in path > > > > type Status report > > > > message missing core name in path > > > > description The requested resource is not available. > > The URL must include the core name. Your defaultCoreName is > collection1, and I'm guessing you don't have a core named collection1. > > Try browsing to just /solr instead of /solr/admin ... you should get a > list of links for valid cores, each of which will take you to the admin > page for that core. > > Probably what you will find is that when you click on one of those > links, you will end up on /solr/corename/admin.jsp as the URL in your > browser. > > Thanks, > Shawn > > -- GPG me!! gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B
solr 3.6.2 under tomcat 8 missing corename in path
I'm trying to setup an old version of Solr for one of our drupal developers. Apparently only versions 1.x or 3.x will work with the current version of drupal. I'm setting up solr 3.4.2 under tomcat. And I'm getting this error when I start tomcat and surf to the /solr/admin URL: HTTP Status 404 - missing core name in path type Status report message missing core name in path description The requested resource is not available. I have solr living in /opt: # ls -ld /opt/solr lrwxrwxrwx. 1 root root 17 May 6 12:48 /opt/solr -> apache-solr-3.6.2 And I have my cores located here: # ls -ld /opt/solr/admin/cores drwxr-xr-x. 3 root root 4096 May 6 14:37 /opt/solr/admin/cores Just one core so far, until I can get this working. # ls -l /opt/solr/admin/cores/ total 4 drwxr-xr-x. 5 root root 4096 May 6 14:08 collection1 I have this as my solr.xml file: Which is located in these two places: # ls -l /opt/solr/solr.xml /usr/local/tomcat/conf/Catalina/solr.xml -rw-r--r--. 1 root root 169 May 6 14:38 /opt/solr/solr.xml -rw-r--r--. 1 root root 169 May 6 14:38 /usr/local/tomcat/conf/Catalina/solr.xml These are the contents of my /opt/solr directory # ls -l /opt/solr/ total 436 drwxr-xr-x. 3 root root 4096 May 6 14:37 admin -rw-r--r--. 1 root root 176647 Dec 18 2012 CHANGES.txt drwxr-xr-x. 3 root root 4096 May 6 12:48 client drwxr-xr-x. 9 root root 4096 Dec 18 2012 contrib drwxr-xr-x. 3 root root 4096 May 6 12:48 dist drwxr-xr-x. 3 root root 4096 May 6 12:48 docs -rw-r--r--. 1 root root 1274 May 6 13:28 elevate.xml drwxr-xr-x. 11 root root 4096 May 6 12:48 example -rw-r--r--. 1 root root 81331 Dec 18 2012 LICENSE.txt -rw-r--r--. 1 root root 20828 Dec 18 2012 NOTICE.txt -rw-r--r--. 1 root root 5270 Dec 18 2012 README.txt -rw-r--r--. 1 root root 55644 May 6 13:27 schema.xml -rw-r--r--. 1 root root 60884 May 6 13:27 solrconfig.xml -rw-r--r--. 1 root root169 May 6 14:38 solr.xml Yet, when I bounce tomcat, this is the result that I get: HTTP Status 404 - missing core name in path type Status report message missing core name in path description The requested resource is not available. Cany anyone tell me what I'm doing wrong? Thanks!! Tim -- GPG me!! gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B
Re: apache 5.1.0 under apache web server
> > The container in the default 5.x install is a completely unmodified > Jetty 8.x (soon to be Jetty 9.x) with a stripped and optimized config. > The config for Jetty is similar to tomcat, you just need to figure out > how to make it work with Apache like you would with Tomcat. > > Incidentially, at least for right now, you CAN still take the .war file > out of the jetty install and put it in Tomcat just like you would have > with a 4.3 or later version. We are planning on making that impossible > in a later 5.x version, but for right now, it is still possible. Hmm well of the two options you present the second one sounds a little easier and more attractive. However, when I tried doing just that like so: [root@aoadbld00032la ~]# cp -v solr-5.1.0/server/webapps/solr.war /usr/local/tomcat/webapps/ `solr-5.1.0/server/webapps/solr.war' -> `/usr/local/tomcat/webapps/solr.war' And then start tomcat up... I can't get to the solr interface :( HTTP Status 503 - Server is shutting down or failed to initialize *type* Status report *message* *Server is shutting down or failed to initialize* *description* *The requested service is not currently available.* -- Apache Tomcat/8.0.21Not seeing anything telling in the logs, unfortunately: [root@aoadbld00032la ~]# tail /usr/local/tomcat/logs/catalina.out 04-May-2015 15:48:26.945 INFO [localhost-startStop-1] org.apache.catalina.startup.HostConfig.deployDirectory Deployment of web application directory /usr/local/apache-tomcat-8.0.21/webapps/ROOT has finished in 32 ms 04-May-2015 15:48:26.946 INFO [localhost-startStop-1] org.apache.catalina.startup.HostConfig.deployDirectory Deploying web application directory /usr/local/apache-tomcat-8.0.21/webapps/host-manager 04-May-2015 15:48:26.979 INFO [localhost-startStop-1] org.apache.jasper.servlet.TldScanner.scanJars At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time. 04-May-2015 15:48:26.983 INFO [localhost-startStop-1] org.apache.catalina.startup.HostConfig.deployDirectory Deployment of web application directory /usr/local/apache-tomcat-8.0.21/webapps/host-manager has finished in 36 ms 04-May-2015 15:48:26.983 INFO [localhost-startStop-1] org.apache.catalina.startup.HostConfig.deployDirectory Deploying web application directory /usr/local/apache-tomcat-8.0.21/webapps/examples 04-May-2015 15:48:27.195 INFO [localhost-startStop-1] org.apache.jasper.servlet.TldScanner.scanJars At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time. 04-May-2015 15:48:27.245 INFO [localhost-startStop-1] org.apache.catalina.startup.HostConfig.deployDirectory Deployment of web application directory /usr/local/apache-tomcat-8.0.21/webapps/examples has finished in 262 ms 04-May-2015 15:48:27.248 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["http-nio-8080"] 04-May-2015 15:48:27.257 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["ajp-nio-8009"] 04-May-2015 15:48:27.258 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in 3350 ms However it sounds like you're sure it's supposed to work this way. Can I get some advice on this error? Thanks Tim On Mon, May 4, 2015 at 3:12 PM, Shawn Heisey wrote: > On 5/4/2015 1:04 PM, Tim Dunphy wrote: > > I need to run solr 5.1.0 on port 80 with some basic apache > authentication. > > Normally, under earlier versions of solr I would set it up to run under > > tomcat, then connect it to apache web server using mod_jk. > > > > However 5.1.0 seems totally different. I see that tomcat support has been > > removed from the latest versions. So how do I set this up in front of > > apache web server? I need to get this running on port 443 with SSL and > > something at least equivalent to basic apache auth. > > > > I really wish this hadn't changed because I could set this up under the > old > > method rather easily and quickly. Sigh.. > > > > But thank you for your advice! > > The container in the default 5.x install is a completely unmodified > Jetty 8.x (soon to be Jetty 9.x) with a stripped and optimized config. > The config for Jetty is similar to tomcat, you just need to figure out > how to make it work with Apache like you would with Tomcat. > > Incidentially, at least for right now, you CAN still take the .war file > out of the jetty install and put it in Tomcat just like you would have &g
apache 5.1.0 under apache web server
Hey all, I need to run solr 5.1.0 on port 80 with some basic apache authentication. Normally, under earlier versions of solr I would set it up to run under tomcat, then connect it to apache web server using mod_jk. However 5.1.0 seems totally different. I see that tomcat support has been removed from the latest versions. So how do I set this up in front of apache web server? I need to get this running on port 443 with SSL and something at least equivalent to basic apache auth. I really wish this hadn't changed because I could set this up under the old method rather easily and quickly. Sigh.. But thank you for your advice! Tim -- GPG me!! gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B
solr training
Hey guys, My company has a training budget that it wants me to use. So what I'd like to find out is if there is any instructor lead courses in the NY/NJ area, or courses online that are instructor lead that you could recommend? Thanks, Tim -- GPG me!! gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B
import community cassandra into solr
Hey folks, Is there any way that we know of to import the open source Apache version of the Cassandra database into Solr? I know that the pay for Datastax version has a connection built in. But we're not using that. Any thoughts or observations will be appreciated. Thanks, Tim -- GPG me!! gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B
Re: import 2 mysql tables into Solr 4
Hi Alex, On Tue, Nov 4, 2014 at 4:10 PM, Alexandre Rafalovitch wrote: > Looks right. Just remember to double check the preImportDeleteQuery > documentation to avoid surprises later > > Regards, >Alex. > Personal: http://www.outerthoughts.com/ and @arafalov > Solr resources and newsletter: http://www.solr-start.com/ and @solrstart > Solr popularizers community: https://www.linkedin.com/groups?gid=6713853 > > > On 4 November 2014 15:56, Tim Dunphy wrote: > > Hey Alexandre, > > > > Thanks for the example! This is what worked for me: > > > > > > > > > > > url="jdbc:mysql://web1.mydomain.com:3306/mydomain" user="admin" > > password=“secret” batchSize="1" /> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > name="user_activation_key" > > /> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Thank you again! > > > > > > Tim > > > > On Tue, Nov 4, 2014 at 3:12 PM, Alexandre Rafalovitch < > arafa...@gmail.com> > > wrote: > > > >> I can't remember what document element does, but I am quite sure the > >> entities just need to be side-by-side. > >> > >> See the example from my book: > >> > >> > https://github.com/arafalov/solr-indexing-book/blob/master/published/dihdb/conf/dih-definition.xml > >> > >> Notice that you need preImportDeleteQuery for each definition, > >> otherwise they will do "delete *" and break each other's content. > >> > >> Regards, > >>Alex. > >> Personal: http://www.outerthoughts.com/ and @arafalov > >> Solr resources and newsletter: http://www.solr-start.com/ and > @solrstart > >> Solr popularizers community: > https://www.linkedin.com/groups?gid=6713853 > >> > >> > >> On 4 November 2014 14:52, Tim Dunphy wrote: > >> > Hey all, > >> > > >> > I finally got mysql data into Solr 4 with your help. First off, thank > >> you > >> > for that! > >> > > >> > But now I'm hoping to refine the resulting process a bit. > >> > > >> > What I'm trying to do, now that mysql imports are working, is to > import > >> 2 > >> > separate tables from the same mysql database. I tried this in my xml > and > >> it > >> > doesn't work: > >> > > >> > > >> > >> > url="jdbc:mysql://web1.mydomain.com:3306/mydomain" user="admin" > >> > password=“secret” batchSize="1" /> > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > >> name="user_activation_key" > >> > /> > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > What happens is that the first table (document name mydomain_users) > gets > >> > imported. But the second table (document name mydomain_posts) does > not. > >> > > >> > Can anybody tell me what I'm doing wrong? I know that I need to get a > >> > little more used to using XML. > >> > > >> > Thanks > >> > Tim > >> > > >> > -- > >> > GPG me!! > >> > > >> > gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B > >> > > > > > > > > -- > > GPG me!! > > > > gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B > -- GPG me!! gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B
Re: import 2 mysql tables into Solr 4
> > Looks right. Just remember to double check the preImportDeleteQuery > documentation to avoid surprises later Sure! Sounds good. Thanks again. On Tue, Nov 4, 2014 at 4:10 PM, Alexandre Rafalovitch wrote: > Looks right. Just remember to double check the preImportDeleteQuery > documentation to avoid surprises later > > Regards, >Alex. > Personal: http://www.outerthoughts.com/ and @arafalov > Solr resources and newsletter: http://www.solr-start.com/ and @solrstart > Solr popularizers community: https://www.linkedin.com/groups?gid=6713853 > > > On 4 November 2014 15:56, Tim Dunphy wrote: > > Hey Alexandre, > > > > Thanks for the example! This is what worked for me: > > > > > > > > > > > url="jdbc:mysql://web1.mydomain.com:3306/mydomain" user="admin" > > password=“secret” batchSize="1" /> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > name="user_activation_key" > > /> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Thank you again! > > > > > > Tim > > > > On Tue, Nov 4, 2014 at 3:12 PM, Alexandre Rafalovitch < > arafa...@gmail.com> > > wrote: > > > >> I can't remember what document element does, but I am quite sure the > >> entities just need to be side-by-side. > >> > >> See the example from my book: > >> > >> > https://github.com/arafalov/solr-indexing-book/blob/master/published/dihdb/conf/dih-definition.xml > >> > >> Notice that you need preImportDeleteQuery for each definition, > >> otherwise they will do "delete *" and break each other's content. > >> > >> Regards, > >>Alex. > >> Personal: http://www.outerthoughts.com/ and @arafalov > >> Solr resources and newsletter: http://www.solr-start.com/ and > @solrstart > >> Solr popularizers community: > https://www.linkedin.com/groups?gid=6713853 > >> > >> > >> On 4 November 2014 14:52, Tim Dunphy wrote: > >> > Hey all, > >> > > >> > I finally got mysql data into Solr 4 with your help. First off, thank > >> you > >> > for that! > >> > > >> > But now I'm hoping to refine the resulting process a bit. > >> > > >> > What I'm trying to do, now that mysql imports are working, is to > import > >> 2 > >> > separate tables from the same mysql database. I tried this in my xml > and > >> it > >> > doesn't work: > >> > > >> > > >> > >> > url="jdbc:mysql://web1.mydomain.com:3306/mydomain" user="admin" > >> > password=“secret” batchSize="1" /> > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > >> name="user_activation_key" > >> > /> > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > > >> > What happens is that the first table (document name mydomain_users) > gets > >> > imported. But the second table (document name mydomain_posts) does > not. > >> > > >> > Can anybody tell me what I'm doing wrong? I know that I need to get a > >> > little more used to using XML. > >> > > >> > Thanks > >> > Tim > >> > > >> > -- > >> > GPG me!! > >> > > >> > gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B > >> > > > > > > > > -- > > GPG me!! > > > > gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B > -- GPG me!! gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B
Re: import 2 mysql tables into Solr 4
Hey Alexandre, Thanks for the example! This is what worked for me: Thank you again! Tim On Tue, Nov 4, 2014 at 3:12 PM, Alexandre Rafalovitch wrote: > I can't remember what document element does, but I am quite sure the > entities just need to be side-by-side. > > See the example from my book: > > https://github.com/arafalov/solr-indexing-book/blob/master/published/dihdb/conf/dih-definition.xml > > Notice that you need preImportDeleteQuery for each definition, > otherwise they will do "delete *" and break each other's content. > > Regards, >Alex. > Personal: http://www.outerthoughts.com/ and @arafalov > Solr resources and newsletter: http://www.solr-start.com/ and @solrstart > Solr popularizers community: https://www.linkedin.com/groups?gid=6713853 > > > On 4 November 2014 14:52, Tim Dunphy wrote: > > Hey all, > > > > I finally got mysql data into Solr 4 with your help. First off, thank > you > > for that! > > > > But now I'm hoping to refine the resulting process a bit. > > > > What I'm trying to do, now that mysql imports are working, is to import > 2 > > separate tables from the same mysql database. I tried this in my xml and > it > > doesn't work: > > > > > > > url="jdbc:mysql://web1.mydomain.com:3306/mydomain" user="admin" > > password=“secret” batchSize="1" /> > > > > > > > > > > > > > > > > > > name="user_activation_key" > > /> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > What happens is that the first table (document name mydomain_users) gets > > imported. But the second table (document name mydomain_posts) does not. > > > > Can anybody tell me what I'm doing wrong? I know that I need to get a > > little more used to using XML. > > > > Thanks > > Tim > > > > -- > > GPG me!! > > > > gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B > -- GPG me!! gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B
import 2 mysql tables into Solr 4
Hey all, I finally got mysql data into Solr 4 with your help. First off, thank you for that! But now I'm hoping to refine the resulting process a bit. What I'm trying to do, now that mysql imports are working, is to import 2 separate tables from the same mysql database. I tried this in my xml and it doesn't work: What happens is that the first table (document name mydomain_users) gets imported. But the second table (document name mydomain_posts) does not. Can anybody tell me what I'm doing wrong? I know that I need to get a little more used to using XML. Thanks Tim -- GPG me!! gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B
Re: Solr authentication
Shay, > Thanks for the quick response. No problem. > > 1. I'm using Solr with Jetty. > Yes. I got that from the fact that you were running Solr over port 8983. That's the Jetty port. I just didn't mention that in the email cuz I thought it was pretty obvious. :) But what I am saying you should do is to get Solr to run under Tomcat instead of Jetty. And then front it with apache. It'll be the only way to put authentication on your Solr instance that I know of. It's also pretty easy to do. And I did think that was the only way to secure solr. But after googling this question I do see there are some other ways to go about it. http://stackoverflow.com/questions/17613835/securing-solr-in-production But like I said the way I did this is pretty easy and that's what I'm recommending you do. > 2. I'm using Java to access Solr, so I need a way to pass / add > this authentication as well. You should have no trouble doing that with the way that I told you to set this up. If you do what I did you'll be using SSL. Which is the most secure you can get! Tim On Tue, Nov 4, 2014 at 8:49 AM, Shay Sofer wrote: > Thanks for the quick response. > > 1. I'm using Solr with Jetty. > 2. I'm using Java to access Solr, so I need a way to pass / add > this authentication as well. > > > > > -Original Message- > From: Tim Dunphy [mailto:bluethu...@gmail.com] > Sent: Tuesday, November 04, 2014 3:22 PM > To: solr-user@lucene.apache.org > Subject: Re: Solr authentication > > Hi Shay, > > I'm new to using Solr myself. But what I've done to solve this problem is > to run Solr via Tomcat. Then I put Apache in front of Tomcat using mod_jk > and made Solr accessible via SSL on port 443. I also put basic > authentication in front of Apache. That way you have to enter a username > and password to log in. > > Then I made port 8080 (the native port for Apache Tomcat) inaccessible > using the firewall. So that the only way to access the Solr instance was > through Apache and entering your password. With everything going over SSL. > It's very secure. > > From what I read about Solr, there are no security considerations (such as > using a password for access) built in. So the only way to achieve some > level of security without doing what I just did is to secure it with a > firewall. Making your Solr instance accessible only from certain IPs. > Please someone correct me if I'm wrong about that. > > But the way I did it with running Solr with Apache and SSL and mod_jk over > tomcat is pretty easy. If you google it you will find plenty of useful > guides out there on how to do this. I'd recommend taking that approach. > > Tim > > Sent from my iPhone > > > On Nov 4, 2014, at 7:53 AM, Shay Sofer wrote: > > > > Hi, > > > > I want that my Solr web connection will be protected by username and > password. > > > > When someone try to get to - 1.1.1.1:8983/Solr, he can do it only after > login (with known users). > > > > Is it possible ? > > > > Thanks, > > Shay. > > Email secured by Check Point > -- GPG me!! gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B
Re: Solr authentication
Hi Shay, I'm new to using Solr myself. But what I've done to solve this problem is to run Solr via Tomcat. Then I put Apache in front of Tomcat using mod_jk and made Solr accessible via SSL on port 443. I also put basic authentication in front of Apache. That way you have to enter a username and password to log in. Then I made port 8080 (the native port for Apache Tomcat) inaccessible using the firewall. So that the only way to access the Solr instance was through Apache and entering your password. With everything going over SSL. It's very secure. From what I read about Solr, there are no security considerations (such as using a password for access) built in. So the only way to achieve some level of security without doing what I just did is to secure it with a firewall. Making your Solr instance accessible only from certain IPs. Please someone correct me if I'm wrong about that. But the way I did it with running Solr with Apache and SSL and mod_jk over tomcat is pretty easy. If you google it you will find plenty of useful guides out there on how to do this. I'd recommend taking that approach. Tim Sent from my iPhone > On Nov 4, 2014, at 7:53 AM, Shay Sofer wrote: > > Hi, > > I want that my Solr web connection will be protected by username and password. > > When someone try to get to - 1.1.1.1:8983/Solr, he can do it only after login > (with known users). > > Is it possible ? > > Thanks, > Shay.
Re: Solr error : sorry, no dataimport-handler defined!
s, so they are being ignored. But
> still very very wrong. Take those out all together.
>
> You should just have 3 things tying together:
> 1) jars loaded in the lib statement in solrconfig.xml
> 2) handler definition that points at your data-config file
> 3) data-config file itself.
>
> If you are still having troubles, I strongly recommend getting the
> shipped example to work and then adding your own stuff until you get
> that working. Then, try to create a standalone configuration.
> Sometimes, this is an easier approach for the first time user.
>
> Regards,
>Alex.
> P.s. I also cover that in my Solr book. A relevant example is here:
> https://github.com/arafalov/solr-indexing-book/tree/master/published/dihdb
> Personal: http://www.outerthoughts.com/ and @arafalov
> Solr resources and newsletter: http://www.solr-start.com/ and @solrstart
> Solr popularizers community: https://www.linkedin.com/groups?gid=6713853
>
>
> On 3 November 2014 13:40, Tim Dunphy wrote:
> > Hi Alexandre,
> >
> > Thanks so much for your input and examples! Ok so here's what I've done
> so
> > far with no luck as of yet unfortunately.
> >
> > Inside of solrconfig.xml I put the following:
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > As you can see, I've replaced the relative paths with absolute ones. So
> as
> > of now, my solr 4 server is no longer complaining about not being able to
> > find directories and modules. So we're off to a good start! And now I can
> > list the 'dist' directory and in my case find the jar files I'm looking
> for.
> >
> >
> > [root@solr1:/opt/solr/collection1/conf] #ls /opt/solr/dist/ | grep
> > dataimporthandler
> > solr-dataimporthandler-4.10.1.jar
> > solr-dataimporthandler-extras-4.10.1.jar
> >
> > So far so good.
> >
> > I next tried this db-data-config file in the same directory as
> > solrconfig.xml
> >
> > [root@solr1:/opt/solr/collection1/conf] #cat db-data-config.xml.bak
> >
> >
> >
> >
> > > url="jdbc:mysql://web1.mydomain.com:3306/jokefire" user="admin"
> > password="secret" batchSize="1" />
> >
> >
> >
> >
> >
> >
> >
> >
> >
> > name="user_activation_key"
> > />
> >
> >
> >
> >
> >
> >
> >
> >
> > Restarted tomcat, and with this setup I wasn't getting any errors in the
> > browser or logs and the web interface was still working. Always a good
> sign!
> >
> > So then I went down to Core Selector -> collection1 -> data import. And
> it
> > was quite frustrating, cuz I was getting the same error as before!
> >
> > sorry, no dataimport-handler defined!
> >
> > So then I tried the exact db-data-config.xml file from your example.
> >
> >
> > > url="jdbc:hsqldb:./example-DIH/hsqldb/ex" user="sa" />
> >
> > > deltaQuery="select id from item where last_modified >
> > '${dataimporter.last_index_time}'">
> >
> >
> > > query="select DESCRIPTION from FEATURE where
> > ITEM_ID='${item.ID}'"
> > deltaQuery="select ITEM_ID from FEATURE where
> > last_modified > '${dataimporter.last_index_time}'"
> > parentDeltaQuery="select ID from item where
> > ID=${feature.ITEM_ID}">
> >
> >
> >
> > > query="select CATEGORY_ID from item_category where
> > ITEM_ID='${item.ID}'"
> > deltaQuery="select ITEM_ID, CATEGORY_ID from
> > item_category where last_modified > '${dataimporter.last_index_time}'"
> > parentDeltaQuery="select ID from item where
> > ID=${item_category.ITEM_ID}">
> > > query="select DESCRIPTION from category where ID
> =
> > '${item_category.CATEGORY_ID}'"
> > deltaQuery="select ID from category where
> > last_modified > '${dataimporter.last_index_time}'"
Re: Solr error : sorry, no dataimport-handler defined!
Hi Alexandre,
Thanks so much for your input and examples! Ok so here's what I've done so
far with no luck as of yet unfortunately.
Inside of solrconfig.xml I put the following:
**
As you can see, I've replaced the relative paths with absolute ones. So as
of now, my solr 4 server is no longer complaining about not being able to
find directories and modules. So we're off to a good start! And now I can
list the 'dist' directory and in my case find the jar files I'm looking for.
[root@solr1:/opt/solr/collection1/conf] #ls /opt/solr/dist/ | grep
dataimporthandler
*solr-dataimporthandler-4.10.1.jar*
*solr-dataimporthandler-extras-4.10.1.jar*
So far so good.
I next tried this db-data-config file in the same directory as
solrconfig.xml
[root@solr1:/opt/solr/collection1/conf] #cat db-data-config.xml.bak
Restarted tomcat, and with this setup I wasn't getting any errors in the
browser or logs and the web interface was still working. Always a good sign!
So then I went down to Core Selector -> collection1 -> data import. And it
was quite frustrating, cuz I was getting the same error as before!
*sorry, no dataimport-handler defined!*
So then I tried the exact db-data-config.xml file from your example.
Knowing full well it wouldn't actually work, as I"m using a remote mysql
database instead of a local hsqldb database.But at this point, my only goal
was to get the data import to show up as an option. I'd tweak the
db-data-config.xml file at a later point if this in fact worked!
But alas, I was still getting the same result...
*sorry, no dataimport-handler defined!*
G.. so annoying after all that work. Anyway, I really do appreciate
your kindness and help. :) I'm enclosing my solrconfig.xml and both
versions of my db-data-config.xml in hopes that we can make some progress
here!
Thank
Tim
On Sun, Nov 2, 2014 at 9:50 PM, Alexandre Rafalovitch
wrote:
> That tutorial seems to be somewhat dodgy. You need at least one more
> step of adding DIH library in solrconfig.xml:
>
> https://github.com/apache/lucene-solr/blob/lucene_solr_4_10_2/solr/example/example-DIH/solr/db/conf/solrconfig.xml#L75
> (I recommend using absolute path though).
>
> Also, you should not need to spell the full class out. See lower down
> in the same class:
>
> https://github.com/apache/lucene-solr/blob/lucene_solr_4_10_2/solr/example/example-DIH/solr/db/conf/solrconfig.xml#L823
>
> Finally, in the config file, I don't remember document element having
> a name. Again, the working example can be found in the same directory:
>
> https://github.com/apache/lucene-solr/blob/lucene_solr_4_10_2/solr/example/example-DIH/solr/db/conf/db-data-config.xml#L3
>
> Solr ships with a bunch of examples. If you are using/download
> standard distribution, you could start from those until you understand
> how it all hangs together.
>
> Regards,
>Alex.
>
> Personal: http://www.outerthoughts.com/ and @arafalov
> Solr resources and newsletter: http://www.solr-start.com/ and @solrstart
> Solr popularizers community: https://www.linkedin.com/groups?gid=6713853
>
>
> On 2 November 2014 21:26, Tim Dunphy wrote:
> > Hi Alex,
> >
> >
> >> I thought the ""
> >> and the ending span were broken email thing but they seem to be in the
> >> solrconfig.xml file as well. I would start from removing those and
> >> leaving just the actual definition.
> >
> >
> > Thanks for your response!
> >
> > OK so I tried your suggestion of removing those span tags like so:
> >
>
--
GPG me!!
gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B
4.10.1
${solr.data.dir:}
${solr.hdfs.home:}
${solr.hdfs.confdir:}
${solr.hdfs.blockcache.enabled:true}
${solr.hdfs.blockcache.global:true}
${solr.lock.type:native}
true
false
${solr.ulog.dir:}
${solr.autoCommit.maxTime:15000}
false
${solr.autoSoftCommit.maxTime:-1}
Re: Solr error : sorry, no dataimport-handler defined!
that, I still don't have the ability to import data from mysql. :( Any other ideas? Thanks, Tim On Sun, Nov 2, 2014 at 8:56 PM, Alexandre Rafalovitch wrote: > Well, > > I thought the "" > and the ending span were broken email thing but they seem to be in the > solrconfig.xml file as well. I would start from removing those and > leaving just the actual definition. > > Regards, >Alex. > Personal: http://www.outerthoughts.com/ and @arafalov > Solr resources and newsletter: http://www.solr-start.com/ and @solrstart > Solr popularizers community: https://www.linkedin.com/groups?gid=6713853 > > > On 2 November 2014 20:50, Tim Dunphy wrote: > > > > Hey guys, > > > > I'm real new at working with Solr. But I need to get up to speed and I > > appreciate your bearing with me. > > > > I've installed solr 4 and am running it under tomcat 7. The install went > > perfectly fine and everything seems to work, up to a point. I've even > > automated the installation with puppet which gets everything up and > running > > perfectly as well. > > > > However my problem is that I need to be able to import some data from a > > mysql database. > > > > I've followed this tutorial to try and do this: > > > > > > > http://www.beingjavaguys.com/2013/01/how-to-use-solr-data-import-handler-to.html > > > > > > I've added a file called data-config.xml to the following location under > my > > solr root: > > > > [root@solr1:/opt/solr/collection1/conf] #cat data-config.xml > > > > > > > > > url="jdbc:mysql://web1.mydomain.com:3306/mydomain" user="admin" > > password=“secret” batchSize="1" /> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > name="user_activation_key" /> > > > > > > > > > > > > > > > > > > > > > > > > > > > > And added the following section to my > > /opt/solr/collection1/conf/solrconfig.xml > > > >> name="/dataimport" > > class="org.apache.solr.handler.dataimport.DataImportHandler"> > > > > > > > >data-config.xml > > > > > > > > > > > > > > > > Then restart tomcat. I then navigate to collection1 -> data import in the > > solr admin interface and see the following response: > > > > sorry, no dataimport-handler defined! > > > > I am ok with parsing XML with my eyes. I've worked in some big > environments, > > where I've had to read it until my eyes bled! hah.. but I am not sure if > I > > am placing the section in solrconfig.xml that it needs to be. I'm > probably > > missing something obvious since I'm so new at using solr. I'm hoping > someone > > with more experience can point me in the right direction. > > > > I'm enclosing my solrconfig.xml files and data-config.xml in case someone > > wants to get a sense of the context that I'm working with. > > > > Thanks! > > > > -- > > GPG me!! > > > > gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B > > > -- GPG me!! gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B
Solr error : sorry, no dataimport-handler defined!
Hey guys,
I'm real new at working with Solr. But I need to get up to speed and I
appreciate your bearing with me.
I've installed solr 4 and am running it under tomcat 7. The install went
perfectly fine and everything seems to work, up to a point. I've even
automated the installation with puppet which gets everything up and running
perfectly as well.
However my problem is that I need to be able to import some data from a
mysql database.
I've followed this tutorial to try and do this:
http://www.beingjavaguys.com/2013/01/how-to-use-solr-data-import-handler-to.html
I've added a file called data-config.xml to the following location under my
solr root:
[root@solr1:*/opt/solr/collection1/con*f] #cat data-config.xml
And added the following section to
my /opt/solr/collection1/conf/solrconfig.xml
data-config.xml
Then restart tomcat. I then navigate to collection1 -> data import in the
solr admin interface and see the following response:
sorry, no dataimport-handler defined!
I am ok with parsing XML with my eyes. I've worked in some big
environments, where I've had to read it until my eyes bled! hah.. but I am
not sure if I am placing the section in solrconfig.xml that it needs to be.
I'm probably missing something obvious since I'm so new at using solr. I'm
hoping someone with more experience can point me in the right direction.
I'm enclosing my solrconfig.xml files and data-config.xml in case someone
wants to get a sense of the context that I'm working with.
Thanks!
--
GPG me!!
gpg --keyserver pool.sks-keyservers.net --recv-keys F186197B
4.10.1
${solr.data.dir:}
${solr.hdfs.home:}
${solr.hdfs.confdir:}
${solr.hdfs.blockcache.enabled:true}
${solr.hdfs.blockcache.global:true}
${solr.lock.type:native}
true
false
${solr.ulog.dir:}
${solr.autoCommit.maxTime:15000}
false
${solr.autoSoftCommit.maxTime:-1}
1024
true
20
200
static firstSearcher warming in solrconfig.xml
false
2
explicit
10
text
explicit
json
true
text
data-config.xml
true
json
true
{!xport}
xsort
false
query
explicit
velocity
browse
layout
Solritas
edismax
text^0.5 features^1.0 name^1.2 sku^1.5 id^10.0 manu^1.1 cat^1.4
title^10.0 description^5.0 keywords^5.0 author^2.0 resourcename^1.0
text
100%
*:*
10
*,score
text^0.5 features^1.0 name^1.2 sku^1.5 id^10.0 manu^1.1 cat^1.4
title^10.0 description^5.0 keywords^5.0 author^2.0 resourcename^1.0
text,features,name,sku,id,manu,cat,title,description,keywords,author,resourcename
3
on
true
cat
manu_exact
content_type
author_s
ipod
GB
1
cat,inStock
after
price
0
600
50
popularity
0
10
3
manufacturedate_dt
NOW/YEAR-10YEARS
NOW
+1YEAR
before
after
on
content features title name
true
html
0
title
0
name
3
200
content
750
on
false
5
2
5
true
true
5
3
spellcheck
true
ignored_
true
links
ignored_
