import data into solr from velocity (aka Solritas)
hello everyone, I did lots of search, and did not find a proper way to solve this problem, and it brings me to here ask for help. I am trying to import data from velocity into solr. I defined a new link which is localhost:8983/solr/collection1/browse/importdata. This webpage is used to collect the data imported. However, it seems the velocity is only able to define only one main template, in other words, I am not able to add one more webpage in this velocity UI. I also checked DIH (data import handler), it seems it only works with relational databases or XML files. My question is: how can I import data from velocity UI. Any input is welcome. -- View this message in context: http://lucene.472066.n3.nabble.com/import-data-into-solr-from-velocity-aka-Solritas-tp4164751.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: import data into solr from velocity (aka Solritas)
Could you elaborate more on what you're trying to do? You've defined a new request handler? You can use any template you want with the Velocity writer - v.template=template_name As for DIH - it can do a lot, database, XML, email, another Solr, etc. What kind of import are you trying to accomplish? Erik On Oct 18, 2014, at 01:36, LongY zhangyulin8...@hotmail.com wrote: hello everyone, I did lots of search, and did not find a proper way to solve this problem, and it brings me to here ask for help. I am trying to import data from velocity into solr. I defined a new link which is localhost:8983/solr/collection1/browse/importdata. This webpage is used to collect the data imported. However, it seems the velocity is only able to define only one main template, in other words, I am not able to add one more webpage in this velocity UI. I also checked DIH (data import handler), it seems it only works with relational databases or XML files. My question is: how can I import data from velocity UI. Any input is welcome. -- View this message in context: http://lucene.472066.n3.nabble.com/import-data-into-solr-from-velocity-aka-Solritas-tp4164751.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: import data into solr from velocity (aka Solritas)
Thanks a lot. Eric. I still used the same /browse request handler in the example. My goal is to create a webform UI to collect user input to be further indexed. My thoughts is adding a new webpage to the existing user interface, the link is localhost:8983/solr/collection1/browse/. I added a new link which is localhost:8983/solr/collection1/browse/importdata. The problem is: how to add a new webform in the existing velocity response writer. Velocity seems allow only one html layout file. Regarding DIH, it seems does not have this functionality. It is not able to collect the user input from a webpage, like a webform. -- View this message in context: http://lucene.472066.n3.nabble.com/import-data-into-solr-from-velocity-aka-Solritas-tp4164751p4164784.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: import data into solr from velocity (aka Solritas)
On 10/18/2014 8:15 AM, LongY wrote: I still used the same /browse request handler in the example. My goal is to create a webform UI to collect user input to be further indexed. My thoughts is adding a new webpage to the existing user interface, the link is localhost:8983/solr/collection1/browse/. I added a new link which is localhost:8983/solr/collection1/browse/importdata. The problem is: how to add a new webform in the existing velocity response writer. Velocity seems allow only one html layout file. I have no wish to disparage whoever built the /browse handler and/or whoever maintains it, even though it might seem like it with what I'm going to say below. I've only glanced at the code, but it does not look like a trivial work. It serves as an excellent example for Solr's capabilities, so it's really nice to have. If the code you are developing is intended to face the public, you do not want to use the /browse handler, and you do not want to utilize a javascript solr client. The reason is simple: These things require that the end user has direct access to your Solr server. If someone has direct access to your Solr server, it's wide open to them. They can change the index, delete the index, send crafted denial of service queries, etc. It's possible to put Solr behind an intelligent proxy that can detect these attempts and deny them, but configuring such a proxy is not an easy task. There's a special caveat for what you're trying to do: It would require leaving the indexing handler open, even through a proxy, so you'd have no protection against users changing your index to include whatever they want. If the audience for what you are writing is completely trustworthy and internal, and the web server will not face the Internet, then you can set it up any way you like without worry, use any technology you want. Thanks, Shawn
Re: import data into solr from velocity (aka Solritas)
Thanks for pointing this out. The web server I developed is only for internal use, and users are trustworthy. Yes, I agree with you. Velocity/Solaritas is never intended to be a user-facing app. It need a middleware layer if user is public. -- View this message in context: http://lucene.472066.n3.nabble.com/import-data-into-solr-from-velocity-aka-Solritas-tp4164751p4164787.html Sent from the Solr - User mailing list archive at Nabble.com.
Import Data Into Solr
Hi, all, I am a new user of Solr. Before using it, all of the data is indexed myself with Lucene. According to the Chapter 3 of the book, Solr. 1.4 Enterprise Search Server written by David Smiley and Eric Pugh, data in the formats of XML, CSV and even PDF, etc, can be imported to Solr. If I wish to import the Lucene indexes into Solr, may I have any other approaches? I know that Solr is a serverized Lucene. Thanks, Bing Li
Re: Import Data Into Solr
You can just point your Solr instance at your Lucene index. Really, copy the Lucene index into the right place to be found by solr. HOWEVER, you need to take great care that the field definitions that you used when you built your Lucene index are compatible with the ones configured in your schema.xml file. This is NOT a trivial task. I'd recommend that you try having Solr build your index, you'll probably want to sometime in the future anyway so you might as well bite the bullet now if possible... Plus, I'm not quite sure about version index issues. Best Erick On Thu, Dec 2, 2010 at 11:54 AM, Bing Li lbl...@gmail.com wrote: Hi, all, I am a new user of Solr. Before using it, all of the data is indexed myself with Lucene. According to the Chapter 3 of the book, Solr. 1.4 Enterprise Search Server written by David Smiley and Eric Pugh, data in the formats of XML, CSV and even PDF, etc, can be imported to Solr. If I wish to import the Lucene indexes into Solr, may I have any other approaches? I know that Solr is a serverized Lucene. Thanks, Bing Li
