You may also want to look at the existing systems, such as https://nifi.apache.org/
Regards, Alex. On Mon, 8 Jul 2019 at 08:23, Joseph_Tucker <joseph.tuc...@homehardware.ca> wrote: > > Thanks again. > > I guess I'll have to start researching how to create such custom indexing > scripts and determine which language would be best based on the environment > I'm using (Azure in this case). > > Appreciate the help greatly > > > > > Charlie Hull-3 wrote > > On 05/07/2019 14:33, Joseph_Tucker wrote: > >> Thanks for your help / suggestion. > >> > >> I'm not sure I completely follow in this case. > >> SolrJ looks like a method to allow Java applications to talk to Solr, or > >> any > >> other third party application would simply be a communication method > >> between > >> Solr and the language of your choosing. > >> > >> I guess what I'm after is, how would using SolrJ improve performance when > >> indexing? > > > > It's not just about improving performance (although DIH is single > > threaded, so you could obtain a marked indexing performance gain using a > > client such as SolrJ). With DIH you will embed a lot of SQL code into > > Solr's configuration files, and the more sources you add the more > > complicated, hard to debug and unmaintainable it's going to be. You > > should thus consider writing a proper indexing script in Java, Python or > > whatever language you are most familiar with - this has always been our > > approach. > > > > Best > > > > > > Charlie > > > >> > >> *** I could be wrong in my assumptions as I'm still learning a great deal > >> about Solr. *** > >> > >> I appreciate your help > >> > >> Regards, > >> > >> Joe > >> > >> > >> > >> -- > >> Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html > > > > > > -- > > Charlie Hull > > Flax - Open Source Enterprise Search > > > > tel/fax: +44 (0)8700 118334 > > mobile: +44 (0)7767 825828 > > web: www.flax.co.uk > > > > > > -- > Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html
