Re: What's the actual story with new morphline and hadoop contribs?

2014-09-18 Thread rulinma
I think it is useful to dirstribute index and then merge to solr. Cloudear use it often. But reference is too less to understand. -- View this message in context: http://lucene.472066.n3.nabble.com/What-s-the-actual-story-with-new-morphline-and-hadoop-contribs-tp4130999p4159830.html Sent from

Re: What's the actual story with new morphline and hadoop contribs?

2014-04-15 Thread Wolfgang Hoschek
The solr morphline jars are integrated with solr by way of the solr specific solr/contrib/map-reduce module. Ingestion from Flume into Solr is available here: http://flume.apache.org/FlumeUserGuide.html#morphlinesolrsink FWIW, for our purposes we see no role for DataImportHandler anymore.

What's the actual story with new morphline and hadoop contribs?

2014-04-14 Thread Alexandre Rafalovitch
Hello, I saw that 4.7.1 has morphline and hadoop contribution libraries, but I can't figure out the degree to which they are useful to _Solr_ users. I found one hadoop example in the readme that does some sort injection into Solr. Is that the only use case supported? I thought that maybe there

Re: What's the actual story with new morphline and hadoop contribs?

2014-04-14 Thread Wolfgang Hoschek
Currently all Solr morphline use cases I’m aware of run in processes outside of the Solr JVM, e.g. in Flume, in MapReduce, in HBase Lily Indexer, etc. These ingestion processes generate Solr documents for Solr updates. Running in external processes is done to improve scalability, reliability,

Re: What's the actual story with new morphline and hadoop contribs?

2014-04-14 Thread Alexandre Rafalovitch
The use case I keep thinking about is Flue/Morphline replacing DataImportHandler. So, when I saw morphline shipped with Solr, I tried to understand whether it is a step towards it. As it is, I am still not sure I understand why those jars are shipped with Solr, if it is not actually integrating