Sameday it would be nice to see DIH be able to run in its own JVM for just the reason Jack mentions. There are quite a few neat things like this that could be done with DIH, but I've tried to work more on improving the tests, fixing bugs, and generally making the code more attractive to developers. I don't think DIH has a chance to really "grow up" until these types of things get done.
I know nothing about solr cell except a few people on the mailing list have been burned trying to run it in production only to learn that it doesn't scale. At least that's the general gist I've heard: "for prototyping purposes only". Maybe if it is re-architectured as a stand-alone app it would fare better? James Dyer Ingram Content Group (615) 213-4311 -----Original Message----- From: Shawn Heisey [mailto:[email protected]] Sent: Friday, March 22, 2013 9:07 PM To: [email protected] Subject: Re: Mini-proposal: Standalone Solr DIH and SolrCell jars On 3/22/2013 7:04 PM, Jack Krupansky wrote: > I wanted to get some preliminary feedback before filing this proposal as > a Jira(s): > > Package Solr Data Import Handler and Solr Cell as standalone jars with > command line interfaces to run as separate processes to promote more > efficient distributed processing, both by separating them from the Solr > JVM and allowing multiple instances running in parallel on multiple > machines. And to make it easier for mere mortals to customize the > ingestion code without diving deep into core Solr. That's a really interesting idea. You mentioned having them be grown-up siblings of the SimplePostTool, which would imply that the jar would be directly executable. What would be the mechanism for configuring it and getting DIH status? An alternate idea, if it's feasible, would be that you could drop the jar and its dependencies into a lib directory and embed into an index update application. Hopefully it is only tied to SolrJ, not deep Solr or Lucene internals. I haven't checked. Thanks, Shawn --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
