[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009817#comment-16009817 ] Jan Høydahl commented on SOLR-5103: --- I'll use this as an umbrella and close it when sub-tasks are resolved. > Plugin Improvements > --- > > Key: SOLR-5103 > URL: https://issues.apache.org/jira/browse/SOLR-5103 > Project: Solr > Issue Type: Improvement > Components: Plugin system >Reporter: Grant Ingersoll >Assignee: Grant Ingersoll > Fix For: master (7.0) > > > I think for 5.0, we should make it easier to add plugins by defining a plugin > package, ala a Hadoop Job jar, which is a self--contained archive of a plugin > that can be easily installed (even from the UI!) and configured > programmatically. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009547#comment-16009547 ] Noble Paul commented on SOLR-5103: -- Should we close this ticket? We already have a plugin system in solr. It needs some polish and we should focus our efforts there > Plugin Improvements > --- > > Key: SOLR-5103 > URL: https://issues.apache.org/jira/browse/SOLR-5103 > Project: Solr > Issue Type: Improvement > Components: Plugin system >Reporter: Grant Ingersoll >Assignee: Grant Ingersoll > Fix For: master (7.0) > > > I think for 5.0, we should make it easier to add plugins by defining a plugin > package, ala a Hadoop Job jar, which is a self--contained archive of a plugin > that can be easily installed (even from the UI!) and configured > programmatically. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882518#comment-15882518 ] Jan Høydahl commented on SOLR-5103: --- I looked around a bit and saw that PF4J (https://github.com/decebals/pf4j) actually has been maintained and improved the last few years. Will probably try to do a POC at some point to see how well it fits with our needs. It even has pluggable UpdateManager support which could let us define e.g. Apache's Dist site as a plugin repository, and local disk as another one. That could be the piece we're looking for to be able to strip solr core download to a minimum and support e.g. {{bin/solr install velocity langid}}, or tell the installer to install it {{install_solr_service.sh solr-6.4.1.tgz -plugins velocity,langid}}. We could then have a new tag in solrconfig {{velocitylangid}} which would list the required dependencies and either refuse to start or trigger install. > Plugin Improvements > --- > > Key: SOLR-5103 > URL: https://issues.apache.org/jira/browse/SOLR-5103 > Project: Solr > Issue Type: Improvement >Reporter: Grant Ingersoll >Assignee: Grant Ingersoll > Fix For: 6.0 > > > I think for 5.0, we should make it easier to add plugins by defining a plugin > package, ala a Hadoop Job jar, which is a self--contained archive of a plugin > that can be easily installed (even from the UI!) and configured > programmatically. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14704464#comment-14704464 ] Jan Høydahl commented on SOLR-5103: --- bq. What happens if a plugin project uses one of the same dependent jars as Solr, but packages a wildly different version than the version we package? I think we don't need to re-invent OSGI to get a better plugin regime for Solr. We can document simple requirements for developers to follow. * Never include libraries or classes that is already part of core Lucene/Solr * In your {{solrplugin.properties}}, list the Solr version(s) that the plugin is tested with (and our tooling could require a {{--force}} option to disregard this and install anyway) * etc In the first version we can then simply add all jars in the plugin's {{/lib}} folder to classloader. Then if a future version of Solr causes trouble for an older plugin, the plugin maintainer must release a compatible update. When it comes to clashes between different 3rd party plugins we can tackle that with more advanced measures when it happens, or plugin developers could treat such cases as bugs and provide a fix themselves. For now let's keep it simple. Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: Trunk I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702902#comment-14702902 ] Jan Høydahl commented on SOLR-5103: --- The issue description is quite describing, isn't it? We're on-topic here as far as I can tell: {quote} I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. {quote} Solr's plugins today are really just Java classes that happen to implement a certain interface that we have defined as a plugin, and then it is up to the user to get hold of the plugin from somewhere, find a way to place it on the classpath, register the full class name into appropriate config file (varies depending on what the plugin does), restart Solr and then start using it. This JIRA is trying to define a broader pluging definition, where the Java class is just part of it all, where dependency jars and configuration could be packaged with the plugin, where the whole fetch-install-configure complexity is hidden and can be done by the click of a GUI button or running of one shell command. Besides - how many Solr plugins do you know of today in the wild? How do you find them? Most are just patches in JIRA, others have their own installers, yet others include some description of how to copy thing into various places, editing some XML files etc. The 3rd party market for cool new features will probably take off once we can offer such a simplified plugin architecture. And we won't force anyone, you can still plug classes in the manual way if you like. Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: Trunk I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702947#comment-14702947 ] Alexandre Rafalovitch commented on SOLR-5103: - I think that's a little more to a plugin than upload mechanics. There is a need for meta-data convention, dependency handling, versioning, etc. Supplementary UI. So, making upload mechanics could be a good first step, but the bigger picture needs to be kept in mind as well. BTW, Velocity loader apparently can load pages from the classpath. So, it might be possible to bundle pages with the plugin somehow already, if the classpath is setup right. Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: Trunk I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702985#comment-14702985 ] Jan Høydahl commented on SOLR-5103: --- bq. I think that's a little more to a plugin than upload mechanics. There is a need for meta-data convention, dependency handling, versioning, etc. Supplementary UI. Totally agree. But we need to start in one end. Perhaps defining the minimum zip/jar layout for what to constitute a plugin. What if we choose our own file ending, e.g. {.solrplugin} which is really just a zip file. Then a possible layout could be {noformat} my-plugin.solrplugin /solrplugin.properties -- defining e.g. name, version, dependencies etc /lib/ (jars to be added to classpath) /config/config-api-commands.json (a series of commands to be run towards config API) /config/schema-api-commands.json (a series of commands to be run towards config API) {noformat} Then, over time, we can evolve the spec and add support for pluggable UI etc. There are tons of questions to address too * Size limitation in blob store? * Should Solr unpack all libs from the {{.solrplugin}} pkg and add them individually to blob store, or write a classloader that adds everything directly from the zip? * What about version clash of dependencies - should not jeopardize the rest of the system * Should all plugins be system-level, and then require a new {{/collection/config install-plugin}} command to enable it for each collection? * What about system-level plugins, such as Authentication and Authorization plugins? Should {{security.json}} be auto updated when installing an auth plugin, or only if it does not exist already? * There should be a way to install plugins without registering the component with APIs, e.g. {{bin/solr installplugin solrcell -noregister}} * Uninstall of a plugin - it should also be able to unregister things from config / schema, for all collections where it is enabled (scary) First step is to see if there is enough committer interest in going down this path, then split things up into many smaller tasks that can be handled separately. Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: Trunk I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703009#comment-14703009 ] Noble Paul commented on SOLR-5103: -- If someone wants to offer a plugin with dependency jars , please make a jar with all the dependencies included. Once you make that assumption everything else becomes simpler. Then it is still possible to write a script which runs as follows {noformat} /bin/solr install-plugin xyz.jar -conf xyz.json -c collection1 {noformat} or we can package the xyz.jar in such a way that the META-INF contains {{plugin.json}} and the command can be simplified to {noformat} /bin/solr install-plugin xyz.jar -c collection1 {noformat} bq.Size limitation in blob store? as of now it is set to 5MB by default . However the user can increase it to any number with a command Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: Trunk I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702871#comment-14702871 ] Noble Paul commented on SOLR-5103: -- I fail to see what are you trying to solve here. Please give the problem statement and state the proposed solution. I guess it is worth opening a new ticket Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: Trunk I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702953#comment-14702953 ] Noble Paul commented on SOLR-5103: -- We don't yet have a concept of a plugin offering a UI . Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: Trunk I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703017#comment-14703017 ] Jan Høydahl commented on SOLR-5103: --- bq. If someone wants to offer a plugin with dependency jars , please make a jar with all the dependencies included. Well that is for us to dictate, isn't it? Who says the plugin format must conform to the JAR specs? Is it technically problematic to add all classes from multiple JARs from within a ZIP to a classloader? If yes, the user-facing plugin format could still be a zip with multiple jars in a lib folder, and our plugin installer code handles merging all jars together into one jar {{plugin-xyz-merged.jar}} which is the one being registered with the classloader? Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: Trunk I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703072#comment-14703072 ] Alexandre Rafalovitch commented on SOLR-5103: - Only the classloader leakage hell! :=( There is no standard mechanism for inlining the dependencies, though there are a couple of different approaches, all doing weird and less than wonderful things with classloader mechanisms. Something like http://maven.apache.org/plugins/maven-shade-plugin/ and http://docs.spring.io/spring-boot/docs/1.3.0.BUILD-SNAPSHOT/reference/htmlsingle/#executable-jar Or, of course, OSGI http://www.javaworld.com/article/2075836/description-of-osgi-layer.html Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: Trunk I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702972#comment-14702972 ] Alexandre Rafalovitch commented on SOLR-5103: - Actually, *wt=velocityv.template.x* allow to serve a velocity template around the search results. Unless broken by recent changes, etc. [~ehatcher] may be able to add details. And, if admin-extra was loaded from classpath, there might be a way to wire it in into UI automatically. It may not be pretty on the first round, but at least something like /browse might be more possible than expected. Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: Trunk I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702990#comment-14702990 ] Alexandre Rafalovitch commented on SOLR-5103: - My position is still that madness lies that way if we try to reinvent plugin management from scratch and that 3rd party solution may make better sense for that. Even if that solution is not perfect. But, on the other hand, I don't know internals of Solr well enough to know whether there is enough extensibility built-in to allow that. Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: Trunk I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703047#comment-14703047 ] Noble Paul commented on SOLR-5103: -- bq.Well that is for us to dictate, isn't it? Who says the plugin format must conform to the JAR specs? It's OK for the plugin format not conform to jar specs. The payload could be a zip file with multiple jars. But, is it a big deal to merge multiple jars. It solves a problem of name collisions. What if the same FQN of a class is found in two jars , which one to load? bq. and our plugin installer code handles merging all jars together into one jar plugin-xyz-merged.jar Please don't . The plugin installer should do as little magic as possible. Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: Trunk I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703050#comment-14703050 ] Shawn Heisey commented on SOLR-5103: bq. If someone wants to offer a plugin with dependency jars , please make a jar with all the dependencies included. Once you make that assumption everything else becomes simpler. I worry about this idea a little bit. Maybe I don't need to be worried. What happens if a plugin project uses one of the same dependent jars as Solr, but packages a wildly different version than the version we package? Are there any situations where that might cause a larger problem than using a little more memory? Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: Trunk I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702925#comment-14702925 ] Noble Paul commented on SOLR-5103: -- I guess I'm getting what you are trying to say Now we need to follow the following steps to register a plugin from a jar (using SOLR-7073) # upload the jar to {{.system}} collection # add the jar to collection classpath using the {{add-runtime-lib}} command # add the component using the {{add-companent-naam}} command So you are trying to eliminate step #3 here. Is that right ? Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: Trunk I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702955#comment-14702955 ] Jan Høydahl commented on SOLR-5103: --- bq. So you are trying to eliminate step #3 here. Is that right ? Not primarily. Your list is over simplified. Today: # Realize that there is a plugin for what you want to do # Locate and download that plugin # Read the docs and find and download any dependencies of the plugin #* Example: dist/solr-cell-5.0.0.jar is the plugin, and you also have 34 dependency jars from contrib/lib/ # For each jar required (35 in total): #* {{curl -X POST -H 'Content-Type: application/octet-stream' --data-binary @filename.jar http://localhost:8983/solr/.system/blob/name }} # For each collection in the system (that needs the plugin): #* For each jar that belongs to the plugin: #** Put each jar on the classpath for the collection #** {code} curl http://localhost:8983/solr/collection1/config -H 'Content-type:application/json' -d '{ add-runtimelib : {name: jarname , version:2 }, update-runtimelib :{name: jarname ,version:3}, delete-runtimelib :jarname }' {code} #** Register the plugin into config or schema or zookeeper or solr.xml depending on the type, e.g. #** {code} {add-searchcomponent: name:elevator, class:QueryElevationComponent, queryFieldType:string, config-file:elevate.xml } {code} Not to mention when you want to upgrade the plugin to a newer version, or uninstall it.. Now compare this to a click in the Admin UI or: {noformat} bin/solr installplugin solrcell 5.2.1 bin/solr removeplugin solrcell bin/solr installplugin solrcell 5.3.0 {noformat} Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: Trunk I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703087#comment-14703087 ] Erik Hatcher commented on SOLR-5103: bq. Actually, wt=velocityv.template.x allow to serve a velocity template around the search results. :) bq. And, if admin-extra was loaded from classpath, there might be a way to wire it in into UI automatically. It may not be pretty on the first round, but at least something like /browse might be more possible than expected. VrW has a VelocitySolrResourceLoader which pulls templates (anything textual would work), but it is constrained to only look under a `velocity/` sub-tree from the resource loader root. I'm not quite getting what you're getting at here though, but one can #parse another velocity template or #include anything textual with no parsing. And easily wrap a response with a layout to get headers/footers, etc. Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: Trunk I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703121#comment-14703121 ] Upayavira commented on SOLR-5103: - All the above seems to be describing OSGi, for which we have the Apache Felix project here at Apache. If we are considering plugins that can hold conflicting dependencies, that does seem the obvious way to go. Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: Trunk I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14702771#comment-14702771 ] Jan Høydahl commented on SOLR-5103: --- After we got SOLR-7073, we can now add a single {{.jar}} to a collection by uploading it to {{.system}} collection. Could we perhaps piggyback on this mechanism for full-blown plugins as well? I.e. we similarly upload a plugin, e.g. {{my-cool-responsewriter-plugin.zip}} to {{.system}}. Solr will then automatically inspect the zip, add jars to classpath and register the new responsewriter under its default name. On node start, we would iterate over all registered plugins in {{.system}} and register them. Perhaps a super generic way to support auto wiring is to allow scripts in the zip root, like {{config-api-commands.json}} and {{schema-api-commands.json}}, which will be replayed on load. Then a FieldType plugin can e.g. register itself with a {{fieldType}} and {{dynamicField}} in schema. The whole idea of such a zip format would be to encourage creation of 3rd party plugins that can be installed from AdminUI or {{bin/solr installplugin my-plugin.zip}}, and perhaps also more modularization of the Solr distro, i.e. our contribs would become plugins and not litter solrconfig.xml with config that is only active if a system property is enabled. Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: Trunk I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14223096#comment-14223096 ] Noble Paul commented on SOLR-5103: -- We don't yet have a uniform way to manage code+UI . To be honest , all UI is kind of an afterthought in Solr Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: Trunk I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14223110#comment-14223110 ] Alexandre Rafalovitch commented on SOLR-5103: - bq. We don't yet have a uniform way to manage code+UI . To be honest , all UI is kind of an afterthought in Solr Well, it will continue being an afterthought if you continue not thinking about it. May I suggest a thought experiment? Let's imagine we are shipping Solr Javadoc as a plugin. And it will be searchable (e.g. come with pre-built Solr collection). And the HTML itself is - ideally - compressed and is served that way. Now, we can walk through the aspects required to make it work. Maybe they will not all make it into 5, but the pieces that do line up should be on the critical path of making a specific scenario happen. The problem with plugins is that they seem easy but the real-life consequences of them get hairy very fast. I think Solr desperately needs plugins, but they need to be a bit more than a class in a jar. There needs to be some sort of management/flow/metadata to avoid fragmentation and user confusion. Does not have to be super-comprehensive in initial setup, just with some advance forethought. Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: Trunk I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14223627#comment-14223627 ] Jan Høydahl commented on SOLR-5103: --- There are existing lightweight frameworks out there, such as https://github.com/decebals/pf4j, loading all plugins found in a folder. Looks pretty extensible.. Adding a {{bin/plugin}} script for install/uninstall from a repo or github would also be cool. Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: Trunk I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14223688#comment-14223688 ] Alexandre Rafalovitch commented on SOLR-5103: - What about something like OSGI? It might be a little heavier but I suspect addresses a bunch of questions that we would be fighting through until Solr 7 otherwise. And there is a corresponding Apache project: http://felix.apache.org/ (and others on top, I think). Which, I am sure, comes with built-in community and tooling support. Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: Trunk I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222128#comment-14222128 ] Alexandre Rafalovitch commented on SOLR-5103: - It may be worth considering that plugin may contain more than code. For example, it may contain AdminUI screens, similar to those *admin-extra* files. Elasticsearch has something like this. There might also be some sort of dependency in there to avoid *jar rabbits* (multiple copies of the same shaded jars). Elasticsarch does NOT seem to have something like this. On the positive side, a website to track the plugins and dependencies would make for a very nice Solr demo project and would help the community actually start contributing things as plugins, once the visibility part is solved :-) Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: Trunk I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193973#comment-14193973 ] Jan Høydahl commented on SOLR-5103: --- Also see from mailing list: http://search-lucene.com/m/WwzTb2jQWpl1 Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: Trunk I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13730663#comment-13730663 ] Grant Ingersoll commented on SOLR-5103: --- Hoss, A few of my thoughts on it: # I don't think the config necessarily needs to be in the plugin. Part of the goal here is to be able to easily add a plugin and then easily configure it and manage it (from the UI?). # Plugins should be self-contained and (ideally) class loader isolated # You shouldn't necessarily have to restart Solr in order to add a plugin Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: 5.0 I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13730846#comment-13730846 ] Mark Miller commented on SOLR-5103: --- I think we would still need a configuration option that does not involve Java. Other than that, I don't really see too many issues. As far as names, it could possibly default to the name of the plugin jar or something else and first one wins, second one fails. We could also namespace, kind of how you see with eclipse. Honestly though, nothing sounds much better than a simple config file with the jar, same name or whatever, that has the plugin name or url. Probably that's the default minimal setup - even if you can delete that file and run with some default names or whatever for plugins that don't require any config. I think the path is obviously right - you see it used plenty elsewhere, and it resonates with me. But I think Hoss is right in that the common case will still need configuration. I don't see how the two points argue with each other though. We will need to be able to configure with a user friendly format - most plugins will have that - if not just to show the user what can be configured. There is no reason we have to require it though. Some plugin might simply be there to insert some custom code on startup. Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: 5.0 I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13729137#comment-13729137 ] Noble Paul commented on SOLR-5103: -- does it have a custom format for the plugin jar? some kind of a meta-data along with the jar? Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: 5.0 I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13729372#comment-13729372 ] Grant Ingersoll commented on SOLR-5103: --- Tying this in w/ Guice, I _think_ we can get away w/o any meta-data, but instead the plugin will need to provide an AbstractModule (maybe even not) and then they can configure the plugin via an API, or it can also default. Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: 5.0 I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13729403#comment-13729403 ] Noble Paul commented on SOLR-5103: -- In any plugin loading , we may just need a Plugin class name and probably that is it If the plugin has dependency jars, do you expect it to be a part of the jar itself? Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: 5.0 I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13729404#comment-13729404 ] Grant Ingersoll commented on SOLR-5103: --- bq. If the plugin has dependency jars, do you expect it to be a part of the jar itself? Yes, I'm thinking something along the lines of Hadoop Job Jar. Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: 5.0 I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13729412#comment-13729412 ] Uwe Schindler commented on SOLR-5103: - Theoretically you can put references to additional JARs, that are needed for running, into the META-INF/MANIFEST.MF file as classpath. I have not tried this, but it works e.g. for {{java -jar something.jar}}. If something.jar has additional JARs in its manifest, those are added to classpath. See http://docs.oracle.com/javase/tutorial/deployment/jar/downman.html Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: 5.0 I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13729905#comment-13729905 ] Hoss Man commented on SOLR-5103: bq. a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. bq. +1 for this! Keep the configuration w/ the plugin and don't require any central place to wire it up. can someone give me a practical/hypothetical example of what this would look like to someone setting up a solr instance? For all the examples i can think of, this doens't really make sens to me -- specifically: all of the existing plugins you can find in solr/contrib ... are we expecting users to JAR up their own copy of DIH with it's config inside of it's jar? are we expecting people who want to use the langid update processor to re-jar it with some bit of config snippet that tells it what fields to populate and what langauge to look for? ... and then what? they drop that jar into some directory, and it still does nothing until they programatically use some API to say which of their (possibly may) update processor chains they want it to be a part of, and where in the chain it should execute? Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: 5.0 I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13729932#comment-13729932 ] Yonik Seeley commented on SOLR-5103: bq. can someone give me a practical/hypothetical example of what this would look like to someone setting up a solr instance? Small stuff shouldn't need any configuration... for instance a custom QParser should just be able to work if it's in the classpath. bq. are we expecting users to JAR up their own copy of DIH with it's config inside of it's jar? I hope not. That would seem like a step backwards in usability. Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: 5.0 I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13729972#comment-13729972 ] Hoss Man commented on SOLR-5103: bq. Small stuff shouldn't need any configuration... for instance a custom QParser should just be able to work if it's in the classpath. Ok, so something like a QParserPlugin could *optionally* register itself using a default name hardcoded in it's code (similar to how SolrCore auto-wires the default QParsers that come with solr-core out of hte box) ... but how would that work if multiple plugins try to use the same name? (in solr-core we can ensure that doesn't happen, and we don't register something with the same name as a qparser explicitly registered via users configuration) Not to mention you'd still need to support a method of explicitly registering QParserPlugins since it might support init params that you want to specify (none of hte out of the box QParsers do, but it's possible, and we shouldn't take that customization away) QParsers really seem like the special case not the common case as far as plugins go and this sort of hypothetical automatic loading registration ... FieldTypes, Analysis factories, search components, request handlers, ... these are all things i'm hard pressed to imagine being useul w/o some sort of explicit this is how i want to use it type information from the person admining the solr instance. Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: 5.0 I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728840#comment-13728840 ] Grant Ingersoll commented on SOLR-5103: --- I don't see any downside to it, but the classloader stuff can get real hairy. Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: 5.0 I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728138#comment-13728138 ] Grant Ingersoll commented on SOLR-5103: --- Should be noted that we would want classloader isolation for this packaging. Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: 5.0 I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728149#comment-13728149 ] Yonik Seeley commented on SOLR-5103: +1 for this! Keep the configuration w/ the plugin and don't require any central place to wire it up. bq. Should be noted that we would want classloader isolation for this packaging. Any downsides to that? Also, any reason it can't be in 4x (provided it's done in time?) Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: 5.0 I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5103) Plugin Improvements
[ https://issues.apache.org/jira/browse/SOLR-5103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13726362#comment-13726362 ] Grant Ingersoll commented on SOLR-5103: --- https://code.google.com/p/google-guice/wiki/Multibindings has some baseline good ideas in it, see SOLR-5091 as well for how Guice gets brought in. Plugin Improvements --- Key: SOLR-5103 URL: https://issues.apache.org/jira/browse/SOLR-5103 Project: Solr Issue Type: Improvement Reporter: Grant Ingersoll Assignee: Grant Ingersoll Fix For: 5.0 I think for 5.0, we should make it easier to add plugins by defining a plugin package, ala a Hadoop Job jar, which is a self--contained archive of a plugin that can be easily installed (even from the UI!) and configured programmatically. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org