[ 
https://issues.apache.org/jira/browse/SPARK-3270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14161585#comment-14161585
 ] 

Apache Spark commented on SPARK-3270:
-------------------------------------

User 'mmalohlava' has created a pull request for this issue:
https://github.com/apache/spark/pull/2691

> Spark API for Application Extensions
> ------------------------------------
>
>                 Key: SPARK-3270
>                 URL: https://issues.apache.org/jira/browse/SPARK-3270
>             Project: Spark
>          Issue Type: New Feature
>          Components: Spark Core
>            Reporter: Michal Malohlava
>
> Any application should be able to enrich spark infrastructure by services 
> which are not available by default.  
> Hence, to support such application extensions (aka "extesions"/"plugins") 
> Spark platform should provide:
>   - an API to register an extension 
>   - an API to register a "service" (meaning provided functionality)
>   - well-defined points in Spark infrastructure which can be enriched/hooked 
> by extension
>   - a way of deploying extension (for example, simply putting the extension 
> on classpath and using Java service interface)
>   - a way to access extension from application
> Overall proposal is available here: 
> https://docs.google.com/document/d/1dHF9zi7GzFbYnbV2PwaOQ2eLPoTeiN9IogUe4PAOtrQ/edit?usp=sharing
> Note: In this context, I do not mean reinventing OSGi (or another plugin 
> platform) but it can serve as a good starting point.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to