[
https://issues.apache.org/jira/browse/SPARK-4605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225308#comment-14225308
]
David Fallside commented on SPARK-4605:
---------------------------------------
Yes, the proposal is to merge it into Spark rather than it being an external
package. With regard making the code available for review, the project is not
yet hosted anywhere although we expect to make it available shortly within a
week or two.
> Proposed Contribution: Spark Kernel to enable interactive Spark applications
> ----------------------------------------------------------------------------
>
> Key: SPARK-4605
> URL: https://issues.apache.org/jira/browse/SPARK-4605
> Project: Spark
> Issue Type: New Feature
> Reporter: Chip Senkbeil
> Attachments: Kernel Architecture Widescreen.pdf, Kernel
> Architecture.pdf
>
>
> This architecture is describing running kernel code that was demonstrated at
> the StrataConf in Barcelona, Spain.
> ----
> Enables applications to interact with a Spark cluster using Scala in several
> ways:
> * Defining and running core Spark Tasks
> * Collecting results from a cluster without needing to write to external data
> store
> ** Ability to stream results using well-defined protocol
> * Arbitrary Scala code definition and execution (without submitting
> heavy-weight jars)
> Applications can be hosted and managed separate from the Spark cluster using
> the kernel as a proxy to communicate requests.
> The Spark Kernel implements the server side of the IPython Kernel protocol,
> the rising “de-facto” protocol for language (Python, Haskell, etc.) execution.
> Inherits a suite of industry adopted clients such as the IPython Notebook.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
