[
https://issues.apache.org/jira/browse/IGNITE-9357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Kukushkin updated IGNITE-9357:
-------------------------------------
Description:
We are working on a PoC where we want to use Ignite as a data storage and Spark
as a computation engine. We found that Ignite is supported neither as a source
nor as a Sink when using Spark Structured Streaming, which is a must for us.
We are enhancing Ignite to support Spark streaming with Ignite. We will send
docs and code for review for the Ignite Community to consider if the community
wants to accept this feature.
was:
We are working on a PoC where we want to use Ignite as a data storage and Spark
as a computation engine. We found that Ignite is not supported neither as a
source nor as a Sink when using Spark Structured Streaming, which is a must for
us.
We are enhancing Ignite to support Spark streaming with Ignite. We will send
docs and code for review for the Ignite Community to consider if the Community
want to accept this feature.
> Spark Structured Streaming with Ignite as data source and sink
> --------------------------------------------------------------
>
> Key: IGNITE-9357
> URL: https://issues.apache.org/jira/browse/IGNITE-9357
> Project: Ignite
> Issue Type: New Feature
> Components: spark
> Affects Versions: 2.7
> Reporter: Alexey Kukushkin
> Assignee: Alexey Kukushkin
> Priority: Major
>
> We are working on a PoC where we want to use Ignite as a data storage and
> Spark as a computation engine. We found that Ignite is supported neither as a
> source nor as a Sink when using Spark Structured Streaming, which is a must
> for us.
> We are enhancing Ignite to support Spark streaming with Ignite. We will send
> docs and code for review for the Ignite Community to consider if the
> community wants to accept this feature.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)