[ 
https://issues.apache.org/jira/browse/IGNITE-9357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16620452#comment-16620452
 ] 

Stephen Darlington commented on IGNITE-9357:
--------------------------------------------

I created a patch to this patch here:

[https://github.com/sdarlington/ignite/commit/15df75bf60ab3cbd6f6936131d26be560a026d22]

This is needed so that using an OffsetPolicy of 'timestamp' works correctly.

> Spark Structured Streaming with Ignite as data source and sink
> --------------------------------------------------------------
>
>                 Key: IGNITE-9357
>                 URL: https://issues.apache.org/jira/browse/IGNITE-9357
>             Project: Ignite
>          Issue Type: New Feature
>          Components: spark
>    Affects Versions: 2.7
>            Reporter: Alexey Kukushkin
>            Assignee: Alexey Kukushkin
>            Priority: Major
>
> We are working on a PoC where we want to use Ignite as a data storage and 
> Spark as a computation engine. We found that Ignite is supported neither as a 
> source nor as a Sink when using Spark Structured Streaming, which is a must 
> for us.
> We are enhancing Ignite to support Spark streaming with Ignite. We will send 
> docs and code for review for the Ignite Community to consider if the 
> community wants to accept this feature. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to