[
https://issues.apache.org/jira/browse/IGNITE-532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14381533#comment-14381533
]
Dmitriy Setrakyan edited comment on IGNITE-532 at 3/26/15 8:06 AM:
-------------------------------------------------------------------
As far as the proposed sequence, I would need some clarification. It just seems
to me that this sequence would work faster than the one you are suggesting:
{noformat}
[akka actor] -> [ignite-data-streamer]
{noformat}
I also think that we may need this as well
{noformat}
akka-stream -> [akka stream flow (conversion)] -> [ignite-data-streamer]
{noformat}
Perhaps we should support both?
I don't think you need to extend {{DataStreamerImpl}} class. I think using
public Ignite API and delegating from your Akka code directly to
{{IgniteDataStreamer}} is a better approach, e.g.
{code}
IgniteDataStreamer stmr = ignite.dataStreamer("myStreamName");
stmr.addData(...);
{code}
Let me know what you think.
was (Author: dsetrakyan):
As far as the proposed sequence, I would need some clarification. It just seems
to me that this sequence would work faster than the one you are suggesting:
{noformat}
[akka actor] -> [ignite-data-streamer]
{noformat}
I also think that we may need this as well
{noformat}
akka-stream -> [akka stream flow (conversion)] -> [ignite-data-streamer]
{noformat}
Perhaps we should support both?
I don't think you need to extend {{DataStreamerImpl}} class. I think using
public Ignite API and delegating from your Akka code directly to
{{IgniteDataStreamer}} is a better approach.
Let me know what you think.
> Implement IgniteAkkaStreamer to stream data from Akka actors.
> -------------------------------------------------------------
>
> Key: IGNITE-532
> URL: https://issues.apache.org/jira/browse/IGNITE-532
> Project: Ignite
> Issue Type: Sub-task
> Components: streaming
> Reporter: Dmitriy Setrakyan
> Assignee: Joshua Goldie
>
> We have {{IgniteDataStreamer}} which is used to load data into Ignite under
> high load. It was previously named {{IgniteDataLoader}}, see ticket
> IGNITE-394.
> See [Akka|http://akka.io/] for more information. Given that Akka is a Scala
> frameworks, this streamer should be available in Scala.
> We should create {{IgniteAkkaStreamer}} which will consume messages from Akka
> Actors and stream them into Ignite caches.
> More details to follow, but to the least we should be able to:
> * Convert data from Akka to Ignite using an optional pluggable converter. If
> not provided, then we should have some default mechanism.
> * Specify the cache name for the Ignite cache to load data into.
> * Specify other flags available on {{IgniteDataStreamer}} class.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
