[
https://issues.apache.org/jira/browse/IGNITE-530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14907865#comment-14907865
]
Anton Vinogradov commented on IGNITE-530:
-----------------------------------------
Hello,
it's better to use mock developed by twitter in case it exists. Own mock should
be created only in case no third-party implementation exists.
call() method should not be marked as throws Exception. InterruptedException
should be handled around tweetQueue.take().
tweetStreamProcesser.shutdownNow() should be used to interrupt thread from
waiting at tweetQueue.take() before stopping client.
> Implement IgniteTwitterStreamer to stream data from Twitter feeds
> -----------------------------------------------------------------
>
> Key: IGNITE-530
> URL: https://issues.apache.org/jira/browse/IGNITE-530
> Project: Ignite
> Issue Type: Sub-task
> Components: streaming
> Reporter: Dmitriy Setrakyan
> Assignee: Lalit Kumar Jha
>
> We have {{IgniteDataStreamer}} which is used to load data into Ignite under
> high load. It was previously named {{IgniteDataLoader}}, see ticket
> IGNITE-394.
> We should create {{IgniteTwitterStreamer}} which will consume messages from
> Twitter and stream them into Ignite caches.
> More details to follow, but to the least we should be able to:
> * Convert Twitter data to Ignite data using an optional pluggable converter.
> * Specify the cache name for the Ignite cache to load data into.
> * Specify other flags available on {{IgniteDataStreamer}} class.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
