[ 
https://issues.apache.org/jira/browse/BAHIR-66?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16704523#comment-16704523
 ] 

ASF subversion and git services commented on BAHIR-66:
------------------------------------------------------

Commit fb752570c7ac817b414c738e05b751dd5864feb6 in bahir's branch 
refs/heads/master from [~lukasz.antoniak]
[ https://git-wip-us.apache.org/repos/asf?p=bahir.git;h=fb75257 ]

[BAHIR-66] Switch to Java binding for ZeroMQ

Initially, I just wanted to implement integration test for BAHIR-66.
Google pointed me to JeroMQ, which provides official ZeroMQ binding
for Java and does not require native libraries. I have decided to give
it a try, but quickly realized that akka-zeromq module (transient
dependency from current Bahir master) is not compatible with JeroMQ.
Actually Akka team also wanted to move to JeroMQ (akka/akka#13856),
but in the end decided to remove akka-zeromq project completely
(akka/akka#15864, https://www.lightbend.com/blog/akka-roadmap-update-2014).

Having in mind that akka-zeromq does not support latest version of ZeroMQ
protocol and further development may come delayed, I have decided to refactor
streaming-zeromq implementation and leverage JeroMQ. With the change we receive
various benefits, such as support for PUB-SUB and PUSH-PULL messaging patterns
and the ability to bind the socket on whatever end of communication channel
(see test cases), subscription to multiple channels, etc. JeroMQ seems pretty
reliable and reconnection is handled out-of-the-box. Actually, we could even
start the ZeroMQ subscriber trying to connect to remote socket before other
end created and bound the socket. While I tried to preserve backward 
compatibility
of method signatures, there was no easy way to support Akka API and business
logic that users could put there (e.g. akka.actor.ActorSystem).

Closes #71


> Add test that ZeroMQ streaming connector can receive data
> ---------------------------------------------------------
>
>                 Key: BAHIR-66
>                 URL: https://issues.apache.org/jira/browse/BAHIR-66
>             Project: Bahir
>          Issue Type: Sub-task
>          Components: Spark Streaming Connectors
>            Reporter: Christian Kadner
>            Priority: Major
>              Labels: test
>
> Add test cases that verify that the *ZeroMQ streaming connector* can receive 
> streaming data.
> See [BAHIR-63|https://issues.apache.org/jira/browse/BAHIR-63]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to