I have a spark streaming zmq application running fine in non-cluster mode. When running a local cluster and I do spark-submit, zero mq java client is choking.
org.zeromq.ZMQException: No such file or directory at org.zeromq.ZMQ$Socket.raiseZMQException(ZMQ.java:480) at org.zeromq.ZMQ$Socket.recv(ZMQ The classpath has jzmq jar and the java.library.path points to /usr/local/lib which has the zmq bindings. The compilation of jzmq et all are fine as non-cluster application works fine, this seems to be some env parameter not getting passed onto the executor correctly... Any clues on what I might be missing?
