I'll start with Kafka implementation. Thanks for all the help. On Mar 21, 2014 7:00 PM, "anoldbrain [via Apache Spark User List]" < ml-node+s1001560n2994...@n3.nabble.com> wrote:
> It is my understanding that there is no way to make FlumeInputDStream work > in a cluster environment with the current release. Switch to Kafka, if you > can, would be my suggestion, although I have not used KafkaInputDStream. > There is a big difference between Kafka and Flume InputDstream: > KafkaInputDStreams are consumers (clients). FlumeInputDStream, which needs > to listen on a specific address:port so other flume agent can send messages > to. This may also give Kafka an advantage on performance too. > > ------------------------------ > If you reply to this email, your message will be added to the discussion > below: > > http://apache-spark-user-list.1001560.n3.nabble.com/How-to-use-FlumeInputDStream-in-spark-cluster-tp1604p2994.html > To unsubscribe from How to use FlumeInputDStream in spark cluster?, click > here<http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=1604&code=cmF2aWlpaGVtbmFuaUBnbWFpbC5jb218MTYwNHwtMTk4NTIxNTA1Nw==> > . > NAML<http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml> > -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-use-FlumeInputDStream-in-spark-cluster-tp1604p2997.html Sent from the Apache Spark User List mailing list archive at Nabble.com.
