dynamically change receiver for a spark stream

2015-03-03 Thread Islem
AND_DISK_2()); JavaDStream tweets = ssc.receiverStream(receiver); its working but i need to upgrade filteru by adding id of other users without stopping stream . thanks, -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/dynamically-change-receiver-f

Re: dynamically change receiver for a spark stream

2015-01-21 Thread Tamas Jambor
t;>>>> I don't think current Spark Streaming support this feature, all the >>>>> DStream lineage is fixed after the context is started. >>>>> >>>>> Also stopping a stream is not supported, instead currently we need to >>>>> st

Re: dynamically change receiver for a spark stream

2015-01-21 Thread Gerard Maas
t think current Spark Streaming support this feature, all the >>>> DStream lineage is fixed after the context is started. >>>> >>>> Also stopping a stream is not supported, instead currently we need to >>>> stop the whole streaming context to

Re: dynamically change receiver for a spark stream

2015-01-21 Thread Tamas Jambor
context is started. >>> >>> Also stopping a stream is not supported, instead currently we need to >>> stop the whole streaming context to meet what you want. >>> >>> Thanks >>> Saisai >>> >>> -Original Message- >>>

Re: dynamically change receiver for a spark stream

2015-01-21 Thread Gerard Maas
rently we need to >> stop the whole streaming context to meet what you want. >> >> Thanks >> Saisai >> >> -Original Message- >> From: jamborta [mailto:jambo...@gmail.com] >> Sent: Wednesday, January 21, 2015 3:09 AM >> To: user@spark.apache.org &g

Re: dynamically change receiver for a spark stream

2015-01-21 Thread Tamas Jambor
Wednesday, January 21, 2015 3:09 AM > To: user@spark.apache.org > Subject: dynamically change receiver for a spark stream > > Hi all, > > we have been trying to setup a stream using a custom receiver that would > pick up data from sql databases. we'd like to keep that stream context &g

RE: dynamically change receiver for a spark stream

2015-01-20 Thread Shao, Saisai
ssage- From: jamborta [mailto:jambo...@gmail.com] Sent: Wednesday, January 21, 2015 3:09 AM To: user@spark.apache.org Subject: dynamically change receiver for a spark stream Hi all, we have been trying to setup a stream using a custom receiver that would pick up data from sql databases. we'

Re: dynamically change receiver for a spark stream

2015-01-20 Thread Akhil Das
user-list.1001560.n3.nabble.com/dynamically-change-receiver-for-a-spark-stream-tp21268.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > - > To unsubscribe, e-mail: user-unsubscr

dynamically change receiver for a spark stream

2015-01-20 Thread jamborta
is it possible to stop a stream, change to config and start again? thanks, -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/dynamically-change-receiver-for-a-spark-stream-tp21268.html Sent from the Apache Spark User List mailing list archive at Nabbl