of that - sometimes
a simple cronjob is enough!
--
Date: Sun, 5 Jul 2015 22:48:37 +1000
Subject: Re: JDBC Streams
From: guha.a...@gmail.com
To: ak...@sigmoidanalytics.com
CC: user@spark.apache.org
Thanks Akhil. In case I go with spark streaming, I guess I have to
implment
I would use Sqoop. It has been designed exactly for these types of
scenarios. Spark streaming does not make sense here
Le dim. 5 juil. 2015 à 1:59, ayan guha guha.a...@gmail.com a écrit :
Hi All
I have a requireent to connect to a DB every few minutes and bring data to
HBase. Can anyone
of a simplification, but should give you the idea that your db
polling interval and streaming interval are not tied together.
-Ashic.
--
Date: Mon, 6 Jul 2015 01:12:34 +1000
Subject: Re: JDBC Streams
From: guha.a...@gmail.com
To: as...@live.com
CC: ak...@sigmoidanalytics.com
If you want a long running application, then go with spark streaming (which
kind of blocks your resources). On the other hand, if you use job server
then you can actually use the resources (CPUs) for other jobs also when
your dbjob is not using them.
Thanks
Best Regards
On Sun, Jul 5, 2015 at
:37 +1000
Subject: Re: JDBC Streams
From: guha.a...@gmail.com
To: ak...@sigmoidanalytics.com
CC: user@spark.apache.org
Thanks Akhil. In case I go with spark streaming, I guess I have to implment a
custom receiver and spark streaming will call this receiver every batch
interval, is that correct? Any
Thanks Akhil. In case I go with spark streaming, I guess I have to implment
a custom receiver and spark streaming will call this receiver every batch
interval, is that correct? Any gotcha you see in this plan? TIA...Best, Ayan
On Sun, Jul 5, 2015 at 5:40 PM, Akhil Das ak...@sigmoidanalytics.com
an hour, once every 15 minutes, etc.),
then I'd simply write a normal spark application, and trigger it
periodically. There are many things that can take care of that - sometimes
a simple cronjob is enough!
--
Date: Sun, 5 Jul 2015 22:48:37 +1000
Subject: Re: JDBC
.
-Ashic.
Date: Mon, 6 Jul 2015 01:12:34 +1000
Subject: Re: JDBC Streams
From: guha.a...@gmail.com
To: as...@live.com
CC: ak...@sigmoidanalytics.com; user@spark.apache.org
Hi
Thanks for the reply. here is my situation: I hve a DB which enbles synchronus
CDC, think this as a DBtrigger which writes
