Re: Wrting data from Spark streaming to AWS Redshift?

2016-12-11 Thread kant kodali
@shyla a side question: What does Redshift can do that Spark cannot do? Trying to understand your use case. On Fri, Dec 9, 2016 at 8:47 PM, ayan guha wrote: > Ideally, saving data to external sources should not be any different. give > the write options as stated in the

Re: Wrting data from Spark streaming to AWS Redshift?

2016-12-09 Thread ayan guha
Ideally, saving data to external sources should not be any different. give the write options as stated in the bloga shot, but changing mode to append. On Sat, Dec 10, 2016 at 8:25 AM, shyla deshpande wrote: > Hello all, > > Is it possible to Write data from Spark

Wrting data from Spark streaming to AWS Redshift?

2016-12-09 Thread shyla deshpande
Hello all, Is it possible to Write data from Spark streaming to AWS Redshift? I came across the following article, so looks like it works from a Spark batch program. https://databricks.com/blog/2015/10/19/introducing-redshift-data-source-for-spark.html I want to write to AWS Redshift from