ilto:georg.kf.hei...@gmail.com>>,
"user@spark.apache.org<mailto:user@spark.apache.org>"
mailto:user@spark.apache.org>>
Subject: Re: Spark structured streaming: Is it possible to periodically refresh
static data frame?
Here are couple of ideas.
1. You can set up a Stru
wrote:
>>
>> Thanks Georg for your reply.
>>
>> But I’m not sure if I fully understood your answer.
>>
>>
>>
>> If you meant to join two streams (one reading Kafka, and another reading
>> database table), then I think it’s not possib
o achieve this?
>
>
>
> Thanks,
>
> Hemanth
>
>
>
>
>
> *From: *Tathagata Das
>
>
> *Date: *Friday, 21 April 2017 at 0.03
> *To: *Hemanth Gudela
>
> *Cc: *Georg Heiler , "user@spark.apache.org" <
> user@spark.apache.org>
>
” the
way to achieve this?
Thanks,
Hemanth
From: Tathagata Das
Date: Friday, 21 April 2017 at 0.03
To: Hemanth Gudela
Cc: Georg Heiler , "user@spark.apache.org"
Subject: Re: Spark structured streaming: Is it possible to periodically refresh
static data frame?
Here are couple o
Cc: *Georg Heiler , "user@spark.apache.org" <
> user@spark.apache.org>
>
>
> *Subject: *Re: Spark structured streaming: Is it possible to periodically
> refresh static data frame?
>
>
>
> Here are couple of ideas.
>
> 1. You can set up a Structured Streaming query t
: Friday, 21 April 2017 at 0.03
To: Hemanth Gudela
Cc: Georg Heiler , "user@spark.apache.org"
Subject: Re: Spark structured streaming: Is it possible to periodically refresh
static data frame?
Here are couple of ideas.
1. You can set up a Structured Streaming query to update in-memory t
pport database as a streaming source
>
> 2. Joining between two streams is not possible yet.
>
>
>
> Regards,
>
> Hemanth
>
>
>
> *From: *Georg Heiler
> *Date: *Thursday, 20 April 2017 at 23.11
> *To: *Hemanth Gudela , "user@spark.apache.org"
>
.apache.org"
Subject: Re: Spark structured streaming: Is it possible to periodically refresh
static data frame?
What about treating the static data as a (slow) stream as well?
Hemanth Gudela mailto:hemanth.gud...@qvantel.com>>
schrieb am Do., 20. Apr. 2017 um 22:09 Uhr:
Hello,
I am
What about treating the static data as a (slow) stream as well?
Hemanth Gudela schrieb am Do., 20. Apr. 2017
um 22:09 Uhr:
> Hello,
>
>
>
> I am working on a use case where there is a need to join streaming data
> frame with a static data frame.
>
> The streaming data frame continuously gets dat
Hello,
I am working on a use case where there is a need to join streaming data frame
with a static data frame.
The streaming data frame continuously gets data from Kafka topics, whereas
static data frame fetches data from a database table.
However, as the underlying database table is getting up
10 matches
Mail list logo
