On Wed, Oct 29, 2014 at 3:39 PM, spr wrote:
> I need more precision to understand. If the elements of one DStream/RDD
> are
> (String) and the elements of the other are (Time, Int), what does "union"
> mean? I'm hoping for (String, Time, Int) but that appears optimistic. :)
>
It won't compile.
I need more precision to understand. If the elements of one DStream/RDD are
(String) and the elements of the other are (Time, Int), what does "union"
mean? I'm hoping for (String, Time, Int) but that appears optimistic. :)
Do the elements have to be of homogeneous type?
Holden Karau wrote
>
The union function simply returns a DStream with the elements from both.
This is the same behavior as when we call union on RDDs :) (You can think
of union as similar to the union operator on sets except without the unique
element restrictions).
On Wed, Oct 29, 2014 at 3:15 PM, spr wrote:
> The
The documentation at
https://spark.apache.org/docs/1.0.0/api/scala/index.html#org.apache.spark.streaming.dstream.DStream
describes the union() method as
"Return a new DStream by unifying data of another DStream with this
DStream."
Can somebody provide a clear definition of what "unifying" means i
