although this is correct, KeyValueGroupedDataset.coGroup requires one to
implement their own join logic with Iterator functions. its fun to do that,
and i appreciate the flexibility it gives, but i would not consider it a
good solution for someone that just wants to do a typed join
On Thu, Nov 10,
You can groupByKey and then cogroup.
On Thu, Nov 10, 2016 at 10:44 AM, Yang wrote:
> the new DataSet API is supposed to provide type safety and type checks at
> compile time https://spark.apache.org/docs/latest/structured-
> streaming-programming-guide.html#join-operations
>
> It does this indee
the new DataSet API is supposed to provide type safety and type checks at
compile time
https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html#join-operations
It does this indeed for a lot of places, but I found it still doesn't have
a type safe join:
val ds1 = hc.sql("se