is
> going to be out soon? Do you have some sort of ETA?
>
>
>
> *From: *"Lalwani, Jayesh"
> *Date: *Friday, July 7, 2017 at 5:46 PM
> *To: *Michael Armbrust
>
> *Cc: *"user@spark.apache.org" , #MM - Heartbeat <
> mm-heartb...@capitalone.c
ot;
Cc: "user@spark.apache.org" , #MM - Heartbeat
Subject: Re: Union of 2 streaming data frames
Ah, looks like you are hitting
SPARK-20441<https://issues.apache.org/jira/browse/SPARK-20441>. Should be
fixed in 2.2.
On Fri, Jul 7, 2017 at 2:37 PM, Lalwani, Jayesh
mailto:jayes
rg" , #MM - Heartbeat
Subject: Re: Union of 2 streaming data frames
Ah, looks like you are hitting
SPARK-20441<https://issues.apache.org/jira/browse/SPARK-20441>. Should be
fixed in 2.2.
On Fri, Jul 7, 2017 at 2:37 PM, Lalwani, Jayesh
mailto:jayesh.lalw...@capitalone.com>> wro
pache.spark.sql.execution.streaming.
> StreamExecution$$anonfun$org$apache$spark$sql$execution$
> streaming$StreamExecution$$runBatches$1.apply$mcZ$sp(
> StreamExecution.scala:244)
>
> at org.apache.spark.sql.execution.streaming.
> ProcessingTimeExecutor.execute(TriggerExe
rust
Date: Friday, July 7, 2017 at 2:30 PM
To: "Lalwani, Jayesh"
Cc: "user@spark.apache.org"
Subject: Re: Union of 2 streaming data frames
df.union(df2) should be supported when both DataFrames are created from a
streaming source. What error are you seeing?
On Fri, Jul 7, 201
df.union(df2) should be supported when both DataFrames are created from a
streaming source. What error are you seeing?
On Fri, Jul 7, 2017 at 11:27 AM, Lalwani, Jayesh <
jayesh.lalw...@capitalone.com> wrote:
> In structured streaming, Is there a way to Union 2 streaming data frames?
> Are there
In structured streaming, Is there a way to Union 2 streaming data frames? Are
there any plans to support Union of 2 streaming dataframes soon? I can
understand the inherent complexity in joining 2 streaming data frames. But,
Union is just concatenating 2 microbatches, innit?
The problem that w
