Re: Correlated subqueries in the DataFrame API

2018-04-27 Thread Nicholas Chammas
3945> but wanted to >>> double check here to make sure I didn't miss something fundamental. >>> >>> Correlated subqueries are tracked at a high level in SPARK-18455 >>> <https://issues.apache.org/jira/browse/SPARK-18455>, but it's not clear >>> to me whether they are "design-appropriate" for the DataFrame API. >>> >>> Are correlated subqueries a thing we can expect to have in the DataFrame >>> API? >>> >>> Nick >>> >>> >> >> >> -- >> Ryan Blue >> Software Engineer >> Netflix >> > >

Re: Correlated subqueries in the DataFrame API

2018-04-19 Thread Reynold Xin
t; check here to make sure I didn't miss something fundamental. >> >> Correlated subqueries are tracked at a high level in SPARK-18455 >> <https://issues.apache.org/jira/browse/SPARK-18455>, but it's not clear >> to me whether they are "design-appropriate"

Re: Correlated subqueries in the DataFrame API

2018-04-19 Thread Ryan Blue
ache.org/jira/browse/SPARK-18455>, but it's not clear > to me whether they are "design-appropriate" for the DataFrame API. > > Are correlated subqueries a thing we can expect to have in the DataFrame > API? > > Nick > > -- Ryan Blue Software Engineer Netflix

Correlated subqueries in the DataFrame API

2018-04-09 Thread Nicholas Chammas
t;, but it's not clear to me whether they are "design-appropriate" for the DataFrame API. Are correlated subqueries a thing we can expect to have in the DataFrame API? Nick