such as this table definition:

desc people;
+-----------+---------------------------+----------+
| col_name  |         data_type         | comment  |
+-----------+---------------------------+----------+
| name      | string                    |          |
| born      | date                      |          |
| sex       | struct<id:int,fm:string>  |          |
| contact   | map<string,string>        |          |
| jobs      | array<string>             |          |
+-----------+---------------------------+----------+

And this sql statement:

 with t1 as (
 select name,
 case when sex.id=0 then "female" else "male" end as sex,
 jobs[1] as lastjob
 from people)
 select * from t1 limit 10;


how does dataframe run with this kind of subquery?

Thank you.

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Reply via email to