such as this table definition:
desc people;
+-----------+---------------------------+----------+ | col_name | data_type | comment | +-----------+---------------------------+----------+ | name | string | | | born | date | | | sex | struct<id:int,fm:string> | | | contact | map<string,string> | | | jobs | array<string> | | +-----------+---------------------------+----------+
And this sql statement: with t1 as ( select name, case when sex.id=0 then "female" else "male" end as sex, jobs[1] as lastjob from people) select * from t1 limit 10; how does dataframe run with this kind of subquery? Thank you. --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org