Yin Huai created SPARK-11329: -------------------------------- Summary: Expand Star when creating a struct Key: SPARK-11329 URL: https://issues.apache.org/jira/browse/SPARK-11329 Project: Spark Issue Type: Improvement Components: SQL Reporter: Yin Huai
It is pretty common for customers to do regular extractions of update data from an external datasource (e.g. mysql or postgres). While this is possible today, the syntax is a little onerous. With some small improvements to the analyzer I think we could make this much easier. Goal: Allow users to execute the following two queries as well as their dataframe equivalents to find the most recent record for each key {{SELECT max(struct(timestamp, *)) as mostRecentRecord GROUP BY key}} to unnest the struct from above. {{SELECT mostRecentRecord.* FROM data}} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org