You can always add the columns to old dataframes giving them null (or some literal) as a preprocessing.
-----Original Message----- From: Kristoffer Sjögren [mailto:sto...@gmail.com] Sent: Friday, November 18, 2016 4:32 PM To: user Subject: DataFrame select non-existing column Hi We have evolved a DataFrame by adding a few columns but cannot write select statements on these columns for older data that doesn't have them since they fail with a AnalysisException with message "No such struct field". We also tried dropping columns but this doesn't work for nested columns. Any non-hacky ways to get around this? Cheers, -Kristoffer --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
