Re: Saving Table with Special Characters in Columns

Thanks Michael! But what about when I am not trying to save as parquet? No way around the error using saveAsTable()? I am using Spark 1.4. Tobi On Jul 11, 2016 2:10 PM, "Michael Armbrust" wrote: > This is protecting you from a limitation in parquet. The library will

Re: Saving Table with Special Characters in Columns

This is protecting you from a limitation in parquet. The library will let you write out invalid files that can't be read back, so we added this check. You can call .format("csv") (in spark 2.0) to switch it to CSV. On Mon, Jul 11, 2016 at 11:16 AM, Tobi Bosede wrote: > Hi

Saving Table with Special Characters in Columns

Hi everyone, I am trying to save a data frame with special characters in the column names as a table in hive. However I am getting the following error. Is the only solution to rename all the columns? Or is there some argument that can be passed to into the saveAsTable() or write.parquet()