Re: Spark 1.5.2 : change datatype in programaticallly generated schema

Change the type of a subset of the columns using withColumn, after you have loaded the DataFrame. Here is an example. On Thu, Mar 3,

Spark 1.5.2 : change datatype in programaticallly generated schema

Hi, I am generating schema programatically as show below val schemaFile = sc.textFile("/TestDivya/Spark/cars.csv") val schemaString = schemaFile.first() val schema = StructType(Array( schemaString.split(" ").map(fieldName => StructField(fieldName, StringType(), true I want to