In the Spark SQL 1.2 Programmers Guide, we can generate the schema based on
the string of schema via
val schema =
StructType(
schemaString.split(" ").map(fieldName => StructField(fieldName,
StringType, true)))
But when running this on Spark 1.3.0 (RC1), I get the error:
val schema = StructType(schemaString.split(" ").map(fieldName =>
StructField(fieldName, StringType, true)))
<console>:26: error: not found: value StringType
val schema = StructType(schemaString.split(" ").map(fieldName =>
StructField(fieldName, StringType, true)))
I'm looking through the various datatypes within
org.apache.spark.sql.types.DataType
but thought I'd ask to see if I was missing something obvious here.
Thanks!
Denny