Spark 1.3 RC1 Generate schema based on string of schema

2015-02-20 Thread Denny Lee 
In the Spark SQL 1.2 Programmers Guide, we can generate the schema based on
the string of schema via

val schema =
  StructType(
schemaString.split( ).map(fieldName = StructField(fieldName,
StringType, true)))

But when running this on Spark 1.3.0 (RC1), I get the error:

val schema =  StructType(schemaString.split( ).map(fieldName =
StructField(fieldName, StringType, true)))

console:26: error: not found: value StringType

   val schema =  StructType(schemaString.split( ).map(fieldName =
StructField(fieldName, StringType, true)))

I'm looking through the various datatypes within
org.apache.spark.sql.types.DataType
but thought I'd ask to see if I was missing something obvious here.

Thanks!
Denny

Re: Spark 1.3 RC1 Generate schema based on string of schema

2015-02-20 Thread Denny Lee 
Oh, I just realized that I never imported all of sql._ .  My bad!


On Fri Feb 20 2015 at 7:51:32 AM Denny Lee denny.g@gmail.com wrote:

 In the Spark SQL 1.2 Programmers Guide, we can generate the schema based
 on the string of schema via

 val schema =
   StructType(
 schemaString.split( ).map(fieldName = StructField(fieldName,
 StringType, true)))

 But when running this on Spark 1.3.0 (RC1), I get the error:

 val schema =  StructType(schemaString.split( ).map(fieldName =
 StructField(fieldName, StringType, true)))

 console:26: error: not found: value StringType

val schema =  StructType(schemaString.split( ).map(fieldName =
 StructField(fieldName, StringType, true)))

 I'm looking through the various datatypes within 
 org.apache.spark.sql.types.DataType
 but thought I'd ask to see if I was missing something obvious here.

 Thanks!


 Denny