I am loading some avro data into spark using the following code:
sqlContext.sql("CREATE TEMPORARY TABLE foo USING com.databricks.spark.avro
OPTIONS (path 'hdfs://*.avro')")
The avro data contains some binary fields that get translated to the
BinaryType data type. I am struggling with how to use the binary type in a
query statement.
For example:
sqlContext.sql("select * from foo where
name='\x00\x00\x0c\x07\xac\x02'").collect()
throws a utf8 error.
Trying this:
sqlContext.sql(u"select * from foo where
name='\x00\x00\x0c\x07\xac\x02'").collect()
does not return any results.
Any thoughts/ideas?
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Pyspark-query-by-binary-type-tp22431.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org
