Re: Expand the Spark SQL programming guide?

2016-12-20 Thread Jim Hughes
-12-18 15:08 GMT+01:00 Anton Okolnychyi mailto:anton.okolnyc...@gmail.com>>: Here is the pull request: https://github.com/apache/spark/pull/16329 <https://github.com/apache/spark/pull/16329> 2016-12-16 20:54 GMT+01:00 Jim Hughes mailto:jn...@ccri.com>>:

Re: Expand the Spark SQL programming guide?

2016-12-16 Thread Jim Hughes
functions. *From: *Anton Okolnychyi *Date: *Thursday, December 15, 2016 at 4:34 PM *To: *Conversant *Cc: *Michael Armbrust , Jim Hughes , "dev@spark.apache.org" *Subject: *Re: Expand the Spark SQL programming guide? I think it will make sense to show a samp

Re: Expand the Spark SQL programming guide?

2016-12-15 Thread Jim Hughes
Hi Anton, I'd like to see this as well. I've been working on implementing geospatial user-defined types and functions. Having examples of aggregations and window functions would be awesome! I did test out implementing a distributed convex hull as a UserDefinedAggregateFunction, and that se

Issues using Hive JDBC

2016-12-02 Thread Jim Hughes
Hi all, I'm investigating adding geospatial user-defined functions and types to Spark SQL in Spark 2.0.x. That is going rather well; I've seen how to add geospatial UDT and UDFs (and even UDAFs!). As part of the investigation, I tried out the Thrift JDBC server, and I have encountered two g