Hi, AFAIK, you could use Hive GenericUDF stuffs in spark without much effort. If you'd like to check test suites about that, you'd better to visit HiveUDFSuite. https://github.com/apache/spark/blob/master/sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveUDFSuite.scala
I also have used Hive UDFs (including GenericUDF) in Spark for another incubator project I belong to (https://github.com/apache/incubator-hivemall), but I didn't hit critical issues so far. // maropu On Tue, Jan 17, 2017 at 5:31 PM, Sirisha Cheruvu <siri8...@gmail.com> wrote: > Hi > > Anybody has a test and tried generic udf with object inspector > implementaion which sucessfully ran on both hive and spark-sql > > please share me the git hub link or source code file > > Thanks in advance > Sirisha > -- --- Takeshi Yamamuro
