Yes, I guess it is. 2017-07-20 11:31 GMT+09:00 Matthew cao <cybea...@gmail.com>:
> AH, I get it. So that’s why I get the not register error? Cuz it not added > into SQL in 2.1.0? > > On 2017年7月19日, at 22:35, Hyukjin Kwon <gurwls...@gmail.com> wrote: > > Yea, but it was added into SQL from Spark 2.2.0 > > 2017-07-19 23:02 GMT+09:00 Matthew cao <cybea...@gmail.com>: > >> I am using version 2.1.1 As I could remember, this function was added >> since 2.1.0. >> >> On 2017年7月17日, at 12:05, Burak Yavuz <brk...@gmail.com> wrote: >> >> Hi Matthew, >> >> Which Spark version are you using? The expression `to_json` was added in >> 2.2 with this commit: >> https://github.com/apache/spark/commit/0cdcf9114527a2c359c25 >> e46fd6556b3855bfb28 >> >> Best, >> Burak >> >> On Sun, Jul 16, 2017 at 6:24 PM, Matthew cao <cybea...@gmail.com> wrote: >> >>> Hi all, >>> I just read the databricks blog here: https://docs.databricks. >>> com/_static/notebooks/complex-nested-structured.html >>> >>> When I try to follow the example about the to_json and selectExpr part, >>> it gave error: “org.apache.spark.sql.AnalysisException: Undefined >>> function: 'to_json'. This function is neither a registered temporary >>> function nor a permanent function registered in the database 'default'.; >>> line 1 pos 0”. >>> Also this error show in the original databricks notebook. I know that >>> to_json function works great with select. Do I miss something when using >>> selectExpr? THX. >>> >>> Best, >>> Matthew >>> >>> >> >> > >
