Or , you can extend SQLContext to add your plans . Not sure if it fits your requirement , but answered to highlight an option.
Regards, Rishitesh Mishra, SnappyData . (http://www.snappydata.io/) https://in.linkedin.com/in/rishiteshmishra On Thu, Jul 7, 2016 at 8:39 PM, tan shai <tan.shai...@gmail.com> wrote: > That was what I am thinking to do. > > Do you have any idea about this? Or any documentations? > > Many thanks. > > 2016-07-07 17:07 GMT+02:00 Koert Kuipers <ko...@tresata.com>: > >> i dont see any easy way to extend the plans, beyond creating a custom >> version of spark. >> >> On Thu, Jul 7, 2016 at 9:31 AM, tan shai <tan.shai...@gmail.com> wrote: >> >>> Hi, >>> >>> I need to add new operations to the dataframe API. >>> Can any one explain to me how to extend the plans of query execution? >>> >>> Many thanks. >>> >> >> >
