Another thing you may want to be aware is, if the result is not idempotent, your query result is also not idempotent. For fault-tolerance there's a chance for record (row) to be replayed (recomputed).
-Jungtaek Lim (HeartSaVioR) 2018년 4월 24일 (화) 오후 2:07, Jörn Franke <jornfra...@gmail.com>님이 작성: > What is your use case? > > > On 23. Apr 2018, at 23:27, kant kodali <kanth...@gmail.com> wrote: > > > > Hi All, > > > > Is it ok to make I/O calls in UDF? other words is it a standard practice? > > > > Thanks! > > --------------------------------------------------------------------- > To unsubscribe e-mail: user-unsubscr...@spark.apache.org > >
