custom sink & model transformation

Hi, Is it unsfate to do model prediction within a custom sink eg. model.transform(df)? I see that the only transformation done is adding a prediction column AFAIK. Stavros

PushDown Filter Not Reset

Hi, I am developing my own datasource reader and have implemented pushdown filters. I am struggling with a case where I do not get a call to pushFilters() when I have no filter in order to reset a previously defined filter. Here is a a Spark shell session to demonstrate the issue, with debug lo