Can you also provide some examples of what you are trying to accomplish? It seems like you might be saying that you want a virtual attribute for the entire path rather than individual pieces? Also remember that partition pruning can also be done if you're using Parquet files without all the dirN syntax.
-- Jacques Nadeau CTO and Co-Founder, Dremio On Thu, Sep 17, 2015 at 10:42 AM, Stefán Baxter <[email protected]> wrote: > Hi, > > I have been writing a few simple utility functions for Drill and staring at > the cumbersome dirN conditions required to take advantage of directory > pruning. > > Would it be possible to allow UDFs to throw fileOutOfScope and > directoryOutOfScope exceptions that would allow me to a) write a failry > clever inRange(from, to, dirN...) function and would b) allow for > additional pruning during execution? > > Maybe I'm seeing this all wrong but the process of complicating all queries > with a, sometimes quite complicated, dirN tail just seems like too much > redundancy. > > Regards, > -Stefan >
