[
https://issues.apache.org/jira/browse/DRILL-3838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14908270#comment-14908270
]
Jacques Nadeau commented on DRILL-3838:
---------------------------------------
I'm starting to think that we may want to model directory attributes as a type
of join and then support some kind of "sideband" join. This would make the
algebra much clearer. The need here is really similar to the needs for a
bloomfilter pushdown join. [~julianhyde], [~jni] and [~amansinha100] any
thoughts on the best pattern around this?
> Ability to use UDFs in the directory pruning process
> ----------------------------------------------------
>
> Key: DRILL-3838
> URL: https://issues.apache.org/jira/browse/DRILL-3838
> Project: Apache Drill
> Issue Type: New Feature
> Components: Query Planning & Optimization
> Affects Versions: 1.2.0
> Reporter: Stefán Baxter
>
> This feature request is about allowing UDFs to participate in the
> Directory/Partition pruning process at runtime rather than at
> planing/optimization time.
> For this a UDF needs:
> - filename
> - full path (not just dirN)
> - to be able to throw a IgnoreFile exception
> - to be able to throw a IgnoreDirecotyr exception
> I think the naming is pretty self explanatory and hopefully this brief
> description is enough.
> _Stefan
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
