sachouche commented on issue #1414: DRILL-6101: Optimized implicit columns handling within scanner URL: https://github.com/apache/drill/pull/1414#issuecomment-410086886 @paul-rogers I agree the planner should have been responsible for optimally exposing the implicit & partition columns since it has all the necessary metadata. This feature was not implemented that way.. The execution layer included logic to optimize implicit column handling if the query was not a STAR_QUERY. My fix was mainly to pass the missing metadata in the case of STAR_QUERY and thus trigger the existing optimization. Our testing showed up to 30% improvement within the Parquet scanner for SELECT_STAR queries and big reduction in batch memory utilization.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
