Brian Cho created SPARK-15956:
---------------------------------
Summary: When unwrapping ORC avoid pattern matching at runtime
Key: SPARK-15956
URL: https://issues.apache.org/jira/browse/SPARK-15956
Project: Spark
Issue Type: Improvement
Components: SQL
Reporter: Brian Cho
Priority: Minor
When unwrapping ORC values, pattern matching for each data value at runtime
hurts performance. This should be avoided.
Instead, we can run pattern matching once and return a function that is
subsequently used to unwrap each data value. This is already implemented for
certain primitive types. We should implement for the remaining types, including
complex types (e.g, list, map).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
