Spark has not supported Arrow yet. There is a JIRA https://issues.apache.org/jira/browse/SPARK-13391 requesting working on it.
From: Robert Towne [mailto:[email protected]] Sent: Wednesday, February 24, 2016 5:21 AM To: [email protected] Subject: Apache Arrow + Spark examples? I have been reading some of the news this week about Apache Arrow as a new top level project. It appears to be a common data layer between Spark and other systems<http://arrow.apache.org/> (Cassandra, Drill, Impala, etc). Has anyone seen any sample Spark code that integrates with Arrow? Thanks, Robert
