[ https://issues.apache.org/jira/browse/SPARK-7340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen resolved SPARK-7340. ------------------------------ Resolution: Duplicate Fix Version/s: (was: 1.4.0) [~saucam] Please don't set Fix Version. It's good to search JIRA first, too, as this is a duplicate, and not quite as simple as it seems from the discussion. Please have a look at https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark > Use latest parquet release 1.6.0 in spark > ----------------------------------------- > > Key: SPARK-7340 > URL: https://issues.apache.org/jira/browse/SPARK-7340 > Project: Spark > Issue Type: Improvement > Components: SQL > Affects Versions: 1.3.1 > Reporter: Yash Datta > > Bump the used parquet version from 1.6.0rc3 to 1.6.0. > This brings in major improvement in the form of reading footers in the task > side instead of the driver, removing a major bottleneck -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org