Hi Gourav, the question in fact is are there any the limitations of Apache Spark support for Parquet file format.
The example schema from the dremel paper is something that is supported in Apache Parquet (using Apache Parquet Java API). Now I am trying to implement the same schema using Apache Spark SQL types, but not very successful. And probably this is not unexpected. What was unexpected is that Apache Spark can't read a parquet file with the dremel example schema. Probably there are some limitations of what Apache Spark can support from Apache Parquet file format, but for me it is not obvious what this limitations are. Thanks, Lubomir Chorbadjiev -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ --------------------------------------------------------------------- To unsubscribe e-mail: [email protected]
