Re: Spark SQL with a sorted file

2014-12-23 Thread Cheng Lian
newParquet.scala) Cheng Hao -Original Message- From: Jerry Raj [mailto:jerry@gmail.com <mailto:jerry@gmail.com>] Sent: Thursday, December 4, 2014 11:34 AM To: user@spark.apache.org <mailto:user@spark.apache.org> Subject: Spark SQL with a sorted fil

Re: Spark SQL with a sorted file

2014-12-22 Thread Jerry Raj
t;] Sent: Thursday, December 4, 2014 11:34 AM To: user@spark.apache.org <mailto:user@spark.apache.org> Subject: Spark SQL with a sorted file Hi, If I create a SchemaRDD from a file that I know is sorted on a certain field, is it possible to somehow pass that information

Re: Spark SQL with a sorted file

2014-12-04 Thread Michael Armbrust
-- > From: Jerry Raj [mailto:jerry@gmail.com] > Sent: Thursday, December 4, 2014 11:34 AM > To: user@spark.apache.org > Subject: Spark SQL with a sorted file > > Hi, > If I create a SchemaRDD from a file that I know is sorted on a certain > field, is it possible to somehow p

RE: Spark SQL with a sorted file

2014-12-03 Thread Cheng, Hao
@gmail.com] Sent: Thursday, December 4, 2014 11:34 AM To: user@spark.apache.org Subject: Spark SQL with a sorted file Hi, If I create a SchemaRDD from a file that I know is sorted on a certain field, is it possible to somehow pass that information on to Spark SQL so that SQL queries referencing

Spark SQL with a sorted file

2014-12-03 Thread Jerry Raj
Hi, If I create a SchemaRDD from a file that I know is sorted on a certain field, is it possible to somehow pass that information on to Spark SQL so that SQL queries referencing that field are optimized? Thanks -Jerry - To un