Re: SQLContext and HiveContext Query Performance

2014-06-05 Thread Michael Armbrust
at > Exchange.scala:44 > from 13 s? > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/SQLContext-and-HiveContext-Query-Performance-tp6948p7075.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. >

Re: SQLContext and HiveContext Query Performance

2014-06-05 Thread ssb61
Any inputs to reduce the time duration for mapPartitions at Exchange.scala:44 from 13 s? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SQLContext-and-HiveContext-Query-Performance-tp6948p7075.html Sent from the Apache Spark User List mailing list archive

Re: SQLContext and HiveContext Query Performance

2014-06-04 Thread ssb61
mapPartitions at Exchange.scala:44 - 13 s Thanks, Santosh -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SQLContext-and-HiveContext-Query-Performance-tp6948p6981.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: SQLContext and HiveContext Query Performance

2014-06-04 Thread Zongheng Yang
me time to run the optimizer & generate physical plans that slows down the query. Thanks, Zongheng On Wed, Jun 4, 2014 at 2:16 PM, ssb61 wrote: > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/SQLContext-and-HiveContext

Re: SQLContext and HiveContext Query Performance

2014-06-04 Thread ssb61
-- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/SQLContext-and-HiveContext-Query-Performance-tp6948p6976.html Sent from the Apache Spark User List mailing list archive at Nabble.com.