git commit: [SQL] Improve Speed of InsertIntoHiveTable

2014-06-20 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.0 a0e22d398 - cc2e4ca01 [SQL] Improve Speed of InsertIntoHiveTable Author: Michael Armbrust mich...@databricks.com Closes #1130 from marmbrus/noFunctional and squashes the following commits: ccdb68c [Michael Armbrust] Remove functional

git commit: [SPARK-2177][SQL] describe table result contains only one column

2014-06-20 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.0 cc2e4ca01 - ff4d5a234 [SPARK-2177][SQL] describe table result contains only one column ``` scala hql(describe src).collect().foreach(println) [keystring None] [value

git commit: [SPARK-2210] cast to boolean on boolean value gets turned into NOT((boolean_condition) = 0)

2014-06-20 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.0 357d16bcd - a803e009c [SPARK-2210] cast to boolean on boolean value gets turned into NOT((boolean_condition) = 0) ``` explain select cast(cast(key=0 as boolean) as boolean) aaa from src ``` should be ``` [Physical execution plan:]

git commit: [SPARK-2209][SQL] Cast shouldn't do null check twice.

2014-06-20 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.0 a803e009c - 86c4f5af9 [SPARK-2209][SQL] Cast shouldn't do null check twice. Also took the chance to clean up cast a little bit. Too many arrows on each line before! Author: Reynold Xin r...@apache.org Closes #1143 from rxin/cast and

git commit: [SPARK-2218] rename Equals to EqualTo in Spark SQL expressions.

2014-06-20 Thread rxin
Repository: spark Updated Branches: refs/heads/master 324952892 - 2f6a835e1 [SPARK-2218] rename Equals to EqualTo in Spark SQL expressions. Due to the existence of scala.Equals, it is very error prone to name the expression Equals, especially because we use a lot of partial functions and

git commit: [SPARK-2218] rename Equals to EqualTo in Spark SQL expressions.

2014-06-20 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.0 0d05e13e0 - 7594b3f94 [SPARK-2218] rename Equals to EqualTo in Spark SQL expressions. Due to the existence of scala.Equals, it is very error prone to name the expression Equals, especially because we use a lot of partial functions and

git commit: [SQL] Use hive.SessionState, not the thread local SessionState

2014-06-20 Thread rxin
Repository: spark Updated Branches: refs/heads/master d4c7572db - 204478491 [SQL] Use hive.SessionState, not the thread local SessionState Note that this is simply mimicing lookupRelation(). I do not have a concrete notion of why this solution is necessarily right-er than SessionState.get,

git commit: [SQL] Use hive.SessionState, not the thread local SessionState

2014-06-20 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.0 91dc0641c - 36668662f [SQL] Use hive.SessionState, not the thread local SessionState Note that this is simply mimicing lookupRelation(). I do not have a concrete notion of why this solution is necessarily right-er than

git commit: SPARK-1902 Silence stacktrace from logs when doing port failover to port n+1

2014-06-20 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 204478491 - 08d0aca78 SPARK-1902 Silence stacktrace from logs when doing port failover to port n+1 Before: ``` 14/06/08 23:58:23 WARN AbstractLifeCycle: FAILED SelectChannelConnector@0.0.0.0:4040: java.net.BindException: Address already

git commit: [SPARK-2061] Made splits deprecated in JavaRDDLike

2014-06-20 Thread pwendell
Repository: spark Updated Branches: refs/heads/master a67864249 - 010c460d6 [SPARK-2061] Made splits deprecated in JavaRDDLike The jira for the issue can be found at: https://issues.apache.org/jira/browse/SPARK-2061 Most of spark has used over to consistently using `partitions` instead of

git commit: [SQL] Pass SQLContext instead of SparkContext into physical operators.

2014-06-20 Thread rxin
Repository: spark Updated Branches: refs/heads/master 648553d48 - ca5d8b590 [SQL] Pass SQLContext instead of SparkContext into physical operators. This makes it easier to use config options in operators. Author: Reynold Xin r...@apache.org Closes #1164 from rxin/sqlcontext and squashes the

git commit: [SQL] Pass SQLContext instead of SparkContext into physical operators.

2014-06-20 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-1.0 36668662f - 1829ec411 [SQL] Pass SQLContext instead of SparkContext into physical operators. This makes it easier to use config options in operators. Author: Reynold Xin r...@apache.org Closes #1164 from rxin/sqlcontext and squashes