git commit: [SPARK-2093] [SQL] NullPropagation should use exact type value.

2014-06-11 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 601032f5b - 0402bd77e [SPARK-2093] [SQL] NullPropagation should use exact type value. `NullPropagation` should use exact type value when transform `Count` or `Sum`. Author: Takuya UESHIN ues...@happy-camper.st Closes #1034 from

git commit: [SPARK-2093] [SQL] NullPropagation should use exact type value.

2014-06-11 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.0 2cdce7cf3 - 6d15e9f7c [SPARK-2093] [SQL] NullPropagation should use exact type value. `NullPropagation` should use exact type value when transform `Count` or `Sum`. Author: Takuya UESHIN ues...@happy-camper.st Closes #1034 from

git commit: [SPARK-1968][SQL] SQL/HiveQL command for caching/uncaching tables

2014-06-11 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.0 6d15e9f7c - 65ed7793d [SPARK-1968][SQL] SQL/HiveQL command for caching/uncaching tables JIRA issue: [SPARK-1968](https://issues.apache.org/jira/browse/SPARK-1968) This PR added support for SQL/HiveQL command for caching/uncaching

git commit: SPARK-2107: FilterPushdownSuite doesn't need Junit jar.

2014-06-11 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 0f1dc3a73 - 6e1193031 SPARK-2107: FilterPushdownSuite doesn't need Junit jar. Author: Qiuzhuang.Lian qiuzhuang.l...@gmail.com Closes #1046 from Qiuzhuang/master and squashes the following commits: 0a9921a [Qiuzhuang.Lian] SPARK-2107:

git commit: SPARK-2107: FilterPushdownSuite doesn't need Junit jar.

2014-06-11 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.0 65ed7793d - 54ff00547 SPARK-2107: FilterPushdownSuite doesn't need Junit jar. Author: Qiuzhuang.Lian qiuzhuang.l...@gmail.com Closes #1046 from Qiuzhuang/master and squashes the following commits: 0a9921a [Qiuzhuang.Lian] SPARK-2107:

git commit: SPARK-1639. Tidy up some Spark on YARN code

2014-06-11 Thread tgraves
Repository: spark Updated Branches: refs/heads/master 6e1193031 - 2a4225dd9 SPARK-1639. Tidy up some Spark on YARN code This contains a bunch of small tidyings of the Spark on YARN code. I focused on the yarn stable code. @tgravescs, let me know if you'd like me to make these for the alpha

git commit: [SPARK-2108] Mark SparkContext methods that return block information as developer API's

2014-06-11 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.0 54ff00547 - 9ef076510 [SPARK-2108] Mark SparkContext methods that return block information as developer API's Author: Prashant Sharma prashan...@imaginea.com Closes #1047 from ScrapCodes/SPARK-2108/mark-as-dev-api and squashes the

git commit: [SPARK-2108] Mark SparkContext methods that return block information as developer API's

2014-06-11 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 5b754b45f - e508f599f [SPARK-2108] Mark SparkContext methods that return block information as developer API's Author: Prashant Sharma prashan...@imaginea.com Closes #1047 from ScrapCodes/SPARK-2108/mark-as-dev-api and squashes the

git commit: [SPARK-2042] Prevent unnecessary shuffle triggered by take()

2014-06-11 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 4d5c12aa1 - 4107cce58 [SPARK-2042] Prevent unnecessary shuffle triggered by take() This PR implements `take()` on a `SchemaRDD` by inserting a logical limit that is followed by a `collect()`. This is also accompanied by adding a catalyst

git commit: [SPARK-2042] Prevent unnecessary shuffle triggered by take()

2014-06-11 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.0 684a93a72 - cc004488d [SPARK-2042] Prevent unnecessary shuffle triggered by take() This PR implements `take()` on a `SchemaRDD` by inserting a logical limit that is followed by a `collect()`. This is also accompanied by adding a

git commit: [SQL] Code Cleanup: Left Semi Hash Join

2014-06-11 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 4107cce58 - ce6deb1e5 [SQL] Code Cleanup: Left Semi Hash Join Some improvement for PR #837, add another case to white list and use `filter` to build result iterator. Author: Daoyuan daoyuan.w...@intel.com Closes #1049 from

git commit: [SQL] Code Cleanup: Left Semi Hash Join

2014-06-11 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.0 cc004488d - 597c7efdc [SQL] Code Cleanup: Left Semi Hash Join Some improvement for PR #837, add another case to white list and use `filter` to build result iterator. Author: Daoyuan daoyuan.w...@intel.com Closes #1049 from

git commit: HOTFIX: PySpark tests should be order insensitive.

2014-06-11 Thread pwendell
Repository: spark Updated Branches: refs/heads/master fe78b8b6f - 14e6dc94f HOTFIX: PySpark tests should be order insensitive. This has been messing up the SQL PySpark tests on Jenkins. Author: Patrick Wendell pwend...@gmail.com Closes #1054 from pwendell/pyspark and squashes the following

git commit: HOTFIX: Forgot to remove false change in previous commit

2014-06-11 Thread pwendell
Repository: spark Updated Branches: refs/heads/master 14e6dc94f - d45e0c6b9 HOTFIX: Forgot to remove false change in previous commit Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d45e0c6b Tree:

git commit: HOTFIX: PySpark tests should be order insensitive.

2014-06-11 Thread pwendell
Repository: spark Updated Branches: refs/heads/branch-1.0 597c7efdc - 81049eb54 HOTFIX: PySpark tests should be order insensitive. This has been messing up the SQL PySpark tests on Jenkins. Author: Patrick Wendell pwend...@gmail.com Closes #1054 from pwendell/pyspark and squashes the

git commit: [SPARK-2052] [SQL] Add optimization for CaseConversionExpression's.

2014-06-11 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master d45e0c6b9 - 9a2448daf [SPARK-2052] [SQL] Add optimization for CaseConversionExpression's. Add optimization for `CaseConversionExpression`'s. Author: Takuya UESHIN ues...@happy-camper.st Closes #990 from ueshin/issues/SPARK-2052 and

git commit: [SPARK-2052] [SQL] Add optimization for CaseConversionExpression's.

2014-06-11 Thread marmbrus
Repository: spark Updated Branches: refs/heads/branch-1.0 81049eb54 - e3955643d [SPARK-2052] [SQL] Add optimization for CaseConversionExpression's. Add optimization for `CaseConversionExpression`'s. Author: Takuya UESHIN ues...@happy-camper.st Closes #990 from ueshin/issues/SPARK-2052 and

git commit: [SPARK-1672][MLLIB] Separate user and product partitioning in ALS

2014-06-11 Thread meng
Repository: spark Updated Branches: refs/heads/master 9a2448daf - d9203350b [SPARK-1672][MLLIB] Separate user and product partitioning in ALS Some clean up work following #593. 1. Allow to set different number user blocks and number product blocks in `ALS`. 2. Update `MovieLensALS` to