spark git commit: [SPARK-17032][SQL] Add test cases for methods in ParserUtils.

2016-08-17 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 0f6aa8afa -> 4d0cc84af [SPARK-17032][SQL] Add test cases for methods in ParserUtils. ## What changes were proposed in this pull request? Currently methods in `ParserUtils` are tested indirectly, we should add test cases in

spark git commit: [SPARK-15285][SQL] Generated SpecificSafeProjection.apply method grows beyond 64 KB

2016-08-17 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.0 68a24d3e7 -> 22c7660a8 [SPARK-15285][SQL] Generated SpecificSafeProjection.apply method grows beyond 64 KB ## What changes were proposed in this pull request? This PR splits the generated code for ```SafeProjection.apply``` by using

spark git commit: [SPARK-15285][SQL] Generated SpecificSafeProjection.apply method grows beyond 64 KB

2016-08-17 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 363793f2b -> 56d86742d [SPARK-15285][SQL] Generated SpecificSafeProjection.apply method grows beyond 64 KB ## What changes were proposed in this pull request? This PR splits the generated code for ```SafeProjection.apply``` by using

spark git commit: [SPARK-17106] [SQL] Simplify the SubqueryExpression interface

2016-08-17 Thread davies
Repository: spark Updated Branches: refs/heads/master 56d86742d -> 0b0c8b95e [SPARK-17106] [SQL] Simplify the SubqueryExpression interface ## What changes were proposed in this pull request? The current subquery expression interface contains a little bit of technical debt in the form of a

spark git commit: [SPARK-16444][SPARKR] Isotonic Regression wrapper in SparkR

2016-08-17 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 4d0cc84af -> 363793f2b [SPARK-16444][SPARKR] Isotonic Regression wrapper in SparkR ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) Add Isotonic Regression wrapper in SparkR Wrappers in R

spark git commit: [SPARK-17102][SQL] bypass UserDefinedGenerator for json format check

2016-08-17 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 0b0c8b95e -> 928ca1c6d [SPARK-17102][SQL] bypass UserDefinedGenerator for json format check ## What changes were proposed in this pull request? We use reflection to convert `TreeNode` to json string, and currently don't support arbitrary

spark git commit: [SPARK-17102][SQL] bypass UserDefinedGenerator for json format check

2016-08-17 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-2.0 22c7660a8 -> 394d59866 [SPARK-17102][SQL] bypass UserDefinedGenerator for json format check ## What changes were proposed in this pull request? We use reflection to convert `TreeNode` to json string, and currently don't support

spark git commit: [SPARK-17102][SQL] bypass UserDefinedGenerator for json format check

2016-08-17 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-1.6 5c34029b8 -> 60de30faf [SPARK-17102][SQL] bypass UserDefinedGenerator for json format check We use reflection to convert `TreeNode` to json string, and currently don't support arbitrary object. `UserDefinedGenerator` takes a function

spark git commit: [SPARK-16930][YARN] Fix a couple of races in cluster app initialization.

2016-08-17 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 928ca1c6d -> e3fec51fa [SPARK-16930][YARN] Fix a couple of races in cluster app initialization. There are two narrow races that could cause the ApplicationMaster to miss when the user application instantiates the SparkContext, which could

spark git commit: [SPARK-16446][SPARKR][ML] Gaussian Mixture Model wrapper in SparkR

2016-08-17 Thread meng
Repository: spark Updated Branches: refs/heads/master e3fec51fa -> 4d92af310 [SPARK-16446][SPARKR][ML] Gaussian Mixture Model wrapper in SparkR ## What changes were proposed in this pull request? Gaussian Mixture Model wrapper in SparkR, similarly to R's ```mvnormalmixEM```. ## How was this

spark git commit: [SPARK-16736][CORE][SQL] purge superfluous fs calls

2016-08-17 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 4d92af310 -> cc97ea188 [SPARK-16736][CORE][SQL] purge superfluous fs calls A review of the code, working back from Hadoop's `FileSystem.exists()` and `FileSystem.isDirectory()` code, then removing uses of the calls when superfluous. 1.

spark git commit: [SPARK-17096][SQL][STREAMING] Improve exception string reported through the StreamingQueryListener

2016-08-17 Thread tdas
Repository: spark Updated Branches: refs/heads/master cc97ea188 -> d60af8f6a [SPARK-17096][SQL][STREAMING] Improve exception string reported through the StreamingQueryListener ## What changes were proposed in this pull request? Currently, the stackTrace (as `Array[StackTraceElements]`)

spark git commit: [SPARK-17096][SQL][STREAMING] Improve exception string reported through the StreamingQueryListener

2016-08-17 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-2.0 394d59866 -> 9406f82db [SPARK-17096][SQL][STREAMING] Improve exception string reported through the StreamingQueryListener ## What changes were proposed in this pull request? Currently, the stackTrace (as `Array[StackTraceElements]`)

spark git commit: [SPARK-17068][SQL] Make view-usage visible during analysis

2016-08-17 Thread rxin
Repository: spark Updated Branches: refs/heads/master 4a2c375be -> f7c9ff57c [SPARK-17068][SQL] Make view-usage visible during analysis ## What changes were proposed in this pull request? This PR adds a field to subquery alias in order to make the usage of views in a resolved `LogicalPlan`

spark git commit: [MINOR][DOC] Fix the descriptions for `properties` argument in the documenation for jdbc APIs

2016-08-17 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.0 3e0163bee -> 68a24d3e7 [MINOR][DOC] Fix the descriptions for `properties` argument in the documenation for jdbc APIs ## What changes were proposed in this pull request? This should be credited to mvervuurt. The main purpose of this

spark git commit: [MINOR][DOC] Fix the descriptions for `properties` argument in the documenation for jdbc APIs

2016-08-17 Thread rxin
Repository: spark Updated Branches: refs/heads/master f7c9ff57c -> 0f6aa8afa [MINOR][DOC] Fix the descriptions for `properties` argument in the documenation for jdbc APIs ## What changes were proposed in this pull request? This should be credited to mvervuurt. The main purpose of this PR is

spark git commit: [SPARK-17038][STREAMING] fix metrics retrieval source of 'lastReceivedBatch'

2016-08-17 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-1.6 60de30faf -> 412b0e896 [SPARK-17038][STREAMING] fix metrics retrieval source of 'lastReceivedBatch' https://issues.apache.org/jira/browse/SPARK-17038 ## What changes were proposed in this pull request? StreamingSource's

spark git commit: [SPARK-17038][STREAMING] fix metrics retrieval source of 'lastReceivedBatch'

2016-08-17 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master d60af8f6a -> e6bef7d52 [SPARK-17038][STREAMING] fix metrics retrieval source of 'lastReceivedBatch' https://issues.apache.org/jira/browse/SPARK-17038 ## What changes were proposed in this pull request? StreamingSource's

spark git commit: [SPARK-17038][STREAMING] fix metrics retrieval source of 'lastReceivedBatch'

2016-08-17 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.0 9406f82db -> 585d1d95c [SPARK-17038][STREAMING] fix metrics retrieval source of 'lastReceivedBatch' https://issues.apache.org/jira/browse/SPARK-17038 ## What changes were proposed in this pull request? StreamingSource's

spark git commit: [SPARK-16995][SQL] TreeNodeException when flat mapping RelationalGroupedDataset created from DataFrame containing a column created with lit/expr

2016-08-17 Thread wenchen
Repository: spark Updated Branches: refs/heads/master e6bef7d52 -> 10204b9d2 [SPARK-16995][SQL] TreeNodeException when flat mapping RelationalGroupedDataset created from DataFrame containing a column created with lit/expr ## What changes were proposed in this pull request? A

spark git commit: [SPARK-16995][SQL] TreeNodeException when flat mapping RelationalGroupedDataset created from DataFrame containing a column created with lit/expr

2016-08-17 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.0 585d1d95c -> 91aa53239 [SPARK-16995][SQL] TreeNodeException when flat mapping RelationalGroupedDataset created from DataFrame containing a column created with lit/expr ## What changes were proposed in this pull request? A