spark git commit: [SPARK-19088][SQL] Optimize sequence type deserialization codegen

2017-03-27 Thread wenchen
Repository: spark Updated Branches: refs/heads/master ea361165e -> 6c70a38c2 [SPARK-19088][SQL] Optimize sequence type deserialization codegen ## What changes were proposed in this pull request? Optimization of arbitrary Scala sequence deserialization introduced by #16240. The previous

spark git commit: [SPARK-20100][SQL] Refactor SessionState initialization

2017-03-27 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 8a6f33f04 -> ea361165e [SPARK-20100][SQL] Refactor SessionState initialization ## What changes were proposed in this pull request? The current SessionState initialization code path is quite complex. A part of the creation is done in the

spark git commit: [SPARK-19803][CORE][TEST] Proactive replication test failures

2017-03-27 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 1d00761b9 -> a250933c6 [SPARK-19803][CORE][TEST] Proactive replication test failures ## What changes were proposed in this pull request? Executors cache a list of their peers that is refreshed by default every minute. The cached stale

spark git commit: [MINOR][SPARKR] Move 'Data type mapping between R and Spark' to right place in SparkR doc.

2017-03-27 Thread yliang
Repository: spark Updated Branches: refs/heads/master 3fada2f50 -> 1d00761b9 [MINOR][SPARKR] Move 'Data type mapping between R and Spark' to right place in SparkR doc. Section ```Data type mapping between R and Spark``` was put in the wrong place in SparkR doc currently, we should move it

spark git commit: [SPARK-20105][TESTS][R] Add tests for checkType and type string in structField in R

2017-03-27 Thread felixcheung
Repository: spark Updated Branches: refs/heads/master 314cf51de -> 3fada2f50 [SPARK-20105][TESTS][R] Add tests for checkType and type string in structField in R ## What changes were proposed in this pull request? It seems `checkType` and the type string in `structField` are not being tested

spark git commit: [SPARK-20102] Fix nightly packaging and RC packaging scripts w/ two minor build fixes

2017-03-27 Thread joshrosen
Repository: spark Updated Branches: refs/heads/master 0588dc7c0 -> 314cf51de [SPARK-20102] Fix nightly packaging and RC packaging scripts w/ two minor build fixes ## What changes were proposed in this pull request? The master snapshot publisher builds are currently broken due to two minor

spark git commit: [SPARK-20088] Do not create new SparkContext in SparkR createSparkContext

2017-03-27 Thread meng
Repository: spark Updated Branches: refs/heads/master 890493458 -> 0588dc7c0 [SPARK-20088] Do not create new SparkContext in SparkR createSparkContext ## What changes were proposed in this pull request? Instead of creating new `JavaSparkContext` we use `SparkContext.getOrCreate`. ## How was

spark git commit: [SPARK-20104][SQL] Don't estimate IsNull or IsNotNull predicates for non-leaf node

2017-03-27 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 3fbf0a5f9 -> 890493458 [SPARK-20104][SQL] Don't estimate IsNull or IsNotNull predicates for non-leaf node ## What changes were proposed in this pull request? In current stage, we don't have advanced statistics such as sketches or

spark-website git commit: added section about mima

2017-03-27 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 39838046c -> 8b27c470c added section about mima Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/8b27c470 Tree: