spark git commit: [SPARK-18773][CORE] Make commons-crypto config translation consistent.

2016-12-12 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 8a51cfdca -> bc59951ba [SPARK-18773][CORE] Make commons-crypto config translation consistent. This change moves the logic that translates Spark configuration to commons-crypto configuration to the network-common module. It also extends

spark git commit: [SPARK-18810][SPARKR] SparkR install.spark does not work for RCs, snapshots

2016-12-12 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.1 523071f3f -> 1aeb7f427 [SPARK-18810][SPARKR] SparkR install.spark does not work for RCs, snapshots ## What changes were proposed in this pull request? Support overriding the download url (include version directory) in an environment

spark git commit: [SPARK-18810][SPARKR] SparkR install.spark does not work for RCs, snapshots

2016-12-12 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 90abfd15f -> 8a51cfdca [SPARK-18810][SPARKR] SparkR install.spark does not work for RCs, snapshots ## What changes were proposed in this pull request? Support overriding the download url (include version directory) in an environment

spark git commit: [SPARK-18681][SQL] Fix filtering to compatible with partition keys of type int

2016-12-12 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master 476b34c23 -> 90abfd15f [SPARK-18681][SQL] Fix filtering to compatible with partition keys of type int ## What changes were proposed in this pull request? Cloudera put

spark git commit: [SPARK-18681][SQL] Fix filtering to compatible with partition keys of type int

2016-12-12 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.1 35011608f -> 523071f3f [SPARK-18681][SQL] Fix filtering to compatible with partition keys of type int ## What changes were proposed in this pull request? Cloudera put

spark git commit: [SPARK-18752][HIVE] isSrcLocal" value should be set from user query.

2016-12-12 Thread lixiao
Repository: spark Updated Branches: refs/heads/master bf42c2db5 -> 476b34c23 [SPARK-18752][HIVE] isSrcLocal" value should be set from user query. The value of the "isSrcLocal" parameter passed to Hive's loadTable and loadPartition methods needs to be set according to the user query (e.g.

spark git commit: [SPARK-18797][SPARKR] Update spark.logit in sparkr-vignettes

2016-12-12 Thread meng
Repository: spark Updated Branches: refs/heads/branch-2.1 9dc5fa5f7 -> 9f0e3be62 [SPARK-18797][SPARKR] Update spark.logit in sparkr-vignettes ## What changes were proposed in this pull request? spark.logit is added in 2.1. We need to update spark-vignettes to reflect the changes. This is

spark git commit: [SPARK-18797][SPARKR] Update spark.logit in sparkr-vignettes

2016-12-12 Thread meng
Repository: spark Updated Branches: refs/heads/master 417e45c58 -> 2aa16d03d [SPARK-18797][SPARKR] Update spark.logit in sparkr-vignettes ## What changes were proposed in this pull request? spark.logit is added in 2.1. We need to update spark-vignettes to reflect the changes. This is part of

spark git commit: [SPARK-18717][SQL] Make code generation for Scala Map work with immutable.Map also

2016-12-12 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 2aa16d03d -> 46d30ac48 [SPARK-18717][SQL] Make code generation for Scala Map work with immutable.Map also ## What changes were proposed in this pull request? Fixes compile errors in generated code when user has case class with a

spark git commit: [SPARK-18796][SS] StreamingQueryManager should not block when starting a query

2016-12-12 Thread tdas
Repository: spark Updated Branches: refs/heads/master bc59951ba -> 417e45c58 [SPARK-18796][SS] StreamingQueryManager should not block when starting a query ## What changes were proposed in this pull request? Major change in this PR: - Add `pendingQueryNames` and `pendingQueryIds` to track

spark git commit: [SPARK-18796][SS] StreamingQueryManager should not block when starting a query

2016-12-12 Thread tdas
Repository: spark Updated Branches: refs/heads/branch-2.1 1aeb7f427 -> 9dc5fa5f7 [SPARK-18796][SS] StreamingQueryManager should not block when starting a query ## What changes were proposed in this pull request? Major change in this PR: - Add `pendingQueryNames` and `pendingQueryIds` to

spark git commit: [DOCS][MINOR] Clarify Where AccumulatorV2s are Displayed

2016-12-12 Thread srowen
Repository: spark Updated Branches: refs/heads/master 83a42897a -> 7021f [DOCS][MINOR] Clarify Where AccumulatorV2s are Displayed ## What changes were proposed in this pull request? This PR clarifies where accumulators will be displayed. ## How was this patch tested? No testing.

spark git commit: [DOCS][MINOR] Clarify Where AccumulatorV2s are Displayed

2016-12-12 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 63693c17e -> 35011608f [DOCS][MINOR] Clarify Where AccumulatorV2s are Displayed ## What changes were proposed in this pull request? This PR clarifies where accumulators will be displayed. ## How was this patch tested? No testing.

spark git commit: [SPARK-16297][SQL] Fix mapping Microsoft SQLServer dialect

2016-12-12 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 586d19822 -> bf42c2db5 [SPARK-16297][SQL] Fix mapping Microsoft SQLServer dialect The problem is if it is run with no fix throws an exception and causes the following error: "Cannot specify a column width on data type bit." The

spark git commit: [SPARK-15844][CORE] HistoryServer doesn't come up if spark.authenticate = true

2016-12-12 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 7021f -> 586d19822 [SPARK-15844][CORE] HistoryServer doesn't come up if spark.authenticate = true ## What changes were proposed in this pull request? During history server startup, the spark configuration is examined. If