spark git commit: [SPARK-18967][SCHEDULER] compute locality levels even if delay = 0

2017-02-06 Thread kayousterhout
Repository: spark Updated Branches: refs/heads/master 7a0a630e0 -> d9043092c [SPARK-18967][SCHEDULER] compute locality levels even if delay = 0 ## What changes were proposed in this pull request? Before this change, with delay scheduling off, spark would effectively ignore locality

spark git commit: [SPARK-19407][SS] defaultFS is used FileSystem.get instead of getting it from uri scheme

2017-02-06 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.1 f55bd4c73 -> 62fab5bee [SPARK-19407][SS] defaultFS is used FileSystem.get instead of getting it from uri scheme ## What changes were proposed in this pull request? ``` Caused by: java.lang.IllegalArgumentException: Wrong FS:

spark git commit: [SPARK-19407][SS] defaultFS is used FileSystem.get instead of getting it from uri scheme

2017-02-06 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master fab0d62a7 -> 7a0a630e0 [SPARK-19407][SS] defaultFS is used FileSystem.get instead of getting it from uri scheme ## What changes were proposed in this pull request? ``` Caused by: java.lang.IllegalArgumentException: Wrong FS:

spark git commit: [SPARK-19467][ML][PYTHON] Remove cyclic imports from pyspark.ml.pipeline

2017-02-06 Thread jkbradley
Repository: spark Updated Branches: refs/heads/master d6dc603ed -> fab0d62a7 [SPARK-19467][ML][PYTHON] Remove cyclic imports from pyspark.ml.pipeline ## What changes were proposed in this pull request? Remove cyclic imports between `pyspark.ml.pipeline` and `pyspark.ml`. ## How was this

spark git commit: [SPARK-19441][SQL] Remove IN type coercion from PromoteStrings

2017-02-06 Thread wenchen
Repository: spark Updated Branches: refs/heads/master cb2677b86 -> d6dc603ed [SPARK-19441][SQL] Remove IN type coercion from PromoteStrings ### What changes were proposed in this pull request? The removed codes for `IN` are not reachable, because the previous rule `InConversion` already

spark git commit: [SPARK-19472][SQL] Parser should not mistake CASE WHEN(...) for a function call

2017-02-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.0 b41294bb8 -> 8bf642226 [SPARK-19472][SQL] Parser should not mistake CASE WHEN(...) for a function call ## What changes were proposed in this pull request? The SQL parser can mistake a `WHEN (...)` used in `CASE` for a function call.

spark git commit: [SPARK-19472][SQL] Parser should not mistake CASE WHEN(...) for a function call

2017-02-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.1 7c23bd49e -> f55bd4c73 [SPARK-19472][SQL] Parser should not mistake CASE WHEN(...) for a function call ## What changes were proposed in this pull request? The SQL parser can mistake a `WHEN (...)` used in `CASE` for a function call.

spark git commit: [SPARK-19398] Change one misleading log in TaskSetManager.

2017-02-06 Thread kayousterhout
Repository: spark Updated Branches: refs/heads/master aff53021c -> d33021b31 [SPARK-19398] Change one misleading log in TaskSetManager. ## What changes were proposed in this pull request? Log below is misleading: ``` if (successful(index)) { logInfo( s"Task ${info.id} in stage

spark git commit: [SPARK-19080][SQL] simplify data source analysis

2017-02-06 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 0f16ff5b0 -> aff53021c [SPARK-19080][SQL] simplify data source analysis ## What changes were proposed in this pull request? The current way of resolving `InsertIntoTable` and `CreateTable` is convoluted: sometimes we replace them with

spark git commit: [SPARK-17663][CORE] SchedulableBuilder should handle invalid data access via scheduler.allocation.file

2017-02-06 Thread irashid
Repository: spark Updated Branches: refs/heads/master 7730426cb -> 7beb227cc [SPARK-17663][CORE] SchedulableBuilder should handle invalid data access via scheduler.allocation.file ## What changes were proposed in this pull request? If `spark.scheduler.allocation.file` has invalid `minShare`