spark git commit: [SPARK-10365][SQL] Support Parquet logical type TIMESTAMP_MICROS

2017-11-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/master d6ee69e77 -> 21a7bfd5c [SPARK-10365][SQL] Support Parquet logical type TIMESTAMP_MICROS ## What changes were proposed in this pull request? This PR makes Spark to be able to read Parquet TIMESTAMP_MICROS values, and add a new config to al

spark git commit: [SPARK-22488][SQL] Fix the view resolution issue in the SparkSession internal table() API

2017-11-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 154351e6d -> d6ee69e77 [SPARK-22488][SQL] Fix the view resolution issue in the SparkSession internal table() API ## What changes were proposed in this pull request? The current internal `table()` API of `SparkSession` bypasses the Analyzer

spark git commit: [SPARK-22462][SQL] Make rdd-based actions in Dataset trackable in SQL UI

2017-11-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 223d83ee9 -> 154351e6d [SPARK-22462][SQL] Make rdd-based actions in Dataset trackable in SQL UI ## What changes were proposed in this pull request? For the few Dataset actions such as `foreach`, currently no SQL metrics are visible in the

spark git commit: [SPARK-22476][R] Add dayofweek function to R

2017-11-11 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 3eb315d71 -> 223d83ee9 [SPARK-22476][R] Add dayofweek function to R ## What changes were proposed in this pull request? This PR adds `dayofweek` to R API: ```r data <- list(list(d = as.Date("2012-12-13")), list(d = as.Date("2

spark git commit: [SPARK-19759][ML] not using blas in ALSModel.predict for optimization

2017-11-11 Thread srowen
Repository: spark Updated Branches: refs/heads/master 808e886b9 -> 3eb315d71 [SPARK-19759][ML] not using blas in ALSModel.predict for optimization ## What changes were proposed in this pull request? In `ALS.predict` currently we are using `blas.sdot` function to perform a dot product on two