[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15644 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15644 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69004/ Test PASSed. ---

[GitHub] spark issue #15970: [SPARK-18134][SQL] Comparable MapTypes [POC]

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15970 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69003/ Test PASSed. ---

[GitHub] spark issue #15970: [SPARK-18134][SQL] Comparable MapTypes [POC]

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15970 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15644 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69005/ Test PASSed. ---

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15644 **[Test build #69004 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69004/consoleFull)** for PR 15644 at commit

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15644 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15970: [SPARK-18134][SQL] Comparable MapTypes [POC]

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15970 **[Test build #69003 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69003/consoleFull)** for PR 15970 at commit

[GitHub] spark pull request #15975: [SPARK-18538] [SQL] Fix Concurrent Table Fetching...

2016-11-22 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15975#discussion_r89181212 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/jdbc/JDBCSuite.scala --- @@ -404,6 +425,7 @@ class JDBCSuite extends SparkFunSuite

[GitHub] spark issue #15820: [SPARK-18373][SPARK-18529][SS][Kafka]Make failOnDataLoss...

2016-11-22 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15820 > @zsxwing should the title include SPARK-18529 per your comment on the JIRA? Thanks for pointing out. Updated. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15644 **[Test build #69005 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69005/consoleFull)** for PR 15644 at commit

[GitHub] spark pull request #15874: [Spark-18408][ML] API Improvements for LSH

2016-11-22 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15874#discussion_r89180705 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinHashLSH.scala --- @@ -31,36 +31,38 @@ import org.apache.spark.sql.types.StructType /**

[GitHub] spark pull request #15959: [SPARK-18522][SQL] Explicit contract for column s...

2016-11-22 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15959#discussion_r89180234 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/Statistics.scala --- @@ -58,60 +61,164 @@ case class Statistics( }

[GitHub] spark issue #15966: [SPARK-18413][SQL][FOLLOW-UP] Use `numPartitions` instea...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15966 **[Test build #69019 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69019/consoleFull)** for PR 15966 at commit

[GitHub] spark issue #15976: [SPARK-18403][SQL] Fix unsafe data false sharing issue i...

2016-11-22 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/15976 cc @yhuai @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-11-22 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/11105 Ping for @srowen / @rxin / @squito updated with the latest changes in the `SparkContext`. The issue is tagged for 2.1.0 and I know were cutting an RC soon so if there is anything I should to try

[GitHub] spark issue #15978: [SPARK-18507][SQL] HiveExternalCatalog.listPartitions sh...

2016-11-22 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/15978 This patch resolves the performance problem I was seeing. Thank you! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request #15976: [SPARK-18403][SQL] Fix unsafe data false sharing ...

2016-11-22 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/15976#discussion_r89178617 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/ObjectHashAggregateSuite.scala --- @@ -325,70 +320,67 @@ class

[GitHub] spark issue #15976: [SPARK-18403][SQL] Fix unsafe data false sharing issue i...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15976 **[Test build #69016 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69016/consoleFull)** for PR 15976 at commit

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11105 **[Test build #69018 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69018/consoleFull)** for PR 11105 at commit

[GitHub] spark issue #15896: [SPARK-18465] Add 'IF EXISTS' clause to 'UNCACHE' to not...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15896 **[Test build #69017 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69017/consoleFull)** for PR 15896 at commit

[GitHub] spark pull request #15977: [SPARK-18436][SQL] isin causing SQL syntax error ...

2016-11-22 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15977#discussion_r89178225 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala --- @@ -114,10 +114,14 @@ object ReorderAssociativeOperator

[GitHub] spark issue #15966: [SPARK-18413][SQL][FOLLOW-UP] Use `numPartitions` instea...

2016-11-22 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15966 Great! Thank you for #15975. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15896: [SPARK-18465] Add 'IF EXISTS' clause to 'UNCACHE' to not...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15896 **[Test build #69014 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69014/consoleFull)** for PR 15896 at commit

[GitHub] spark issue #15541: [SPARK-17637][Scheduler]Packed scheduling for Spark task...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15541 **[Test build #69015 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69015/consoleFull)** for PR 15541 at commit

[GitHub] spark issue #15896: [SPARK-18465] Add 'IF EXISTS' clause to 'UNCACHE' to not...

2016-11-22 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/15896 Hey @andrewor14 ! I went with your way. @hvanhovell can you take a quick look please? I would really like this to be available in Spark 2.1 (even though it is a new API) --- If your project is set

[GitHub] spark issue #15896: [SPARK-18465] Uncache table shouldn't throw an exception...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15896 **[Test build #69013 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69013/consoleFull)** for PR 15896 at commit

[GitHub] spark issue #15976: [SPARK-18403][SQL] Fix unsafe data false sharing issue i...

2016-11-22 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/15976 The last build failure was caused by a logical conflict with #15703. We don't really have any aggregate functions that don't support partial aggregation now after merging #15703, while the

[GitHub] spark pull request #12004: [SPARK-7481] [build] Add spark-cloud module to pu...

2016-11-22 Thread steveloughran
Github user steveloughran commented on a diff in the pull request: https://github.com/apache/spark/pull/12004#discussion_r89176373 --- Diff: pom.xml --- @@ -2558,6 +2660,26 @@ +

[GitHub] spark issue #15926: [SPARK-16803] [SQL] SaveAsTable does not work when targe...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15926 **[Test build #69011 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69011/consoleFull)** for PR 15926 at commit

[GitHub] spark issue #15874: [Spark-18408][ML] API Improvements for LSH

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15874 **[Test build #69012 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69012/consoleFull)** for PR 15874 at commit

[GitHub] spark pull request #15874: [Spark-18408][ML] API Improvements for LSH

2016-11-22 Thread Yunni
Github user Yunni commented on a diff in the pull request: https://github.com/apache/spark/pull/15874#discussion_r89175604 --- Diff: mllib/src/test/scala/org/apache/spark/ml/feature/BucketedRandomProjectionLSHSuite.scala --- @@ -43,70 +43,73 @@ class RandomProjectionSuite

[GitHub] spark pull request #15874: [Spark-18408][ML] API Improvements for LSH

2016-11-22 Thread Yunni
Github user Yunni commented on a diff in the pull request: https://github.com/apache/spark/pull/15874#discussion_r89175438 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/LSH.scala --- @@ -155,8 +148,30 @@ private[ml] abstract class LSHModel[T <: LSHModel[T]] }

[GitHub] spark pull request #15874: [Spark-18408][ML] API Improvements for LSH

2016-11-22 Thread Yunni
Github user Yunni commented on a diff in the pull request: https://github.com/apache/spark/pull/15874#discussion_r89175473 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/LSH.scala --- @@ -155,8 +148,30 @@ private[ml] abstract class LSHModel[T <: LSHModel[T]] }

[GitHub] spark pull request #15874: [Spark-18408][ML] API Improvements for LSH

2016-11-22 Thread Yunni
Github user Yunni commented on a diff in the pull request: https://github.com/apache/spark/pull/15874#discussion_r89175497 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinHashLSH.scala --- @@ -31,36 +31,38 @@ import org.apache.spark.sql.types.StructType /**

[GitHub] spark issue #15813: [SPARK-18362][SQL] Use TextFileFormat in JsonFileFormat ...

2016-11-22 Thread NathanHowell
Github user NathanHowell commented on the issue: https://github.com/apache/spark/pull/15813 Any thoughts on modifying `JsonToStruct` to support arrays (and options), then parsing could be something like: ``` dataset.select( Column(Inline( JsonToValue(

[GitHub] spark pull request #15874: [Spark-18408][ML] API Improvements for LSH

2016-11-22 Thread Yunni
Github user Yunni commented on a diff in the pull request: https://github.com/apache/spark/pull/15874#discussion_r89175448 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/LSH.scala --- @@ -155,8 +148,30 @@ private[ml] abstract class LSHModel[T <: LSHModel[T]] }

[GitHub] spark pull request #15874: [Spark-18408][ML] API Improvements for LSH

2016-11-22 Thread Yunni
Github user Yunni commented on a diff in the pull request: https://github.com/apache/spark/pull/15874#discussion_r89175401 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/MinHashLSH.scala --- @@ -31,36 +31,38 @@ import org.apache.spark.sql.types.StructType /**

[GitHub] spark issue #15620: [SPARK-18091] [SQL] Deep if expressions cause Generated ...

2016-11-22 Thread kapilsingh5050
Github user kapilsingh5050 commented on the issue: https://github.com/apache/spark/pull/15620 I did not want to run tests using ./dev/run-tests on my machine because it'll take hours. I ran the mllib module tests using "mvn test" which worked fine on my machine. What could be the

[GitHub] spark pull request #15926: [SPARK-16803] [SQL] SaveAsTable does not work whe...

2016-11-22 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15926#discussion_r89174072 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/MetastoreDataSourcesSuite.scala --- @@ -413,6 +413,40 @@ class MetastoreDataSourcesSuite

[GitHub] spark issue #15951: [SPARK-18510] Fix data corruption from inferred partitio...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15951 **[Test build #69010 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69010/consoleFull)** for PR 15951 at commit

[GitHub] spark issue #15978: [SPARK-18507][SQL] HiveExternalCatalog.listPartitions sh...

2016-11-22 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/15978 I'll give this patch a try. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15505: [SPARK-17931][CORE] taskScheduler has some unneed...

2016-11-22 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/15505#discussion_r89166735 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSetManagerSuite.scala --- @@ -592,47 +579,6 @@ class TaskSetManagerSuite extends SparkFunSuite

[GitHub] spark issue #15936: [SPARK-18504][SQL] Scalar subquery with extra group by c...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15936 **[Test build #69009 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69009/consoleFull)** for PR 15936 at commit

[GitHub] spark pull request #15505: [SPARK-17931][CORE] taskScheduler has some unneed...

2016-11-22 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/15505#discussion_r89167206 --- Diff: mesos/src/test/scala/org/apache/spark/scheduler/cluster/mesos/MesosFineGrainedSchedulerBackendSuite.scala --- @@ -345,7 +374,17 @@ class

[GitHub] spark pull request #15505: [SPARK-17931][CORE] taskScheduler has some unneed...

2016-11-22 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/15505#discussion_r89166210 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskDescription.scala --- @@ -17,27 +17,178 @@ package org.apache.spark.scheduler

[GitHub] spark pull request #15505: [SPARK-17931][CORE] taskScheduler has some unneed...

2016-11-22 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/15505#discussion_r89166493 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala --- @@ -139,29 +139,6 @@ class TaskSchedulerImplSuite extends

[GitHub] spark pull request #15505: [SPARK-17931][CORE] taskScheduler has some unneed...

2016-11-22 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/15505#discussion_r89166279 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskDescription.scala --- @@ -17,27 +17,178 @@ package org.apache.spark.scheduler

[GitHub] spark issue #15936: [SPARK-18504][SQL] Scalar subquery with extra group by c...

2016-11-22 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15936 add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #15936: [SPARK-18504][SQL] Scalar subquery with extra group by c...

2016-11-22 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15936 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #15936: [SPARK-18504][SQL] Scalar subquery with extra group by c...

2016-11-22 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15936 It should pick it up automatically. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15936: [SPARK-18504][SQL] Scalar subquery with extra group by c...

2016-11-22 Thread nsyca
Github user nsyca commented on the issue: https://github.com/apache/spark/pull/15936 Should I say `retest this please` to kick off the regression test? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request #15968: [SPARK-18533] Raise correct error upon specificat...

2016-11-22 Thread dilipbiswal
Github user dilipbiswal commented on a diff in the pull request: https://github.com/apache/spark/pull/15968#discussion_r89164848 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -322,7 +322,26 @@ class SparkSqlAstBuilder(conf: SQLConf)

[GitHub] spark issue #15956: [SPARK-18519][SQL] map type can not be used in EqualTo

2016-11-22 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15956 @cloud-fan I cannot merge this to 2.0. Can you make a backport if we need one? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request #15956: [SPARK-18519][SQL] map type can not be used in Eq...

2016-11-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15956 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15956: [SPARK-18519][SQL] map type can not be used in EqualTo

2016-11-22 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15956 LGTM - merging to master/2.0. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15644 **[Test build #69008 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69008/consoleFull)** for PR 15644 at commit

[GitHub] spark issue #15968: [SPARK-18533] Raise correct error upon specification of ...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15968 **[Test build #69007 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69007/consoleFull)** for PR 15968 at commit

[GitHub] spark issue #15957: [SPARK-18520][ML] Add missing setXXXCol methods for Bise...

2016-11-22 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15957 CC @jkbradley per your message today in case this should really be in for 2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-22 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/15644#discussion_r89163640 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala --- @@ -282,6 +316,211 @@ class TaskSchedulerImplSuite extends

[GitHub] spark issue #15956: [SPARK-18519][SQL] map type can not be used in EqualTo

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15956 **[Test build #69002 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69002/consoleFull)** for PR 15956 at commit

[GitHub] spark issue #15956: [SPARK-18519][SQL] map type can not be used in EqualTo

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15956 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69002/ Test PASSed. ---

[GitHub] spark issue #15956: [SPARK-18519][SQL] map type can not be used in EqualTo

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15956 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15936: [SPARK-18504][SQL] Scalar subquery with extra gro...

2016-11-22 Thread nsyca
Github user nsyca commented on a diff in the pull request: https://github.com/apache/spark/pull/15936#discussion_r89159852 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala --- @@ -117,19 +117,36 @@ trait CheckAnalysis extends

[GitHub] spark issue #15967: [SPARK-18073][DOCS][WIP] Migrate wiki to spark.apache.or...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15967 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69001/ Test PASSed. ---

[GitHub] spark issue #15967: [SPARK-18073][DOCS][WIP] Migrate wiki to spark.apache.or...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15967 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15967: [SPARK-18073][DOCS][WIP] Migrate wiki to spark.apache.or...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15967 **[Test build #69001 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69001/consoleFull)** for PR 15967 at commit

[GitHub] spark issue #15979: [SPARK-18251][SQL] the type of Dataset can't be Option o...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15979 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15936: [SPARK-18504][SQL] Scalar subquery with extra gro...

2016-11-22 Thread nsyca
Github user nsyca commented on a diff in the pull request: https://github.com/apache/spark/pull/15936#discussion_r89158982 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala --- @@ -117,19 +117,36 @@ trait CheckAnalysis extends

[GitHub] spark pull request #15968: [SPARK-18533] Raise correct error upon specificat...

2016-11-22 Thread dilipbiswal
Github user dilipbiswal commented on a diff in the pull request: https://github.com/apache/spark/pull/15968#discussion_r89158685 --- Diff: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 --- @@ -71,11 +71,7 @@ statement | createTableHeader

[GitHub] spark pull request #15936: [SPARK-18504][SQL] Scalar subquery with extra gro...

2016-11-22 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/15936#discussion_r89156723 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala --- @@ -117,19 +117,36 @@ trait CheckAnalysis extends

[GitHub] spark issue #15979: [SPARK-18251][SQL] the type of Dataset can't be Option o...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15979 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69000/ Test PASSed. ---

[GitHub] spark issue #15979: [SPARK-18251][SQL] the type of Dataset can't be Option o...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15979 **[Test build #69000 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69000/consoleFull)** for PR 15979 at commit

[GitHub] spark pull request #15936: [SPARK-18504][SQL] Scalar subquery with extra gro...

2016-11-22 Thread nsyca
Github user nsyca commented on a diff in the pull request: https://github.com/apache/spark/pull/15936#discussion_r89155790 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala --- @@ -117,19 +117,36 @@ trait CheckAnalysis extends

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15644 **[Test build #69006 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69006/consoleFull)** for PR 15644 at commit

[GitHub] spark pull request #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-22 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/15644#discussion_r89152929 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala --- @@ -282,6 +316,211 @@ class TaskSchedulerImplSuite extends

[GitHub] spark pull request #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-22 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/15644#discussion_r89152684 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala --- @@ -282,6 +316,211 @@ class TaskSchedulerImplSuite extends

[GitHub] spark pull request #15977: [SPARK-18436][SQL] isin causing SQL syntax error ...

2016-11-22 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/15977#discussion_r89152336 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCRDD.scala --- @@ -120,7 +120,13 @@ object JDBCRDD extends Logging

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-22 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/15644 The final commit (https://github.com/apache/spark/pull/15644/commits/4a91e5fc0a64cfe740530fbeddf3722d2006bd10) just changes whether the iterations are inside or outside of the test so you can

[GitHub] spark pull request #15936: [SPARK-18504][SQL] Scalar subquery with extra gro...

2016-11-22 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/15936#discussion_r89151615 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala --- @@ -117,19 +117,36 @@ trait CheckAnalysis extends

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15644 **[Test build #69005 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69005/consoleFull)** for PR 15644 at commit

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15644 **[Test build #69004 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69004/consoleFull)** for PR 15644 at commit

[GitHub] spark issue #15970: [SPARK-18134][SQL] Comparable MapTypes [POC]

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15970 **[Test build #69003 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69003/consoleFull)** for PR 15970 at commit

[GitHub] spark pull request #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-22 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/15644#discussion_r89146230 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala --- @@ -282,6 +316,211 @@ class TaskSchedulerImplSuite extends

[GitHub] spark pull request #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-11-22 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/15644#discussion_r89144137 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala --- @@ -282,6 +316,211 @@ class TaskSchedulerImplSuite extends

[GitHub] spark issue #15977: [SPARK-18436][SQL] isin causing SQL syntax error with JD...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15977 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15977: [SPARK-18436][SQL] isin causing SQL syntax error with JD...

2016-11-22 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15977 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68998/ Test PASSed. ---

[GitHub] spark issue #15212: [SPARK-17645][MLLIB][ML]add feature selector method base...

2016-11-22 Thread mpjlu
Github user mpjlu commented on the issue: https://github.com/apache/spark/pull/15212 hi @yanboliang , @srowen @jkbradley , I have updated this PR, thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #15977: [SPARK-18436][SQL] isin causing SQL syntax error with JD...

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15977 **[Test build #68998 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68998/consoleFull)** for PR 15977 at commit

[GitHub] spark issue #15965: [SPARK-18356] [ML] Improve MLKmeans Performance

2016-11-22 Thread ZakariaHili
Github user ZakariaHili commented on the issue: https://github.com/apache/spark/pull/15965 @srowen, Ok I found it I fixed --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #12004: [SPARK-7481] [build] Add spark-cloud module to pu...

2016-11-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/12004#discussion_r89133451 --- Diff: docs/cloud-integration.md --- @@ -0,0 +1,953 @@ +--- +layout: global +displayTitle: Integration with Cloud Infrastructures +title:

[GitHub] spark pull request #12004: [SPARK-7481] [build] Add spark-cloud module to pu...

2016-11-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/12004#discussion_r89134807 --- Diff: pom.xml --- @@ -2558,6 +2660,26 @@ +

[GitHub] spark pull request #12004: [SPARK-7481] [build] Add spark-cloud module to pu...

2016-11-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/12004#discussion_r89132111 --- Diff: cloud/src/test/scala/org/apache/spark/cloud/AzureInstantiationSuite.scala --- @@ -0,0 +1,29 @@ +/* --- End diff -- What are these

[GitHub] spark pull request #12004: [SPARK-7481] [build] Add spark-cloud module to pu...

2016-11-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/12004#discussion_r89134487 --- Diff: docs/cloud-integration.md --- @@ -0,0 +1,953 @@ +--- +layout: global +displayTitle: Integration with Cloud Infrastructures +title:

[GitHub] spark pull request #12004: [SPARK-7481] [build] Add spark-cloud module to pu...

2016-11-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/12004#discussion_r89133827 --- Diff: docs/cloud-integration.md --- @@ -0,0 +1,953 @@ +--- +layout: global +displayTitle: Integration with Cloud Infrastructures +title:

[GitHub] spark pull request #12004: [SPARK-7481] [build] Add spark-cloud module to pu...

2016-11-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/12004#discussion_r89134682 --- Diff: docs/storage-openstack-swift.md --- @@ -19,41 +19,32 @@ Although not mandatory, it is recommended to configure the proxy server of Swift

[GitHub] spark pull request #12004: [SPARK-7481] [build] Add spark-cloud module to pu...

2016-11-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/12004#discussion_r89133312 --- Diff: docs/cloud-integration.md --- @@ -0,0 +1,953 @@ +--- +layout: global +displayTitle: Integration with Cloud Infrastructures +title:

[GitHub] spark pull request #12004: [SPARK-7481] [build] Add spark-cloud module to pu...

2016-11-22 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/12004#discussion_r89132623 --- Diff: cloud/pom.xml --- @@ -0,0 +1,158 @@ + + +http://maven.apache.org/POM/4.0.0; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance;

[GitHub] spark issue #15956: [SPARK-18519][SQL] map type can not be used in EqualTo

2016-11-22 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15956 **[Test build #69002 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69002/consoleFull)** for PR 15956 at commit

[GitHub] spark issue #15956: [SPARK-18519][SQL] map type can not be used in EqualTo

2016-11-22 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15956 LGTM pending Jenkins --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

<    1   2   3   4   5   6   7   >