[GitHub] spark issue #17188: [SPARK-19751][SQL] Throw an exception if bean class has ...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17188 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74304/ Test FAILed. ---

[GitHub] spark issue #17188: [SPARK-19751][SQL] Throw an exception if bean class has ...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17188 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17188: [SPARK-19751][SQL] Throw an exception if bean class has ...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17188 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17236: [SPARK-19893][SQL] Cannot run intersect/except with map ...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17236 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74300/ Test FAILed. ---

[GitHub] spark issue #17236: [SPARK-19893][SQL] Cannot run intersect/except with map ...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17236 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17188: [SPARK-19751][SQL] Throw an exception if bean class has ...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17188 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74303/ Test FAILed. ---

[GitHub] spark issue #17188: [SPARK-19751][SQL] Throw an exception if bean class has ...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17188 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74302/ Test FAILed. ---

[GitHub] spark issue #17188: [SPARK-19751][SQL] Throw an exception if bean class has ...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17188 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17087: [SPARK-19372][SQL] Fix throwing a Java exception at df.f...

2017-03-10 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/17087 Thank you for pointing out `InterpretedPredicate`. Now, `newPredicate` always returns `Predicate` that can be executed by calling `eval()`. It looks simpler and better than the first

[GitHub] spark pull request #17234: [SPARK-19892][MLlib] Implement findAnalogies meth...

2017-03-10 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/17234#discussion_r105351636 --- Diff: R/pkg/DESCRIPTION --- @@ -54,5 +54,5 @@ Collate: 'types.R' 'utils.R' 'window.R' -RoxygenNote: 5.0.1

[GitHub] spark pull request #17234: [SPARK-19892][MLlib] Implement findAnalogies meth...

2017-03-10 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/17234#discussion_r105351890 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/feature/Word2Vec.scala --- @@ -610,6 +610,71 @@ class Word2VecModel private[spark] ( }

[GitHub] spark issue #17087: [SPARK-19372][SQL] Fix throwing a Java exception at df.f...

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17087 **[Test build #74311 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74311/testReport)** for PR 17087 at commit

[GitHub] spark issue #17087: [SPARK-19372][SQL] Fix throwing a Java exception at df.f...

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17087 **[Test build #74310 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74310/testReport)** for PR 17087 at commit

[GitHub] spark issue #17087: [SPARK-19372][SQL] Fix throwing a Java exception at df.f...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17087 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74310/ Test FAILed. ---

[GitHub] spark issue #17087: [SPARK-19372][SQL] Fix throwing a Java exception at df.f...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17087 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17087: [SPARK-19372][SQL] Fix throwing a Java exception at df.f...

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17087 **[Test build #74311 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74311/testReport)** for PR 17087 at commit

[GitHub] spark issue #17087: [SPARK-19372][SQL] Fix throwing a Java exception at df.f...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17087 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74311/ Test FAILed. ---

[GitHub] spark issue #17237: [SPARK-19852][PYSPARK][ML] Update Python API setHandleIn...

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17237 **[Test build #74312 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74312/testReport)** for PR 17237 at commit

[GitHub] spark issue #17087: [SPARK-19372][SQL] Fix throwing a Java exception at df.f...

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17087 **[Test build #74313 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74313/testReport)** for PR 17087 at commit

[GitHub] spark issue #15009: [SPARK-17443][SPARK-11035] Stop Spark Application if lau...

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15009 **[Test build #74306 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74306/testReport)** for PR 15009 at commit

[GitHub] spark issue #17188: [SPARK-19751][SQL] Throw an exception if bean class has ...

2017-03-10 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/17188 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17188: [SPARK-19751][SQL] Throw an exception if bean class has ...

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17188 **[Test build #74307 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74307/testReport)** for PR 17188 at commit

[GitHub] spark issue #17238: getRackForHost returns None if host is unknown by driver

2017-03-10 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17238 Please change the title per http://spark.apache.org/contributing.html @squito or @vanzin do you know enough to evaluate this? --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #17239: Using map function in spark for huge operation

2017-03-10 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17239 Please close this @nischay21 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17236: [SPARK-19893][SQL] Cannot run intersect/except with map ...

2017-03-10 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17236 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #17237: [SPARK-19852][PYSPARK][ML] Update Python API setHandleIn...

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17237 **[Test build #74308 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74308/testReport)** for PR 17237 at commit

[GitHub] spark issue #17236: [SPARK-19893][SQL] Cannot run intersect/except with map ...

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17236 **[Test build #74309 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74309/testReport)** for PR 17236 at commit

[GitHub] spark issue #17232: [SPARK-18112] [SQL] Support reading data from Hive 2.1 m...

2017-03-10 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/17232 ... The end-to-end test cases in `VersionSuite.scala` does not use the expected hive client versions. Need to fix that at first. --- If your project is set up for it, you can reply to this

[GitHub] spark issue #17237: [SPARK-19852][PYSPARK][ML] Update Python API setHandleIn...

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17237 **[Test build #74308 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74308/testReport)** for PR 17237 at commit

[GitHub] spark issue #17237: [SPARK-19852][PYSPARK][ML] Update Python API setHandleIn...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17237 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17237: [SPARK-19852][PYSPARK][ML] Update Python API setHandleIn...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17237 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74308/ Test FAILed. ---

[GitHub] spark issue #17087: [SPARK-19372][SQL] Fix throwing a Java exception at df.f...

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17087 **[Test build #74310 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74310/testReport)** for PR 17087 at commit

[GitHub] spark pull request #17175: [SPARK-19468][SQL] Rewrite physical Project opera...

2017-03-10 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/17175#discussion_r105351477 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/basicPhysicalOperators.scala --- @@ -78,9 +78,42 @@ case class ProjectExec(projectList:

[GitHub] spark pull request #17236: [SPARK-19893][SQL] Cannot run intersect/except wi...

2017-03-10 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/17236#discussion_r105351724 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala --- @@ -319,7 +322,7 @@ trait CheckAnalysis extends

[GitHub] spark pull request #17234: [SPARK-19892][MLlib] Implement findAnalogies meth...

2017-03-10 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/17234#discussion_r105351937 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/feature/Word2Vec.scala --- @@ -610,6 +610,71 @@ class Word2VecModel private[spark] ( }

[GitHub] spark pull request #17234: [SPARK-19892][MLlib] Implement findAnalogies meth...

2017-03-10 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/17234#discussion_r105351821 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/feature/Word2Vec.scala --- @@ -610,6 +610,71 @@ class Word2VecModel private[spark] ( }

[GitHub] spark pull request #17236: [SPARK-19893][SQL] Cannot run intersect/except wi...

2017-03-10 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/17236#discussion_r105352149 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala --- @@ -319,7 +322,7 @@ trait CheckAnalysis extends

[GitHub] spark issue #17087: [SPARK-19372][SQL] Fix throwing a Java exception at df.f...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17087 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #17237: [SPARK-19852][PYSPARK][ML] Update Python API setHandleIn...

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17237 **[Test build #74312 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74312/testReport)** for PR 17237 at commit

[GitHub] spark issue #17236: [SPARK-19893][SQL] Cannot run intersect/except with map ...

2017-03-10 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/17236 @cloud-fan can we also check `Distinct`? We rewrite this into an `Aggregate` in the optimizer, which has the same problem with `MapType`. --- If your project is set up for it, you can reply to

[GitHub] spark issue #17237: [SPARK-19852][PYSPARK][ML] Update Python API setHandleIn...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17237 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74312/ Test PASSed. ---

[GitHub] spark issue #17237: [SPARK-19852][PYSPARK][ML] Update Python API setHandleIn...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17237 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17212: [SPARK-17979] Remove deprecated support for config SPARK...

2017-03-10 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17212 This actually covers SPARK-14453 too then. It relates to SPARK-12344 but doesn't fully resolve it. We can link all these in the title though. Yes, I support removing these props as they have

[GitHub] spark issue #17236: [SPARK-19893][SQL] Cannot run intersect/except with map ...

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17236 **[Test build #74309 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74309/testReport)** for PR 17236 at commit

[GitHub] spark issue #17236: [SPARK-19893][SQL] Cannot run intersect/except with map ...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17236 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17240: [SPARK-17080][SQL][followup] simplify algorithm

2017-03-10 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17240 This looks like a bunch of change for an addendum -- should this not have gone into the original change? the title isn't descriptive here. --- If your project is set up for it, you can reply to

[GitHub] spark issue #17236: [SPARK-19893][SQL] Cannot run intersect/except with map ...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17236 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74309/ Test FAILed. ---

[GitHub] spark issue #17177: [SPARK-19834][SQL] csv escape of quote escape

2017-03-10 Thread ep1804
Github user ep1804 commented on the issue: https://github.com/apache/spark/pull/17177 @jbax They are not CSV inputs. They are RAW TEXT. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #15009: [SPARK-17443][SPARK-11035] Stop Spark Application if lau...

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15009 **[Test build #74306 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74306/testReport)** for PR 15009 at commit

[GitHub] spark pull request #17240: [SPARK-17080][SQL][followup] simplify algorithm

2017-03-10 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/17240#discussion_r105368096 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/CostBasedJoinReorder.scala --- @@ -36,27 +36,27 @@ case class

[GitHub] spark pull request #17240: [SPARK-17080][SQL][followup] simplify algorithm

2017-03-10 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/17240#discussion_r105368212 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/CostBasedJoinReorder.scala --- @@ -75,8 +75,9 @@ case class

[GitHub] spark issue #17188: [SPARK-19751][SQL] Throw an exception if bean class has ...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17188 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #17240: [SPARK-17080][SQL][followup] simplify algorithm

2017-03-10 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/17240#discussion_r105368556 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/CostBasedJoinReorder.scala --- @@ -122,46 +123,59 @@ case class

[GitHub] spark issue #17188: [SPARK-19751][SQL] Throw an exception if bean class has ...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17188 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74307/ Test PASSed. ---

[GitHub] spark issue #17236: [SPARK-19893][SQL] Cannot run intersect/except/distinct ...

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17236 **[Test build #74317 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74317/testReport)** for PR 17236 at commit

[GitHub] spark pull request #17240: [SPARK-17080][SQL][followup] simplify algorithm

2017-03-10 Thread wzhfy
GitHub user wzhfy opened a pull request: https://github.com/apache/spark/pull/17240 [SPARK-17080][SQL][followup] simplify algorithm ## What changes were proposed in this pull request? 1. Do column pruning during reordering is troublesome. We can do it right after

[GitHub] spark issue #17240: [SPARK-17080][SQL][followup] simplify algorithm

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17240 **[Test build #74314 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74314/testReport)** for PR 17240 at commit

[GitHub] spark issue #17179: [SPARK-19067][SS] Processing-time-based timeout in MapGr...

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17179 **[Test build #74315 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74315/testReport)** for PR 17179 at commit

[GitHub] spark issue #15009: [SPARK-17443][SPARK-11035] Stop Spark Application if lau...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15009 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74306/ Test FAILed. ---

[GitHub] spark issue #15009: [SPARK-17443][SPARK-11035] Stop Spark Application if lau...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15009 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17240: [SPARK-17080][SQL][followup] simplify algorithm

2017-03-10 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/17240 also cc @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #17179: [SPARK-19067][SS] Processing-time-based timeout i...

2017-03-10 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/17179#discussion_r105363636 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/statefulOperators.scala --- @@ -256,94 +257,6 @@ case class StateStoreSaveExec(

[GitHub] spark pull request #17240: [SPARK-17080][SQL][followup] simplify algorithm

2017-03-10 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/17240#discussion_r105368297 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/CostBasedJoinReorder.scala --- @@ -87,8 +88,8 @@ case class

[GitHub] spark issue #17188: [SPARK-19751][SQL] Throw an exception if bean class has ...

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17188 **[Test build #74307 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74307/testReport)** for PR 17188 at commit

[GitHub] spark issue #17236: [SPARK-19893][SQL] Cannot run intersect/except/distinct ...

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17236 **[Test build #74316 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74316/testReport)** for PR 17236 at commit

[GitHub] spark issue #17236: [SPARK-19893][SQL] Cannot run intersect/except/distinct ...

2017-03-10 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/17236 LGTM pending jenkins --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #17240: [SPARK-17080][SQL][followup] 1.Postpone column pr...

2017-03-10 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/17240#discussion_r105371649 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/CostBasedJoinReorder.scala --- @@ -122,46 +123,59 @@ case class

[GitHub] spark pull request #17179: [SPARK-19067][SS] Processing-time-based timeout i...

2017-03-10 Thread amitsela
Github user amitsela commented on a diff in the pull request: https://github.com/apache/spark/pull/17179#discussion_r105396443 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/streaming/KeyedState.scala --- @@ -61,25 +65,49 @@ import

[GitHub] spark issue #17242: [SQL][WIP] Support more expression canonicalization

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17242 **[Test build #74321 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74321/testReport)** for PR 17242 at commit

[GitHub] spark pull request #17243: [SPARK-19901][Core]Clean up the clunky method sig...

2017-03-10 Thread ConeyLiu
Github user ConeyLiu closed the pull request at: https://github.com/apache/spark/pull/17243 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #17243: [SPARK-19901][Core]Clean up the clunky method sig...

2017-03-10 Thread ConeyLiu
GitHub user ConeyLiu reopened a pull request: https://github.com/apache/spark/pull/17243 [SPARK-19901][Core]Clean up the clunky method signature of acquireMemory ## What changes were proposed in this pull request? Clean up the clunky method signature of acquireMemory.

[GitHub] spark issue #17243: [SPARK-19901][Core]Clean up the clunky method signature ...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17243 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #17243: [SPARK-19901][Core]Clean up the clunky method signature ...

2017-03-10 Thread ConeyLiu
Github user ConeyLiu commented on the issue: https://github.com/apache/spark/pull/17243 Sorry for the mistake, reopen it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #17242: [SQL][WIP] Support more expression canonicalization

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17242 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #17179: [SPARK-19067][SS] Processing-time-based timeout i...

2017-03-10 Thread amitsela
Github user amitsela commented on a diff in the pull request: https://github.com/apache/spark/pull/17179#discussion_r105395680 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/streaming/KeyedState.scala --- @@ -61,25 +65,49 @@ import

[GitHub] spark issue #17243: [SPARK-19901][Core]Clean up the clunky method signature ...

2017-03-10 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17243 This doesn't look simpler to me. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #17170: [SPARK-19825][R][ML] spark.ml R API for FPGrowth

2017-03-10 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/17170 You're right of course: [SPARK-19899](https://issues.apache.org/jira/browse/SPARK-19899). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #17242: [SQL][WIP] Support more expression canonicalization

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17242 **[Test build #74319 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74319/testReport)** for PR 17242 at commit

[GitHub] spark issue #17242: [SQL][WIP] Support more expression canonicalization

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17242 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74319/ Test PASSed. ---

[GitHub] spark pull request #17164: [SPARK-16844][SQL] Support codegen for sort-based...

2017-03-10 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/17164#discussion_r105407263 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/AggregateCodegenHelper.scala --- @@ -0,0 +1,226 @@ +/* + * Licensed to

[GitHub] spark issue #17191: [SPARK-14471][SQL] Aliases in SELECT could be used in GR...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17191 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17242: [SQL][WIP] Support more expression canonicalization

2017-03-10 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/17242 cc @cloud-fan @hvanhovell --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17243: [SPARK-19901][Core]Clean up the clunky method signature ...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17243 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #17243: [SPARK-19901][Core]Clean up the clunky method sig...

2017-03-10 Thread ConeyLiu
GitHub user ConeyLiu opened a pull request: https://github.com/apache/spark/pull/17243 [SPARK-19901][Core]Clean up the clunky method signature of acquireMemory ## What changes were proposed in this pull request? Clean up the clunky method signature of acquireMemory.

[GitHub] spark pull request #17164: [SPARK-16844][SQL] Support codegen for sort-based...

2017-03-10 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/17164#discussion_r105403332 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/AggregateCodegenHelper.scala --- @@ -0,0 +1,226 @@ +/* + * Licensed to

[GitHub] spark issue #16867: [SPARK-16929] Improve performance when check speculatabl...

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16867 **[Test build #74322 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74322/testReport)** for PR 16867 at commit

[GitHub] spark issue #17191: [SPARK-14471][SQL] Aliases in SELECT could be used in GR...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17191 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74320/ Test PASSed. ---

[GitHub] spark issue #17191: [SPARK-14471][SQL] Aliases in SELECT could be used in GR...

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17191 **[Test build #74320 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74320/testReport)** for PR 17191 at commit

[GitHub] spark issue #17241: [SPARK-19877][SQL] Restrict the nested level of a view

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17241 **[Test build #74318 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74318/testReport)** for PR 17241 at commit

[GitHub] spark issue #17241: [SPARK-19877][SQL] Restrict the nested level of a view

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17241 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74318/ Test PASSed. ---

[GitHub] spark issue #17241: [SPARK-19877][SQL] Restrict the nested level of a view

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17241 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #17164: [SPARK-16844][SQL] Support codegen for sort-based...

2017-03-10 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/17164#discussion_r105404213 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/SortAggregateExec.scala --- @@ -106,6 +105,126 @@ case class SortAggregateExec(

[GitHub] spark pull request #17222: [SPARK-19439][PYSPARK][SQL] PySpark's registerJav...

2017-03-10 Thread zjffdu
Github user zjffdu commented on a diff in the pull request: https://github.com/apache/spark/pull/17222#discussion_r105392650 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/UDFRegistration.scala --- @@ -484,6 +484,21 @@ class UDFRegistration private[sql] (functionRegistry:

[GitHub] spark issue #15009: [SPARK-17443][SPARK-11035] Stop Spark Application if lau...

2017-03-10 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/15009 Test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #17164: [SPARK-16844][SQL] Support codegen for sort-based...

2017-03-10 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/17164#discussion_r105404064 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/AggregateCodegenHelper.scala --- @@ -0,0 +1,226 @@ +/* + * Licensed to

[GitHub] spark pull request #17244: [SPARK-19889][SQL] Make TaskContext callbacks thr...

2017-03-10 Thread hvanhovell
GitHub user hvanhovell opened a pull request: https://github.com/apache/spark/pull/17244 [SPARK-19889][SQL] Make TaskContext callbacks thread safe ## What changes were proposed in this pull request? It is sometimes useful to use multiple threads in a task to parallelize tasks.

[GitHub] spark issue #17244: [SPARK-19889][SQL] Make TaskContext callbacks thread saf...

2017-03-10 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/17244 cc @rxin @sameeragarwal @zsxwing --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17244: [SPARK-19889][SQL] Make TaskContext callbacks thread saf...

2017-03-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17244 **[Test build #74323 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/74323/testReport)** for PR 17244 at commit

[GitHub] spark pull request #17245: [SPARK-19850][SQL] Allow the use of aliases in SQ...

2017-03-10 Thread hvanhovell
GitHub user hvanhovell opened a pull request: https://github.com/apache/spark/pull/17245 [SPARK-19850][SQL] Allow the use of aliases in SQL function calls ## What changes were proposed in this pull request? We currently cannot use aliases in SQL function calls. This is

[GitHub] spark issue #16867: [SPARK-16929] Improve performance when check speculatabl...

2017-03-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16867 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/74322/ Test PASSed. ---

  1   2   3   4   5   6   >