[GitHub] spark pull request: [SPARK-11102] [SQL] Uninformative exception wh...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9223#issuecomment-151076305 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11102] [SQL] Uninformative exception wh...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9223#issuecomment-151076306 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5966][WIP]

2015-10-26 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9220#issuecomment-151078262 Merged to master/1.5 (after removing that blank line) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-11102] [SQL] Uninformative exception wh...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9223#issuecomment-151089248 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11102] [SQL] Uninformative exception wh...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9223#issuecomment-151089252 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11312][SQL]drop temporary function shou...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9278#issuecomment-151094624 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11312][SQL]drop temporary function shou...

2015-10-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9278#issuecomment-151094516 [Test build #44346 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44346/console) for PR 9278 at commit

[GitHub] spark pull request: [SPARK-11312][SQL]drop temporary function shou...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9278#issuecomment-151094622 Build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-11245] update twitter4j to 4.0.4 versio...

2015-10-26 Thread steveloughran
Github user steveloughran commented on the pull request: https://github.com/apache/spark/pull/9221#issuecomment-151103830 Adding some tests here could be an interesting little project. the main thing to do is to have some config file in test/resources, which git is set up to ignore;

[GitHub] spark pull request: [SPARK-11086][SPARKR] Use dropFactors column-w...

2015-10-26 Thread zero323
Github user zero323 commented on the pull request: https://github.com/apache/spark/pull/9099#issuecomment-151107679 @shivaram Not yet. I hope I'll have some time later this week to take a deeper look at this. And I still would like to hear some official response regarding

[GitHub] spark pull request: [SPARK-10484][SQL] Optimize the cartesian join...

2015-10-26 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/8652#discussion_r42961980 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala --- @@ -321,6 +320,21 @@ private[sql] abstract class

[GitHub] spark pull request: [SPARK-9858][SPARK-9859][SPARK-9861][SQL][WIP]...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9276#issuecomment-151035063 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9858][SPARK-9859][SPARK-9861][SQL][WIP]...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9276#issuecomment-151035067 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9858][SPARK-9859][SPARK-9861][SQL][WIP]...

2015-10-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9276#issuecomment-151037339 **[Test build #44342 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44342/consoleFull)** for PR 9276 at commit

[GitHub] spark pull request: [SPARK-11311] [SQL] spark cannot describe temp...

2015-10-26 Thread adrian-wang
GitHub user adrian-wang opened a pull request: https://github.com/apache/spark/pull/9277 [SPARK-11311] [SQL] spark cannot describe temporary functions You can merge this pull request into a Git repository by running: $ git pull https://github.com/adrian-wang/spark functionreg

[GitHub] spark pull request: [SPARK-11311] [SQL] spark cannot describe temp...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9277#issuecomment-151046510 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11311] [SQL] spark cannot describe temp...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9277#issuecomment-151046521 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10757] [MLlib] Java friendly constructo...

2015-10-26 Thread javelinjs
Github user javelinjs commented on the pull request: https://github.com/apache/spark/pull/9159#issuecomment-151049530 @yanboliang Your constructor can build. But this implies exposing ```[M <: Matrix]``` to users, we will see something like ```bm: BlockMatrix[SparseMatrix]``` here

[GitHub] spark pull request: [SPARK-10484][SQL] Optimize the cartesian join...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8652#issuecomment-151056814 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10484][SQL] Optimize the cartesian join...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8652#issuecomment-151056815 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11178] Improving naming around task fai...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9164#issuecomment-151057429 Build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-11178] Improving naming around task fai...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9164#issuecomment-151057431 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11188][SQL][WIP] Elide stacktraces in b...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9194#issuecomment-151060084 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11188][SQL][WIP] Elide stacktraces in b...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9194#issuecomment-151060106 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-11258 Converting a Spark DataFrame into ...

2015-10-26 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/9222#issuecomment-151060081 @FRosner, I am not denying a unit test:). My point is that it seems not necessary to add a Scala unit case for dfToCols, which is dedicated for SparkR now and its logic

[GitHub] spark pull request: [SPARK-11102] [SQL] Uninformative exception wh...

2015-10-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9223#issuecomment-151084190 **[Test build #44349 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44349/consoleFull)** for PR 9223 at commit

[GitHub] spark pull request: [SPARK-10586] fix bug: BlockManager ca't be re...

2015-10-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8741#issuecomment-151084189 **[Test build #44350 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44350/consoleFull)** for PR 8741 at commit

[GitHub] spark pull request: [SPARK-11276][CORE] SizeEstimator prevents cla...

2015-10-26 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9244#issuecomment-151079068 If there are no objections, I'll merge to master. This looks like a good targeted fix. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: [SPARK-10947] [SQL] With schema inference from...

2015-10-26 Thread stephend-realitymine
Github user stephend-realitymine commented on a diff in the pull request: https://github.com/apache/spark/pull/9249#discussion_r42979119 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonSuite.scala --- @@ -632,6 +632,39 @@ class JsonSuite

[GitHub] spark pull request: [SPARK-5966][WIP]

2015-10-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9220 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-11188][SQL][WIP] Elide stacktraces in b...

2015-10-26 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/9194#discussion_r42972712 --- Diff: sql/hive-thriftserver/src/test/scala/org/apache/spark/sql/hive/thriftserver/CliSuite.scala --- @@ -219,4 +219,11 @@ class CliSuite extends

[GitHub] spark pull request: [SPARK-10586] fix bug: BlockManager ca't be re...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8741#issuecomment-151109274 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10586] fix bug: BlockManager ca't be re...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8741#issuecomment-151109276 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10586] fix bug: BlockManager ca't be re...

2015-10-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8741#issuecomment-151109164 **[Test build #44350 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44350/consoleFull)** for PR 8741 at commit

[GitHub] spark pull request: [SPARK-11102] [SQL] Uninformative exception wh...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9223#issuecomment-151080499 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10586] fix bug: BlockManager ca't be re...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8741#issuecomment-151080536 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10586] fix bug: BlockManager ca't be re...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8741#issuecomment-151080618 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11102] [SQL] Uninformative exception wh...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9223#issuecomment-151080563 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11102] [SQL] Uninformative exception wh...

2015-10-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9223#issuecomment-151089182 **[Test build #44349 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44349/consoleFull)** for PR 9223 at commit

[GitHub] spark pull request: [SPARK-11116] [SQL] First Draft of Dataset API

2015-10-26 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/9190#discussion_r42977432 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/GroupedIterator.scala --- @@ -0,0 +1,141 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-9858][SPARK-9859][SPARK-9861][SQL][WIP]...

2015-10-26 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9276#discussion_r42962041 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/test/TestSQLContext.scala --- @@ -63,5 +63,6 @@ private[sql] object TestSQLContext { val

[GitHub] spark pull request: [SPARK-9162][SQL] Implement code generation fo...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9270#issuecomment-151034721 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10484][SQL] Optimize the cartesian join...

2015-10-26 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/8652#discussion_r42962007 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkPlanner.scala --- @@ -44,8 +44,9 @@ class SparkPlanner(val sqlContext:

[GitHub] spark pull request: [SPARK-9858][SPARK-9859][SPARK-9861][SQL][WIP]...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9276#issuecomment-151034685 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9858][SPARK-9859][SPARK-9861][SQL][WIP]...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9276#issuecomment-151034664 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10484][SQL] Optimize the cartesian join...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8652#issuecomment-151034668 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10484][SQL] Optimize the cartesian join...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8652#issuecomment-151034684 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9858][SPARK-9859][SPARK-9861][SQL][WIP]...

2015-10-26 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9276#discussion_r42962038 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/test/TestHive.scala --- @@ -465,6 +465,7 @@ private[hive] object TestHiveContext { val

[GitHub] spark pull request: [SPARK-10484][SQL] Optimize the cartesian join...

2015-10-26 Thread chenghao-intel
Github user chenghao-intel commented on the pull request: https://github.com/apache/spark/pull/8652#issuecomment-151034717 Thank you @yhuai , I've just split the `BroadcastNestedLoopJoin` into `BroadcastNestedLoop` and `DefaultJoin`, which probably makes more sense. --- If your

[GitHub] spark pull request: [SPARK-10757] [MLlib] Java friendly constructo...

2015-10-26 Thread yanboliang
Github user yanboliang commented on the pull request: https://github.com/apache/spark/pull/9159#issuecomment-151034714 @mengxr Could you add @javelinjs to whitelist? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-9162][SQL] Implement code generation fo...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9270#issuecomment-151040790 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9162][SQL] Implement code generation fo...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9270#issuecomment-151040802 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11312][SQL]drop temporary function shou...

2015-10-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9278#issuecomment-151049644 [Test build #44346 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44346/consoleFull) for PR 9278 at commit

[GitHub] spark pull request: [SPARK-9858][SPARK-9859][SPARK-9861][SQL][WIP]...

2015-10-26 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9276#discussion_r42961923 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SQLConf.scala --- @@ -233,6 +233,25 @@ private[spark] object SQLConf { defaultValue = Some(200),

[GitHub] spark pull request: [SPARK-10484][SQL] Optimize the cartesian join...

2015-10-26 Thread chenghao-intel
Github user chenghao-intel commented on a diff in the pull request: https://github.com/apache/spark/pull/8652#discussion_r42961928 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala --- @@ -294,25 +294,24 @@ private[sql] abstract class

[GitHub] spark pull request: [SPARK-11277] [SQL] sort_array throws exceptio...

2015-10-26 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/9247#issuecomment-151035107 I think we should follow hive, thus we also need to update the `checkInputDataTypes` to deny struct type. cc @yhuai @marmbrus , what do you think? --- If

[GitHub] spark pull request: [SPARK-10757] [MLlib] Java friendly constructo...

2015-10-26 Thread javelinjs
Github user javelinjs commented on the pull request: https://github.com/apache/spark/pull/9159#issuecomment-151035109 @yanboliang Sure I'll work on it soon. Thank you. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-10895][SPARK-11164][SQL] Push down InSe...

2015-10-26 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/8956#issuecomment-151039952 Well, it depends. The situation is a little bit tricky to explain. In general there are two cases: 1. String filters with high selectivity, namely most

[GitHub] spark pull request: [SPARK-9162][SQL] Implement code generation fo...

2015-10-26 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/9270#discussion_r42962687 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ScalaUDF.scala --- @@ -959,6 +963,861 @@ case class ScalaUDF( }

[GitHub] spark pull request: [SPARK-9162][SQL] Implement code generation fo...

2015-10-26 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/9270#discussion_r42962733 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ScalaUDF.scala --- @@ -959,6 +963,861 @@ case class ScalaUDF( }

[GitHub] spark pull request: [SPARK-9162][SQL] Implement code generation fo...

2015-10-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9270#issuecomment-151041697 **[Test build #44343 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44343/consoleFull)** for PR 9270 at commit

[GitHub] spark pull request: [SPARK-11298] When driver sends message "GetEx...

2015-10-26 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9268#issuecomment-151047372 Your command is not wrong and the usage is not wrong. The PR is wrong. It's the wrong fix for the problem. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-11311] [SQL] spark cannot describe temp...

2015-10-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9277#issuecomment-151047580 **[Test build #44345 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44345/consoleFull)** for PR 9277 at commit

[GitHub] spark pull request: [SPARK-11178] Improving naming around task fai...

2015-10-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9164#issuecomment-151057244 [Test build #44338 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44338/console) for PR 9164 at commit

[GitHub] spark pull request: [SPARK-11279] [PYSPARK] Add DataFrame#toDF in ...

2015-10-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9248 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-11279] [PYSPARK] Add DataFrame#toDF in ...

2015-10-26 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9248#issuecomment-151058028 JIRA doesn't work for me right now. I will close the ticket when it works. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-11292][SQL] Python API for text data so...

2015-10-26 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/9259#discussion_r42968962 --- Diff: python/pyspark/sql/readwriter.py --- @@ -193,10 +194,22 @@ def parquet(self, *paths): """ return

[GitHub] spark pull request: [SPARK-11102] [SQL] Uninformative exception wh...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9223#issuecomment-151070213 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11102] [SQL] Uninformative exception wh...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9223#issuecomment-151070148 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11311] [SQL] spark cannot describe temp...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9277#issuecomment-151046089 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11311] [SQL] spark cannot describe temp...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9277#issuecomment-151046075 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11312][SQL]drop temporary function shou...

2015-10-26 Thread adrian-wang
GitHub user adrian-wang opened a pull request: https://github.com/apache/spark/pull/9278 [SPARK-11312][SQL]drop temporary function should match with create temporary function create temporary function is done by executionHive, while DROP TEMPORARY FUNCTION is done by metadataHive,

[GitHub] spark pull request: [SPARK-11116] [SQL] First Draft of Dataset API

2015-10-26 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/9190#discussion_r42970431 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -0,0 +1,392 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-11116] [SQL] First Draft of Dataset API

2015-10-26 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/9190#discussion_r42970368 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/encoders/tuples.scala --- @@ -0,0 +1,173 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request: [SPARK-11188][SQL][WIP] Elide stacktraces in b...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9194#issuecomment-151069216 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11188][SQL][WIP] Elide stacktraces in b...

2015-10-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9194#issuecomment-151069128 **[Test build #44347 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44347/consoleFull)** for PR 9194 at commit

[GitHub] spark pull request: [SPARK-11188][SQL][WIP] Elide stacktraces in b...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9194#issuecomment-151069214 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11311] [SQL] spark cannot describe temp...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9277#issuecomment-151071849 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11311] [SQL] spark cannot describe temp...

2015-10-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9277#issuecomment-151071437 **[Test build #44345 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44345/consoleFull)** for PR 9277 at commit

[GitHub] spark pull request: [SPARK-11306] Fix hang when JVM exits.

2015-10-26 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/9273#discussion_r42971434 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/SparkDeploySchedulerBackend.scala --- @@ -137,7 +137,7 @@ private[spark] class

[GitHub] spark pull request: [SPARK-10582] If a new AM restarts, the total ...

2015-10-26 Thread jerryshao
Github user jerryshao commented on the pull request: https://github.com/apache/spark/pull/8737#issuecomment-151046589 Yes, the problem still exists, @KaiXinXiaoLei are you still working on this issue to address the comments mentioned above? --- If your project is set up for it, you

[GitHub] spark pull request: [SPARK-11311] [SQL] spark cannot describe temp...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9277#issuecomment-151047755 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11311] [SQL] spark cannot describe temp...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9277#issuecomment-151047753 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11312][SQL]drop temporary function shou...

2015-10-26 Thread adrian-wang
Github user adrian-wang closed the pull request at: https://github.com/apache/spark/pull/9278 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request: [SPARK-11312][SQL]drop temporary function shou...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9278#issuecomment-151048998 Build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-11312][SQL]drop temporary function shou...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9278#issuecomment-151048991 Build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11209][SPARKR] Add window functions int...

2015-10-26 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/9193#issuecomment-151055969 @shivaram, [R lag function](https://stat.ethz.ch/R-manual/R-devel/library/stats/html/lag.html) is for time series objects, which is irrelevant to the lead/lag here in

[GitHub] spark pull request: [SPARK-10484][SQL] Optimize the cartesian join...

2015-10-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8652#issuecomment-151056724 **[Test build #44341 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44341/consoleFull)** for PR 8652 at commit

[GitHub] spark pull request: SPARK-11258 Converting a Spark DataFrame into ...

2015-10-26 Thread FRosner
Github user FRosner commented on the pull request: https://github.com/apache/spark/pull/9222#issuecomment-151056747 @sun-rui I am not sure how callJStatic works but I can imagine that making a method private does not allow it to be called - neither from the test, nor from R. Why

[GitHub] spark pull request: [SPARK-9162][SQL] Implement code generation fo...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9270#issuecomment-151059820 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9162][SQL] Implement code generation fo...

2015-10-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9270#issuecomment-151059691 **[Test build #44343 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44343/consoleFull)** for PR 9270 at commit

[GitHub] spark pull request: [SPARK-9162][SQL] Implement code generation fo...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9270#issuecomment-151059822 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11245] update twitter4j to 4.0.4 versio...

2015-10-26 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9221#issuecomment-151068777 No, I presume that's what led @pronix to the changes here? @pronix did you try this with some real data? Yeah we don't have tests here anyway, and I'd hope that it

[GitHub] spark pull request: [SPARK-10484][SQL] Optimize the cartesian join...

2015-10-26 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8652#issuecomment-151035354 **[Test build #44341 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44341/consoleFull)** for PR 8652 at commit

[GitHub] spark pull request: [SPARK-9858][SPARK-9859][SPARK-9861][SQL][WIP]...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9276#issuecomment-151037502 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-9858][SPARK-9859][SPARK-9861][SQL][WIP]...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9276#issuecomment-151037501 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11298] When driver sends message "GetEx...

2015-10-26 Thread KaiXinXiaoLei
Github user KaiXinXiaoLei commented on the pull request: https://github.com/apache/spark/pull/9268#issuecomment-151044681 @vanzin But i run : --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10524][ML] Use the soft prediction to o...

2015-10-26 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/8734#discussion_r42964746 --- Diff: mllib/src/test/scala/org/apache/spark/mllib/tree/DecisionTreeSuite.scala --- @@ -294,8 +295,12 @@ class DecisionTreeSuite extends SparkFunSuite with

[GitHub] spark pull request: [SPARK-11279] [PYSPARK] Add DataFrame#toDF in ...

2015-10-26 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9248#issuecomment-151057890 Thanks - I've merged this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-9162][SQL] Implement code generation fo...

2015-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9270#issuecomment-151034722 Test FAILed. Refer to this link for build results (access rights to CI server needed):

  1   2   3   4   5   6   7   >