[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15377 **[Test build #66891 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66891/consoleFull)** for PR 15377 at commit

[GitHub] spark issue #12951: [SPARK-15176][Core] Add maxShares setting to Pools

2016-10-13 Thread njwhite
Github user njwhite commented on the issue: https://github.com/apache/spark/pull/12951 Actually, @kayousterhout - I'm not entirely sure what you expect for the semantics of maxShares in general. Maybe a worked example would help: if I have a pool X with 5 running tasks from Taskset A

[GitHub] spark issue #12933: [Spark-15155][Mesos] Optionally ignore default role reso...

2016-10-13 Thread tnachen
Github user tnachen commented on the issue: https://github.com/apache/spark/pull/12933 I ran `mvn test` inside of the mesos folder. On Thu, Oct 13, 2016 at 3:21 AM, Chris Heller wrote: > You saw the error with `./dev/run-tests`? Ok I'll

[GitHub] spark issue #15420: [SPARK-17855][CORE] Remove query string from jar url

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15420 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15465: [SPARK-17909][SQL] we should create table before writing...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15465 **[Test build #66895 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66895/consoleFull)** for PR 15465 at commit

[GitHub] spark issue #15462: [SPARK-17680] [SQL] [TEST] Added test cases for InMemory...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15462 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66889/ Test PASSed. ---

[GitHub] spark issue #15462: [SPARK-17680] [SQL] [TEST] Added test cases for InMemory...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15462 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15464: [SPARK-17827][SQL]maxColLength type should be Int for St...

2016-10-13 Thread robbinspg
Github user robbinspg commented on the issue: https://github.com/apache/spark/pull/15464 Tests all pass on big-endian with this PR --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #15465: [SPARK-17909][SQL] we should create table before ...

2016-10-13 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/15465 [SPARK-17909][SQL] we should create table before writing out the data in CTAS ## What changes were proposed in this pull request? In `CreateDataSourceTableAsSelectCommand`, we write out

[GitHub] spark issue #15272: [SPARK-17698] [SQL] Join predicates should not contain f...

2016-10-13 Thread tejasapatil
Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/15272 @rxin : Yes. I looked at it but could not find the root cause. I have been busy with other stuff so could not invest more time. I plan to get this fixed over the weekend. --- If your project

[GitHub] spark issue #15420: [SPARK-17855][CORE] Remove query string from jar url

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15420 **[Test build #66894 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66894/consoleFull)** for PR 15420 at commit

[GitHub] spark issue #15460: [SPARK-17903][SQL] MetastoreRelation should talk to exte...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15460 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66893/ Test FAILed. ---

[GitHub] spark issue #15460: [SPARK-17903][SQL] MetastoreRelation should talk to exte...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15460 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15460: [SPARK-17903][SQL] MetastoreRelation should talk to exte...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15460 **[Test build #66893 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66893/consoleFull)** for PR 15460 at commit

[GitHub] spark issue #14702: [SPARK-15694] Implement ScriptTransformation in sql/core...

2016-10-13 Thread tejasapatil
Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/14702 @rxin : Yes. I think I know why its happening and will get back with a fix over weekend. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request #15335: [SPARK-17769][Core][Scheduler]Some FetchFailure r...

2016-10-13 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/15335#discussion_r83245093 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -1255,27 +1255,46 @@ class DAGScheduler( s"longer

[GitHub] spark issue #15466: [SPARK-13983][SQL] HiveThriftServer2 can not get "--hive...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15466 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15462: [SPARK-17680] [SQL] [TEST] Added test cases for InMemory...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15462 **[Test build #66889 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66889/consoleFull)** for PR 15462 at commit

[GitHub] spark issue #15466: [SPARK-13983][SQL] HiveThriftServer2 can not get "--hive...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15466 **[Test build #66896 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66896/consoleFull)** for PR 15466 at commit

[GitHub] spark issue #15466: [SPARK-13983][SQL] HiveThriftServer2 can not get "--hive...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15466 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66896/ Test PASSed. ---

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15377 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15377 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66891/ Test PASSed. ---

[GitHub] spark issue #15420: [SPARK-17855][CORE] Remove query string from jar url

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15420 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66894/ Test PASSed. ---

[GitHub] spark issue #12614: [SPARK-14730][ML] Expose ColumnPruner as feature transfo...

2016-10-13 Thread BenFradet
Github user BenFradet commented on the issue: https://github.com/apache/spark/pull/12614 @manugarri I don't think there was much interest in this PR. Would you care to weigh in @jkbradley @yanboliang? --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #15464: [SPARK-17827][SQL]maxColLength type should be Int for St...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15464 **[Test build #66892 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66892/consoleFull)** for PR 15464 at commit

[GitHub] spark issue #15464: [SPARK-17827][SQL]maxColLength type should be Int for St...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15464 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66892/ Test PASSed. ---

[GitHub] spark issue #15464: [SPARK-17827][SQL]maxColLength type should be Int for St...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15464 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15433: [SPARK-17822][SPARKR] Use weak reference in JVMObjectTra...

2016-10-13 Thread techaddict
Github user techaddict commented on the issue: https://github.com/apache/spark/pull/15433 @shivaram @srowen not sure why its failing, will try to fix this ASAP. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #15433: [SPARK-17822][SPARKR] Use weak reference in JVMObjectTra...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15433 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66888/ Test FAILed. ---

[GitHub] spark issue #15433: [SPARK-17822][SPARKR] Use weak reference in JVMObjectTra...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15433 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15433: [SPARK-17822][SPARKR] Use weak reference in JVMObjectTra...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15433 **[Test build #66890 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66890/consoleFull)** for PR 15433 at commit

[GitHub] spark issue #12951: [SPARK-15176][Core] Add maxShares setting to Pools

2016-10-13 Thread njwhite
Github user njwhite commented on the issue: https://github.com/apache/spark/pull/12951 @kayousterhout minShares is a configuration parameter for the fair scheduler algorithm only - what would the semantics of a maxShares setting for the FIFO algorithm be? --- If your project is set

[GitHub] spark issue #15465: [SPARK-17909][SQL] we should create table before writing...

2016-10-13 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15465 cc @yhuai @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #15466: [SPARK-13983][SQL] HiveThriftServer2 can not get ...

2016-10-13 Thread wangyum
GitHub user wangyum opened a pull request: https://github.com/apache/spark/pull/15466 [SPARK-13983][SQL] HiveThriftServer2 can not get "--hiveconf" or ''--hivevar" variables since 1.6 version (both multi-session and single session) ## What changes were proposed in this pull

[GitHub] spark issue #15433: [SPARK-17822][SPARKR] Use weak reference in JVMObjectTra...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15433 **[Test build #66888 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66888/consoleFull)** for PR 15433 at commit

[GitHub] spark issue #15433: [SPARK-17822][SPARKR] Use weak reference in JVMObjectTra...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15433 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66890/ Test FAILed. ---

[GitHub] spark issue #15433: [SPARK-17822][SPARKR] Use weak reference in JVMObjectTra...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15433 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15466: [SPARK-13983][SQL] HiveThriftServer2 can not get "--hive...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15466 **[Test build #66896 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66896/consoleFull)** for PR 15466 at commit

[GitHub] spark issue #15436: [SPARK-17875] [BUILD] Remove unneeded direct dependence ...

2016-10-13 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15436 Well, I'm sure the flume assembly has the classes in question here, and I'm sure it's being added to `--jars` when pyspark is run for the tests. I'm still trying to figure out what's wrong here.

[GitHub] spark issue #15446: [SPARK-17882][SparkR] Fix swallowed exception in RBacken...

2016-10-13 Thread jrshust
Github user jrshust commented on the issue: https://github.com/apache/spark/pull/15446 @felixcheung jrshust as well. I'm the reporter of the JIRA ticket: https://issues.apache.org/jira/browse/SPARK-17882 --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/14690 I've pushed an update to `ParquetMetastoreSuite` that illustrates the bug (or "limitation") WRT support for mixed-case partition columns I discovered yesterday. To reiterate, this is not a

[GitHub] spark pull request #15467: [SPARK-17192][SQL] Refactor code generation to ge...

2016-10-13 Thread kiszk
GitHub user kiszk opened a pull request: https://github.com/apache/spark/pull/15467 [SPARK-17192][SQL] Refactor code generation to get data for ColumnVector/ColumnarBatch ## What changes were proposed in this pull request? This PR refactors the code generation part to get

[GitHub] spark issue #15421: [SPARK-17811] SparkR cannot parallelize data.frame with ...

2016-10-13 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/15421 Last night, I debugged the problem again. Now I can reproduce it as follows: > a <- as.Date("2016-10-01", "NA") > b <- as.data.frame(a) > c <- createDataFrame(b) > a

[GitHub] spark issue #15465: [SPARK-17909][SQL] we should create table before writing...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15465 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-13 Thread weiqingy
Github user weiqingy commented on the issue: https://github.com/apache/spark/pull/15377 Utils#classForName will make maven build fail, please do not use it before figure out : https://issues.apache.org/jira/browse/SPARK-17714. The failure is here:

[GitHub] spark pull request #11105: [SPARK-12469][CORE] Data Property accumulators fo...

2016-10-13 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/11105#discussion_r83270945 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -1251,7 +1251,22 @@ class SparkContext(config: SparkConf) extends Logging with

[GitHub] spark issue #15446: [SPARK-17882][SparkR] Fix swallowed exception in RBacken...

2016-10-13 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/15446 I updated the JIRA. @jrshust could you close this PR ? We don't have permission to close PRs and only PR authors can do it --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #15468: [SPARK-17915][SQL] Prepare a new ColumnVector implementa...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15468 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66901/ Test FAILed. ---

[GitHub] spark issue #13713: [SPARK-15994] [MESOS] Allow enabling Mesos fetch cache i...

2016-10-13 Thread mgummelt
Github user mgummelt commented on the issue: https://github.com/apache/spark/pull/13713 LGTM @srowen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-10-13 Thread vlad17
Github user vlad17 commented on the issue: https://github.com/apache/spark/pull/14547 @jkbradley Re test scripts: `res8: Double = 0.5193104784040287` is the value outputted by `counts.max / counts.sum`. Indeed, it's just a sanity check that the value isn't 1 - i.e., we don't

[GitHub] spark pull request #15468: [SPARK-17915][SQL] Prepare a new ColumnVector imp...

2016-10-13 Thread kiszk
GitHub user kiszk opened a pull request: https://github.com/apache/spark/pull/15468 [SPARK-17915][SQL] Prepare a new ColumnVector implementation for UnsafeData ## What changes were proposed in this pull request? This PR prepares a new implementation

[GitHub] spark pull request #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-10-13 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/14547#discussion_r83278169 --- Diff: mllib/src/test/scala/org/apache/spark/ml/util/GBTSuiteHelper.scala --- @@ -0,0 +1,271 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-10-13 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/14547#discussion_r83278154 --- Diff: mllib/src/test/scala/org/apache/spark/ml/util/GBTSuiteHelper.scala --- @@ -0,0 +1,271 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark issue #15465: [SPARK-17909][SQL] we should create table before writing...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15465 **[Test build #66895 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66895/consoleFull)** for PR 15465 at commit

[GitHub] spark issue #15467: [SPARK-17192][SQL] Refactor code generation to get data ...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15467 **[Test build #66897 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66897/consoleFull)** for PR 15467 at commit

[GitHub] spark issue #9973: [SPARK-11989][SQL] Only use commit in JDBC data source if...

2016-10-13 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/9973 Checked it with @huaxingao who worked for JDBC driver team before. Yeah, we are unable to do it using JDBC. In my previous team, we did it using the native connection methods instead of JDBC. It

[GitHub] spark pull request #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-10-13 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/14547#discussion_r83277784 --- Diff: mllib/src/test/scala/org/apache/spark/ml/util/GBTSuiteHelper.scala --- @@ -0,0 +1,271 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14690 **[Test build #66900 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66900/consoleFull)** for PR 14690 at commit

[GitHub] spark issue #15457: [SPARK-17830][SQL] Annotate remaining SQL APIs with Inte...

2016-10-13 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15457 Merging to master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15468: [SPARK-17915][SQL] Prepare a new ColumnVector implementa...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15468 **[Test build #66901 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66901/consoleFull)** for PR 15468 at commit

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-13 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15377 @weiqingy all the Maven/SBT builds pass now, are you sure this is still an issue? I know the PR builder is just using SBT, yes, but thought we had fixed this. --- If your project is set up for it,

[GitHub] spark pull request #13713: [SPARK-15994] [MESOS] Allow enabling Mesos fetch ...

2016-10-13 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/13713#discussion_r83271593 --- Diff: mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala --- @@ -369,9 +369,11 @@ trait MesosSchedulerUtils

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14690 **[Test build #66898 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66898/consoleFull)** for PR 14690 at commit

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14690 **[Test build #66899 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66899/consoleFull)** for PR 14690 at commit

[GitHub] spark pull request #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-10-13 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/14547#discussion_r83277146 --- Diff: mllib/src/test/scala/org/apache/spark/ml/classification/GBTClassifierSuite.scala --- @@ -223,15 +278,18 @@ private object GBTClassifierSuite

[GitHub] spark pull request #15457: [SPARK-17830][SQL] Annotate remaining SQL APIs wi...

2016-10-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15457 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15458: [SPARK-17899][SQL] add a debug mode to keep raw table pr...

2016-10-13 Thread andrewor14
Github user andrewor14 commented on the issue: https://github.com/apache/spark/pull/15458 Yes that's why it's `internal` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15465: [SPARK-17909][SQL] we should create table before writing...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15465 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66895/ Test FAILed. ---

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-13 Thread weiqingy
Github user weiqingy commented on the issue: https://github.com/apache/spark/pull/15377 Before 28/Sep/16, using Utils#classForName could pass the PR builder, but would fail the Spark QA tests in master Maven builds. Unit now (from 28/Sep/16 - now), if there is no change in maven

[GitHub] spark issue #15468: [SPARK-17915][SQL] Prepare a new ColumnVector implementa...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15468 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15468: [SPARK-17915][SQL] Prepare a new ColumnVector implementa...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15468 **[Test build #66901 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66901/consoleFull)** for PR 15468 at commit

[GitHub] spark issue #15467: [SPARK-17912][SQL] Refactor code generation to get data ...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15467 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66897/ Test PASSed. ---

[GitHub] spark pull request #14788: [SPARK-17174][SQL] Add the support for TimestampT...

2016-10-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14788#discussion_r83280122 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/datetimeExpressions.scala --- @@ -916,21 +931,26 @@ case class

[GitHub] spark pull request #15464: [SPARK-17827][SQL]maxColLength type should be Int...

2016-10-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15464 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15468: [SPARK-17915][SQL] Prepare a new ColumnVector implementa...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15468 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15468: [SPARK-17915][SQL] Prepare a new ColumnVector implementa...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15468 **[Test build #66904 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66904/consoleFull)** for PR 15468 at commit

[GitHub] spark issue #15468: [SPARK-17915][SQL] Prepare a new ColumnVector implementa...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15468 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66904/ Test FAILed. ---

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/14690 MiMa is supposed to detect binary incompatible changes. Looking at the console output though, it seems like MiMa just crashed. Running `./dev/mima` locally worked though, so maybe it was some

[GitHub] spark pull request #15397: [SPARK-17834][SQL]Fetch the earliest offsets manu...

2016-10-13 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15397#discussion_r83289072 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -256,8 +269,6 @@ private[kafka010] case class

[GitHub] spark pull request #15397: [SPARK-17834][SQL]Fetch the earliest offsets manu...

2016-10-13 Thread koeninger
Github user koeninger commented on a diff in the pull request: https://github.com/apache/spark/pull/15397#discussion_r83289086 --- Diff: external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaSource.scala --- @@ -270,7 +281,7 @@ private[kafka010] case class

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14690 **[Test build #66906 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66906/consoleFull)** for PR 14690 at commit

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14690 **[Test build #66899 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66899/consoleFull)** for PR 14690 at commit

[GitHub] spark issue #13713: [SPARK-15994] [MESOS] Allow enabling Mesos fetch cache i...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13713 **[Test build #66909 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66909/consoleFull)** for PR 13713 at commit

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14690 **[Test build #66900 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66900/consoleFull)** for PR 14690 at commit

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14690 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15468: [SPARK-17915][SQL] Prepare a new ColumnVector implementa...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15468 **[Test build #66904 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66904/consoleFull)** for PR 15468 at commit

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/14690 > This patch fails MiMa tests. I've never seen this before. What does this mean? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #15397: [SPARK-17834][SQL]Fetch the earliest offsets manually in...

2016-10-13 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15397 > My main point is that whoever implements SPARK-17812 is going to have to deal with the issue shown in SPARK-17782, which means much of this patch is going to need to be changed anyway.

[GitHub] spark pull request #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-10-13 Thread vlad17
Github user vlad17 commented on a diff in the pull request: https://github.com/apache/spark/pull/14547#discussion_r83285393 --- Diff: python/pyspark/ml/regression.py --- @@ -1003,20 +1003,20 @@ class GBTRegressor(JavaEstimator, HasFeaturesCol, HasLabelCol, HasPredictionCol,

[GitHub] spark issue #14963: [SPARK-16992][PYSPARK] Virtualenv for Pylint and pep8 in...

2016-10-13 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/14963 @Stibbons however the problem is the virtualenv that gets created when a user is in a conda enviroment is partially broken. --- If your project is set up for it, you can reply to this email and

[GitHub] spark issue #14547: [SPARK-16718][MLlib] gbm-style treeboost

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14547 **[Test build #66907 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66907/consoleFull)** for PR 14547 at commit

[GitHub] spark issue #15397: [SPARK-17834][SQL]Fetch the earliest offsets manually in...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15397 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66908/ Test PASSed. ---

[GitHub] spark issue #15397: [SPARK-17834][SQL]Fetch the earliest offsets manually in...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15397 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15044: [SQL][SPARK-17490] Optimize SerializeFromObject()...

2016-10-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/15044#discussion_r83300104 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/CatalystTypeConvertersSuite.scala --- @@ -61,4 +63,39 @@ class

[GitHub] spark issue #13713: [SPARK-15994] [MESOS] Allow enabling Mesos fetch cache i...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13713 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13713: [SPARK-15994] [MESOS] Allow enabling Mesos fetch cache i...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13713 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66909/ Test PASSed. ---

[GitHub] spark issue #15460: [SPARK-17903][SQL] MetastoreRelation should talk to exte...

2016-10-13 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15460 cc @ericl --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #14690: [SPARK-16980][SQL] Load only catalog table partition met...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14690 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15307: [SPARK-17731][SQL][STREAMING] Metrics for structured str...

2016-10-13 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/15307 @marmbrus @brkyvz @zsxwing @koeninger Thank you very much for your feedback. I am going to merge this to master. I will open a different PR to merge this to branch 2.0 --- If your project is set up

[GitHub] spark issue #15468: [SPARK-17915][SQL] Prepare a new ColumnVector implementa...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15468 **[Test build #66902 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66902/consoleFull)** for PR 15468 at commit

  1   2   3   4   5   6   7   >