[GitHub] spark pull request #13713: [SPARK-15994] [MESOS] Allow enabling Mesos fetch ...

2016-10-13 Thread mgummelt
Github user mgummelt commented on a diff in the pull request: https://github.com/apache/spark/pull/13713#discussion_r83271593 --- Diff: mesos/src/main/scala/org/apache/spark/scheduler/cluster/mesos/MesosSchedulerUtils.scala --- @@ -369,9 +369,11 @@ trait MesosSchedulerUtils

[GitHub] spark pull request #11105: [SPARK-12469][CORE] Data Property accumulators fo...

2016-10-13 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/11105#discussion_r83270945 --- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala --- @@ -1251,7 +1251,22 @@ class SparkContext(config: SparkConf) extends Logging with

[GitHub] spark issue #9973: [SPARK-11989][SQL] Only use commit in JDBC data source if...

2016-10-13 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/9973 Checked it with @huaxingao who worked for JDBC driver team before. Yeah, we are unable to do it using JDBC. In my previous team, we did it using the native connection methods instead of JDBC. It

[GitHub] spark issue #15436: [SPARK-17875] [BUILD] Remove unneeded direct dependence ...

2016-10-13 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15436 Well, I'm sure the flume assembly has the classes in question here, and I'm sure it's being added to `--jars` when pyspark is run for the tests. I'm still trying to figure out what's wrong here.

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-13 Thread weiqingy
Github user weiqingy commented on the issue: https://github.com/apache/spark/pull/15377 Before 28/Sep/16, using Utils#classForName could pass the PR builder, but would fail the Spark QA tests in master Maven builds. Unit now (from 28/Sep/16 - now), if there is no change in maven

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-13 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15377 @weiqingy all the Maven/SBT builds pass now, are you sure this is still an issue? I know the PR builder is just using SBT, yes, but thought we had fixed this. --- If your project is set up for it,

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-13 Thread weiqingy
Github user weiqingy commented on the issue: https://github.com/apache/spark/pull/15377 Utils#classForName will make maven build fail, please do not use it before figure out : https://issues.apache.org/jira/browse/SPARK-17714. The failure is here:

[GitHub] spark issue #15467: [SPARK-17192][SQL] Refactor code generation to get data ...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15467 **[Test build #66897 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66897/consoleFull)** for PR 15467 at commit

[GitHub] spark pull request #15467: [SPARK-17192][SQL] Refactor code generation to ge...

2016-10-13 Thread kiszk
GitHub user kiszk opened a pull request: https://github.com/apache/spark/pull/15467 [SPARK-17192][SQL] Refactor code generation to get data for ColumnVector/ColumnarBatch ## What changes were proposed in this pull request? This PR refactors the code generation part to get

[GitHub] spark issue #15465: [SPARK-17909][SQL] we should create table before writing...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15465 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15465: [SPARK-17909][SQL] we should create table before writing...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15465 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66895/ Test FAILed. ---

[GitHub] spark issue #15465: [SPARK-17909][SQL] we should create table before writing...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15465 **[Test build #66895 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66895/consoleFull)** for PR 15465 at commit

[GitHub] spark issue #15458: [SPARK-17899][SQL] add a debug mode to keep raw table pr...

2016-10-13 Thread andrewor14
Github user andrewor14 commented on the issue: https://github.com/apache/spark/pull/15458 Yes that's why it's `internal` --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15420: [SPARK-17855][CORE] Remove query string from jar url

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15420 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66894/ Test PASSed. ---

[GitHub] spark issue #15420: [SPARK-17855][CORE] Remove query string from jar url

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15420 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #12933: [Spark-15155][Mesos] Optionally ignore default role reso...

2016-10-13 Thread tnachen
Github user tnachen commented on the issue: https://github.com/apache/spark/pull/12933 I ran `mvn test` inside of the mesos folder. On Thu, Oct 13, 2016 at 3:21 AM, Chris Heller wrote: > You saw the error with `./dev/run-tests`? Ok I'll

[GitHub] spark issue #15420: [SPARK-17855][CORE] Remove query string from jar url

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15420 **[Test build #66894 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66894/consoleFull)** for PR 15420 at commit

[GitHub] spark issue #15466: [SPARK-13983][SQL] HiveThriftServer2 can not get "--hive...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15466 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15466: [SPARK-13983][SQL] HiveThriftServer2 can not get "--hive...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15466 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66896/ Test PASSed. ---

[GitHub] spark issue #15466: [SPARK-13983][SQL] HiveThriftServer2 can not get "--hive...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15466 **[Test build #66896 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66896/consoleFull)** for PR 15466 at commit

[GitHub] spark issue #15433: [SPARK-17822][SPARKR] Use weak reference in JVMObjectTra...

2016-10-13 Thread techaddict
Github user techaddict commented on the issue: https://github.com/apache/spark/pull/15433 @shivaram @srowen not sure why its failing, will try to fix this ASAP. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #15464: [SPARK-17827][SQL]maxColLength type should be Int for St...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15464 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66892/ Test PASSed. ---

[GitHub] spark issue #15464: [SPARK-17827][SQL]maxColLength type should be Int for St...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15464 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15464: [SPARK-17827][SQL]maxColLength type should be Int for St...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15464 **[Test build #66892 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66892/consoleFull)** for PR 15464 at commit

[GitHub] spark issue #12614: [SPARK-14730][ML] Expose ColumnPruner as feature transfo...

2016-10-13 Thread BenFradet
Github user BenFradet commented on the issue: https://github.com/apache/spark/pull/12614 @manugarri I don't think there was much interest in this PR. Would you care to weigh in @jkbradley @yanboliang? --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #15272: [SPARK-17698] [SQL] Join predicates should not contain f...

2016-10-13 Thread tejasapatil
Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/15272 @rxin : Yes. I looked at it but could not find the root cause. I have been busy with other stuff so could not invest more time. I plan to get this fixed over the weekend. --- If your project

[GitHub] spark pull request #15335: [SPARK-17769][Core][Scheduler]Some FetchFailure r...

2016-10-13 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/15335#discussion_r83245093 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -1255,27 +1255,46 @@ class DAGScheduler( s"longer

[GitHub] spark issue #15466: [SPARK-13983][SQL] HiveThriftServer2 can not get "--hive...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15466 **[Test build #66896 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66896/consoleFull)** for PR 15466 at commit

[GitHub] spark issue #12951: [SPARK-15176][Core] Add maxShares setting to Pools

2016-10-13 Thread njwhite
Github user njwhite commented on the issue: https://github.com/apache/spark/pull/12951 Actually, @kayousterhout - I'm not entirely sure what you expect for the semantics of maxShares in general. Maybe a worked example would help: if I have a pool X with 5 running tasks from Taskset A

[GitHub] spark pull request #15466: [SPARK-13983][SQL] HiveThriftServer2 can not get ...

2016-10-13 Thread wangyum
GitHub user wangyum opened a pull request: https://github.com/apache/spark/pull/15466 [SPARK-13983][SQL] HiveThriftServer2 can not get "--hiveconf" or ''--hivevar" variables since 1.6 version (both multi-session and single session) ## What changes were proposed in this pull

[GitHub] spark issue #15465: [SPARK-17909][SQL] we should create table before writing...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15465 **[Test build #66895 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66895/consoleFull)** for PR 15465 at commit

[GitHub] spark issue #14702: [SPARK-15694] Implement ScriptTransformation in sql/core...

2016-10-13 Thread tejasapatil
Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/14702 @rxin : Yes. I think I know why its happening and will get back with a fix over weekend. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #15465: [SPARK-17909][SQL] we should create table before writing...

2016-10-13 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15465 cc @yhuai @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #12951: [SPARK-15176][Core] Add maxShares setting to Pools

2016-10-13 Thread njwhite
Github user njwhite commented on the issue: https://github.com/apache/spark/pull/12951 @kayousterhout minShares is a configuration parameter for the fair scheduler algorithm only - what would the semantics of a maxShares setting for the FIFO algorithm be? --- If your project is set

[GitHub] spark pull request #15465: [SPARK-17909][SQL] we should create table before ...

2016-10-13 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/15465 [SPARK-17909][SQL] we should create table before writing out the data in CTAS ## What changes were proposed in this pull request? In `CreateDataSourceTableAsSelectCommand`, we write out

[GitHub] spark issue #15460: [SPARK-17903][SQL] MetastoreRelation should talk to exte...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15460 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15460: [SPARK-17903][SQL] MetastoreRelation should talk to exte...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15460 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66893/ Test FAILed. ---

[GitHub] spark issue #15460: [SPARK-17903][SQL] MetastoreRelation should talk to exte...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15460 **[Test build #66893 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66893/consoleFull)** for PR 15460 at commit

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15377 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66891/ Test PASSed. ---

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15377 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15377 **[Test build #66891 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66891/consoleFull)** for PR 15377 at commit

[GitHub] spark issue #15464: [SPARK-17827][SQL]maxColLength type should be Int for St...

2016-10-13 Thread robbinspg
Github user robbinspg commented on the issue: https://github.com/apache/spark/pull/15464 Tests all pass on big-endian with this PR --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15433: [SPARK-17822][SPARKR] Use weak reference in JVMObjectTra...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15433 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66890/ Test FAILed. ---

[GitHub] spark issue #15433: [SPARK-17822][SPARKR] Use weak reference in JVMObjectTra...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15433 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15433: [SPARK-17822][SPARKR] Use weak reference in JVMObjectTra...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15433 **[Test build #66890 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66890/consoleFull)** for PR 15433 at commit

[GitHub] spark issue #15462: [SPARK-17680] [SQL] [TEST] Added test cases for InMemory...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15462 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66889/ Test PASSed. ---

[GitHub] spark issue #15462: [SPARK-17680] [SQL] [TEST] Added test cases for InMemory...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15462 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15462: [SPARK-17680] [SQL] [TEST] Added test cases for InMemory...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15462 **[Test build #66889 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66889/consoleFull)** for PR 15462 at commit

[GitHub] spark issue #15433: [SPARK-17822][SPARKR] Use weak reference in JVMObjectTra...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15433 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15433: [SPARK-17822][SPARKR] Use weak reference in JVMObjectTra...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15433 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66888/ Test FAILed. ---

[GitHub] spark issue #15433: [SPARK-17822][SPARKR] Use weak reference in JVMObjectTra...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15433 **[Test build #66888 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66888/consoleFull)** for PR 15433 at commit

[GitHub] spark issue #15464: [SPARK-17827][SQL]maxColLength type should be Int for St...

2016-10-13 Thread robbinspg
Github user robbinspg commented on the issue: https://github.com/apache/spark/pull/15464 This PR contains a change to o.a.s.sql.hive.StatisticsSuite which I believe should fix that issue (awaiting big-endian build to complete) --- If your project is set up for it, you can reply to

[GitHub] spark issue #15430: [SPARK-15957][Follow-up][ML][PySpark] Add Python API for...

2016-10-13 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/15430 cc @jkbradley --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #15445: [SPARK-17817][PySpark][FOLLOWUP] PySpark RDD Repartition...

2016-10-13 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/15445 @davies @felixcheung I ran another benchmark as follows: import time import random num_partitions = 2 a = sc.parallelize(map(lambda x:

[GitHub] spark issue #15464: [SPARK-17827][SQL]maxColLength type should be Int for St...

2016-10-13 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/15464 Did you check hive/StatisticsSuite? There's also a test case for column stats. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #15460: [SPARK-17903][SQL] MetastoreRelation should talk to exte...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15460 **[Test build #66893 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66893/consoleFull)** for PR 15460 at commit

[GitHub] spark issue #15420: [SPARK-17855][CORE] Remove query string from jar url

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15420 **[Test build #66894 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66894/consoleFull)** for PR 15420 at commit

[GitHub] spark issue #15464: [SPARK-17827][SQL]maxColLength type should be Int for St...

2016-10-13 Thread wzhfy
Github user wzhfy commented on the issue: https://github.com/apache/spark/pull/15464 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #15464: [SPARK-17827][SQL]maxColLength type should be Int...

2016-10-13 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/15464#discussion_r83219244 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/StatisticsColumnSuite.scala --- @@ -150,7 +150,7 @@ class StatisticsColumnSuite extends StatisticsTest

[GitHub] spark issue #15421: [SPARK-17811] SparkR cannot parallelize data.frame with ...

2016-10-13 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15421 FWIW, I wrote a bunch of scripts to automatically launch a build via AppVeyor via @spark-test account with a pretty string such as > Build started: [CORE]

[GitHub] spark issue #15420: [SPARK-17855][CORE] Remove query string from jar url

2016-10-13 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15420 Jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #15377: [SPARK-17802] Improved caller context logging.

2016-10-13 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15377#discussion_r83217975 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -2474,25 +2478,42 @@ private[spark] class CallerContext( val context = "SPARK_"

[GitHub] spark pull request #15230: [SPARK-17657] [SQL] Disallow Users to Change Tabl...

2016-10-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15230 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15230: [SPARK-17657] [SQL] Disallow Users to Change Table Type

2016-10-13 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15230 thanks, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15464: [SPARK-17827][SQL]maxColLength type should be Int for St...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15464 **[Test build #66892 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66892/consoleFull)** for PR 15464 at commit

[GitHub] spark pull request #15464: [SPARK-17827][SQL]maxColLength type should be Int...

2016-10-13 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15464#discussion_r83214509 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/StatisticsColumnSuite.scala --- @@ -150,7 +150,7 @@ class StatisticsColumnSuite extends StatisticsTest

[GitHub] spark pull request #15464: [SPARK-17827][SQL]maxColLength type should be Int...

2016-10-13 Thread robbinspg
GitHub user robbinspg opened a pull request: https://github.com/apache/spark/pull/15464 [SPARK-17827][SQL]maxColLength type should be Int for String and Binary ## What changes were proposed in this pull request? correct the expected type from Length function to be Int

[GitHub] spark issue #12614: [SPARK-14730][ML] Expose ColumnPruner as feature transfo...

2016-10-13 Thread manugarri
Github user manugarri commented on the issue: https://github.com/apache/spark/pull/12614 Any word on when is this going to be available in PySpark? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #15461: [SPARK-16845][SQL] `GeneratedClass$SpecificOrdering` gro...

2016-10-13 Thread lw-lin
Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/15461 Closing for now; will re-open soon. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #15461: [SPARK-16845][SQL] `GeneratedClass$SpecificOrderi...

2016-10-13 Thread lw-lin
Github user lw-lin closed the pull request at: https://github.com/apache/spark/pull/15461 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15377 **[Test build #66891 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66891/consoleFull)** for PR 15377 at commit

[GitHub] spark pull request #15377: [SPARK-17802] Improved caller context logging.

2016-10-13 Thread lins05
Github user lins05 commented on a diff in the pull request: https://github.com/apache/spark/pull/15377#discussion_r83206341 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -2479,20 +2483,35 @@ private[spark] class CallerContext( *

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-13 Thread lins05
Github user lins05 commented on the issue: https://github.com/apache/spark/pull/15377 > Another thing, do you verify it locally? Since there's no unit test to cover it. @jerryshao Yeah, I did test it locally to ensure the error is only logged once. --- If your project is set

[GitHub] spark issue #12933: [Spark-15155][Mesos] Optionally ignore default role reso...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12933 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #12933: [Spark-15155][Mesos] Optionally ignore default role reso...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12933 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66887/ Test PASSed. ---

[GitHub] spark issue #12933: [Spark-15155][Mesos] Optionally ignore default role reso...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12933 **[Test build #66887 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66887/consoleFull)** for PR 12933 at commit

[GitHub] spark issue #15433: [SPARK-17822][SPARKR] Use weak reference in JVMObjectTra...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15433 **[Test build #66890 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66890/consoleFull)** for PR 15433 at commit

[GitHub] spark issue #15462: [SPARK-17680] [SQL] [TEST] Added test cases for InMemory...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15462 **[Test build #66889 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66889/consoleFull)** for PR 15462 at commit

[GitHub] spark issue #15462: [SPARK-17680] [SQL] [TEST] Added test cases for InMemory...

2016-10-13 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/15462 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #15433: [SPARK-17822] Use weak reference in JVMObjectTracker.obj...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15433 **[Test build #66888 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66888/consoleFull)** for PR 15433 at commit

[GitHub] spark issue #12933: [Spark-15155][Mesos] Optionally ignore default role reso...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12933 **[Test build #66887 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66887/consoleFull)** for PR 12933 at commit

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15377 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15377 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66885/ Test PASSed. ---

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15377 **[Test build #66885 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66885/consoleFull)** for PR 15377 at commit

[GitHub] spark issue #15463: [SPARK-17894] [CORE] Ensure uniqueness of TaskSetManager...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15463 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #15463: [SPARK-17894] [CORE] Ensure uniqueness of TaskSet...

2016-10-13 Thread erenavsarogullari
GitHub user erenavsarogullari opened a pull request: https://github.com/apache/spark/pull/15463 [SPARK-17894] [CORE] Ensure uniqueness of TaskSetManager name. ## What changes were proposed in this pull request? `TaskSetManager` should have unique name to avoid adding

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15377 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66886/ Test FAILed. ---

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15377 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15377: [SPARK-17802] Improved caller context logging.

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15377 **[Test build #66886 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66886/consoleFull)** for PR 15377 at commit

[GitHub] spark issue #13571: [SPARK-15369][WIP][RFC][PySpark][SQL] Expose potential t...

2016-10-13 Thread zero323
Github user zero323 commented on the issue: https://github.com/apache/spark/pull/13571 @davies Jython is relatively mature and it has some applications (think about Python UDFs with PIg) but it doesn't change the fact that it is years behind CPython (no released 3.x branch for

[GitHub] spark issue #15462: [SPARK-17680] [SQL] [TEST] Added test cases for InMemory...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15462 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15462: [SPARK-17680] [SQL] [TEST] Added test cases for InMemory...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15462 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66884/ Test FAILed. ---

[GitHub] spark issue #15462: [SPARK-17680] [SQL] [TEST] Added test cases for InMemory...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15462 **[Test build #66884 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66884/consoleFull)** for PR 15462 at commit

[GitHub] spark issue #12933: [Spark-15155][Mesos] Optionally ignore default role reso...

2016-10-13 Thread hellertime
Github user hellertime commented on the issue: https://github.com/apache/spark/pull/12933 You saw the error with `./dev/run-tests`? Ok I'll figure this out. Sent from my iPhone > On Oct 13, 2016, at 12:24 AM, Timothy Chen wrote: >

[GitHub] spark pull request #15382: [SPARK-17810] [SQL] Default spark.sql.warehouse.d...

2016-10-13 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15382#discussion_r83183636 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -757,7 +758,10 @@ private[sql] class SQLConf extends Serializable with

[GitHub] spark issue #15461: [SPARK-16845][SQL] `GeneratedClass$SpecificOrdering` gro...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15461 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15459: [SPARK-17409] [SQL] [FOLLOW-UP] Do Not Optimize Query in...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15459 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15461: [SPARK-16845][SQL] `GeneratedClass$SpecificOrdering` gro...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15461 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66883/ Test FAILed. ---

[GitHub] spark issue #15459: [SPARK-17409] [SQL] [FOLLOW-UP] Do Not Optimize Query in...

2016-10-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15459 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/66881/ Test PASSed. ---

[GitHub] spark issue #15461: [SPARK-16845][SQL] `GeneratedClass$SpecificOrdering` gro...

2016-10-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15461 **[Test build #66883 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/66883/consoleFull)** for PR 15461 at commit

<    1   2   3   4   5   6   7   >