[jira] [Commented] (SPARK-15344) Unable to set default log level for PySpark

[ https://issues.apache.org/jira/browse/SPARK-15344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284442#comment-15284442 ] Maciej Bryński commented on SPARK-15344: Yep. I mention PR from this Jira in desc

[jira] [Commented] (SPARK-15344) Unable to set default log level for PySpark

[ https://issues.apache.org/jira/browse/SPARK-15344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284438#comment-15284438 ] Sean Owen commented on SPARK-15344: --- Comment on SPARK-14881 then maybe? this sounds lik

[jira] [Created] (SPARK-15345) Cannot connect to Hive databases

Piotr Milanowski created SPARK-15345: Summary: Cannot connect to Hive databases Key: SPARK-15345 URL: https://issues.apache.org/jira/browse/SPARK-15345 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-15343) NoClassDefFoundError when initializing Spark with YARN

[ https://issues.apache.org/jira/browse/SPARK-15343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284433#comment-15284433 ] Maciej Bryński commented on SPARK-15343: CC: [~vanzin] > NoClassDefFoundError w

[jira] [Commented] (SPARK-15247) sqlCtx.read.parquet yields at least n_executors * n_cores tasks

[ https://issues.apache.org/jira/browse/SPARK-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284432#comment-15284432 ] Sean Owen commented on SPARK-15247: --- Did you actually open a PR for this? > sqlCtx.rea

[jira] [Commented] (SPARK-15343) NoClassDefFoundError when initializing Spark with YARN

[ https://issues.apache.org/jira/browse/SPARK-15343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284428#comment-15284428 ] Sean Owen commented on SPARK-15343: --- @vanzin did you think this was a HDP-specific thin

[jira] [Created] (SPARK-15344) Unable to set default log level for PySpark

Maciej Bryński created SPARK-15344: -- Summary: Unable to set default log level for PySpark Key: SPARK-15344 URL: https://issues.apache.org/jira/browse/SPARK-15344 Project: Spark Issue Type: B

[jira] [Updated] (SPARK-15343) NoClassDefFoundError when initializing Spark with YARN

[ https://issues.apache.org/jira/browse/SPARK-15343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-15343: --- Description: I'm trying to connect Spark 2.0 (compiled from branch-2.0) with Hadoop. Spark c

[jira] [Updated] (SPARK-15343) NoClassDefFoundError when initializing Spark with YARN

[ https://issues.apache.org/jira/browse/SPARK-15343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-15343: --- Description: I'm trying to connect Spark 2.0 (compiled from branch-2.0) with Hadoop. Spark c

[jira] [Updated] (SPARK-15343) NoClassDefFoundError when initializing Spark with YARN

[ https://issues.apache.org/jira/browse/SPARK-15343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maciej Bryński updated SPARK-15343: --- Summary: NoClassDefFoundError when initializing Spark with YARN (was: Exception when using S

[jira] [Created] (SPARK-15343) Exception when using Spark with YARN

Maciej Bryński created SPARK-15343: -- Summary: Exception when using Spark with YARN Key: SPARK-15343 URL: https://issues.apache.org/jira/browse/SPARK-15343 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-15031) Use SparkSession in Scala/Python/Java example.

[ https://issues.apache.org/jira/browse/SPARK-15031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284392#comment-15284392 ] Apache Spark commented on SPARK-15031: -- User 'HyukjinKwon' has created a pull reques

[jira] [Assigned] (SPARK-15342) PySpark test for non ascii column name does not actually test with unicode column name

[ https://issues.apache.org/jira/browse/SPARK-15342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15342: Assignee: (was: Apache Spark) > PySpark test for non ascii column name does not actual

[jira] [Commented] (SPARK-15342) PySpark test for non ascii column name does not actually test with unicode column name

[ https://issues.apache.org/jira/browse/SPARK-15342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284364#comment-15284364 ] Apache Spark commented on SPARK-15342: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-15342) PySpark test for non ascii column name does not actually test with unicode column name

[ https://issues.apache.org/jira/browse/SPARK-15342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15342: Assignee: Apache Spark > PySpark test for non ascii column name does not actually test wit

[jira] [Created] (SPARK-15342) PySpark test for non ascii column name does not actually test with unicode column name

Liang-Chi Hsieh created SPARK-15342: --- Summary: PySpark test for non ascii column name does not actually test with unicode column name Key: SPARK-15342 URL: https://issues.apache.org/jira/browse/SPARK-15342

[jira] [Commented] (SPARK-6706) kmeans|| hangs for a long time if both k and vector dimension are large

[ https://issues.apache.org/jira/browse/SPARK-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284331#comment-15284331 ] Apache Spark commented on SPARK-6706: - User 'mouendless' has created a pull request fo

[jira] [Commented] (SPARK-12972) Update org.apache.httpcomponents.httpclient, commons-io

[ https://issues.apache.org/jira/browse/SPARK-12972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284322#comment-15284322 ] Apache Spark commented on SPARK-12972: -- User 'srowen' has created a pull request for

[jira] [Updated] (SPARK-12972) Update org.apache.httpcomponents.httpclient, commons-io

[ https://issues.apache.org/jira/browse/SPARK-12972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12972: -- Summary: Update org.apache.httpcomponents.httpclient, commons-io (was: Update org.apache.httpcomponent

[jira] [Commented] (SPARK-15329) When start spark with yarn: spark.SparkContext: Error initializing SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-15329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284307#comment-15284307 ] Vijay Parmar commented on SPARK-15329: -- Thanks Sean for highlighting the things. Jus

[jira] [Comment Edited] (SPARK-6706) kmeans|| hangs for a long time if both k and vector dimension are large

[ https://issues.apache.org/jira/browse/SPARK-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284294#comment-15284294 ] Abraham Zhan edited comment on SPARK-6706 at 5/16/16 9:38 AM: --

[jira] [Assigned] (SPARK-15341) Add documentation for `model.write` to clarify `summary` was not saved

[ https://issues.apache.org/jira/browse/SPARK-15341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15341: Assignee: Apache Spark > Add documentation for `model.write` to clarify `summary` was not

[jira] [Commented] (SPARK-15341) Add documentation for `model.write` to clarify `summary` was not saved

[ https://issues.apache.org/jira/browse/SPARK-15341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284305#comment-15284305 ] Apache Spark commented on SPARK-15341: -- User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-15341) Add documentation for `model.write` to clarify `summary` was not saved

[ https://issues.apache.org/jira/browse/SPARK-15341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15341: Assignee: (was: Apache Spark) > Add documentation for `model.write` to clarify `summar

[jira] [Commented] (SPARK-14709) spark.ml API for linear SVM

[ https://issues.apache.org/jira/browse/SPARK-14709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284304#comment-15284304 ] Nick Pentreath commented on SPARK-14709: It would be great to get the list of ref

[jira] [Updated] (SPARK-15341) Add documentation for `model.write` to clarify `summary` was not saved

[ https://issues.apache.org/jira/browse/SPARK-15341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15341: Summary: Add documentation for `model.write` to clarify `summary` was not saved (was: Add documen

[jira] [Created] (SPARK-15341) Add documentation for `write` to clarify `summary` was not saved

Yanbo Liang created SPARK-15341: --- Summary: Add documentation for `write` to clarify `summary` was not saved Key: SPARK-15341 URL: https://issues.apache.org/jira/browse/SPARK-15341 Project: Spark

[jira] [Issue Comment Deleted] (SPARK-6706) kmeans|| hangs for a long time if both k and vector dimension are large

[ https://issues.apache.org/jira/browse/SPARK-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abraham Zhan updated SPARK-6706: Comment: was deleted (was: h2.Main Issue I found a to be improved feature in LocalKMeans.scala in Ml

[jira] [Commented] (SPARK-6706) kmeans|| hangs for a long time if both k and vector dimension are large

[ https://issues.apache.org/jira/browse/SPARK-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284294#comment-15284294 ] Abraham Zhan commented on SPARK-6706: - h2.Main Issue I found a to be improved feature

[jira] [Commented] (SPARK-6706) kmeans|| hangs for a long time if both k and vector dimension are large

[ https://issues.apache.org/jira/browse/SPARK-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284295#comment-15284295 ] Abraham Zhan commented on SPARK-6706: - h2.Main Issue I found a to be improved feature

[jira] [Commented] (SPARK-15329) When start spark with yarn: spark.SparkContext: Error initializing SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-15329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284292#comment-15284292 ] Saisai Shao commented on SPARK-15329: - Check the container log is an effective way, u

[jira] [Commented] (SPARK-15340) Limit the size of the map used to cache JobConfs to void OOM

[ https://issues.apache.org/jira/browse/SPARK-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284288#comment-15284288 ] Apache Spark commented on SPARK-15340: -- User 'DoingDone9' has created a pull request

[jira] [Assigned] (SPARK-15340) Limit the size of the map used to cache JobConfs to void OOM

[ https://issues.apache.org/jira/browse/SPARK-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15340: Assignee: Apache Spark > Limit the size of the map used to cache JobConfs to void OOM > --

[jira] [Assigned] (SPARK-15340) Limit the size of the map used to cache JobConfs to void OOM

[ https://issues.apache.org/jira/browse/SPARK-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15340: Assignee: (was: Apache Spark) > Limit the size of the map used to cache JobConfs to vo

[jira] [Updated] (SPARK-15340) Limit the size of the map used to cache JobConfs to void OOM

[ https://issues.apache.org/jira/browse/SPARK-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-15340: --- Summary: Limit the size of the map used to cache JobConfs to void OOM (was: Limit the size o

[jira] [Updated] (SPARK-15340) Limit the size of the map used to cache JobConfs

[ https://issues.apache.org/jira/browse/SPARK-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-15340: --- Summary: Limit the size of the map used to cache JobConfs (was: Limit the size of the map us

[jira] [Updated] (SPARK-15340) Limit the size of the map used to cache JobConfs and InputFormats

[ https://issues.apache.org/jira/browse/SPARK-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-15340: --- Description: when i run tpcds (orc) by using JDBCServer, driver always OOM. i find tens of

[jira] [Updated] (SPARK-15340) Limit the size of the map used to cache JobConfs and InputFormats

[ https://issues.apache.org/jira/browse/SPARK-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-15340: --- Description: when i run tpcds (orc) by using JDBCServer, driver always OOM. i find tens of

[jira] [Updated] (SPARK-15340) Limit the size of the map used to cache JobConfs and InputFormats

[ https://issues.apache.org/jira/browse/SPARK-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-15340: --- Description: when i run tpcds (orc) by JDBCServer, driver always OOM. i find tens of thousa

[jira] [Updated] (SPARK-15340) Limit the size of the map used to cache JobConfs and InputFormats

[ https://issues.apache.org/jira/browse/SPARK-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-15340: --- Description: when i run tpcds (orc) by JDBCServer, driver always OOM and i find tens of t

[jira] [Updated] (SPARK-15340) Limit the size of the map used to cache JobConfs and InputFormats

[ https://issues.apache.org/jira/browse/SPARK-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-15340: --- Description: when i run tpcds (orc) by JDBCServer, driver always OOM and i find tens of t

[jira] [Updated] (SPARK-15340) Limit the size of the map used to cache JobConfs and InputFormats

[ https://issues.apache.org/jira/browse/SPARK-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-15340: --- Description: when i run tpcds (orc) by JDBCServer, driver always OOM and i find tens of t

[jira] [Updated] (SPARK-15340) Limit the size of the map used to cache JobConfs and InputFormats

[ https://issues.apache.org/jira/browse/SPARK-15340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-15340: --- Affects Version/s: 1.5.0 1.6.0 > Limit the size of the map used to cac

[jira] [Created] (SPARK-15340) Limit the size of the map used to cache JobConfs and InputFormats

Zhongshuai Pei created SPARK-15340: -- Summary: Limit the size of the map used to cache JobConfs and InputFormats Key: SPARK-15340 URL: https://issues.apache.org/jira/browse/SPARK-15340 Project: Spark

[jira] [Closed] (SPARK-15289) SQL test compilation error from merge conflict

[ https://issues.apache.org/jira/browse/SPARK-15289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Milanowski closed SPARK-15289. Issue has been fixed. Spark builds normally > SQL test compilation error from merge conflict >

[jira] [Assigned] (SPARK-15339) ML 2.0 QA: Scala APIs and code audit for regression

[ https://issues.apache.org/jira/browse/SPARK-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15339: Assignee: Apache Spark > ML 2.0 QA: Scala APIs and code audit for regression > ---

[jira] [Assigned] (SPARK-15339) ML 2.0 QA: Scala APIs and code audit for regression

[ https://issues.apache.org/jira/browse/SPARK-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15339: Assignee: (was: Apache Spark) > ML 2.0 QA: Scala APIs and code audit for regression >

[jira] [Commented] (SPARK-15339) ML 2.0 QA: Scala APIs and code audit for regression

[ https://issues.apache.org/jira/browse/SPARK-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284257#comment-15284257 ] Apache Spark commented on SPARK-15339: -- User 'yanboliang' has created a pull request

[jira] [Updated] (SPARK-15339) ML 2.0 QA: Scala APIs and code audit for regression

[ https://issues.apache.org/jira/browse/SPARK-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15339: Description: ML 2.0 QA: Scala APIs and code audit for regression (was: ML 2.0 QA: Scala APIs audit

[jira] [Updated] (SPARK-15339) ML 2.0 QA: Scala APIs and code audit for regression

[ https://issues.apache.org/jira/browse/SPARK-15339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-15339: Summary: ML 2.0 QA: Scala APIs and code audit for regression (was: ML 2.0 QA: Scala APIs audit for

[jira] [Commented] (SPARK-15329) When start spark with yarn: spark.SparkContext: Error initializing SparkContext.

[ https://issues.apache.org/jira/browse/SPARK-15329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284251#comment-15284251 ] Sean Owen commented on SPARK-15329: --- [~vsparmar] Native libraries won't matter here. I

[jira] [Created] (SPARK-15339) ML 2.0 QA: Scala APIs audit for regression

Yanbo Liang created SPARK-15339: --- Summary: ML 2.0 QA: Scala APIs audit for regression Key: SPARK-15339 URL: https://issues.apache.org/jira/browse/SPARK-15339 Project: Spark Issue Type: Improvem

[jira] [Resolved] (SPARK-14979) Add examples for GeneralizedLinearRegression

[ https://issues.apache.org/jira/browse/SPARK-14979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath resolved SPARK-14979. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12754 [https:/

[jira] [Updated] (SPARK-15316) PySpark GeneralizedLinearRegression missing linkPredictionCol param

[ https://issues.apache.org/jira/browse/SPARK-15316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-15316: --- Assignee: holdenk > PySpark GeneralizedLinearRegression missing linkPredictionCol param > ---

[jira] [Assigned] (SPARK-15338) Run-time Change on the conf spark.sql.warehouse.dir Does not Affect the conf hive.metastore.warehouse.dir

[ https://issues.apache.org/jira/browse/SPARK-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15338: Assignee: (was: Apache Spark) > Run-time Change on the conf spark.sql.warehouse.dir Do

[jira] [Assigned] (SPARK-15338) Run-time Change on the conf spark.sql.warehouse.dir Does not Affect the conf hive.metastore.warehouse.dir

[ https://issues.apache.org/jira/browse/SPARK-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15338: Assignee: Apache Spark > Run-time Change on the conf spark.sql.warehouse.dir Does not Affe

[jira] [Assigned] (SPARK-15337) Unable to Make Run-time Changes on Hive-related Conf

[ https://issues.apache.org/jira/browse/SPARK-15337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15337: Assignee: Apache Spark > Unable to Make Run-time Changes on Hive-related Conf > --

[jira] [Assigned] (SPARK-15337) Unable to Make Run-time Changes on Hive-related Conf

[ https://issues.apache.org/jira/browse/SPARK-15337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15337: Assignee: (was: Apache Spark) > Unable to Make Run-time Changes on Hive-related Conf >

[jira] [Commented] (SPARK-15338) Run-time Change on the conf spark.sql.warehouse.dir Does not Affect the conf hive.metastore.warehouse.dir

[ https://issues.apache.org/jira/browse/SPARK-15338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284217#comment-15284217 ] Apache Spark commented on SPARK-15338: -- User 'gatorsmile' has created a pull request

[jira] [Commented] (SPARK-15337) Unable to Make Run-time Changes on Hive-related Conf

[ https://issues.apache.org/jira/browse/SPARK-15337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284216#comment-15284216 ] Apache Spark commented on SPARK-15337: -- User 'gatorsmile' has created a pull request

<    1   2