[jira] [Commented] (SPARK-26043) Make SparkHadoopUtil private to Spark

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693748#comment-16693748 ] Apache Spark commented on SPARK-26043: -- User 'srowen' has created a pull request for this issue:

[jira] [Updated] (SPARK-25954) Upgrade to Kafka 2.1.0

2018-11-20 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-25954: -- Description: Kafka 2.1.0 vote passed. Since this includes official KAFKA-7264 JDK 11

[jira] [Updated] (SPARK-26118) Make Jetty's requestHeaderSize configurable in Spark

2018-11-20 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-26118: --- Issue Type: New Feature (was: Bug) > Make Jetty's requestHeaderSize configurable

[jira] [Commented] (SPARK-25954) Upgrade to Kafka 2.1.0

2018-11-20 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693849#comment-16693849 ] Dongjoon Hyun commented on SPARK-25954: --- I update the description because Kafka 2.1.0 vote passed

[jira] [Commented] (SPARK-26019) pyspark/accumulators.py: "TypeError: object of type 'NoneType' has no len()" in authenticate_and_accum_updates()

2018-11-20 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693664#comment-16693664 ] Imran Rashid commented on SPARK-26019: -- Yeah I agree with [~viirya]'s analysis, my suggestion was

[jira] [Created] (SPARK-26131) Remove sqlContext.conf from Spark SQL physical operators

2018-11-20 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-26131: - Summary: Remove sqlContext.conf from Spark SQL physical operators Key: SPARK-26131 URL: https://issues.apache.org/jira/browse/SPARK-26131 Project: Spark

[jira] [Resolved] (SPARK-26084) AggregateExpression.references fails on unresolved expression trees

2018-11-20 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-26084. --- Resolution: Fixed Assignee: Simeon Simeonov Fix Version/s: 3.0.0

[jira] [Created] (SPARK-26132) Remove support for Scala 2.11 in Spark 3.0.0

2018-11-20 Thread Sean Owen (JIRA)
Sean Owen created SPARK-26132: - Summary: Remove support for Scala 2.11 in Spark 3.0.0 Key: SPARK-26132 URL: https://issues.apache.org/jira/browse/SPARK-26132 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-26132) Remove support for Scala 2.11 in Spark 3.0.0

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26132: Assignee: Apache Spark (was: Sean Owen) > Remove support for Scala 2.11 in Spark 3.0.0

[jira] [Assigned] (SPARK-25954) Upgrade to Kafka 2.1.0

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25954: Assignee: Apache Spark > Upgrade to Kafka 2.1.0 > -- > >

[jira] [Commented] (SPARK-25954) Upgrade to Kafka 2.1.0

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693864#comment-16693864 ] Apache Spark commented on SPARK-25954: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-26132) Remove support for Scala 2.11 in Spark 3.0.0

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26132: Assignee: Sean Owen (was: Apache Spark) > Remove support for Scala 2.11 in Spark 3.0.0

[jira] [Assigned] (SPARK-25954) Upgrade to Kafka 2.1.0

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25954: Assignee: (was: Apache Spark) > Upgrade to Kafka 2.1.0 > -- > >

[jira] [Commented] (SPARK-26132) Remove support for Scala 2.11 in Spark 3.0.0

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693866#comment-16693866 ] Apache Spark commented on SPARK-26132: -- User 'srowen' has created a pull request for this issue:

[jira] [Commented] (SPARK-26132) Remove support for Scala 2.11 in Spark 3.0.0

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693865#comment-16693865 ] Apache Spark commented on SPARK-26132: -- User 'srowen' has created a pull request for this issue:

[jira] [Created] (SPARK-26130) Change Event Timeline Display Functionality on the Stages Page to use either REST API or data from other tables

2018-11-20 Thread Parth Gandhi (JIRA)
Parth Gandhi created SPARK-26130: Summary: Change Event Timeline Display Functionality on the Stages Page to use either REST API or data from other tables Key: SPARK-26130 URL:

[jira] [Resolved] (SPARK-26120) Fix a streaming query leak in Structured Streaming R tests

2018-11-20 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26120. -- Resolution: Fixed Fix Version/s: 3.0.0 2.4.1 fixed in

[jira] [Assigned] (SPARK-26133) Remove deprecated OneHotEncoder and rename OneHotEncoderEstimator to OneHotEncoder

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26133: Assignee: Apache Spark > Remove deprecated OneHotEncoder and rename

[jira] [Created] (SPARK-26134) Upgrading Hadoop to 2.7.4 to fix java.version problem

2018-11-20 Thread Takanobu Asanuma (JIRA)
Takanobu Asanuma created SPARK-26134: Summary: Upgrading Hadoop to 2.7.4 to fix java.version problem Key: SPARK-26134 URL: https://issues.apache.org/jira/browse/SPARK-26134 Project: Spark

[jira] [Assigned] (SPARK-26122) Support encoding for multiLine in CSV datasource

2018-11-20 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-26122: Assignee: Maxim Gekk > Support encoding for multiLine in CSV datasource >

[jira] [Updated] (SPARK-24627) [Spark2.3.0] After HDFS Token expire kinit not able to submit job using beeline

2018-11-20 Thread ABHISHEK KUMAR GUPTA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ABHISHEK KUMAR GUPTA updated SPARK-24627: - Environment: OS: SUSE11 Spark Version: 2.3.0    was: OS: SUSE11 Spark

[jira] [Commented] (SPARK-26133) Remove deprecated OneHotEncoder and rename OneHotEncoderEstimator to OneHotEncoder

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694169#comment-16694169 ] Apache Spark commented on SPARK-26133: -- User 'viirya' has created a pull request for this issue:

[jira] [Resolved] (SPARK-21121) Set up StorageLevel for CACHE TABLE command

2018-11-20 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-21121. - Resolution: Duplicate Fixed by [SPARK-25269|https://issues.apache.org/jira/browse/SPARK-25269].

[jira] [Resolved] (SPARK-24222) [Cache Column level is not supported in 2.3]

2018-11-20 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang resolved SPARK-24222. - Resolution: Invalid > [Cache Column level is not supported in 2.3] >

[jira] [Created] (SPARK-26133) Remove deprecated OneHotEncoder and rename OneHotEncoderEstimator to OneHotEncoder

2018-11-20 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-26133: --- Summary: Remove deprecated OneHotEncoder and rename OneHotEncoderEstimator to OneHotEncoder Key: SPARK-26133 URL: https://issues.apache.org/jira/browse/SPARK-26133

[jira] [Resolved] (SPARK-26124) Update plugins, including MiMa

2018-11-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26124. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23087

[jira] [Commented] (SPARK-24222) [Cache Column level is not supported in 2.3]

2018-11-20 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694116#comment-16694116 ] Yuming Wang commented on SPARK-24222: - Please use _{{cache table cache1 as select name,num,height

[jira] [Commented] (SPARK-26019) pyspark/accumulators.py: "TypeError: object of type 'NoneType' has no len()" in authenticate_and_accum_updates()

2018-11-20 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694188#comment-16694188 ] Hyukjin Kwon commented on SPARK-26019: -- [~irashid], Yup, maybe I rushed to take an action. I don't

[jira] [Resolved] (SPARK-26122) Support encoding for multiLine in CSV datasource

2018-11-20 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26122. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23091

[jira] [Commented] (SPARK-23178) Kryo Unsafe problems with count distinct from cache

2018-11-20 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694120#comment-16694120 ] Yuming Wang commented on SPARK-23178: - Cloud you try spark-2.4.0 or master branch? we have upgraded

[jira] [Assigned] (SPARK-26133) Remove deprecated OneHotEncoder and rename OneHotEncoderEstimator to OneHotEncoder

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26133: Assignee: (was: Apache Spark) > Remove deprecated OneHotEncoder and rename

[jira] [Commented] (SPARK-25959) Difference in featureImportances results on computed vs saved models

2018-11-20 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692861#comment-16692861 ] Marco Gaido commented on SPARK-25959: - [~srowen] what do you think about backporting this? Maybe 2.2

[jira] [Commented] (SPARK-26110) If you restart the spark history server, the "Last Update" of incomplete app(had been kill) will be updated to current time

2018-11-20 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692868#comment-16692868 ] shahid commented on SPARK-26110: Thanks. I am analyzing the issue > If you restart the spark history

[jira] [Commented] (SPARK-26134) Upgrading Hadoop to 2.7.4 to fix java.version problem

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694288#comment-16694288 ] Apache Spark commented on SPARK-26134: -- User 'tasanuma' has created a pull request for this issue:

[jira] [Assigned] (SPARK-26134) Upgrading Hadoop to 2.7.4 to fix java.version problem

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26134: Assignee: (was: Apache Spark) > Upgrading Hadoop to 2.7.4 to fix java.version

[jira] [Commented] (SPARK-26134) Upgrading Hadoop to 2.7.4 to fix java.version problem

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694289#comment-16694289 ] Apache Spark commented on SPARK-26134: -- User 'tasanuma' has created a pull request for this issue:

[jira] [Commented] (SPARK-26126) Should put scala-library deps into root pom instead of spark-tags module

2018-11-20 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694333#comment-16694333 ] Hyukjin Kwon commented on SPARK-26126: -- Hi [~liupengcheng], is it a question or an issue? > Should

[jira] [Created] (SPARK-26135) Structured Streaming reporting metrics programmatically using asynchronous APIs can't get all queries metrics

2018-11-20 Thread bjkonglu (JIRA)
bjkonglu created SPARK-26135: Summary: Structured Streaming reporting metrics programmatically using asynchronous APIs can't get all queries metrics Key: SPARK-26135 URL:

[jira] [Updated] (SPARK-26135) Structured Streaming reporting metrics programmatically using asynchronous APIs can't get all queries metrics

2018-11-20 Thread bjkonglu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bjkonglu updated SPARK-26135: - Environment: JDK: 1.8.0_151 Scala: 2.11.8 Hadoop: 2.7.1 Spark: 2.3.1       was: h3.      

[jira] [Updated] (SPARK-26135) Structured Streaming reporting metrics programmatically using asynchronous APIs can't get all queries metrics

2018-11-20 Thread bjkonglu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bjkonglu updated SPARK-26135: - Environment: h3.       was: h3.     > Structured Streaming reporting metrics programmatically

[jira] [Updated] (SPARK-26135) Structured Streaming reporting metrics programmatically using asynchronous APIs can't get all queries metrics

2018-11-20 Thread bjkonglu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bjkonglu updated SPARK-26135: - Environment: JDK: 1.8.0_151 Scala: 2.11.8 Hadoop: 2.7.1 Spark: 2.3.1  was: JDK: 1.8.0_151 Scala: 

[jira] [Assigned] (SPARK-26134) Upgrading Hadoop to 2.7.4 to fix java.version problem

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26134: Assignee: Apache Spark > Upgrading Hadoop to 2.7.4 to fix java.version problem >

[jira] [Updated] (SPARK-26134) Upgrading Hadoop to 2.7.4 to fix java.version problem

2018-11-20 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated SPARK-26134: - Affects Version/s: (was: 2.4.0) 3.0.0 > Upgrading Hadoop to

[jira] [Commented] (SPARK-26128) filter breaks input_file_name

2018-11-20 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694330#comment-16694330 ] Hyukjin Kwon commented on SPARK-26128: -- I can't reproduce this: ``` scala>

[jira] [Commented] (SPARK-26134) Upgrading Hadoop to 2.7.4 to fix java.version problem

2018-11-20 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694320#comment-16694320 ] Takanobu Asanuma commented on SPARK-26134: -- Hi, [~dongjoon]. I confirmed that spark-shell

[jira] [Updated] (SPARK-26134) Upgrading Hadoop to 2.7.4 to fix java.version problem

2018-11-20 Thread Takanobu Asanuma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma updated SPARK-26134: - Component/s: (was: Spark Shell) Spark Core > Upgrading Hadoop to

[jira] [Comment Edited] (SPARK-26128) filter breaks input_file_name

2018-11-20 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694330#comment-16694330 ] Hyukjin Kwon edited comment on SPARK-26128 at 11/21/18 7:26 AM: I can't

[jira] [Commented] (SPARK-26134) Upgrading Hadoop to 2.7.4 to fix java.version problem

2018-11-20 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694309#comment-16694309 ] Dongjoon Hyun commented on SPARK-26134: --- Hi, [~tasanuma0829] . Thank you for reporting and sending

[jira] [Commented] (SPARK-23886) update query.status

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693175#comment-16693175 ] Apache Spark commented on SPARK-23886: -- User 'gaborgsomogyi' has created a pull request for this

[jira] [Commented] (SPARK-26077) Reserved SQL words are not escaped by JDBC writer for table name

2018-11-20 Thread Eugene Golovan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693046#comment-16693046 ] Eugene Golovan commented on SPARK-26077: [~maropu] Sure. Have a look please. When running unit

[jira] [Assigned] (SPARK-26077) Reserved SQL words are not escaped by JDBC writer for table name

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26077: Assignee: Apache Spark > Reserved SQL words are not escaped by JDBC writer for table

[jira] [Commented] (SPARK-16044) input_file_name() returns empty strings in data sources based on NewHadoopRDD.

2018-11-20 Thread Paul Praet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693200#comment-16693200 ] Paul Praet commented on SPARK-16044: Still has issues. See

[jira] [Created] (SPARK-26128) filter breaks input_file_name

2018-11-20 Thread Paul Praet (JIRA)
Paul Praet created SPARK-26128: -- Summary: filter breaks input_file_name Key: SPARK-26128 URL: https://issues.apache.org/jira/browse/SPARK-26128 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-26127) Remove deprecated setImpurity from GBTClassificationModel, DecisionTreeRegressionModel, GBTRegressionModel, RandomForestRegressionModel

2018-11-20 Thread Marco Gaido (JIRA)
Marco Gaido created SPARK-26127: --- Summary: Remove deprecated setImpurity from GBTClassificationModel, DecisionTreeRegressionModel, GBTRegressionModel, RandomForestRegressionModel Key: SPARK-26127 URL:

[jira] [Commented] (SPARK-26127) Remove deprecated setImpurity from tree regression and classification models

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692951#comment-16692951 ] Apache Spark commented on SPARK-26127: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Updated] (SPARK-26127) Remove deprecated setImpurity from tree regression and classification models

2018-11-20 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido updated SPARK-26127: Summary: Remove deprecated setImpurity from tree regression and classification models (was:

[jira] [Commented] (SPARK-26077) Reserved SQL words are not escaped by JDBC writer for table name

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693037#comment-16693037 ] Apache Spark commented on SPARK-26077: -- User 'golovan' has created a pull request for this issue:

[jira] [Commented] (SPARK-26127) Remove deprecated setImpurity from tree regression and classification models

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692950#comment-16692950 ] Apache Spark commented on SPARK-26127: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Assigned] (SPARK-26077) Reserved SQL words are not escaped by JDBC writer for table name

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26077: Assignee: (was: Apache Spark) > Reserved SQL words are not escaped by JDBC writer

[jira] [Assigned] (SPARK-26127) Remove deprecated setImpurity from tree regression and classification models

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26127: Assignee: (was: Apache Spark) > Remove deprecated setImpurity from tree regression

[jira] [Assigned] (SPARK-26127) Remove deprecated setImpurity from tree regression and classification models

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26127: Assignee: Apache Spark > Remove deprecated setImpurity from tree regression and

[jira] [Commented] (SPARK-25762) Upgrade guava version in spark dependency lists due to CVE issue

2018-11-20 Thread James Grinter (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693075#comment-16693075 ] James Grinter commented on SPARK-25762: --- We also just bumped into CVE-2018-10237, as it's now

[jira] [Commented] (SPARK-23897) Guava version

2018-11-20 Thread James Grinter (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693076#comment-16693076 ] James Grinter commented on SPARK-23897: --- We also just bumped into CVE-2018-10237, as it's now

[jira] [Commented] (SPARK-25959) Difference in featureImportances results on computed vs saved models

2018-11-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693326#comment-16693326 ] Sean Owen commented on SPARK-25959: --- Yes 2.2 is all but EOL. I am worried about the binary

[jira] [Assigned] (SPARK-26076) Revise ambiguous error message from load-spark-env.sh

2018-11-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26076: - Assignee: Gengliang Wang > Revise ambiguous error message from load-spark-env.sh >

[jira] [Resolved] (SPARK-26076) Revise ambiguous error message from load-spark-env.sh

2018-11-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26076. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23049

[jira] [Updated] (SPARK-26127) Remove deprecated setters from tree regression and classification models

2018-11-20 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido updated SPARK-26127: Summary: Remove deprecated setters from tree regression and classification models (was: Remove

[jira] [Updated] (SPARK-26127) Remove deprecated setters from tree regression and classification models

2018-11-20 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido updated SPARK-26127: Description: Many {{set***}} methods are present for the models of regression and classification

[jira] [Assigned] (SPARK-26118) Make Jetty's requestHeaderSize configurable in Spark

2018-11-20 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-26118: Assignee: Attila Zsolt Piros > Make Jetty's requestHeaderSize configurable in Spark >

[jira] [Resolved] (SPARK-26118) Make Jetty's requestHeaderSize configurable in Spark

2018-11-20 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-26118. -- Resolution: Fixed Fix Version/s: 2.4.1 3.0.0 Issue resolved by pull

[jira] [Created] (SPARK-26129) Instrumentation for query planning time

2018-11-20 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-26129: --- Summary: Instrumentation for query planning time Key: SPARK-26129 URL: https://issues.apache.org/jira/browse/SPARK-26129 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-26116) Spark SQL - Sort when writing partitioned parquet leads to OOM errors

2018-11-20 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693393#comment-16693393 ] Yuming Wang commented on SPARK-26116: - Please try to set spark.executor.memoryOverhead=6G or

[jira] [Commented] (SPARK-26129) Instrumentation for query planning time

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693445#comment-16693445 ] Apache Spark commented on SPARK-26129: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-26129) Instrumentation for query planning time

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26129: Assignee: Apache Spark (was: Reynold Xin) > Instrumentation for query planning time >

[jira] [Assigned] (SPARK-26129) Instrumentation for query planning time

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26129: Assignee: Reynold Xin (was: Apache Spark) > Instrumentation for query planning time >

[jira] [Commented] (SPARK-26129) Instrumentation for query planning time

2018-11-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693447#comment-16693447 ] Apache Spark commented on SPARK-26129: -- User 'rxin' has created a pull request for this issue:

[jira] [Updated] (SPARK-26118) Make Jetty's requestHeaderSize configurable in Spark

2018-11-20 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Zsolt Piros updated SPARK-26118: --- Issue Type: Bug (was: Improvement) > Make Jetty's requestHeaderSize configurable

[jira] [Resolved] (SPARK-26079) Flaky test: StreamingQueryListenersConfSuite

2018-11-20 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-26079. -- Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 3.0.0